2024-08-17T02:09:37.645 INFO:root:teuthology version: 1.2.0 2024-08-17T02:09:37.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-17T02:09:37.754 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858240 branch: wip-mchangir-mgr-volumes-print-thread-name-quincy description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} email: mchangir@redhat.com first_in_suite: false job_id: '7858240' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-mchangir-mgr-volumes-print-thread-name-quincy ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - filesystem is online with fewer MDS than max_mds - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-mgr-volumes-print-thread-name-quincy sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e owner: scheduled_mchangir@teuthology priority: 25 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 5995 sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e sleep_before_teardown: 0 suite: fs suite_branch: wip-mchangir-mgr-volumes-print-thread-name-quincy suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e targets: smithi104.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi117.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestVolumes - tasks.cephfs.test_volumes.TestSubvolumeGroups - tasks.cephfs.test_volumes.TestSubvolumes teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 67db276914d29505c9707d04f3a3b8fb9d8aee4b timestamp: 2024-08-17_01:02:08 tube: smithi user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-08-17T02:09:37.754 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa; will attempt to use it 2024-08-17T02:09:37.755 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks 2024-08-17T02:09:37.755 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-17T02:09:37.757 INFO:teuthology.task.internal:Checking packages... 2024-08-17T02:09:37.780 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '2577e8139c6b8786f9d6d6ea21b8da9244b9260e' 2024-08-17T02:09:37.780 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-17T02:09:37.780 INFO:teuthology.packaging:ref: None 2024-08-17T02:09:37.780 INFO:teuthology.packaging:tag: None 2024-08-17T02:09:37.781 INFO:teuthology.packaging:branch: wip-mchangir-mgr-volumes-print-thread-name-quincy 2024-08-17T02:09:37.781 INFO:teuthology.packaging:sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:09:37.781 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-mchangir-mgr-volumes-print-thread-name-quincy 2024-08-17T02:09:37.923 INFO:teuthology.task.internal:Found packages for ceph version 17.2.7-1375-g2577e813-1focal 2024-08-17T02:09:37.925 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-17T02:09:37.931 INFO:teuthology.task.internal:no buildpackages task found 2024-08-17T02:09:37.931 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-17T02:09:37.946 INFO:teuthology.task.internal:Saving configuration 2024-08-17T02:09:37.961 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-17T02:09:37.968 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-17T02:09:37.993 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi104.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858240', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-17 02:03:43.909714', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-08-17T02:09:38.017 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi117.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858240', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-17 02:03:43.908251', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-08-17T02:09:38.018 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-17T02:09:38.023 INFO:teuthology.task.internal:roles: ubuntu@smithi104.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-08-17T02:09:38.023 INFO:teuthology.task.internal:roles: ubuntu@smithi117.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-08-17T02:09:38.023 INFO:teuthology.run_tasks:Running task console_log... 2024-08-17T02:09:38.082 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6ff3b3bac0>, signals=[15]) 2024-08-17T02:09:38.082 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-17T02:09:38.088 INFO:teuthology.task.internal:Opening connections... 2024-08-17T02:09:38.088 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi104.front.sepia.ceph.com 2024-08-17T02:09:38.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:09:38.186 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi117.front.sepia.ceph.com 2024-08-17T02:09:38.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:09:38.275 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-17T02:09:38.281 DEBUG:teuthology.orchestra.run.smithi104:> uname -m 2024-08-17T02:09:38.287 INFO:teuthology.orchestra.run.smithi104.stdout:x86_64 2024-08-17T02:09:38.288 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release 2024-08-17T02:09:38.336 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="Ubuntu" 2024-08-17T02:09:38.336 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-08-17T02:09:38.336 INFO:teuthology.orchestra.run.smithi104.stdout:ID=ubuntu 2024-08-17T02:09:38.336 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE=debian 2024-08-17T02:09:38.336 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-08-17T02:09:38.336 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="20.04" 2024-08-17T02:09:38.336 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://www.ubuntu.com/" 2024-08-17T02:09:38.336 INFO:teuthology.orchestra.run.smithi104.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-08-17T02:09:38.336 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-08-17T02:09:38.336 INFO:teuthology.orchestra.run.smithi104.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-08-17T02:09:38.336 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_CODENAME=focal 2024-08-17T02:09:38.337 INFO:teuthology.orchestra.run.smithi104.stdout:UBUNTU_CODENAME=focal 2024-08-17T02:09:38.337 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2024-08-17T02:09:38.361 DEBUG:teuthology.orchestra.run.smithi117:> uname -m 2024-08-17T02:09:38.368 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64 2024-08-17T02:09:38.368 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release 2024-08-17T02:09:38.374 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="Ubuntu" 2024-08-17T02:09:38.374 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-08-17T02:09:38.374 INFO:teuthology.orchestra.run.smithi117.stdout:ID=ubuntu 2024-08-17T02:09:38.374 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE=debian 2024-08-17T02:09:38.374 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-08-17T02:09:38.374 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="20.04" 2024-08-17T02:09:38.374 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://www.ubuntu.com/" 2024-08-17T02:09:38.374 INFO:teuthology.orchestra.run.smithi117.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-08-17T02:09:38.374 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-08-17T02:09:38.375 INFO:teuthology.orchestra.run.smithi117.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-08-17T02:09:38.375 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_CODENAME=focal 2024-08-17T02:09:38.375 INFO:teuthology.orchestra.run.smithi117.stdout:UBUNTU_CODENAME=focal 2024-08-17T02:09:38.375 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2024-08-17T02:09:38.394 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-17T02:09:38.403 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-17T02:09:38.408 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-17T02:09:38.408 DEBUG:teuthology.orchestra.run.smithi104:> test '!' -e /home/ubuntu/cephtest 2024-08-17T02:09:38.411 DEBUG:teuthology.orchestra.run.smithi117:> test '!' -e /home/ubuntu/cephtest 2024-08-17T02:09:38.419 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-17T02:09:38.423 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-17T02:09:38.424 DEBUG:teuthology.orchestra.run.smithi104:> test -z $(ls -A /var/lib/ceph) 2024-08-17T02:09:38.426 DEBUG:teuthology.orchestra.run.smithi117:> test -z $(ls -A /var/lib/ceph) 2024-08-17T02:09:38.443 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-17T02:09:38.492 INFO:teuthology.run_tasks:Running task kernel... 2024-08-17T02:09:38.509 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-08-17T02:09:38.509 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-08-17T02:09:38.509 DEBUG:teuthology.orchestra.run.smithi104:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-17T02:09:38.509 DEBUG:teuthology.orchestra.run.smithi117:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-17T02:09:38.515 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:09:38.515 DEBUG:teuthology.orchestra.run.smithi104:> uname -r 2024-08-17T02:09:38.516 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:09:38.516 DEBUG:teuthology.orchestra.run.smithi117:> uname -r 2024-08-17T02:09:38.522 INFO:teuthology.orchestra.run.smithi104.stdout:5.4.0-124-generic 2024-08-17T02:09:38.522 INFO:teuthology.task.kernel:Running kernel on smithi104: 5.4.0-124-generic 2024-08-17T02:09:38.523 DEBUG:teuthology.orchestra.run.smithi104:> sudo apt-get clean 2024-08-17T02:09:38.564 INFO:teuthology.orchestra.run.smithi117.stdout:5.4.0-124-generic 2024-08-17T02:09:38.564 INFO:teuthology.task.kernel:Running kernel on smithi117: 5.4.0-124-generic 2024-08-17T02:09:38.564 DEBUG:teuthology.orchestra.run.smithi117:> sudo apt-get clean 2024-08-17T02:09:38.668 DEBUG:teuthology.orchestra.run.smithi104:> sudo apt-get update 2024-08-17T02:09:38.673 DEBUG:teuthology.orchestra.run.smithi117:> sudo apt-get update 2024-08-17T02:09:39.053 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-08-17T02:09:39.053 INFO:teuthology.orchestra.run.smithi117.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [128 kB] 2024-08-17T02:09:39.055 INFO:teuthology.orchestra.run.smithi104.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-08-17T02:09:39.055 INFO:teuthology.orchestra.run.smithi104.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [128 kB] 2024-08-17T02:09:39.108 INFO:teuthology.orchestra.run.smithi117.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [128 kB] 2024-08-17T02:09:39.108 INFO:teuthology.orchestra.run.smithi104.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [128 kB] 2024-08-17T02:09:39.462 INFO:teuthology.orchestra.run.smithi104.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [128 kB] 2024-08-17T02:09:39.464 INFO:teuthology.orchestra.run.smithi117.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [128 kB] 2024-08-17T02:09:39.542 INFO:teuthology.orchestra.run.smithi104.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [3,126 kB] 2024-08-17T02:09:39.546 INFO:teuthology.orchestra.run.smithi117.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [3,126 kB] 2024-08-17T02:09:39.674 INFO:teuthology.orchestra.run.smithi104.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,496 kB] 2024-08-17T02:09:39.678 INFO:teuthology.orchestra.run.smithi117.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [1,017 kB] 2024-08-17T02:09:40.018 INFO:teuthology.orchestra.run.smithi117.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,496 kB] 2024-08-17T02:09:40.029 INFO:teuthology.orchestra.run.smithi117.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [797 kB] 2024-08-17T02:09:40.042 INFO:teuthology.orchestra.run.smithi117.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [464 kB] 2024-08-17T02:09:40.051 INFO:teuthology.orchestra.run.smithi117.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [14.2 kB] 2024-08-17T02:09:40.052 INFO:teuthology.orchestra.run.smithi104.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [797 kB] 2024-08-17T02:09:40.052 INFO:teuthology.orchestra.run.smithi117.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [3,034 kB] 2024-08-17T02:09:40.066 INFO:teuthology.orchestra.run.smithi104.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [464 kB] 2024-08-17T02:09:40.074 INFO:teuthology.orchestra.run.smithi104.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [14.2 kB] 2024-08-17T02:09:40.074 INFO:teuthology.orchestra.run.smithi104.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [3,034 kB] 2024-08-17T02:09:40.138 INFO:teuthology.orchestra.run.smithi117.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [38.1 kB] 2024-08-17T02:09:40.139 INFO:teuthology.orchestra.run.smithi117.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [425 kB] 2024-08-17T02:09:40.141 INFO:teuthology.orchestra.run.smithi104.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [1,017 kB] 2024-08-17T02:09:40.146 INFO:teuthology.orchestra.run.smithi117.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [544 B] 2024-08-17T02:09:40.146 INFO:teuthology.orchestra.run.smithi117.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [674 kB] 2024-08-17T02:09:40.157 INFO:teuthology.orchestra.run.smithi104.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [543 kB] 2024-08-17T02:09:40.158 INFO:teuthology.orchestra.run.smithi117.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [999 kB] 2024-08-17T02:09:40.161 INFO:teuthology.orchestra.run.smithi104.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [38.1 kB] 2024-08-17T02:09:40.161 INFO:teuthology.orchestra.run.smithi104.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [425 kB] 2024-08-17T02:09:40.166 INFO:teuthology.orchestra.run.smithi104.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.7 kB] 2024-08-17T02:09:40.167 INFO:teuthology.orchestra.run.smithi104.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [3,152 kB] 2024-08-17T02:09:40.170 INFO:teuthology.orchestra.run.smithi104.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [544 B] 2024-08-17T02:09:40.170 INFO:teuthology.orchestra.run.smithi104.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [999 kB] 2024-08-17T02:09:40.207 INFO:teuthology.orchestra.run.smithi117.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [212 kB] 2024-08-17T02:09:40.211 INFO:teuthology.orchestra.run.smithi117.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [21.0 kB] 2024-08-17T02:09:40.212 INFO:teuthology.orchestra.run.smithi117.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,204 B] 2024-08-17T02:09:40.212 INFO:teuthology.orchestra.run.smithi117.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.8 kB] 2024-08-17T02:09:40.219 INFO:teuthology.orchestra.run.smithi104.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [674 kB] 2024-08-17T02:09:40.225 INFO:teuthology.orchestra.run.smithi117.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [543 kB] 2024-08-17T02:09:40.233 INFO:teuthology.orchestra.run.smithi104.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [212 kB] 2024-08-17T02:09:40.236 INFO:teuthology.orchestra.run.smithi104.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [21.0 kB] 2024-08-17T02:09:40.236 INFO:teuthology.orchestra.run.smithi104.stdout:Get:22 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,204 B] 2024-08-17T02:09:40.236 INFO:teuthology.orchestra.run.smithi104.stdout:Get:23 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.8 kB] 2024-08-17T02:09:40.238 INFO:teuthology.orchestra.run.smithi117.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.7 kB] 2024-08-17T02:09:40.238 INFO:teuthology.orchestra.run.smithi117.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [39.4 kB] 2024-08-17T02:09:40.240 INFO:teuthology.orchestra.run.smithi117.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [3,152 kB] 2024-08-17T02:09:40.255 INFO:teuthology.orchestra.run.smithi104.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [39.4 kB] 2024-08-17T02:09:40.255 INFO:teuthology.orchestra.run.smithi104.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [442 kB] 2024-08-17T02:09:40.263 INFO:teuthology.orchestra.run.smithi104.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [540 B] 2024-08-17T02:09:40.263 INFO:teuthology.orchestra.run.smithi104.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [801 kB] 2024-08-17T02:09:40.287 INFO:teuthology.orchestra.run.smithi117.stdout:Get:25 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,968 B] 2024-08-17T02:09:40.288 INFO:teuthology.orchestra.run.smithi117.stdout:Get:26 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2024-08-17T02:09:40.311 INFO:teuthology.orchestra.run.smithi104.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,968 B] 2024-08-17T02:09:40.311 INFO:teuthology.orchestra.run.smithi104.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2024-08-17T02:09:40.312 INFO:teuthology.orchestra.run.smithi104.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,219 kB] 2024-08-17T02:09:40.329 INFO:teuthology.orchestra.run.smithi117.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [442 kB] 2024-08-17T02:09:40.331 INFO:teuthology.orchestra.run.smithi104.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [294 kB] 2024-08-17T02:09:40.336 INFO:teuthology.orchestra.run.smithi104.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [27.8 kB] 2024-08-17T02:09:40.336 INFO:teuthology.orchestra.run.smithi104.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2024-08-17T02:09:40.336 INFO:teuthology.orchestra.run.smithi104.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [27.1 kB] 2024-08-17T02:09:40.352 INFO:teuthology.orchestra.run.smithi117.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [540 B] 2024-08-17T02:09:40.352 INFO:teuthology.orchestra.run.smithi117.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [801 kB] 2024-08-17T02:09:40.374 INFO:teuthology.orchestra.run.smithi117.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,219 kB] 2024-08-17T02:09:40.402 INFO:teuthology.orchestra.run.smithi117.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [294 kB] 2024-08-17T02:09:40.403 INFO:teuthology.orchestra.run.smithi104.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,936 B] 2024-08-17T02:09:40.404 INFO:teuthology.orchestra.run.smithi104.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2024-08-17T02:09:40.404 INFO:teuthology.orchestra.run.smithi104.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-08-17T02:09:40.405 INFO:teuthology.orchestra.run.smithi104.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-08-17T02:09:40.406 INFO:teuthology.orchestra.run.smithi104.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-08-17T02:09:40.408 INFO:teuthology.orchestra.run.smithi117.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [27.8 kB] 2024-08-17T02:09:40.424 INFO:teuthology.orchestra.run.smithi117.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [27.1 kB] 2024-08-17T02:09:40.425 INFO:teuthology.orchestra.run.smithi117.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2024-08-17T02:09:40.425 INFO:teuthology.orchestra.run.smithi117.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,936 B] 2024-08-17T02:09:40.472 INFO:teuthology.orchestra.run.smithi117.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2024-08-17T02:09:40.472 INFO:teuthology.orchestra.run.smithi117.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-08-17T02:09:40.473 INFO:teuthology.orchestra.run.smithi117.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-08-17T02:09:40.474 INFO:teuthology.orchestra.run.smithi117.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-08-17T02:09:40.485 INFO:teuthology.orchestra.run.smithi104.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-08-17T02:09:40.486 INFO:teuthology.orchestra.run.smithi104.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-08-17T02:09:40.486 INFO:teuthology.orchestra.run.smithi104.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-08-17T02:09:40.553 INFO:teuthology.orchestra.run.smithi117.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-08-17T02:09:40.554 INFO:teuthology.orchestra.run.smithi117.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-08-17T02:09:40.554 INFO:teuthology.orchestra.run.smithi117.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-08-17T02:09:44.300 INFO:teuthology.orchestra.run.smithi117.stdout:Fetched 21.4 MB in 4s (5,947 kB/s) 2024-08-17T02:09:44.451 INFO:teuthology.orchestra.run.smithi104.stdout:Fetched 21.4 MB in 4s (5,955 kB/s) 2024-08-17T02:09:45.818 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2024-08-17T02:09:45.844 DEBUG:teuthology.orchestra.run.smithi117:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-08-17T02:09:45.930 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2024-08-17T02:09:46.043 INFO:teuthology.orchestra.run.smithi104.stdout:Reading package lists... 2024-08-17T02:09:46.069 DEBUG:teuthology.orchestra.run.smithi104:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-08-17T02:09:46.146 INFO:teuthology.orchestra.run.smithi117.stdout:Building dependency tree... 2024-08-17T02:09:46.146 INFO:teuthology.orchestra.run.smithi117.stdout:Reading state information... 2024-08-17T02:09:46.147 INFO:teuthology.orchestra.run.smithi104.stdout:Reading package lists... 2024-08-17T02:09:46.338 INFO:teuthology.orchestra.run.smithi104.stdout:Building dependency tree... 2024-08-17T02:09:46.338 INFO:teuthology.orchestra.run.smithi104.stdout:Reading state information... 2024-08-17T02:09:46.358 INFO:teuthology.orchestra.run.smithi117.stdout:The following additional packages will be installed: 2024-08-17T02:09:46.358 INFO:teuthology.orchestra.run.smithi117.stdout: linux-generic linux-headers-5.4.0-192 linux-headers-5.4.0-192-generic 2024-08-17T02:09:46.358 INFO:teuthology.orchestra.run.smithi117.stdout: linux-headers-generic linux-image-5.4.0-192-generic 2024-08-17T02:09:46.358 INFO:teuthology.orchestra.run.smithi117.stdout: linux-modules-5.4.0-192-generic linux-modules-extra-5.4.0-192-generic 2024-08-17T02:09:46.358 INFO:teuthology.orchestra.run.smithi117.stdout:Suggested packages: 2024-08-17T02:09:46.359 INFO:teuthology.orchestra.run.smithi117.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-08-17T02:09:46.359 INFO:teuthology.orchestra.run.smithi117.stdout:Recommended packages: 2024-08-17T02:09:46.359 INFO:teuthology.orchestra.run.smithi117.stdout: thermald 2024-08-17T02:09:46.410 INFO:teuthology.orchestra.run.smithi117.stdout:The following NEW packages will be installed: 2024-08-17T02:09:46.410 INFO:teuthology.orchestra.run.smithi117.stdout: linux-headers-5.4.0-192 linux-headers-5.4.0-192-generic 2024-08-17T02:09:46.410 INFO:teuthology.orchestra.run.smithi117.stdout: linux-image-5.4.0-192-generic linux-modules-5.4.0-192-generic 2024-08-17T02:09:46.410 INFO:teuthology.orchestra.run.smithi117.stdout: linux-modules-extra-5.4.0-192-generic 2024-08-17T02:09:46.411 INFO:teuthology.orchestra.run.smithi117.stdout:The following packages will be upgraded: 2024-08-17T02:09:46.412 INFO:teuthology.orchestra.run.smithi117.stdout: linux-generic linux-headers-generic linux-image-generic 2024-08-17T02:09:46.535 INFO:teuthology.orchestra.run.smithi104.stdout:The following additional packages will be installed: 2024-08-17T02:09:46.535 INFO:teuthology.orchestra.run.smithi104.stdout: linux-generic linux-headers-5.4.0-192 linux-headers-5.4.0-192-generic 2024-08-17T02:09:46.536 INFO:teuthology.orchestra.run.smithi104.stdout: linux-headers-generic linux-image-5.4.0-192-generic 2024-08-17T02:09:46.536 INFO:teuthology.orchestra.run.smithi104.stdout: linux-modules-5.4.0-192-generic linux-modules-extra-5.4.0-192-generic 2024-08-17T02:09:46.537 INFO:teuthology.orchestra.run.smithi104.stdout:Suggested packages: 2024-08-17T02:09:46.537 INFO:teuthology.orchestra.run.smithi104.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-08-17T02:09:46.537 INFO:teuthology.orchestra.run.smithi104.stdout:Recommended packages: 2024-08-17T02:09:46.537 INFO:teuthology.orchestra.run.smithi104.stdout: thermald 2024-08-17T02:09:46.594 INFO:teuthology.orchestra.run.smithi117.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-08-17T02:09:46.594 INFO:teuthology.orchestra.run.smithi117.stdout:Need to get 77.2 MB of archives. 2024-08-17T02:09:46.594 INFO:teuthology.orchestra.run.smithi117.stdout:After this operation, 381 MB of additional disk space will be used. 2024-08-17T02:09:46.595 INFO:teuthology.orchestra.run.smithi117.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-192-generic amd64 5.4.0-192.212 [15.0 MB] 2024-08-17T02:09:46.607 INFO:teuthology.orchestra.run.smithi104.stdout:The following NEW packages will be installed: 2024-08-17T02:09:46.608 INFO:teuthology.orchestra.run.smithi104.stdout: linux-headers-5.4.0-192 linux-headers-5.4.0-192-generic 2024-08-17T02:09:46.608 INFO:teuthology.orchestra.run.smithi104.stdout: linux-image-5.4.0-192-generic linux-modules-5.4.0-192-generic 2024-08-17T02:09:46.608 INFO:teuthology.orchestra.run.smithi104.stdout: linux-modules-extra-5.4.0-192-generic 2024-08-17T02:09:46.609 INFO:teuthology.orchestra.run.smithi104.stdout:The following packages will be upgraded: 2024-08-17T02:09:46.610 INFO:teuthology.orchestra.run.smithi104.stdout: linux-generic linux-headers-generic linux-image-generic 2024-08-17T02:09:46.663 INFO:teuthology.orchestra.run.smithi104.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-08-17T02:09:46.663 INFO:teuthology.orchestra.run.smithi104.stdout:Need to get 77.2 MB of archives. 2024-08-17T02:09:46.664 INFO:teuthology.orchestra.run.smithi104.stdout:After this operation, 381 MB of additional disk space will be used. 2024-08-17T02:09:46.664 INFO:teuthology.orchestra.run.smithi104.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-192-generic amd64 5.4.0-192.212 [15.0 MB] 2024-08-17T02:09:46.978 INFO:teuthology.orchestra.run.smithi104.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-192-generic amd64 5.4.0-192.212 [10.5 MB] 2024-08-17T02:09:47.067 INFO:teuthology.orchestra.run.smithi104.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-192-generic amd64 5.4.0-192.212 [39.2 MB] 2024-08-17T02:09:47.580 INFO:teuthology.orchestra.run.smithi104.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.192.190 [1,900 B] 2024-08-17T02:09:47.580 INFO:teuthology.orchestra.run.smithi104.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.192.190 [2,588 B] 2024-08-17T02:09:47.580 INFO:teuthology.orchestra.run.smithi104.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-192 all 5.4.0-192.212 [11.0 MB] 2024-08-17T02:09:47.677 INFO:teuthology.orchestra.run.smithi104.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-192-generic amd64 5.4.0-192.212 [1,398 kB] 2024-08-17T02:09:47.688 INFO:teuthology.orchestra.run.smithi104.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.192.190 [2,456 B] 2024-08-17T02:09:47.758 INFO:teuthology.orchestra.run.smithi117.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-192-generic amd64 5.4.0-192.212 [10.5 MB] 2024-08-17T02:09:48.075 INFO:teuthology.orchestra.run.smithi117.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-192-generic amd64 5.4.0-192.212 [39.2 MB] 2024-08-17T02:09:48.372 INFO:teuthology.orchestra.run.smithi104.stdout:Fetched 77.2 MB in 1s (72.1 MB/s) 2024-08-17T02:09:48.562 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package linux-modules-5.4.0-192-generic. 2024-08-17T02:09:49.371 INFO:teuthology.orchestra.run.smithi117.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.192.190 [1,900 B] 2024-08-17T02:09:49.371 INFO:teuthology.orchestra.run.smithi117.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.192.190 [2,588 B] 2024-08-17T02:09:49.371 INFO:teuthology.orchestra.run.smithi117.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-192 all 5.4.0-192.212 [11.0 MB] 2024-08-17T02:09:49.657 INFO:teuthology.orchestra.run.smithi117.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-192-generic amd64 5.4.0-192.212 [1,398 kB] 2024-08-17T02:09:49.698 INFO:teuthology.orchestra.run.smithi117.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.192.190 [2,456 B] 2024-08-17T02:09:50.343 INFO:teuthology.orchestra.run.smithi104.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-08-17T02:09:50.348 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../0-linux-modules-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:09:50.445 INFO:teuthology.orchestra.run.smithi117.stdout:Fetched 77.2 MB in 3s (23.5 MB/s) 2024-08-17T02:09:50.486 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking linux-modules-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:09:50.637 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package linux-modules-5.4.0-192-generic. 2024-08-17T02:09:52.391 INFO:teuthology.orchestra.run.smithi117.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-08-17T02:09:52.396 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../0-linux-modules-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:09:52.419 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package linux-image-5.4.0-192-generic. 2024-08-17T02:09:52.432 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../1-linux-image-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:09:52.492 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-modules-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:09:52.520 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking linux-image-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:09:53.605 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-192-generic. 2024-08-17T02:09:53.619 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:09:53.663 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking linux-modules-extra-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:09:54.392 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package linux-image-5.4.0-192-generic. 2024-08-17T02:09:54.409 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../1-linux-image-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:09:54.500 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-image-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:09:55.578 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-192-generic. 2024-08-17T02:09:55.591 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:09:55.636 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-modules-extra-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:09:58.260 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../3-linux-generic_5.4.0.192.190_amd64.deb ... 2024-08-17T02:09:58.384 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking linux-generic (5.4.0.192.190) over (5.4.0.124.125) ... 2024-08-17T02:09:58.685 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.192.190_amd64.deb ... 2024-08-17T02:09:58.812 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking linux-image-generic (5.4.0.192.190) over (5.4.0.124.125) ... 2024-08-17T02:09:59.165 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package linux-headers-5.4.0-192. 2024-08-17T02:09:59.180 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../5-linux-headers-5.4.0-192_5.4.0-192.212_all.deb ... 2024-08-17T02:09:59.223 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking linux-headers-5.4.0-192 (5.4.0-192.212) ... 2024-08-17T02:10:00.353 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../3-linux-generic_5.4.0.192.190_amd64.deb ... 2024-08-17T02:10:00.481 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-generic (5.4.0.192.190) over (5.4.0.124.125) ... 2024-08-17T02:10:00.840 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.192.190_amd64.deb ... 2024-08-17T02:10:00.967 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-image-generic (5.4.0.192.190) over (5.4.0.124.125) ... 2024-08-17T02:10:01.312 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package linux-headers-5.4.0-192. 2024-08-17T02:10:01.329 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../5-linux-headers-5.4.0-192_5.4.0-192.212_all.deb ... 2024-08-17T02:10:01.370 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-headers-5.4.0-192 (5.4.0-192.212) ... 2024-08-17T02:10:04.584 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package linux-headers-5.4.0-192-generic. 2024-08-17T02:10:04.605 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../6-linux-headers-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:10:04.642 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking linux-headers-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:10:06.670 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package linux-headers-5.4.0-192-generic. 2024-08-17T02:10:06.692 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../6-linux-headers-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:10:06.736 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-headers-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:10:07.343 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.192.190_amd64.deb ... 2024-08-17T02:10:07.471 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking linux-headers-generic (5.4.0.192.190) over (5.4.0.124.125) ... 2024-08-17T02:10:07.829 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up linux-headers-5.4.0-192 (5.4.0-192.212) ... 2024-08-17T02:10:07.950 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up linux-modules-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:10:09.168 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up linux-image-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:10:09.360 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.192.190_amd64.deb ... 2024-08-17T02:10:09.508 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-headers-generic (5.4.0.192.190) over (5.4.0.124.125) ... 2024-08-17T02:10:09.849 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-headers-5.4.0-192 (5.4.0-192.212) ... 2024-08-17T02:10:09.954 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-modules-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:10:10.307 INFO:teuthology.orchestra.run.smithi104.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-192-generic 2024-08-17T02:10:10.307 INFO:teuthology.orchestra.run.smithi104.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-192-generic 2024-08-17T02:10:10.445 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up linux-headers-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:10:10.571 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up linux-modules-extra-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:10:11.189 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-image-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:10:11.764 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up linux-image-generic (5.4.0.192.190) ... 2024-08-17T02:10:11.915 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up linux-headers-generic (5.4.0.192.190) ... 2024-08-17T02:10:12.050 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up linux-generic (5.4.0.192.190) ... 2024-08-17T02:10:12.592 INFO:teuthology.orchestra.run.smithi117.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-192-generic 2024-08-17T02:10:12.592 INFO:teuthology.orchestra.run.smithi117.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-192-generic 2024-08-17T02:10:12.960 INFO:teuthology.orchestra.run.smithi104.stdout:Processing triggers for linux-image-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:10:13.373 INFO:teuthology.orchestra.run.smithi104.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-08-17T02:10:13.373 INFO:teuthology.orchestra.run.smithi104.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-192-generic 2024-08-17T02:10:13.375 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-headers-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:10:13.501 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-modules-extra-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:10:14.686 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-image-generic (5.4.0.192.190) ... 2024-08-17T02:10:14.787 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-headers-generic (5.4.0.192.190) ... 2024-08-17T02:10:14.946 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-generic (5.4.0.192.190) ... 2024-08-17T02:10:15.072 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for linux-image-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:10:15.143 INFO:teuthology.orchestra.run.smithi117.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-08-17T02:10:15.143 INFO:teuthology.orchestra.run.smithi117.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-192-generic 2024-08-17T02:10:35.494 INFO:teuthology.orchestra.run.smithi104.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-08-17T02:10:35.495 INFO:teuthology.orchestra.run.smithi104.stdout:Sourcing file `/etc/default/grub' 2024-08-17T02:10:35.500 INFO:teuthology.orchestra.run.smithi104.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-17T02:10:35.520 INFO:teuthology.orchestra.run.smithi104.stdout:Generating grub configuration file ... 2024-08-17T02:10:35.854 INFO:teuthology.orchestra.run.smithi104.stdout:Found linux image: /boot/vmlinuz-5.4.0-192-generic 2024-08-17T02:10:35.876 INFO:teuthology.orchestra.run.smithi104.stdout:Found initrd image: /boot/initrd.img-5.4.0-192-generic 2024-08-17T02:10:36.284 INFO:teuthology.orchestra.run.smithi104.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-08-17T02:10:36.296 INFO:teuthology.orchestra.run.smithi104.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-08-17T02:10:37.019 INFO:teuthology.orchestra.run.smithi117.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-08-17T02:10:37.020 INFO:teuthology.orchestra.run.smithi117.stdout:Sourcing file `/etc/default/grub' 2024-08-17T02:10:37.037 INFO:teuthology.orchestra.run.smithi117.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-17T02:10:37.062 INFO:teuthology.orchestra.run.smithi117.stdout:Generating grub configuration file ... 2024-08-17T02:10:37.367 INFO:teuthology.orchestra.run.smithi117.stdout:Found linux image: /boot/vmlinuz-5.4.0-192-generic 2024-08-17T02:10:37.385 INFO:teuthology.orchestra.run.smithi117.stdout:Found initrd image: /boot/initrd.img-5.4.0-192-generic 2024-08-17T02:10:37.780 INFO:teuthology.orchestra.run.smithi117.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-08-17T02:10:37.792 INFO:teuthology.orchestra.run.smithi117.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-08-17T02:10:38.381 INFO:teuthology.orchestra.run.smithi104.stdout:done 2024-08-17T02:10:38.835 DEBUG:teuthology.orchestra.run.smithi104:> dpkg -s linux-image-generic 2024-08-17T02:10:38.884 INFO:teuthology.orchestra.run.smithi104.stdout:Package: linux-image-generic 2024-08-17T02:10:38.885 INFO:teuthology.orchestra.run.smithi104.stdout:Status: install ok installed 2024-08-17T02:10:38.885 INFO:teuthology.orchestra.run.smithi104.stdout:Priority: optional 2024-08-17T02:10:38.885 INFO:teuthology.orchestra.run.smithi104.stdout:Section: kernel 2024-08-17T02:10:38.885 INFO:teuthology.orchestra.run.smithi104.stdout:Installed-Size: 20 2024-08-17T02:10:38.885 INFO:teuthology.orchestra.run.smithi104.stdout:Maintainer: Ubuntu Kernel Team 2024-08-17T02:10:38.885 INFO:teuthology.orchestra.run.smithi104.stdout:Architecture: amd64 2024-08-17T02:10:38.885 INFO:teuthology.orchestra.run.smithi104.stdout:Source: linux-meta 2024-08-17T02:10:38.885 INFO:teuthology.orchestra.run.smithi104.stdout:Version: 5.4.0.192.190 2024-08-17T02:10:38.885 INFO:teuthology.orchestra.run.smithi104.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-08-17T02:10:38.885 INFO:teuthology.orchestra.run.smithi104.stdout:Depends: linux-image-5.4.0-192-generic, linux-modules-extra-5.4.0-192-generic, linux-firmware, intel-microcode, amd64-microcode 2024-08-17T02:10:38.885 INFO:teuthology.orchestra.run.smithi104.stdout:Recommends: thermald 2024-08-17T02:10:38.885 INFO:teuthology.orchestra.run.smithi104.stdout:Description: Generic Linux kernel image 2024-08-17T02:10:38.886 INFO:teuthology.orchestra.run.smithi104.stdout: This package will always depend on the latest generic kernel image 2024-08-17T02:10:38.886 INFO:teuthology.orchestra.run.smithi104.stdout: available. 2024-08-17T02:10:38.886 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-192-generic 2024-08-17T02:10:38.886 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-08-17T02:10:38.886 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-08-17T02:10:38.889 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-08-17T02:10:38.889 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi104.front.sepia.ceph.com, path=None, version=distro) 2024-08-17T02:10:38.890 DEBUG:teuthology.orchestra.run.smithi104:> sudo apt-get clean 2024-08-17T02:10:38.960 DEBUG:teuthology.orchestra.run.smithi104:> sudo apt-get update 2024-08-17T02:10:39.107 INFO:teuthology.orchestra.run.smithi104.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-08-17T02:10:39.107 INFO:teuthology.orchestra.run.smithi104.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-08-17T02:10:39.114 INFO:teuthology.orchestra.run.smithi104.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-08-17T02:10:39.132 INFO:teuthology.orchestra.run.smithi104.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-08-17T02:10:39.940 INFO:teuthology.orchestra.run.smithi117.stdout:done 2024-08-17T02:10:40.401 DEBUG:teuthology.orchestra.run.smithi117:> dpkg -s linux-image-generic 2024-08-17T02:10:40.453 INFO:teuthology.orchestra.run.smithi117.stdout:Package: linux-image-generic 2024-08-17T02:10:40.454 INFO:teuthology.orchestra.run.smithi117.stdout:Status: install ok installed 2024-08-17T02:10:40.454 INFO:teuthology.orchestra.run.smithi117.stdout:Priority: optional 2024-08-17T02:10:40.454 INFO:teuthology.orchestra.run.smithi117.stdout:Section: kernel 2024-08-17T02:10:40.454 INFO:teuthology.orchestra.run.smithi117.stdout:Installed-Size: 20 2024-08-17T02:10:40.455 INFO:teuthology.orchestra.run.smithi117.stdout:Maintainer: Ubuntu Kernel Team 2024-08-17T02:10:40.455 INFO:teuthology.orchestra.run.smithi117.stdout:Architecture: amd64 2024-08-17T02:10:40.455 INFO:teuthology.orchestra.run.smithi117.stdout:Source: linux-meta 2024-08-17T02:10:40.455 INFO:teuthology.orchestra.run.smithi117.stdout:Version: 5.4.0.192.190 2024-08-17T02:10:40.455 INFO:teuthology.orchestra.run.smithi117.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-08-17T02:10:40.455 INFO:teuthology.orchestra.run.smithi117.stdout:Depends: linux-image-5.4.0-192-generic, linux-modules-extra-5.4.0-192-generic, linux-firmware, intel-microcode, amd64-microcode 2024-08-17T02:10:40.455 INFO:teuthology.orchestra.run.smithi117.stdout:Recommends: thermald 2024-08-17T02:10:40.455 INFO:teuthology.orchestra.run.smithi117.stdout:Description: Generic Linux kernel image 2024-08-17T02:10:40.455 INFO:teuthology.orchestra.run.smithi117.stdout: This package will always depend on the latest generic kernel image 2024-08-17T02:10:40.455 INFO:teuthology.orchestra.run.smithi117.stdout: available. 2024-08-17T02:10:40.455 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-192-generic 2024-08-17T02:10:40.456 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-08-17T02:10:40.456 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-08-17T02:10:40.456 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-08-17T02:10:40.456 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi117.front.sepia.ceph.com, path=None, version=distro) 2024-08-17T02:10:40.456 DEBUG:teuthology.orchestra.run.smithi117:> sudo apt-get clean 2024-08-17T02:10:40.558 DEBUG:teuthology.orchestra.run.smithi117:> sudo apt-get update 2024-08-17T02:10:40.690 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-08-17T02:10:40.809 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2024-08-17T02:10:40.891 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-08-17T02:10:40.945 INFO:teuthology.orchestra.run.smithi104.stdout:Reading package lists... 2024-08-17T02:10:40.970 DEBUG:teuthology.orchestra.run.smithi104:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-08-17T02:10:40.973 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-08-17T02:10:41.042 INFO:teuthology.orchestra.run.smithi104.stdout:Reading package lists... 2024-08-17T02:10:41.245 INFO:teuthology.orchestra.run.smithi104.stdout:Building dependency tree... 2024-08-17T02:10:41.246 INFO:teuthology.orchestra.run.smithi104.stdout:Reading state information... 2024-08-17T02:10:41.474 INFO:teuthology.orchestra.run.smithi104.stdout:linux-image-generic is already the newest version (5.4.0.192.190). 2024-08-17T02:10:41.474 INFO:teuthology.orchestra.run.smithi104.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-08-17T02:10:41.475 DEBUG:teuthology.orchestra.run.smithi104:> dpkg -s linux-image-generic 2024-08-17T02:10:41.495 INFO:teuthology.orchestra.run.smithi104.stdout:Package: linux-image-generic 2024-08-17T02:10:41.495 INFO:teuthology.orchestra.run.smithi104.stdout:Status: install ok installed 2024-08-17T02:10:41.495 INFO:teuthology.orchestra.run.smithi104.stdout:Priority: optional 2024-08-17T02:10:41.496 INFO:teuthology.orchestra.run.smithi104.stdout:Section: kernel 2024-08-17T02:10:41.496 INFO:teuthology.orchestra.run.smithi104.stdout:Installed-Size: 20 2024-08-17T02:10:41.496 INFO:teuthology.orchestra.run.smithi104.stdout:Maintainer: Ubuntu Kernel Team 2024-08-17T02:10:41.496 INFO:teuthology.orchestra.run.smithi104.stdout:Architecture: amd64 2024-08-17T02:10:41.496 INFO:teuthology.orchestra.run.smithi104.stdout:Source: linux-meta 2024-08-17T02:10:41.496 INFO:teuthology.orchestra.run.smithi104.stdout:Version: 5.4.0.192.190 2024-08-17T02:10:41.496 INFO:teuthology.orchestra.run.smithi104.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-08-17T02:10:41.496 INFO:teuthology.orchestra.run.smithi104.stdout:Depends: linux-image-5.4.0-192-generic, linux-modules-extra-5.4.0-192-generic, linux-firmware, intel-microcode, amd64-microcode 2024-08-17T02:10:41.496 INFO:teuthology.orchestra.run.smithi104.stdout:Recommends: thermald 2024-08-17T02:10:41.496 INFO:teuthology.orchestra.run.smithi104.stdout:Description: Generic Linux kernel image 2024-08-17T02:10:41.496 INFO:teuthology.orchestra.run.smithi104.stdout: This package will always depend on the latest generic kernel image 2024-08-17T02:10:41.496 INFO:teuthology.orchestra.run.smithi104.stdout: available. 2024-08-17T02:10:41.497 DEBUG:teuthology.orchestra.run.smithi104:> mktemp 2024-08-17T02:10:41.501 INFO:teuthology.orchestra.run.smithi104.stdout:/tmp/tmp.hJUe8HQbbQ 2024-08-17T02:10:41.501 DEBUG:teuthology.orchestra.run.smithi104:> sudo cp /boot/grub/grub.cfg /tmp/tmp.hJUe8HQbbQ 2024-08-17T02:10:41.511 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 0666 /tmp/tmp.hJUe8HQbbQ 2024-08-17T02:10:41.597 DEBUG:teuthology.orchestra.remote:smithi104:/tmp/tmp.hJUe8HQbbQ is 9KB 2024-08-17T02:10:41.611 DEBUG:teuthology.orchestra.run.smithi104:> rm -fr /tmp/tmp.hJUe8HQbbQ 2024-08-17T02:10:41.617 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-08-17T02:10:41.628 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-08-17T02:10:41.629 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-08-17T02:10:41.629 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-08-17T02:10:41.703 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-192-generic 2024-08-17T02:10:41.703 DEBUG:teuthology.orchestra.run.smithi104:> sudo update-grub 2024-08-17T02:10:42.548 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2024-08-17T02:10:42.575 DEBUG:teuthology.orchestra.run.smithi117:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-08-17T02:10:42.643 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2024-08-17T02:10:42.834 INFO:teuthology.orchestra.run.smithi117.stdout:Building dependency tree... 2024-08-17T02:10:42.835 INFO:teuthology.orchestra.run.smithi117.stdout:Reading state information... 2024-08-17T02:10:43.045 INFO:teuthology.orchestra.run.smithi104.stderr:Sourcing file `/etc/default/grub' 2024-08-17T02:10:43.049 INFO:teuthology.orchestra.run.smithi104.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-17T02:10:43.059 INFO:teuthology.orchestra.run.smithi104.stderr:Generating grub configuration file ... 2024-08-17T02:10:43.065 INFO:teuthology.orchestra.run.smithi117.stdout:linux-image-generic is already the newest version (5.4.0.192.190). 2024-08-17T02:10:43.065 INFO:teuthology.orchestra.run.smithi117.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-08-17T02:10:43.067 DEBUG:teuthology.orchestra.run.smithi117:> dpkg -s linux-image-generic 2024-08-17T02:10:43.082 INFO:teuthology.orchestra.run.smithi117.stdout:Package: linux-image-generic 2024-08-17T02:10:43.082 INFO:teuthology.orchestra.run.smithi117.stdout:Status: install ok installed 2024-08-17T02:10:43.082 INFO:teuthology.orchestra.run.smithi117.stdout:Priority: optional 2024-08-17T02:10:43.083 INFO:teuthology.orchestra.run.smithi117.stdout:Section: kernel 2024-08-17T02:10:43.083 INFO:teuthology.orchestra.run.smithi117.stdout:Installed-Size: 20 2024-08-17T02:10:43.083 INFO:teuthology.orchestra.run.smithi117.stdout:Maintainer: Ubuntu Kernel Team 2024-08-17T02:10:43.083 INFO:teuthology.orchestra.run.smithi117.stdout:Architecture: amd64 2024-08-17T02:10:43.083 INFO:teuthology.orchestra.run.smithi117.stdout:Source: linux-meta 2024-08-17T02:10:43.083 INFO:teuthology.orchestra.run.smithi117.stdout:Version: 5.4.0.192.190 2024-08-17T02:10:43.083 INFO:teuthology.orchestra.run.smithi117.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-08-17T02:10:43.083 INFO:teuthology.orchestra.run.smithi117.stdout:Depends: linux-image-5.4.0-192-generic, linux-modules-extra-5.4.0-192-generic, linux-firmware, intel-microcode, amd64-microcode 2024-08-17T02:10:43.083 INFO:teuthology.orchestra.run.smithi117.stdout:Recommends: thermald 2024-08-17T02:10:43.083 INFO:teuthology.orchestra.run.smithi117.stdout:Description: Generic Linux kernel image 2024-08-17T02:10:43.083 INFO:teuthology.orchestra.run.smithi117.stdout: This package will always depend on the latest generic kernel image 2024-08-17T02:10:43.083 INFO:teuthology.orchestra.run.smithi117.stdout: available. 2024-08-17T02:10:43.084 DEBUG:teuthology.orchestra.run.smithi117:> mktemp 2024-08-17T02:10:43.088 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.ZwWwrgyzlB 2024-08-17T02:10:43.088 DEBUG:teuthology.orchestra.run.smithi117:> sudo cp /boot/grub/grub.cfg /tmp/tmp.ZwWwrgyzlB 2024-08-17T02:10:43.146 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.ZwWwrgyzlB 2024-08-17T02:10:43.187 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.ZwWwrgyzlB is 9KB 2024-08-17T02:10:43.201 DEBUG:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.ZwWwrgyzlB 2024-08-17T02:10:43.207 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-08-17T02:10:43.266 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-17T02:10:43.266 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-08-17T02:10:43.266 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-08-17T02:10:43.300 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-192-generic 2024-08-17T02:10:43.300 DEBUG:teuthology.orchestra.run.smithi117:> sudo update-grub 2024-08-17T02:10:43.319 INFO:teuthology.orchestra.run.smithi104.stderr:Found linux image: /boot/vmlinuz-5.4.0-192-generic 2024-08-17T02:10:43.330 INFO:teuthology.orchestra.run.smithi104.stderr:Found initrd image: /boot/initrd.img-5.4.0-192-generic 2024-08-17T02:10:43.695 INFO:teuthology.orchestra.run.smithi104.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-08-17T02:10:43.706 INFO:teuthology.orchestra.run.smithi104.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-08-17T02:10:44.628 INFO:teuthology.orchestra.run.smithi117.stderr:Sourcing file `/etc/default/grub' 2024-08-17T02:10:44.636 INFO:teuthology.orchestra.run.smithi117.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-17T02:10:44.653 INFO:teuthology.orchestra.run.smithi117.stderr:Generating grub configuration file ... 2024-08-17T02:10:44.672 INFO:teuthology.orchestra.run.smithi104.stderr:done 2024-08-17T02:10:44.674 DEBUG:teuthology.orchestra.run.smithi104:> sudo shutdown -r now 2024-08-17T02:10:44.926 INFO:teuthology.orchestra.run.smithi117.stderr:Found linux image: /boot/vmlinuz-5.4.0-192-generic 2024-08-17T02:10:44.937 INFO:teuthology.orchestra.run.smithi117.stderr:Found initrd image: /boot/initrd.img-5.4.0-192-generic 2024-08-17T02:10:45.342 INFO:teuthology.orchestra.run.smithi117.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-08-17T02:10:45.354 INFO:teuthology.orchestra.run.smithi117.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-08-17T02:10:46.380 INFO:teuthology.orchestra.run.smithi117.stderr:done 2024-08-17T02:10:46.382 DEBUG:teuthology.orchestra.run.smithi117:> sudo shutdown -r now 2024-08-17T02:11:14.702 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-08-17T02:11:14.703 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-08-17T02:11:14.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:11:16.427 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-08-17T02:11:16.427 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-08-17T02:11:16.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:11:33.215 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.104 2024-08-17T02:11:34.750 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-08-17T02:11:42.222 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-08-17T02:11:42.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:11:43.753 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-08-17T02:11:43.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:11:45.278 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.104 2024-08-17T02:11:46.818 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-08-17T02:11:57.290 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-08-17T02:11:57.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:11:58.821 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-08-17T02:11:58.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:12:15.711 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.104 2024-08-17T02:12:17.246 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-08-17T02:12:30.722 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-08-17T02:12:30.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:12:30.994 DEBUG:teuthology.orchestra.run.smithi104:> true 2024-08-17T02:12:31.590 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-08-17T02:12:31.590 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-192-generic"... 2024-08-17T02:12:31.591 DEBUG:teuthology.orchestra.run.smithi104:> uname -r 2024-08-17T02:12:31.637 INFO:teuthology.orchestra.run.smithi104.stdout:5.4.0-192-generic 2024-08-17T02:12:31.637 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-192-generic vs 5.4.0-192-generic 2024-08-17T02:12:31.637 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-17T02:12:31.637 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-08-17T02:12:32.248 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-08-17T02:12:32.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:12:32.494 DEBUG:teuthology.orchestra.run.smithi117:> true 2024-08-17T02:12:32.638 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-08-17T02:12:32.639 DEBUG:teuthology.orchestra.run.smithi104:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-17T02:12:32.740 INFO:teuthology.orchestra.run.smithi104.stdout:ttyS1 2024-08-17T02:12:32.761 DEBUG:teuthology.parallel:result is None 2024-08-17T02:12:33.100 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-08-17T02:12:33.101 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-192-generic"... 2024-08-17T02:12:33.101 DEBUG:teuthology.orchestra.run.smithi117:> uname -r 2024-08-17T02:12:33.107 INFO:teuthology.orchestra.run.smithi117.stdout:5.4.0-192-generic 2024-08-17T02:12:33.107 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-192-generic vs 5.4.0-192-generic 2024-08-17T02:12:33.108 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-17T02:12:33.108 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-08-17T02:12:34.108 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-08-17T02:12:34.108 DEBUG:teuthology.orchestra.run.smithi117:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-17T02:12:34.211 INFO:teuthology.orchestra.run.smithi117.stdout:ttyS1 2024-08-17T02:12:34.230 DEBUG:teuthology.parallel:result is None 2024-08-17T02:12:34.230 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-17T02:12:34.237 INFO:teuthology.task.internal:Creating test directory... 2024-08-17T02:12:34.237 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-17T02:12:34.239 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-17T02:12:34.246 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-17T02:12:34.254 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-17T02:12:34.263 INFO:teuthology.task.internal:Creating archive directory... 2024-08-17T02:12:34.264 DEBUG:teuthology.orchestra.run.smithi104:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-17T02:12:34.288 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-17T02:12:34.306 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-17T02:12:34.312 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-17T02:12:34.312 DEBUG:teuthology.orchestra.run.smithi104:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-17T02:12:34.315 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-17T02:12:34.338 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:12:34.346 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:12:34.360 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:12:34.370 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:12:34.372 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-17T02:12:34.379 INFO:teuthology.task.internal:Configuring sudo... 2024-08-17T02:12:34.379 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-17T02:12:34.393 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-17T02:12:34.408 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-17T02:12:34.417 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-17T02:12:34.417 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-17T02:12:34.419 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-17T02:12:34.425 DEBUG:teuthology.orchestra.run.smithi104:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:12:34.470 DEBUG:teuthology.orchestra.run.smithi104:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:12:34.477 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-08-17T02:12:34.477 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-17T02:12:34.501 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:12:34.508 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:12:34.516 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-17T02:12:34.516 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-17T02:12:34.541 DEBUG:teuthology.orchestra.run.smithi104:> sudo service rsyslog restart 2024-08-17T02:12:34.544 DEBUG:teuthology.orchestra.run.smithi117:> sudo service rsyslog restart 2024-08-17T02:12:34.591 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-17T02:12:34.598 INFO:teuthology.task.internal:Starting timer... 2024-08-17T02:12:34.598 INFO:teuthology.run_tasks:Running task pcp... 2024-08-17T02:12:34.611 INFO:teuthology.run_tasks:Running task selinux... 2024-08-17T02:12:34.619 DEBUG:teuthology.task.selinux:Excluding smithi104: OS 'ubuntu' does not support SELinux 2024-08-17T02:12:34.619 DEBUG:teuthology.task.selinux:Excluding smithi117: OS 'ubuntu' does not support SELinux 2024-08-17T02:12:34.619 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-17T02:12:34.619 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-08-17T02:12:34.620 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-17T02:12:34.620 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-17T02:12:34.641 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-08-17T02:12:34.645 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-08-17T02:12:34.823 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-17T02:12:34.985 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-17T02:12:34.986 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi104.front.sepia.ceph.com,smithi117.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-17T02:18:19.891 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi104.front.sepia.ceph.com'), Remote(name='ubuntu@smithi117.front.sepia.ceph.com')] 2024-08-17T02:18:19.892 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-08-17T02:18:19.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:18:20.000 DEBUG:teuthology.orchestra.run.smithi104:> true 2024-08-17T02:18:20.128 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-08-17T02:18:20.128 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-08-17T02:18:20.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:18:20.222 DEBUG:teuthology.orchestra.run.smithi117:> true 2024-08-17T02:18:20.347 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-08-17T02:18:20.348 INFO:teuthology.run_tasks:Running task clock... 2024-08-17T02:18:20.365 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-17T02:18:20.365 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-17T02:18:20.366 DEBUG:teuthology.orchestra.run.smithi104:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:18:20.370 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-17T02:18:20.371 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:18:20.401 INFO:teuthology.orchestra.run.smithi104.stdout:17 Aug 02:18:20 ntpd[13576]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-08-17T02:18:20.401 INFO:teuthology.orchestra.run.smithi104.stdout:17 Aug 02:18:20 ntpd[13576]: Command line: ntpd -gq 2024-08-17T02:18:20.403 INFO:teuthology.orchestra.run.smithi104.stdout:17 Aug 02:18:20 ntpd[13576]: proto: precision = 0.085 usec (-23) 2024-08-17T02:18:20.403 INFO:teuthology.orchestra.run.smithi104.stdout:17 Aug 02:18:20 ntpd[13576]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-17T02:18:20.403 INFO:teuthology.orchestra.run.smithi104.stdout:17 Aug 02:18:20 ntpd[13576]: restrict ::: KOD does nothing without LIMITED. 2024-08-17T02:18:20.403 INFO:teuthology.orchestra.run.smithi104.stdout:17 Aug 02:18:20 ntpd[13576]: Listen and drop on 0 v6wildcard [::]:123 2024-08-17T02:18:20.403 INFO:teuthology.orchestra.run.smithi104.stdout:17 Aug 02:18:20 ntpd[13576]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-08-17T02:18:20.404 INFO:teuthology.orchestra.run.smithi104.stdout:17 Aug 02:18:20 ntpd[13576]: Listen normally on 2 lo 127.0.0.1:123 2024-08-17T02:18:20.404 INFO:teuthology.orchestra.run.smithi104.stdout:17 Aug 02:18:20 ntpd[13576]: Listen normally on 3 enp3s0f1 172.21.15.104:123 2024-08-17T02:18:20.404 INFO:teuthology.orchestra.run.smithi104.stdout:17 Aug 02:18:20 ntpd[13576]: Listen normally on 4 lo [::1]:123 2024-08-17T02:18:20.404 INFO:teuthology.orchestra.run.smithi104.stdout:17 Aug 02:18:20 ntpd[13576]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:ce89%5]:123 2024-08-17T02:18:20.404 INFO:teuthology.orchestra.run.smithi104.stdout:17 Aug 02:18:20 ntpd[13576]: Listening on routing socket on fd #22 for interface updates 2024-08-17T02:18:20.404 INFO:teuthology.orchestra.run.smithi104.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-17T02:18:20.405 INFO:teuthology.orchestra.run.smithi104.stderr:restrict ::: KOD does nothing without LIMITED. 2024-08-17T02:18:20.420 INFO:teuthology.orchestra.run.smithi117.stdout:17 Aug 02:18:20 ntpd[13623]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-08-17T02:18:20.422 INFO:teuthology.orchestra.run.smithi117.stdout:17 Aug 02:18:20 ntpd[13623]: Command line: ntpd -gq 2024-08-17T02:18:20.423 INFO:teuthology.orchestra.run.smithi117.stdout:17 Aug 02:18:20 ntpd[13623]: proto: precision = 0.063 usec (-24) 2024-08-17T02:18:20.423 INFO:teuthology.orchestra.run.smithi117.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-17T02:18:20.423 INFO:teuthology.orchestra.run.smithi117.stdout:17 Aug 02:18:20 ntpd[13623]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-17T02:18:20.424 INFO:teuthology.orchestra.run.smithi117.stdout:17 Aug 02:18:20 ntpd[13623]: restrict ::: KOD does nothing without LIMITED. 2024-08-17T02:18:20.424 INFO:teuthology.orchestra.run.smithi117.stderr:restrict ::: KOD does nothing without LIMITED. 2024-08-17T02:18:20.425 INFO:teuthology.orchestra.run.smithi117.stdout:17 Aug 02:18:20 ntpd[13623]: Listen and drop on 0 v6wildcard [::]:123 2024-08-17T02:18:20.425 INFO:teuthology.orchestra.run.smithi117.stdout:17 Aug 02:18:20 ntpd[13623]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-08-17T02:18:20.425 INFO:teuthology.orchestra.run.smithi117.stdout:17 Aug 02:18:20 ntpd[13623]: Listen normally on 2 lo 127.0.0.1:123 2024-08-17T02:18:20.425 INFO:teuthology.orchestra.run.smithi117.stdout:17 Aug 02:18:20 ntpd[13623]: Listen normally on 3 enp3s0f1 172.21.15.117:123 2024-08-17T02:18:20.425 INFO:teuthology.orchestra.run.smithi117.stdout:17 Aug 02:18:20 ntpd[13623]: Listen normally on 4 lo [::1]:123 2024-08-17T02:18:20.425 INFO:teuthology.orchestra.run.smithi117.stdout:17 Aug 02:18:20 ntpd[13623]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:4463%5]:123 2024-08-17T02:18:20.425 INFO:teuthology.orchestra.run.smithi117.stdout:17 Aug 02:18:20 ntpd[13623]: Listening on routing socket on fd #22 for interface updates 2024-08-17T02:18:21.422 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:21 ntpd[13623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:18:21.422 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:21 ntpd[13623]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:18:21.422 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:21 ntpd[13623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:18:21.422 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:21 ntpd[13623]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:18:21.422 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:21 ntpd[13623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:18:21.422 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:21 ntpd[13623]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:18:21.423 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:21 ntpd[13623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:18:21.423 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:21 ntpd[13623]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:18:21.423 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:21 ntpd[13623]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:18:21.423 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:21 ntpd[13623]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:18:21.423 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:21 ntpd[13623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:18:21.423 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:21 ntpd[13623]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:18:21.423 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:21 ntpd[13623]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:18:21.423 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:21 ntpd[13623]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:18:22.402 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:22 ntpd[13576]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:18:22.402 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:22 ntpd[13576]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:18:22.402 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:22 ntpd[13576]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:18:22.402 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:22 ntpd[13576]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:18:22.402 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:22 ntpd[13576]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:18:22.403 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:22 ntpd[13576]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:18:22.403 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:22 ntpd[13576]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:18:22.403 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:22 ntpd[13576]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:18:23.402 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:23 ntpd[13576]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:18:23.402 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:23 ntpd[13576]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:18:23.403 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:23 ntpd[13576]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:18:23.403 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:23 ntpd[13576]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:18:23.403 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:23 ntpd[13576]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:18:23.403 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:23 ntpd[13576]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:18:23.403 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:23 ntpd[13576]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:18:23.403 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:23 ntpd[13576]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:18:23.403 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:23 ntpd[13576]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:18:23.403 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:23 ntpd[13576]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:18:23.403 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:23 ntpd[13576]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:18:23.403 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:23 ntpd[13576]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:18:23.421 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:23 ntpd[13623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:18:23.422 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:23 ntpd[13623]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:18:23.422 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:23 ntpd[13623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:18:23.422 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:23 ntpd[13623]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:18:23.422 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:23 ntpd[13623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:18:23.422 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:23 ntpd[13623]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:18:23.422 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:23 ntpd[13623]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:18:23.422 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:23 ntpd[13623]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:18:23.422 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:23 ntpd[13623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:18:23.422 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:23 ntpd[13623]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:18:23.422 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:23 ntpd[13623]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:18:23.422 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:23 ntpd[13623]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:18:24.402 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:24 ntpd[13576]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:18:24.402 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:24 ntpd[13576]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:18:24.402 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:24 ntpd[13576]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:18:24.402 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:24 ntpd[13576]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:18:24.402 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:24 ntpd[13576]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:18:24.403 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:24 ntpd[13576]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:18:25.403 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:25 ntpd[13576]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:18:25.403 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:25 ntpd[13576]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:18:25.403 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:25 ntpd[13576]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:18:25.403 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:25 ntpd[13576]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:18:25.403 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:25 ntpd[13576]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:18:25.403 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:25 ntpd[13576]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:18:25.403 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:25 ntpd[13576]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:18:25.403 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:25 ntpd[13576]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:18:25.403 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:25 ntpd[13576]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:18:25.404 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:25 ntpd[13576]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:18:25.404 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:25 ntpd[13576]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:18:25.404 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:25 ntpd[13576]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:18:25.422 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:25 ntpd[13623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:18:25.423 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:25 ntpd[13623]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:18:25.423 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:25 ntpd[13623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:18:25.423 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:25 ntpd[13623]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:18:25.423 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:25 ntpd[13623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:18:25.423 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:25 ntpd[13623]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:18:25.423 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:25 ntpd[13623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:18:25.423 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:25 ntpd[13623]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:18:25.423 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:25 ntpd[13623]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:18:25.423 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:25 ntpd[13623]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:18:25.423 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:25 ntpd[13623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:18:25.423 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:25 ntpd[13623]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:18:25.423 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:25 ntpd[13623]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:18:25.423 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:25 ntpd[13623]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:18:25.424 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:25 ntpd[13623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:18:25.424 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:25 ntpd[13623]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:18:25.424 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:25 ntpd[13623]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:18:25.424 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:25 ntpd[13623]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:18:26.402 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:26 ntpd[13576]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:18:26.402 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:26 ntpd[13576]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:18:26.402 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:26 ntpd[13576]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:18:26.402 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:26 ntpd[13576]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:18:26.403 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:26 ntpd[13576]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:18:26.403 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:26 ntpd[13576]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:18:27.402 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:27 ntpd[13576]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:18:27.403 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:27 ntpd[13576]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:18:27.403 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:27 ntpd[13576]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:18:27.403 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:27 ntpd[13576]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:18:27.403 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:27 ntpd[13576]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:18:27.403 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:27 ntpd[13576]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:18:27.403 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:27 ntpd[13576]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:18:27.403 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:27 ntpd[13576]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:18:27.403 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:27 ntpd[13576]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:18:27.403 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:27 ntpd[13576]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:18:27.403 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:27 ntpd[13576]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:18:27.403 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:27 ntpd[13576]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:18:27.422 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:27 ntpd[13623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:18:27.422 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:27 ntpd[13623]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:18:27.422 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:27 ntpd[13623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:18:27.422 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:27 ntpd[13623]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:18:27.422 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:27 ntpd[13623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:18:27.422 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:27 ntpd[13623]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:18:27.423 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:27 ntpd[13623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:18:27.423 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:27 ntpd[13623]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:18:27.423 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:27 ntpd[13623]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:18:27.423 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:27 ntpd[13623]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:18:27.423 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:27 ntpd[13623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:18:27.423 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:27 ntpd[13623]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:18:27.423 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:27 ntpd[13623]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:18:27.423 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:27 ntpd[13623]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:18:27.423 INFO:teuthology.orchestra.run.smithi117.stdout:17 Aug 02:18:27 ntpd[13623]: ntpd: time slew +0.000558 s 2024-08-17T02:18:27.424 INFO:teuthology.orchestra.run.smithi117.stdout:ntpd: time slew +0.000558s 2024-08-17T02:18:27.424 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:27 ntpd[13623]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-08-17T02:18:27.424 INFO:teuthology.orchestra.run.smithi117.stderr:17 Aug 02:18:27 ntpd[13623]: can't open /var/log/ntpstats/loopstats.20240817: Permission denied 2024-08-17T02:18:27.489 INFO:teuthology.orchestra.run.smithi117.stdout: remote refid st t when poll reach delay offset jitter 2024-08-17T02:18:27.489 INFO:teuthology.orchestra.run.smithi117.stdout:============================================================================== 2024-08-17T02:18:27.489 INFO:teuthology.orchestra.run.smithi117.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:18:27.489 INFO:teuthology.orchestra.run.smithi117.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:18:27.489 INFO:teuthology.orchestra.run.smithi117.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:18:27.490 INFO:teuthology.orchestra.run.smithi117.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:18:28.402 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:28 ntpd[13576]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:18:28.402 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:28 ntpd[13576]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:18:28.402 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:28 ntpd[13576]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:18:28.402 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:28 ntpd[13576]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:18:28.402 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:28 ntpd[13576]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:18:28.402 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:28 ntpd[13576]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:18:28.403 INFO:teuthology.orchestra.run.smithi104.stdout:17 Aug 02:18:28 ntpd[13576]: ntpd: time slew +0.001578 s 2024-08-17T02:18:28.403 INFO:teuthology.orchestra.run.smithi104.stdout:ntpd: time slew +0.001578s 2024-08-17T02:18:28.403 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:28 ntpd[13576]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-08-17T02:18:28.403 INFO:teuthology.orchestra.run.smithi104.stderr:17 Aug 02:18:28 ntpd[13576]: can't open /var/log/ntpstats/loopstats.20240817: Permission denied 2024-08-17T02:18:28.469 INFO:teuthology.orchestra.run.smithi104.stdout: remote refid st t when poll reach delay offset jitter 2024-08-17T02:18:28.470 INFO:teuthology.orchestra.run.smithi104.stdout:============================================================================== 2024-08-17T02:18:28.470 INFO:teuthology.orchestra.run.smithi104.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:18:28.470 INFO:teuthology.orchestra.run.smithi104.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:18:28.470 INFO:teuthology.orchestra.run.smithi104.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:18:28.470 INFO:teuthology.orchestra.run.smithi104.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:18:28.471 INFO:teuthology.run_tasks:Running task install... 2024-08-17T02:18:28.482 DEBUG:teuthology.task.install:project ceph 2024-08-17T02:18:28.482 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}} 2024-08-17T02:18:28.482 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'} 2024-08-17T02:18:28.482 INFO:teuthology.task.install:Using flavor: default 2024-08-17T02:18:28.488 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-17T02:18:28.488 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-08-17T02:18:28.489 DEBUG:teuthology.orchestra.run.smithi104:> sudo apt-key list | grep Ceph 2024-08-17T02:18:28.489 DEBUG:teuthology.orchestra.run.smithi117:> sudo apt-key list | grep Ceph 2024-08-17T02:18:28.594 INFO:teuthology.orchestra.run.smithi117.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-08-17T02:18:28.595 INFO:teuthology.orchestra.run.smithi104.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-08-17T02:18:28.649 INFO:teuthology.orchestra.run.smithi117.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-08-17T02:18:28.649 INFO:teuthology.orchestra.run.smithi117.stdout:uid [ unknown] Ceph.com (release key) 2024-08-17T02:18:28.650 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-08-17T02:18:28.650 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-08-17T02:18:28.650 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:18:28.655 INFO:teuthology.orchestra.run.smithi104.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-08-17T02:18:28.655 INFO:teuthology.orchestra.run.smithi104.stdout:uid [ unknown] Ceph.com (release key) 2024-08-17T02:18:28.656 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-08-17T02:18:28.656 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-08-17T02:18:28.656 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:18:28.790 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default/ 2024-08-17T02:18:28.790 INFO:teuthology.task.install.deb:Package version is 17.2.7-1375-g2577e813-1focal 2024-08-17T02:18:28.803 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default/ 2024-08-17T02:18:28.803 INFO:teuthology.task.install.deb:Package version is 17.2.7-1375-g2577e813-1focal 2024-08-17T02:18:28.905 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-17T02:18:28.906 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-08-17T02:18:28.917 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-08-17T02:18:28.917 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-08-17T02:18:28.922 DEBUG:teuthology.orchestra.run.smithi117:> sudo apt-get update 2024-08-17T02:18:28.935 DEBUG:teuthology.orchestra.run.smithi104:> sudo apt-get update 2024-08-17T02:18:29.076 INFO:teuthology.orchestra.run.smithi104.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-08-17T02:18:29.111 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-08-17T02:18:29.112 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-08-17T02:18:29.117 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-08-17T02:18:29.130 INFO:teuthology.orchestra.run.smithi104.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal InRelease 2024-08-17T02:18:29.134 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-08-17T02:18:29.152 INFO:teuthology.orchestra.run.smithi104.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-08-17T02:18:29.166 INFO:teuthology.orchestra.run.smithi117.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal InRelease 2024-08-17T02:18:29.176 INFO:teuthology.orchestra.run.smithi104.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal Release.gpg 2024-08-17T02:18:29.188 INFO:teuthology.orchestra.run.smithi117.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-08-17T02:18:29.195 INFO:teuthology.orchestra.run.smithi104.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2024-08-17T02:18:29.196 INFO:teuthology.orchestra.run.smithi104.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2024-08-17T02:18:29.211 INFO:teuthology.orchestra.run.smithi117.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal Release.gpg 2024-08-17T02:18:29.232 INFO:teuthology.orchestra.run.smithi117.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main i386 Packages [3,382 B] 2024-08-17T02:18:29.235 INFO:teuthology.orchestra.run.smithi104.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main i386 Packages [3,382 B] 2024-08-17T02:18:29.265 INFO:teuthology.orchestra.run.smithi117.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2024-08-17T02:18:29.276 INFO:teuthology.orchestra.run.smithi104.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-08-17T02:18:29.369 INFO:teuthology.orchestra.run.smithi104.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-08-17T02:18:29.736 INFO:teuthology.orchestra.run.smithi104.stdout:Fetched 28.5 kB in 1s (44.7 kB/s) 2024-08-17T02:18:29.771 INFO:teuthology.orchestra.run.smithi117.stdout:Fetched 28.5 kB in 1s (45.0 kB/s) 2024-08-17T02:18:30.867 INFO:teuthology.orchestra.run.smithi104.stdout:Reading package lists... 2024-08-17T02:18:30.894 DEBUG:teuthology.orchestra.run.smithi104:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.7-1375-g2577e813-1focal cephadm=17.2.7-1375-g2577e813-1focal ceph-mds=17.2.7-1375-g2577e813-1focal ceph-mgr=17.2.7-1375-g2577e813-1focal ceph-common=17.2.7-1375-g2577e813-1focal ceph-fuse=17.2.7-1375-g2577e813-1focal ceph-test=17.2.7-1375-g2577e813-1focal ceph-volume=17.2.7-1375-g2577e813-1focal radosgw=17.2.7-1375-g2577e813-1focal python3-rados=17.2.7-1375-g2577e813-1focal python3-rgw=17.2.7-1375-g2577e813-1focal python3-cephfs=17.2.7-1375-g2577e813-1focal python3-rbd=17.2.7-1375-g2577e813-1focal libcephfs2=17.2.7-1375-g2577e813-1focal libcephfs-dev=17.2.7-1375-g2577e813-1focal librados2=17.2.7-1375-g2577e813-1focal librbd1=17.2.7-1375-g2577e813-1focal rbd-fuse=17.2.7-1375-g2577e813-1focal python3-cephfs=17.2.7-1375-g2577e813-1focal cephfs-shell=17.2.7-1375-g2577e813-1focal cephfs-top=17.2.7-1375-g2577e813-1focal cephfs-mirror=17.2.7-1375-g2577e813-1focal 2024-08-17T02:18:30.914 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2024-08-17T02:18:30.940 DEBUG:teuthology.orchestra.run.smithi117:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.7-1375-g2577e813-1focal cephadm=17.2.7-1375-g2577e813-1focal ceph-mds=17.2.7-1375-g2577e813-1focal ceph-mgr=17.2.7-1375-g2577e813-1focal ceph-common=17.2.7-1375-g2577e813-1focal ceph-fuse=17.2.7-1375-g2577e813-1focal ceph-test=17.2.7-1375-g2577e813-1focal ceph-volume=17.2.7-1375-g2577e813-1focal radosgw=17.2.7-1375-g2577e813-1focal python3-rados=17.2.7-1375-g2577e813-1focal python3-rgw=17.2.7-1375-g2577e813-1focal python3-cephfs=17.2.7-1375-g2577e813-1focal python3-rbd=17.2.7-1375-g2577e813-1focal libcephfs2=17.2.7-1375-g2577e813-1focal libcephfs-dev=17.2.7-1375-g2577e813-1focal librados2=17.2.7-1375-g2577e813-1focal librbd1=17.2.7-1375-g2577e813-1focal rbd-fuse=17.2.7-1375-g2577e813-1focal python3-cephfs=17.2.7-1375-g2577e813-1focal cephfs-shell=17.2.7-1375-g2577e813-1focal cephfs-top=17.2.7-1375-g2577e813-1focal cephfs-mirror=17.2.7-1375-g2577e813-1focal 2024-08-17T02:18:30.968 INFO:teuthology.orchestra.run.smithi104.stdout:Reading package lists... 2024-08-17T02:18:31.015 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2024-08-17T02:18:31.157 INFO:teuthology.orchestra.run.smithi104.stdout:Building dependency tree... 2024-08-17T02:18:31.158 INFO:teuthology.orchestra.run.smithi104.stdout:Reading state information... 2024-08-17T02:18:31.206 INFO:teuthology.orchestra.run.smithi117.stdout:Building dependency tree... 2024-08-17T02:18:31.206 INFO:teuthology.orchestra.run.smithi117.stdout:Reading state information... 2024-08-17T02:18:31.346 INFO:teuthology.orchestra.run.smithi104.stdout:The following packages were automatically installed and are no longer required: 2024-08-17T02:18:31.348 INFO:teuthology.orchestra.run.smithi104.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-08-17T02:18:31.348 INFO:teuthology.orchestra.run.smithi104.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-17T02:18:31.348 INFO:teuthology.orchestra.run.smithi104.stdout:The following additional packages will be installed: 2024-08-17T02:18:31.348 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-08-17T02:18:31.348 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-08-17T02:18:31.348 INFO:teuthology.orchestra.run.smithi104.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-08-17T02:18:31.348 INFO:teuthology.orchestra.run.smithi104.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-08-17T02:18:31.349 INFO:teuthology.orchestra.run.smithi104.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-08-17T02:18:31.350 INFO:teuthology.orchestra.run.smithi104.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-08-17T02:18:31.350 INFO:teuthology.orchestra.run.smithi104.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2024-08-17T02:18:31.351 INFO:teuthology.orchestra.run.smithi104.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2024-08-17T02:18:31.351 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 python3-cmd2 2024-08-17T02:18:31.351 INFO:teuthology.orchestra.run.smithi104.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2024-08-17T02:18:31.351 INFO:teuthology.orchestra.run.smithi104.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-08-17T02:18:31.351 INFO:teuthology.orchestra.run.smithi104.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-08-17T02:18:31.351 INFO:teuthology.orchestra.run.smithi104.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-08-17T02:18:31.351 INFO:teuthology.orchestra.run.smithi104.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-08-17T02:18:31.351 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-08-17T02:18:31.351 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-08-17T02:18:31.351 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2024-08-17T02:18:31.351 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2024-08-17T02:18:31.351 INFO:teuthology.orchestra.run.smithi104.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-08-17T02:18:31.351 INFO:teuthology.orchestra.run.smithi104.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-08-17T02:18:31.352 INFO:teuthology.orchestra.run.smithi104.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-08-17T02:18:31.352 INFO:teuthology.orchestra.run.smithi104.stdout: qttranslations5-l10n socat xmlstarlet 2024-08-17T02:18:31.352 INFO:teuthology.orchestra.run.smithi104.stdout:Suggested packages: 2024-08-17T02:18:31.352 INFO:teuthology.orchestra.run.smithi104.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-08-17T02:18:31.352 INFO:teuthology.orchestra.run.smithi104.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-08-17T02:18:31.352 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-08-17T02:18:31.352 INFO:teuthology.orchestra.run.smithi104.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-08-17T02:18:31.352 INFO:teuthology.orchestra.run.smithi104.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-08-17T02:18:31.352 INFO:teuthology.orchestra.run.smithi104.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-08-17T02:18:31.352 INFO:teuthology.orchestra.run.smithi104.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-08-17T02:18:31.352 INFO:teuthology.orchestra.run.smithi104.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-08-17T02:18:31.353 INFO:teuthology.orchestra.run.smithi104.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-08-17T02:18:31.353 INFO:teuthology.orchestra.run.smithi104.stdout:Recommended packages: 2024-08-17T02:18:31.353 INFO:teuthology.orchestra.run.smithi104.stdout: btrfs-tools 2024-08-17T02:18:31.392 INFO:teuthology.orchestra.run.smithi117.stdout:The following packages were automatically installed and are no longer required: 2024-08-17T02:18:31.393 INFO:teuthology.orchestra.run.smithi117.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-08-17T02:18:31.394 INFO:teuthology.orchestra.run.smithi117.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-17T02:18:31.394 INFO:teuthology.orchestra.run.smithi117.stdout:The following additional packages will be installed: 2024-08-17T02:18:31.394 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-08-17T02:18:31.394 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-08-17T02:18:31.394 INFO:teuthology.orchestra.run.smithi117.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-08-17T02:18:31.394 INFO:teuthology.orchestra.run.smithi117.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-08-17T02:18:31.394 INFO:teuthology.orchestra.run.smithi117.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-08-17T02:18:31.395 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-08-17T02:18:31.395 INFO:teuthology.orchestra.run.smithi117.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2024-08-17T02:18:31.395 INFO:teuthology.orchestra.run.smithi117.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2024-08-17T02:18:31.395 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 python3-cmd2 2024-08-17T02:18:31.395 INFO:teuthology.orchestra.run.smithi117.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2024-08-17T02:18:31.395 INFO:teuthology.orchestra.run.smithi117.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-08-17T02:18:31.395 INFO:teuthology.orchestra.run.smithi117.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-08-17T02:18:31.396 INFO:teuthology.orchestra.run.smithi117.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-08-17T02:18:31.396 INFO:teuthology.orchestra.run.smithi117.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-08-17T02:18:31.396 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-08-17T02:18:31.396 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-08-17T02:18:31.396 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2024-08-17T02:18:31.396 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2024-08-17T02:18:31.396 INFO:teuthology.orchestra.run.smithi117.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-08-17T02:18:31.396 INFO:teuthology.orchestra.run.smithi117.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-08-17T02:18:31.396 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-08-17T02:18:31.396 INFO:teuthology.orchestra.run.smithi117.stdout: qttranslations5-l10n socat xmlstarlet 2024-08-17T02:18:31.397 INFO:teuthology.orchestra.run.smithi117.stdout:Suggested packages: 2024-08-17T02:18:31.397 INFO:teuthology.orchestra.run.smithi117.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-08-17T02:18:31.397 INFO:teuthology.orchestra.run.smithi117.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-08-17T02:18:31.397 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-08-17T02:18:31.397 INFO:teuthology.orchestra.run.smithi117.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-08-17T02:18:31.398 INFO:teuthology.orchestra.run.smithi117.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-08-17T02:18:31.398 INFO:teuthology.orchestra.run.smithi117.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-08-17T02:18:31.399 INFO:teuthology.orchestra.run.smithi117.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-08-17T02:18:31.399 INFO:teuthology.orchestra.run.smithi117.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-08-17T02:18:31.399 INFO:teuthology.orchestra.run.smithi117.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-08-17T02:18:31.399 INFO:teuthology.orchestra.run.smithi117.stdout:Recommended packages: 2024-08-17T02:18:31.399 INFO:teuthology.orchestra.run.smithi117.stdout: btrfs-tools 2024-08-17T02:18:31.473 INFO:teuthology.orchestra.run.smithi104.stdout:The following NEW packages will be installed: 2024-08-17T02:18:31.473 INFO:teuthology.orchestra.run.smithi104.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-08-17T02:18:31.473 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-08-17T02:18:31.473 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-08-17T02:18:31.474 INFO:teuthology.orchestra.run.smithi104.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2024-08-17T02:18:31.474 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2024-08-17T02:18:31.474 INFO:teuthology.orchestra.run.smithi104.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2024-08-17T02:18:31.474 INFO:teuthology.orchestra.run.smithi104.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2024-08-17T02:18:31.475 INFO:teuthology.orchestra.run.smithi104.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2024-08-17T02:18:31.475 INFO:teuthology.orchestra.run.smithi104.stdout: nvme-cli python-natsort-doc python-pastedeploy-tpl python3-atomicwrites 2024-08-17T02:18:31.476 INFO:teuthology.orchestra.run.smithi104.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2024-08-17T02:18:31.476 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2024-08-17T02:18:31.476 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2024-08-17T02:18:31.476 INFO:teuthology.orchestra.run.smithi104.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2024-08-17T02:18:31.476 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2024-08-17T02:18:31.476 INFO:teuthology.orchestra.run.smithi104.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-08-17T02:18:31.476 INFO:teuthology.orchestra.run.smithi104.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-08-17T02:18:31.476 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-08-17T02:18:31.476 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-08-17T02:18:31.476 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2024-08-17T02:18:31.476 INFO:teuthology.orchestra.run.smithi104.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-08-17T02:18:31.476 INFO:teuthology.orchestra.run.smithi104.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-08-17T02:18:31.476 INFO:teuthology.orchestra.run.smithi104.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-08-17T02:18:31.476 INFO:teuthology.orchestra.run.smithi104.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-08-17T02:18:31.477 INFO:teuthology.orchestra.run.smithi104.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-08-17T02:18:31.477 INFO:teuthology.orchestra.run.smithi104.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2024-08-17T02:18:31.477 INFO:teuthology.orchestra.run.smithi104.stdout:The following packages will be upgraded: 2024-08-17T02:18:31.477 INFO:teuthology.orchestra.run.smithi104.stdout: librados2 librbd1 2024-08-17T02:18:31.522 INFO:teuthology.orchestra.run.smithi117.stdout:The following NEW packages will be installed: 2024-08-17T02:18:31.522 INFO:teuthology.orchestra.run.smithi117.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-08-17T02:18:31.522 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-08-17T02:18:31.522 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-08-17T02:18:31.522 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2024-08-17T02:18:31.522 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2024-08-17T02:18:31.523 INFO:teuthology.orchestra.run.smithi117.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2024-08-17T02:18:31.523 INFO:teuthology.orchestra.run.smithi117.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2024-08-17T02:18:31.524 INFO:teuthology.orchestra.run.smithi117.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2024-08-17T02:18:31.524 INFO:teuthology.orchestra.run.smithi117.stdout: nvme-cli python-natsort-doc python-pastedeploy-tpl python3-atomicwrites 2024-08-17T02:18:31.524 INFO:teuthology.orchestra.run.smithi117.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2024-08-17T02:18:31.524 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2024-08-17T02:18:31.524 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2024-08-17T02:18:31.524 INFO:teuthology.orchestra.run.smithi117.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2024-08-17T02:18:31.524 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2024-08-17T02:18:31.524 INFO:teuthology.orchestra.run.smithi117.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-08-17T02:18:31.524 INFO:teuthology.orchestra.run.smithi117.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-08-17T02:18:31.524 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-08-17T02:18:31.525 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-08-17T02:18:31.525 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2024-08-17T02:18:31.525 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-08-17T02:18:31.525 INFO:teuthology.orchestra.run.smithi117.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-08-17T02:18:31.525 INFO:teuthology.orchestra.run.smithi117.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-08-17T02:18:31.525 INFO:teuthology.orchestra.run.smithi117.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-08-17T02:18:31.525 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-08-17T02:18:31.525 INFO:teuthology.orchestra.run.smithi117.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2024-08-17T02:18:31.526 INFO:teuthology.orchestra.run.smithi117.stdout:The following packages will be upgraded: 2024-08-17T02:18:31.526 INFO:teuthology.orchestra.run.smithi117.stdout: librados2 librbd1 2024-08-17T02:18:31.589 INFO:teuthology.orchestra.run.smithi117.stdout:2 upgraded, 114 newly installed, 0 to remove and 295 not upgraded. 2024-08-17T02:18:31.589 INFO:teuthology.orchestra.run.smithi117.stdout:Need to get 201 MB of archives. 2024-08-17T02:18:31.590 INFO:teuthology.orchestra.run.smithi117.stdout:After this operation, 938 MB of additional disk space will be used. 2024-08-17T02:18:31.590 INFO:teuthology.orchestra.run.smithi117.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2024-08-17T02:18:31.608 INFO:teuthology.orchestra.run.smithi117.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-08-17T02:18:31.615 INFO:teuthology.orchestra.run.smithi117.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2024-08-17T02:18:31.641 INFO:teuthology.orchestra.run.smithi117.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-08-17T02:18:31.669 INFO:teuthology.orchestra.run.smithi104.stdout:2 upgraded, 114 newly installed, 0 to remove and 295 not upgraded. 2024-08-17T02:18:31.669 INFO:teuthology.orchestra.run.smithi104.stdout:Need to get 201 MB of archives. 2024-08-17T02:18:31.669 INFO:teuthology.orchestra.run.smithi104.stdout:After this operation, 938 MB of additional disk space will be used. 2024-08-17T02:18:31.670 INFO:teuthology.orchestra.run.smithi104.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2024-08-17T02:18:31.670 INFO:teuthology.orchestra.run.smithi117.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-08-17T02:18:31.672 INFO:teuthology.orchestra.run.smithi117.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-08-17T02:18:31.683 INFO:teuthology.orchestra.run.smithi117.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-08-17T02:18:31.685 INFO:teuthology.orchestra.run.smithi117.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-08-17T02:18:31.702 INFO:teuthology.orchestra.run.smithi117.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-08-17T02:18:31.703 INFO:teuthology.orchestra.run.smithi117.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-08-17T02:18:31.712 INFO:teuthology.orchestra.run.smithi117.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-08-17T02:18:31.736 INFO:teuthology.orchestra.run.smithi117.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-08-17T02:18:31.738 INFO:teuthology.orchestra.run.smithi117.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-08-17T02:18:31.744 INFO:teuthology.orchestra.run.smithi117.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-08-17T02:18:31.746 INFO:teuthology.orchestra.run.smithi117.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-08-17T02:18:31.746 INFO:teuthology.orchestra.run.smithi117.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-08-17T02:18:31.748 INFO:teuthology.orchestra.run.smithi117.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-08-17T02:18:31.748 INFO:teuthology.orchestra.run.smithi117.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-08-17T02:18:31.748 INFO:teuthology.orchestra.run.smithi117.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-08-17T02:18:31.749 INFO:teuthology.orchestra.run.smithi117.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-08-17T02:18:31.753 INFO:teuthology.orchestra.run.smithi104.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-08-17T02:18:31.757 INFO:teuthology.orchestra.run.smithi117.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-08-17T02:18:31.757 INFO:teuthology.orchestra.run.smithi117.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-08-17T02:18:31.772 INFO:teuthology.orchestra.run.smithi104.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.7-1375-g2577e813-1focal [3,506 kB] 2024-08-17T02:18:31.774 INFO:teuthology.orchestra.run.smithi117.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-08-17T02:18:31.774 INFO:teuthology.orchestra.run.smithi117.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-08-17T02:18:31.775 INFO:teuthology.orchestra.run.smithi117.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-08-17T02:18:31.776 INFO:teuthology.orchestra.run.smithi117.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-08-17T02:18:31.776 INFO:teuthology.orchestra.run.smithi117.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-08-17T02:18:31.776 INFO:teuthology.orchestra.run.smithi117.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2024-08-17T02:18:31.777 INFO:teuthology.orchestra.run.smithi117.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-08-17T02:18:31.778 INFO:teuthology.orchestra.run.smithi117.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-08-17T02:18:31.787 INFO:teuthology.orchestra.run.smithi104.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2024-08-17T02:18:31.791 INFO:teuthology.orchestra.run.smithi117.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-08-17T02:18:31.792 INFO:teuthology.orchestra.run.smithi117.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-08-17T02:18:31.808 INFO:teuthology.orchestra.run.smithi117.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-08-17T02:18:31.813 INFO:teuthology.orchestra.run.smithi117.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-08-17T02:18:31.813 INFO:teuthology.orchestra.run.smithi117.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-08-17T02:18:31.814 INFO:teuthology.orchestra.run.smithi117.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-08-17T02:18:31.814 INFO:teuthology.orchestra.run.smithi117.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-08-17T02:18:31.815 INFO:teuthology.orchestra.run.smithi117.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.2 [183 kB] 2024-08-17T02:18:31.817 INFO:teuthology.orchestra.run.smithi117.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.3 [96.0 kB] 2024-08-17T02:18:31.819 INFO:teuthology.orchestra.run.smithi117.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-08-17T02:18:31.825 INFO:teuthology.orchestra.run.smithi117.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-08-17T02:18:31.826 INFO:teuthology.orchestra.run.smithi117.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-08-17T02:18:31.840 INFO:teuthology.orchestra.run.smithi117.stdout:Get:43 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.7-1375-g2577e813-1focal [3,506 kB] 2024-08-17T02:18:31.842 INFO:teuthology.orchestra.run.smithi117.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-08-17T02:18:31.843 INFO:teuthology.orchestra.run.smithi117.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-08-17T02:18:31.843 INFO:teuthology.orchestra.run.smithi117.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-08-17T02:18:31.844 INFO:teuthology.orchestra.run.smithi117.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-08-17T02:18:31.916 INFO:teuthology.orchestra.run.smithi104.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-08-17T02:18:31.940 INFO:teuthology.orchestra.run.smithi117.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-08-17T02:18:31.957 INFO:teuthology.orchestra.run.smithi117.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-08-17T02:18:31.958 INFO:teuthology.orchestra.run.smithi117.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-08-17T02:18:31.970 INFO:teuthology.orchestra.run.smithi117.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-08-17T02:18:31.970 INFO:teuthology.orchestra.run.smithi117.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-08-17T02:18:32.034 INFO:teuthology.orchestra.run.smithi117.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-08-17T02:18:32.036 INFO:teuthology.orchestra.run.smithi117.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-08-17T02:18:32.036 INFO:teuthology.orchestra.run.smithi117.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-08-17T02:18:32.037 INFO:teuthology.orchestra.run.smithi117.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-08-17T02:18:32.040 INFO:teuthology.orchestra.run.smithi117.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-08-17T02:18:32.041 INFO:teuthology.orchestra.run.smithi117.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-08-17T02:18:32.041 INFO:teuthology.orchestra.run.smithi117.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-08-17T02:18:32.043 INFO:teuthology.orchestra.run.smithi104.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-08-17T02:18:32.052 INFO:teuthology.orchestra.run.smithi117.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-08-17T02:18:32.053 INFO:teuthology.orchestra.run.smithi104.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-08-17T02:18:32.055 INFO:teuthology.orchestra.run.smithi117.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-08-17T02:18:32.056 INFO:teuthology.orchestra.run.smithi117.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-08-17T02:18:32.069 INFO:teuthology.orchestra.run.smithi117.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-08-17T02:18:32.070 INFO:teuthology.orchestra.run.smithi117.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-08-17T02:18:32.073 INFO:teuthology.orchestra.run.smithi117.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-08-17T02:18:32.076 INFO:teuthology.orchestra.run.smithi117.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2024-08-17T02:18:32.076 INFO:teuthology.orchestra.run.smithi117.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-08-17T02:18:32.094 INFO:teuthology.orchestra.run.smithi117.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2024-08-17T02:18:32.095 INFO:teuthology.orchestra.run.smithi104.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-08-17T02:18:32.096 INFO:teuthology.orchestra.run.smithi117.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-08-17T02:18:32.107 INFO:teuthology.orchestra.run.smithi104.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-08-17T02:18:32.135 INFO:teuthology.orchestra.run.smithi117.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-08-17T02:18:32.136 INFO:teuthology.orchestra.run.smithi117.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-08-17T02:18:32.137 INFO:teuthology.orchestra.run.smithi117.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-08-17T02:18:32.137 INFO:teuthology.orchestra.run.smithi117.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-08-17T02:18:32.137 INFO:teuthology.orchestra.run.smithi117.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-08-17T02:18:32.138 INFO:teuthology.orchestra.run.smithi117.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-08-17T02:18:32.149 INFO:teuthology.orchestra.run.smithi117.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-08-17T02:18:32.150 INFO:teuthology.orchestra.run.smithi117.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-08-17T02:18:32.183 INFO:teuthology.orchestra.run.smithi117.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-08-17T02:18:32.183 INFO:teuthology.orchestra.run.smithi117.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-08-17T02:18:32.183 INFO:teuthology.orchestra.run.smithi117.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-08-17T02:18:32.183 INFO:teuthology.orchestra.run.smithi117.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-08-17T02:18:32.187 INFO:teuthology.orchestra.run.smithi104.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-08-17T02:18:32.188 INFO:teuthology.orchestra.run.smithi117.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-08-17T02:18:32.188 INFO:teuthology.orchestra.run.smithi117.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-08-17T02:18:32.192 INFO:teuthology.orchestra.run.smithi104.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-08-17T02:18:32.215 INFO:teuthology.orchestra.run.smithi104.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-08-17T02:18:32.340 INFO:teuthology.orchestra.run.smithi104.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-08-17T02:18:32.349 INFO:teuthology.orchestra.run.smithi104.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-08-17T02:18:32.371 INFO:teuthology.orchestra.run.smithi104.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-08-17T02:18:32.378 INFO:teuthology.orchestra.run.smithi104.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-08-17T02:18:32.379 INFO:teuthology.orchestra.run.smithi104.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-08-17T02:18:32.385 INFO:teuthology.orchestra.run.smithi104.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-08-17T02:18:32.386 INFO:teuthology.orchestra.run.smithi104.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-08-17T02:18:32.387 INFO:teuthology.orchestra.run.smithi104.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-08-17T02:18:32.387 INFO:teuthology.orchestra.run.smithi104.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-08-17T02:18:32.450 INFO:teuthology.orchestra.run.smithi104.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-08-17T02:18:32.451 INFO:teuthology.orchestra.run.smithi104.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-08-17T02:18:32.531 INFO:teuthology.orchestra.run.smithi104.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-08-17T02:18:32.532 INFO:teuthology.orchestra.run.smithi104.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-08-17T02:18:32.533 INFO:teuthology.orchestra.run.smithi104.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-08-17T02:18:32.534 INFO:teuthology.orchestra.run.smithi104.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-08-17T02:18:32.535 INFO:teuthology.orchestra.run.smithi104.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-08-17T02:18:32.536 INFO:teuthology.orchestra.run.smithi104.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2024-08-17T02:18:32.539 INFO:teuthology.orchestra.run.smithi104.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-08-17T02:18:32.539 INFO:teuthology.orchestra.run.smithi104.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-08-17T02:18:32.613 INFO:teuthology.orchestra.run.smithi104.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-08-17T02:18:32.615 INFO:teuthology.orchestra.run.smithi104.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-08-17T02:18:32.695 INFO:teuthology.orchestra.run.smithi104.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-08-17T02:18:32.702 INFO:teuthology.orchestra.run.smithi104.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-08-17T02:18:32.703 INFO:teuthology.orchestra.run.smithi104.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-08-17T02:18:32.703 INFO:teuthology.orchestra.run.smithi104.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-08-17T02:18:32.705 INFO:teuthology.orchestra.run.smithi104.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-08-17T02:18:32.706 INFO:teuthology.orchestra.run.smithi104.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.2 [183 kB] 2024-08-17T02:18:32.711 INFO:teuthology.orchestra.run.smithi104.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.3 [96.0 kB] 2024-08-17T02:18:32.712 INFO:teuthology.orchestra.run.smithi104.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-08-17T02:18:32.776 INFO:teuthology.orchestra.run.smithi104.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-08-17T02:18:32.777 INFO:teuthology.orchestra.run.smithi104.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-08-17T02:18:32.858 INFO:teuthology.orchestra.run.smithi104.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-08-17T02:18:32.859 INFO:teuthology.orchestra.run.smithi104.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-08-17T02:18:32.860 INFO:teuthology.orchestra.run.smithi104.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-08-17T02:18:32.861 INFO:teuthology.orchestra.run.smithi104.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-08-17T02:18:33.138 INFO:teuthology.orchestra.run.smithi104.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-08-17T02:18:33.213 INFO:teuthology.orchestra.run.smithi104.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-08-17T02:18:33.215 INFO:teuthology.orchestra.run.smithi104.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-08-17T02:18:33.285 INFO:teuthology.orchestra.run.smithi104.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-08-17T02:18:33.285 INFO:teuthology.orchestra.run.smithi104.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-08-17T02:18:33.286 INFO:teuthology.orchestra.run.smithi104.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-08-17T02:18:33.286 INFO:teuthology.orchestra.run.smithi104.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-08-17T02:18:33.287 INFO:teuthology.orchestra.run.smithi104.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-08-17T02:18:33.287 INFO:teuthology.orchestra.run.smithi104.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-08-17T02:18:33.287 INFO:teuthology.orchestra.run.smithi104.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-08-17T02:18:33.302 INFO:teuthology.orchestra.run.smithi104.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-08-17T02:18:33.302 INFO:teuthology.orchestra.run.smithi104.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-08-17T02:18:33.383 INFO:teuthology.orchestra.run.smithi104.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-08-17T02:18:33.388 INFO:teuthology.orchestra.run.smithi104.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-08-17T02:18:33.391 INFO:teuthology.orchestra.run.smithi104.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-08-17T02:18:33.394 INFO:teuthology.orchestra.run.smithi104.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-08-17T02:18:33.395 INFO:teuthology.orchestra.run.smithi104.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-08-17T02:18:33.400 INFO:teuthology.orchestra.run.smithi104.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-08-17T02:18:33.402 INFO:teuthology.orchestra.run.smithi104.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2024-08-17T02:18:33.402 INFO:teuthology.orchestra.run.smithi104.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-08-17T02:18:33.474 INFO:teuthology.orchestra.run.smithi104.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2024-08-17T02:18:33.486 INFO:teuthology.orchestra.run.smithi104.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-08-17T02:18:33.641 INFO:teuthology.orchestra.run.smithi104.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-08-17T02:18:33.642 INFO:teuthology.orchestra.run.smithi104.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-08-17T02:18:33.642 INFO:teuthology.orchestra.run.smithi104.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-08-17T02:18:33.672 INFO:teuthology.orchestra.run.smithi104.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-08-17T02:18:33.673 INFO:teuthology.orchestra.run.smithi104.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-08-17T02:18:33.675 INFO:teuthology.orchestra.run.smithi104.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-08-17T02:18:33.692 INFO:teuthology.orchestra.run.smithi104.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-08-17T02:18:33.693 INFO:teuthology.orchestra.run.smithi104.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-08-17T02:18:33.693 INFO:teuthology.orchestra.run.smithi104.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-08-17T02:18:33.723 INFO:teuthology.orchestra.run.smithi104.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-08-17T02:18:33.808 INFO:teuthology.orchestra.run.smithi104.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-08-17T02:18:33.808 INFO:teuthology.orchestra.run.smithi104.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-08-17T02:18:33.808 INFO:teuthology.orchestra.run.smithi104.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-08-17T02:18:33.809 INFO:teuthology.orchestra.run.smithi104.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-08-17T02:18:35.351 INFO:teuthology.orchestra.run.smithi104.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.7-1375-g2577e813-1focal [3,560 kB] 2024-08-17T02:18:35.351 INFO:teuthology.orchestra.run.smithi117.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.7-1375-g2577e813-1focal [3,560 kB] 2024-08-17T02:18:36.834 INFO:teuthology.orchestra.run.smithi104.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.7-1375-g2577e813-1focal [761 kB] 2024-08-17T02:18:36.883 INFO:teuthology.orchestra.run.smithi117.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.7-1375-g2577e813-1focal [761 kB] 2024-08-17T02:18:37.207 INFO:teuthology.orchestra.run.smithi104.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.7-1375-g2577e813-1focal [414 kB] 2024-08-17T02:18:37.210 INFO:teuthology.orchestra.run.smithi117.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.7-1375-g2577e813-1focal [414 kB] 2024-08-17T02:18:37.389 INFO:teuthology.orchestra.run.smithi104.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.7-1375-g2577e813-1focal [22.6 kB] 2024-08-17T02:18:37.390 INFO:teuthology.orchestra.run.smithi104.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.7-1375-g2577e813-1focal [200 kB] 2024-08-17T02:18:37.398 INFO:teuthology.orchestra.run.smithi117.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.7-1375-g2577e813-1focal [22.6 kB] 2024-08-17T02:18:37.451 INFO:teuthology.orchestra.run.smithi117.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.7-1375-g2577e813-1focal [200 kB] 2024-08-17T02:18:37.518 INFO:teuthology.orchestra.run.smithi104.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.7-1375-g2577e813-1focal [49.1 kB] 2024-08-17T02:18:37.518 INFO:teuthology.orchestra.run.smithi104.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.7-1375-g2577e813-1focal [389 kB] 2024-08-17T02:18:37.520 INFO:teuthology.orchestra.run.smithi117.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.7-1375-g2577e813-1focal [49.1 kB] 2024-08-17T02:18:37.582 INFO:teuthology.orchestra.run.smithi117.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.7-1375-g2577e813-1focal [389 kB] 2024-08-17T02:18:37.724 INFO:teuthology.orchestra.run.smithi104.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.7-1375-g2577e813-1focal [5,612 kB] 2024-08-17T02:18:37.794 INFO:teuthology.orchestra.run.smithi117.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.7-1375-g2577e813-1focal [5,612 kB] 2024-08-17T02:18:39.935 INFO:teuthology.orchestra.run.smithi104.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.7-1375-g2577e813-1focal [116 kB] 2024-08-17T02:18:39.986 INFO:teuthology.orchestra.run.smithi117.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.7-1375-g2577e813-1focal [116 kB] 2024-08-17T02:18:39.987 INFO:teuthology.orchestra.run.smithi104.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.7-1375-g2577e813-1focal [478 kB] 2024-08-17T02:18:40.045 INFO:teuthology.orchestra.run.smithi117.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.7-1375-g2577e813-1focal [478 kB] 2024-08-17T02:18:40.182 INFO:teuthology.orchestra.run.smithi104.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.7-1375-g2577e813-1focal [26.9 MB] 2024-08-17T02:18:40.241 INFO:teuthology.orchestra.run.smithi117.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.7-1375-g2577e813-1focal [26.9 MB] 2024-08-17T02:18:43.861 INFO:teuthology.orchestra.run.smithi117.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.7-1375-g2577e813-1focal [5,173 kB] 2024-08-17T02:18:43.873 INFO:teuthology.orchestra.run.smithi104.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.7-1375-g2577e813-1focal [5,173 kB] 2024-08-17T02:18:44.238 INFO:teuthology.orchestra.run.smithi117.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.7-1375-g2577e813-1focal [223 kB] 2024-08-17T02:18:44.249 INFO:teuthology.orchestra.run.smithi104.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.7-1375-g2577e813-1focal [223 kB] 2024-08-17T02:18:44.255 INFO:teuthology.orchestra.run.smithi117.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.7-1375-g2577e813-1focal [157 kB] 2024-08-17T02:18:44.267 INFO:teuthology.orchestra.run.smithi104.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.7-1375-g2577e813-1focal [157 kB] 2024-08-17T02:18:44.271 INFO:teuthology.orchestra.run.smithi104.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.7-1375-g2577e813-1focal [1,594 kB] 2024-08-17T02:18:44.274 INFO:teuthology.orchestra.run.smithi117.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.7-1375-g2577e813-1focal [1,594 kB] 2024-08-17T02:18:44.382 INFO:teuthology.orchestra.run.smithi117.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.7-1375-g2577e813-1focal [4,686 kB] 2024-08-17T02:18:44.396 INFO:teuthology.orchestra.run.smithi104.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.7-1375-g2577e813-1focal [4,686 kB] 2024-08-17T02:18:44.732 INFO:teuthology.orchestra.run.smithi117.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.7-1375-g2577e813-1focal [23.1 MB] 2024-08-17T02:18:44.747 INFO:teuthology.orchestra.run.smithi104.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.7-1375-g2577e813-1focal [23.1 MB] 2024-08-17T02:18:46.285 INFO:teuthology.orchestra.run.smithi117.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.7-1375-g2577e813-1focal [3,944 B] 2024-08-17T02:18:46.287 INFO:teuthology.orchestra.run.smithi117.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.7-1375-g2577e813-1focal [871 kB] 2024-08-17T02:18:46.308 INFO:teuthology.orchestra.run.smithi117.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.7-1375-g2577e813-1focal [2,415 kB] 2024-08-17T02:18:46.308 INFO:teuthology.orchestra.run.smithi104.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.7-1375-g2577e813-1focal [3,944 B] 2024-08-17T02:18:46.308 INFO:teuthology.orchestra.run.smithi104.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.7-1375-g2577e813-1focal [871 kB] 2024-08-17T02:18:46.328 INFO:teuthology.orchestra.run.smithi104.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.7-1375-g2577e813-1focal [2,415 kB] 2024-08-17T02:18:46.415 INFO:teuthology.orchestra.run.smithi117.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.7-1375-g2577e813-1focal [81.4 kB] 2024-08-17T02:18:46.417 INFO:teuthology.orchestra.run.smithi117.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.7-1375-g2577e813-1focal [120 kB] 2024-08-17T02:18:46.431 INFO:teuthology.orchestra.run.smithi117.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.7-1375-g2577e813-1focal [6,653 kB] 2024-08-17T02:18:46.436 INFO:teuthology.orchestra.run.smithi104.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.7-1375-g2577e813-1focal [81.4 kB] 2024-08-17T02:18:46.451 INFO:teuthology.orchestra.run.smithi104.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.7-1375-g2577e813-1focal [120 kB] 2024-08-17T02:18:46.453 INFO:teuthology.orchestra.run.smithi104.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.7-1375-g2577e813-1focal [6,653 kB] 2024-08-17T02:18:46.732 INFO:teuthology.orchestra.run.smithi117.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.7-1375-g2577e813-1focal [7,886 kB] 2024-08-17T02:18:46.767 INFO:teuthology.orchestra.run.smithi104.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.7-1375-g2577e813-1focal [7,886 kB] 2024-08-17T02:18:47.116 INFO:teuthology.orchestra.run.smithi104.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.7-1375-g2577e813-1focal [4,060 B] 2024-08-17T02:18:47.116 INFO:teuthology.orchestra.run.smithi104.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.7-1375-g2577e813-1focal [53.3 MB] 2024-08-17T02:18:47.131 INFO:teuthology.orchestra.run.smithi117.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.7-1375-g2577e813-1focal [4,060 B] 2024-08-17T02:18:47.132 INFO:teuthology.orchestra.run.smithi117.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.7-1375-g2577e813-1focal [53.3 MB] 2024-08-17T02:18:49.657 INFO:teuthology.orchestra.run.smithi117.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.7-1375-g2577e813-1focal [230 kB] 2024-08-17T02:18:49.662 INFO:teuthology.orchestra.run.smithi117.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 17.2.7-1375-g2577e813-1focal [241 kB] 2024-08-17T02:18:49.667 INFO:teuthology.orchestra.run.smithi117.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 17.2.7-1375-g2577e813-1focal [22.0 kB] 2024-08-17T02:18:49.668 INFO:teuthology.orchestra.run.smithi117.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 17.2.7-1375-g2577e813-1focal [13.1 kB] 2024-08-17T02:18:49.668 INFO:teuthology.orchestra.run.smithi117.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.7-1375-g2577e813-1focal [21.9 kB] 2024-08-17T02:18:49.669 INFO:teuthology.orchestra.run.smithi117.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.7-1375-g2577e813-1focal [17.1 MB] 2024-08-17T02:18:49.789 INFO:teuthology.orchestra.run.smithi104.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.7-1375-g2577e813-1focal [230 kB] 2024-08-17T02:18:49.794 INFO:teuthology.orchestra.run.smithi104.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 17.2.7-1375-g2577e813-1focal [241 kB] 2024-08-17T02:18:49.799 INFO:teuthology.orchestra.run.smithi104.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 17.2.7-1375-g2577e813-1focal [22.0 kB] 2024-08-17T02:18:49.799 INFO:teuthology.orchestra.run.smithi104.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 17.2.7-1375-g2577e813-1focal [13.1 kB] 2024-08-17T02:18:49.800 INFO:teuthology.orchestra.run.smithi104.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.7-1375-g2577e813-1focal [21.9 kB] 2024-08-17T02:18:49.801 INFO:teuthology.orchestra.run.smithi104.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.7-1375-g2577e813-1focal [17.1 MB] 2024-08-17T02:18:50.701 INFO:teuthology.orchestra.run.smithi117.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.7-1375-g2577e813-1focal [80.6 kB] 2024-08-17T02:18:50.868 INFO:teuthology.orchestra.run.smithi104.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.7-1375-g2577e813-1focal [80.6 kB] 2024-08-17T02:18:51.334 INFO:teuthology.orchestra.run.smithi117.stdout:Fetched 201 MB in 19s (10.5 MB/s) 2024-08-17T02:18:51.477 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pyperclip. 2024-08-17T02:18:51.506 INFO:teuthology.orchestra.run.smithi104.stdout:Fetched 201 MB in 19s (10.4 MB/s) 2024-08-17T02:18:51.530 INFO:teuthology.orchestra.run.smithi117.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141718 files and directories currently installed.) 2024-08-17T02:18:51.534 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2024-08-17T02:18:51.575 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2024-08-17T02:18:51.654 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-pyperclip. 2024-08-17T02:18:51.710 INFO:teuthology.orchestra.run.smithi104.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141718 files and directories currently installed.) 2024-08-17T02:18:51.714 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2024-08-17T02:18:51.774 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2024-08-17T02:18:51.903 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-wcwidth. 2024-08-17T02:18:51.924 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-08-17T02:18:51.961 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-08-17T02:18:52.072 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-wcwidth. 2024-08-17T02:18:52.092 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-08-17T02:18:52.130 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-08-17T02:18:52.246 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-cmd2. 2024-08-17T02:18:52.266 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2024-08-17T02:18:52.305 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2024-08-17T02:18:52.466 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-cmd2. 2024-08-17T02:18:52.484 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2024-08-17T02:18:52.525 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2024-08-17T02:18:52.674 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-08-17T02:18:52.695 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-08-17T02:18:52.774 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-08-17T02:18:52.936 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-08-17T02:18:52.952 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-08-17T02:18:53.036 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-08-17T02:18:53.088 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../004-librbd1_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:18:53.186 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking librbd1 (17.2.7-1375-g2577e813-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-08-17T02:18:53.397 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../004-librbd1_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:18:53.498 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking librbd1 (17.2.7-1375-g2577e813-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-08-17T02:18:53.890 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../005-librados2_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:18:54.016 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking librados2 (17.2.7-1375-g2577e813-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-08-17T02:18:54.204 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../005-librados2_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:18:54.332 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking librados2 (17.2.7-1375-g2577e813-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-08-17T02:18:54.678 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libcephfs2. 2024-08-17T02:18:54.694 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../006-libcephfs2_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:18:54.728 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libcephfs2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:18:55.038 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-rados. 2024-08-17T02:18:55.040 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libcephfs2. 2024-08-17T02:18:55.055 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../007-python3-rados_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:18:55.057 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../006-libcephfs2_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:18:55.096 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-rados (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:18:55.098 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libcephfs2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:18:55.450 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-rados. 2024-08-17T02:18:55.458 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-08-17T02:18:55.469 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../007-python3-rados_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:18:55.473 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../008-python3-ceph-argparse_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:18:55.500 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-rados (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:18:55.516 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-ceph-argparse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:18:55.768 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-cephfs. 2024-08-17T02:18:55.786 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../009-python3-cephfs_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:18:55.826 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-cephfs (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:18:55.870 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-08-17T02:18:55.886 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../008-python3-ceph-argparse_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:18:55.928 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-ceph-argparse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:18:56.112 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-ceph-common. 2024-08-17T02:18:56.128 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../010-python3-ceph-common_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:18:56.162 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:18:56.239 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-cephfs. 2024-08-17T02:18:56.259 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../009-python3-cephfs_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:18:56.297 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-cephfs (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:18:56.499 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-prettytable. 2024-08-17T02:18:56.519 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2024-08-17T02:18:56.557 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-08-17T02:18:56.658 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-ceph-common. 2024-08-17T02:18:56.674 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../010-python3-ceph-common_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:18:56.743 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:18:56.818 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-rbd. 2024-08-17T02:18:56.837 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../012-python3-rbd_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:18:56.876 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-rbd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:18:57.086 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-prettytable. 2024-08-17T02:18:57.102 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2024-08-17T02:18:57.144 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-08-17T02:18:57.229 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-08-17T02:18:57.244 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../013-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-08-17T02:18:57.288 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-08-17T02:18:57.431 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-rbd. 2024-08-17T02:18:57.446 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../012-python3-rbd_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:18:57.510 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-rbd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:18:57.656 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-08-17T02:18:57.672 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../014-librabbitmq4_0.10.0-1_amd64.deb ... 2024-08-17T02:18:57.706 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-08-17T02:18:57.883 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-08-17T02:18:57.899 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../013-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-08-17T02:18:57.950 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-08-17T02:18:58.068 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-08-17T02:18:58.084 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../015-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-08-17T02:18:58.126 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-08-17T02:18:58.369 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-08-17T02:18:58.386 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../014-librabbitmq4_0.10.0-1_amd64.deb ... 2024-08-17T02:18:58.428 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-08-17T02:18:58.537 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-08-17T02:18:58.553 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../016-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-08-17T02:18:58.595 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-08-17T02:18:58.789 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-08-17T02:18:58.806 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../015-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-08-17T02:18:58.864 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-08-17T02:18:58.973 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-08-17T02:18:58.992 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../017-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-08-17T02:18:59.031 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-08-17T02:18:59.259 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-08-17T02:18:59.275 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../016-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-08-17T02:18:59.317 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-08-17T02:18:59.518 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-08-17T02:18:59.534 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../018-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-08-17T02:18:59.587 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:18:59.711 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-08-17T02:18:59.728 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../017-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-08-17T02:18:59.770 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-08-17T02:19:00.104 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-08-17T02:19:00.123 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../019-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-08-17T02:19:00.162 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:19:00.307 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-08-17T02:19:00.324 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../018-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-08-17T02:19:00.375 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:19:00.507 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-08-17T02:19:00.526 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../020-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-08-17T02:19:00.582 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:19:00.885 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-08-17T02:19:00.904 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../019-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-08-17T02:19:00.960 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-08-17T02:19:00.968 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:19:00.976 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../021-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-08-17T02:19:01.018 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-08-17T02:19:01.346 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-08-17T02:19:01.362 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../020-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-08-17T02:19:01.362 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package librgw2. 2024-08-17T02:19:01.382 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../022-librgw2_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:19:01.396 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:19:01.420 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking librgw2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:01.807 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-08-17T02:19:01.823 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../021-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-08-17T02:19:01.866 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-08-17T02:19:02.215 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-rgw. 2024-08-17T02:19:02.234 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../023-python3-rgw_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:19:02.277 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package librgw2. 2024-08-17T02:19:02.281 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-rgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:02.293 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../022-librgw2_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:19:02.335 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking librgw2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:02.609 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package liboath0. 2024-08-17T02:19:02.629 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2024-08-17T02:19:02.667 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-08-17T02:19:03.012 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libradosstriper1. 2024-08-17T02:19:03.030 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../025-libradosstriper1_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:19:03.070 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libradosstriper1 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:03.130 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-rgw. 2024-08-17T02:19:03.150 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../023-python3-rgw_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:19:03.187 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-rgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:03.599 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package liboath0. 2024-08-17T02:19:03.615 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2024-08-17T02:19:03.657 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-08-17T02:19:04.334 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-common. 2024-08-17T02:19:04.353 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../026-ceph-common_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:19:04.386 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:04.785 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libradosstriper1. 2024-08-17T02:19:04.804 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../025-libradosstriper1_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:19:04.843 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libradosstriper1 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:05.338 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package ceph-common. 2024-08-17T02:19:05.357 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../026-ceph-common_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:19:05.396 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:06.972 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-base. 2024-08-17T02:19:06.990 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../027-ceph-base_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:19:07.040 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-base (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:07.910 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-cryptography. 2024-08-17T02:19:07.927 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../028-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-08-17T02:19:07.951 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package ceph-base. 2024-08-17T02:19:07.967 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../027-ceph-base_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:19:07.967 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-08-17T02:19:08.011 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking ceph-base (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:08.363 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-openssl. 2024-08-17T02:19:08.379 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../029-python3-openssl_19.0.0-1build1_all.deb ... 2024-08-17T02:19:08.421 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-08-17T02:19:08.741 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-packaging. 2024-08-17T02:19:08.757 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../030-python3-packaging_20.3-1_all.deb ... 2024-08-17T02:19:08.799 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-packaging (20.3-1) ... 2024-08-17T02:19:08.964 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-cryptography. 2024-08-17T02:19:08.981 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../028-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-08-17T02:19:09.022 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-08-17T02:19:09.077 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-08-17T02:19:09.092 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../031-ceph-mgr-modules-core_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:19:09.135 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr-modules-core (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:09.467 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-openssl. 2024-08-17T02:19:09.483 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../029-python3-openssl_19.0.0-1build1_all.deb ... 2024-08-17T02:19:09.526 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-08-17T02:19:09.540 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-bcrypt. 2024-08-17T02:19:09.555 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../032-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-08-17T02:19:09.597 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-08-17T02:19:09.828 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-packaging. 2024-08-17T02:19:09.848 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../030-python3-packaging_20.3-1_all.deb ... 2024-08-17T02:19:09.878 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-packaging (20.3-1) ... 2024-08-17T02:19:09.900 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-cherrypy3. 2024-08-17T02:19:09.918 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../033-python3-cherrypy3_8.9.1-6_all.deb ... 2024-08-17T02:19:09.992 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-08-17T02:19:10.150 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-08-17T02:19:10.166 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../031-ceph-mgr-modules-core_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:19:10.233 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking ceph-mgr-modules-core (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:10.345 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-natsort. 2024-08-17T02:19:10.365 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../034-python3-natsort_7.0.1-1_all.deb ... 2024-08-17T02:19:10.403 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-08-17T02:19:10.646 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-bcrypt. 2024-08-17T02:19:10.662 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../032-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-08-17T02:19:10.704 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-08-17T02:19:10.715 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-jwt. 2024-08-17T02:19:10.734 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../035-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-08-17T02:19:10.773 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-08-17T02:19:11.082 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-cherrypy3. 2024-08-17T02:19:11.099 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../033-python3-cherrypy3_8.9.1-6_all.deb ... 2024-08-17T02:19:11.101 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-logutils. 2024-08-17T02:19:11.117 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../036-python3-logutils_0.3.3-7_all.deb ... 2024-08-17T02:19:11.140 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-08-17T02:19:11.162 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-08-17T02:19:11.462 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-markupsafe. 2024-08-17T02:19:11.479 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../037-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-08-17T02:19:11.520 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-08-17T02:19:11.535 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-natsort. 2024-08-17T02:19:11.553 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../034-python3-natsort_7.0.1-1_all.deb ... 2024-08-17T02:19:11.593 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-08-17T02:19:11.857 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-mako. 2024-08-17T02:19:11.872 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../038-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-08-17T02:19:11.912 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-jwt. 2024-08-17T02:19:11.915 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-08-17T02:19:11.932 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../035-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-08-17T02:19:11.971 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-08-17T02:19:12.260 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-simplegeneric. 2024-08-17T02:19:12.276 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../039-python3-simplegeneric_0.8.1-3_all.deb ... 2024-08-17T02:19:12.318 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-08-17T02:19:12.341 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-logutils. 2024-08-17T02:19:12.358 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../036-python3-logutils_0.3.3-7_all.deb ... 2024-08-17T02:19:12.399 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-08-17T02:19:12.612 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-singledispatch. 2024-08-17T02:19:12.628 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../040-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-08-17T02:19:12.704 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-08-17T02:19:12.726 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-markupsafe. 2024-08-17T02:19:12.742 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../037-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-08-17T02:19:12.784 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-08-17T02:19:13.007 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-webob. 2024-08-17T02:19:13.024 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../041-python3-webob_1%3a1.8.5-2_all.deb ... 2024-08-17T02:19:13.073 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2024-08-17T02:19:13.146 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-mako. 2024-08-17T02:19:13.162 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../038-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-08-17T02:19:13.204 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-08-17T02:19:13.418 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-soupsieve. 2024-08-17T02:19:13.433 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../042-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-08-17T02:19:13.476 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-08-17T02:19:13.549 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-simplegeneric. 2024-08-17T02:19:13.568 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../039-python3-simplegeneric_0.8.1-3_all.deb ... 2024-08-17T02:19:13.632 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-08-17T02:19:13.804 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-bs4. 2024-08-17T02:19:13.820 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../043-python3-bs4_4.8.2-1_all.deb ... 2024-08-17T02:19:13.862 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-08-17T02:19:13.951 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-singledispatch. 2024-08-17T02:19:13.972 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../040-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-08-17T02:19:14.009 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-08-17T02:19:14.206 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-waitress. 2024-08-17T02:19:14.224 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../044-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-08-17T02:19:14.276 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-08-17T02:19:14.320 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-webob. 2024-08-17T02:19:14.336 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../041-python3-webob_1%3a1.8.5-2_all.deb ... 2024-08-17T02:19:14.403 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2024-08-17T02:19:14.618 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-tempita. 2024-08-17T02:19:14.634 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../045-python3-tempita_0.5.2-6_all.deb ... 2024-08-17T02:19:14.676 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-08-17T02:19:14.756 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-soupsieve. 2024-08-17T02:19:14.776 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../042-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-08-17T02:19:14.823 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-08-17T02:19:14.970 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-paste. 2024-08-17T02:19:14.987 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../046-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-08-17T02:19:15.020 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-08-17T02:19:15.200 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-bs4. 2024-08-17T02:19:15.218 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../043-python3-bs4_4.8.2-1_all.deb ... 2024-08-17T02:19:15.258 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-08-17T02:19:15.332 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-08-17T02:19:15.348 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../047-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-08-17T02:19:15.415 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-08-17T02:19:15.628 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-waitress. 2024-08-17T02:19:15.646 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../044-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-08-17T02:19:15.699 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pastedeploy. 2024-08-17T02:19:15.718 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../048-python3-pastedeploy_2.1.0-1_all.deb ... 2024-08-17T02:19:15.718 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-08-17T02:19:15.757 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-08-17T02:19:16.069 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-tempita. 2024-08-17T02:19:16.085 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-webtest. 2024-08-17T02:19:16.086 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../045-python3-tempita_0.5.2-6_all.deb ... 2024-08-17T02:19:16.101 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../049-python3-webtest_2.0.32-2_all.deb ... 2024-08-17T02:19:16.127 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-08-17T02:19:16.143 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-08-17T02:19:16.454 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pecan. 2024-08-17T02:19:16.471 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../050-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-08-17T02:19:16.488 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-paste. 2024-08-17T02:19:16.505 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../046-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-08-17T02:19:16.520 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-08-17T02:19:16.546 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-08-17T02:19:16.834 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-werkzeug. 2024-08-17T02:19:16.849 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../051-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.2_all.deb ... 2024-08-17T02:19:16.883 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-08-17T02:19:16.908 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-08-17T02:19:16.926 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../047-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-08-17T02:19:16.985 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-08-17T02:19:17.262 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-08-17T02:19:17.279 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../052-libsqlite3-mod-ceph_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:19:17.319 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-pastedeploy. 2024-08-17T02:19:17.320 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libsqlite3-mod-ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:17.337 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../048-python3-pastedeploy_2.1.0-1_all.deb ... 2024-08-17T02:19:17.377 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-08-17T02:19:17.665 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr. 2024-08-17T02:19:17.683 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../053-ceph-mgr_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:19:17.688 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-webtest. 2024-08-17T02:19:17.708 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../049-python3-webtest_2.0.32-2_all.deb ... 2024-08-17T02:19:17.723 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:17.746 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-08-17T02:19:18.134 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-pecan. 2024-08-17T02:19:18.150 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../050-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-08-17T02:19:18.191 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-08-17T02:19:18.243 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mon. 2024-08-17T02:19:18.260 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../054-ceph-mon_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:19:18.301 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mon (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:18.604 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-werkzeug. 2024-08-17T02:19:18.624 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../051-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.2_all.deb ... 2024-08-17T02:19:18.662 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-08-17T02:19:19.027 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-08-17T02:19:19.043 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../052-libsqlite3-mod-ceph_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:19:19.092 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-osd. 2024-08-17T02:19:19.111 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../055-ceph-osd_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:19:19.119 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libsqlite3-mod-ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:19.150 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-osd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:19.548 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package ceph-mgr. 2024-08-17T02:19:19.565 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../053-ceph-mgr_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:19:19.638 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking ceph-mgr (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:20.540 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package ceph-mon. 2024-08-17T02:19:20.556 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../054-ceph-mon_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:19:20.598 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking ceph-mon (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:21.214 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph. 2024-08-17T02:19:21.227 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../056-ceph_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:19:21.269 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:21.435 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package ceph-osd. 2024-08-17T02:19:21.451 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../055-ceph-osd_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:19:21.493 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking ceph-osd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:21.622 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-fuse. 2024-08-17T02:19:21.637 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../057-ceph-fuse_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:19:21.679 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:22.119 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mds. 2024-08-17T02:19:22.135 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../058-ceph-mds_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:19:22.173 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mds (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:22.744 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package cephadm. 2024-08-17T02:19:22.760 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../059-cephadm_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:19:22.801 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:23.154 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-jinja2. 2024-08-17T02:19:23.172 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../060-python3-jinja2_2.10.1-2ubuntu0.3_all.deb ... 2024-08-17T02:19:23.212 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-08-17T02:19:23.532 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-08-17T02:19:23.549 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../061-ceph-mgr-cephadm_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:19:23.587 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package ceph. 2024-08-17T02:19:23.599 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr-cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:23.603 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../056-ceph_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:19:23.681 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:23.919 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-repoze.lru. 2024-08-17T02:19:23.938 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../062-python3-repoze.lru_0.7-2_all.deb ... 2024-08-17T02:19:23.977 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-08-17T02:19:24.006 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package ceph-fuse. 2024-08-17T02:19:24.024 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../057-ceph-fuse_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:19:24.065 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking ceph-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:24.221 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libjs-underscore. 2024-08-17T02:19:24.239 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../063-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-08-17T02:19:24.279 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-08-17T02:19:24.518 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package ceph-mds. 2024-08-17T02:19:24.537 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../058-ceph-mds_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:19:24.565 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-08-17T02:19:24.576 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking ceph-mds (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:24.580 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../064-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-08-17T02:19:24.643 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-08-17T02:19:24.959 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-routes. 2024-08-17T02:19:24.975 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../065-python3-routes_2.4.1-2_all.deb ... 2024-08-17T02:19:25.017 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-08-17T02:19:25.121 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package cephadm. 2024-08-17T02:19:25.138 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../059-cephadm_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:19:25.179 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:25.353 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-08-17T02:19:25.372 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../066-ceph-mgr-dashboard_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:19:25.411 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr-dashboard (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:25.615 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-jinja2. 2024-08-17T02:19:25.633 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../060-python3-jinja2_2.10.1-2ubuntu0.3_all.deb ... 2024-08-17T02:19:25.673 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-08-17T02:19:26.009 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-08-17T02:19:26.028 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../061-ceph-mgr-cephadm_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:19:26.088 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking ceph-mgr-cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:26.446 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-repoze.lru. 2024-08-17T02:19:26.465 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../062-python3-repoze.lru_0.7-2_all.deb ... 2024-08-17T02:19:26.504 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-08-17T02:19:26.675 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-decorator. 2024-08-17T02:19:26.691 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../067-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-08-17T02:19:26.725 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-08-17T02:19:26.789 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libjs-underscore. 2024-08-17T02:19:26.806 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../063-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-08-17T02:19:26.873 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-08-17T02:19:27.053 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-08-17T02:19:27.069 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../068-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-08-17T02:19:27.111 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-08-17T02:19:27.192 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-08-17T02:19:27.209 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../064-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-08-17T02:19:27.250 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-08-17T02:19:27.463 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-scipy. 2024-08-17T02:19:27.481 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../069-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-08-17T02:19:27.521 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-08-17T02:19:27.569 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-routes. 2024-08-17T02:19:27.586 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../065-python3-routes_2.4.1-2_all.deb ... 2024-08-17T02:19:27.652 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-08-17T02:19:27.997 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-08-17T02:19:28.016 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../066-ceph-mgr-dashboard_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:19:28.055 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking ceph-mgr-dashboard (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:28.814 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-08-17T02:19:28.833 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-08-17T02:19:28.873 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-08-17T02:19:29.402 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-decorator. 2024-08-17T02:19:29.418 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-joblib. 2024-08-17T02:19:29.422 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../067-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-08-17T02:19:29.436 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../071-python3-joblib_0.14.0-3_all.deb ... 2024-08-17T02:19:29.476 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-08-17T02:19:29.485 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-08-17T02:19:29.771 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-08-17T02:19:29.789 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../068-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-08-17T02:19:29.821 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-08-17T02:19:29.863 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-sklearn. 2024-08-17T02:19:29.880 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../072-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-08-17T02:19:29.913 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-08-17T02:19:30.192 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-scipy. 2024-08-17T02:19:30.208 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../069-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-08-17T02:19:30.266 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-08-17T02:19:30.596 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-08-17T02:19:30.613 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../073-ceph-mgr-diskprediction-local_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:19:30.671 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:31.617 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-08-17T02:19:31.634 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-08-17T02:19:31.678 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-08-17T02:19:31.832 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-cachetools. 2024-08-17T02:19:31.851 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../074-python3-cachetools_4.0.0-1_all.deb ... 2024-08-17T02:19:31.890 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-08-17T02:19:32.135 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pyasn1. 2024-08-17T02:19:32.152 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../075-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-08-17T02:19:32.185 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-08-17T02:19:32.270 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-joblib. 2024-08-17T02:19:32.287 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../071-python3-joblib_0.14.0-3_all.deb ... 2024-08-17T02:19:32.361 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-08-17T02:19:32.538 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-08-17T02:19:32.554 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../076-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-08-17T02:19:32.596 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-08-17T02:19:32.773 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-sklearn. 2024-08-17T02:19:32.790 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../072-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-08-17T02:19:32.866 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-08-17T02:19:32.916 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-rsa. 2024-08-17T02:19:32.932 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../077-python3-rsa_4.0-3_all.deb ... 2024-08-17T02:19:32.974 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-rsa (4.0-3) ... 2024-08-17T02:19:33.285 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-google-auth. 2024-08-17T02:19:33.301 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../078-python3-google-auth_1.5.1-2_all.deb ... 2024-08-17T02:19:33.360 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-08-17T02:19:33.680 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-blinker. 2024-08-17T02:19:33.689 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-08-17T02:19:33.696 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../079-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-08-17T02:19:33.709 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../073-ceph-mgr-diskprediction-local_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:19:33.738 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-08-17T02:19:33.746 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:34.033 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-oauthlib. 2024-08-17T02:19:34.050 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../080-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-08-17T02:19:34.082 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-08-17T02:19:34.521 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-08-17T02:19:34.542 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../081-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-08-17T02:19:34.579 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-08-17T02:19:34.884 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-websocket. 2024-08-17T02:19:34.903 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../082-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-08-17T02:19:34.925 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-cachetools. 2024-08-17T02:19:34.942 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-08-17T02:19:34.944 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../074-python3-cachetools_4.0.0-1_all.deb ... 2024-08-17T02:19:34.983 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-08-17T02:19:35.270 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-kubernetes. 2024-08-17T02:19:35.288 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../083-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-08-17T02:19:35.328 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-08-17T02:19:35.352 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-pyasn1. 2024-08-17T02:19:35.368 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../075-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-08-17T02:19:35.410 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-08-17T02:19:35.772 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-08-17T02:19:35.788 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../076-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-08-17T02:19:35.855 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-08-17T02:19:35.885 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-08-17T02:19:35.901 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../084-ceph-mgr-k8sevents_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:19:35.943 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr-k8sevents (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:36.208 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-rsa. 2024-08-17T02:19:36.228 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../077-python3-rsa_4.0-3_all.deb ... 2024-08-17T02:19:36.246 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libonig5:amd64. 2024-08-17T02:19:36.266 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-rsa (4.0-3) ... 2024-08-17T02:19:36.266 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../085-libonig5_6.9.4-1_amd64.deb ... 2024-08-17T02:19:36.304 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-08-17T02:19:36.602 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-google-auth. 2024-08-17T02:19:36.619 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../078-python3-google-auth_1.5.1-2_all.deb ... 2024-08-17T02:19:36.685 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-08-17T02:19:36.698 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libjq1:amd64. 2024-08-17T02:19:36.714 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../086-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-08-17T02:19:36.756 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:19:37.026 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package jq. 2024-08-17T02:19:37.030 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-blinker. 2024-08-17T02:19:37.042 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../087-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-08-17T02:19:37.047 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../079-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-08-17T02:19:37.084 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:19:37.088 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-08-17T02:19:37.398 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package socat. 2024-08-17T02:19:37.416 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../088-socat_1.7.3.3-2_amd64.deb ... 2024-08-17T02:19:37.450 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-oauthlib. 2024-08-17T02:19:37.456 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking socat (1.7.3.3-2) ... 2024-08-17T02:19:37.469 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../080-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-08-17T02:19:37.508 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-08-17T02:19:37.785 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package xmlstarlet. 2024-08-17T02:19:37.803 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../089-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-08-17T02:19:37.843 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-08-17T02:19:37.997 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-08-17T02:19:38.014 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../081-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-08-17T02:19:38.055 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-08-17T02:19:38.172 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-test. 2024-08-17T02:19:38.191 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../090-ceph-test_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:19:38.230 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-test (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:38.400 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-websocket. 2024-08-17T02:19:38.418 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../082-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-08-17T02:19:38.483 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-08-17T02:19:38.820 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-kubernetes. 2024-08-17T02:19:38.838 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../083-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-08-17T02:19:38.878 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-08-17T02:19:39.462 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-08-17T02:19:39.479 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../084-ceph-mgr-k8sevents_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:19:39.553 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking ceph-mgr-k8sevents (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:39.922 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libonig5:amd64. 2024-08-17T02:19:39.939 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../085-libonig5_6.9.4-1_amd64.deb ... 2024-08-17T02:19:39.981 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-08-17T02:19:40.384 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libjq1:amd64. 2024-08-17T02:19:40.400 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../086-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-08-17T02:19:40.442 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:19:40.745 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package jq. 2024-08-17T02:19:40.761 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../087-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-08-17T02:19:40.803 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:19:41.130 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package socat. 2024-08-17T02:19:41.147 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../088-socat_1.7.3.3-2_amd64.deb ... 2024-08-17T02:19:41.188 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking socat (1.7.3.3-2) ... 2024-08-17T02:19:41.526 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package xmlstarlet. 2024-08-17T02:19:41.543 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../089-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-08-17T02:19:41.584 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-08-17T02:19:41.972 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package ceph-test. 2024-08-17T02:19:41.990 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../090-ceph-test_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:19:42.026 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking ceph-test (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:42.834 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-volume. 2024-08-17T02:19:42.854 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../091-ceph-volume_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:19:42.893 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-volume (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:43.314 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package cephfs-mirror. 2024-08-17T02:19:43.332 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../092-cephfs-mirror_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:19:43.372 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking cephfs-mirror (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:43.714 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-colorama. 2024-08-17T02:19:43.732 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../093-python3-colorama_0.4.3-1build1_all.deb ... 2024-08-17T02:19:43.773 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2024-08-17T02:19:44.059 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package cephfs-shell. 2024-08-17T02:19:44.076 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../094-cephfs-shell_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:19:44.126 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking cephfs-shell (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:44.395 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package cephfs-top. 2024-08-17T02:19:44.412 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../095-cephfs-top_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:19:44.445 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking cephfs-top (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:44.680 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package fonts-mathjax. 2024-08-17T02:19:44.699 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-08-17T02:19:44.738 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:19:45.252 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libcephfs-dev. 2024-08-17T02:19:45.271 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../097-libcephfs-dev_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:19:45.310 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libcephfs-dev (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:45.730 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package nvme-cli. 2024-08-17T02:19:45.746 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2024-08-17T02:19:45.806 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2024-08-17T02:19:46.143 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libjs-mathjax. 2024-08-17T02:19:46.160 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../099-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-08-17T02:19:46.201 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:19:46.480 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package ceph-volume. 2024-08-17T02:19:46.498 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../091-ceph-volume_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:19:46.538 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking ceph-volume (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:47.018 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package cephfs-mirror. 2024-08-17T02:19:47.037 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../092-cephfs-mirror_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:19:47.111 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking cephfs-mirror (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:47.481 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-colorama. 2024-08-17T02:19:47.498 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../093-python3-colorama_0.4.3-1build1_all.deb ... 2024-08-17T02:19:47.539 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2024-08-17T02:19:47.833 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package cephfs-shell. 2024-08-17T02:19:47.850 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../094-cephfs-shell_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:19:47.878 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python-natsort-doc. 2024-08-17T02:19:47.896 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../100-python-natsort-doc_7.0.1-1_all.deb ... 2024-08-17T02:19:47.908 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking cephfs-shell (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:47.936 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-08-17T02:19:48.185 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package cephfs-top. 2024-08-17T02:19:48.202 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../095-cephfs-top_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:19:48.243 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking cephfs-top (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:48.294 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-atomicwrites. 2024-08-17T02:19:48.315 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../101-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-08-17T02:19:48.355 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-08-17T02:19:48.529 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package fonts-mathjax. 2024-08-17T02:19:48.546 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-08-17T02:19:48.587 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:19:48.642 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-attr. 2024-08-17T02:19:48.658 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../102-python3-attr_19.3.0-2_all.deb ... 2024-08-17T02:19:48.699 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-08-17T02:19:49.044 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-webencodings. 2024-08-17T02:19:49.061 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../103-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-08-17T02:19:49.102 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-08-17T02:19:49.141 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libcephfs-dev. 2024-08-17T02:19:49.158 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../097-libcephfs-dev_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:19:49.232 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libcephfs-dev (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:49.455 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-html5lib. 2024-08-17T02:19:49.473 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../104-python3-html5lib_1.0.1-2_all.deb ... 2024-08-17T02:19:49.514 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-08-17T02:19:49.660 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package nvme-cli. 2024-08-17T02:19:49.678 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2024-08-17T02:19:49.770 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2024-08-17T02:19:49.849 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-08-17T02:19:49.866 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../105-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-08-17T02:19:49.926 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-08-17T02:19:50.115 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libjs-mathjax. 2024-08-17T02:19:50.133 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../099-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-08-17T02:19:50.174 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:19:50.746 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pastescript. 2024-08-17T02:19:50.761 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-08-17T02:19:50.802 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-08-17T02:19:51.130 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pluggy. 2024-08-17T02:19:51.154 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-2_all.deb ... 2024-08-17T02:19:51.188 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-08-17T02:19:51.466 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-psutil. 2024-08-17T02:19:51.487 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../108-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-08-17T02:19:51.524 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-08-17T02:19:51.877 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-py. 2024-08-17T02:19:51.894 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../109-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-08-17T02:19:51.927 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-08-17T02:19:52.238 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pyinotify. 2024-08-17T02:19:52.259 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-08-17T02:19:52.296 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-08-17T02:19:52.372 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python-natsort-doc. 2024-08-17T02:19:52.394 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../100-python-natsort-doc_7.0.1-1_all.deb ... 2024-08-17T02:19:52.471 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-08-17T02:19:52.591 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pytest. 2024-08-17T02:19:52.611 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../111-python3-pytest_4.6.9-1_all.deb ... 2024-08-17T02:19:52.682 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-08-17T02:19:52.833 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-atomicwrites. 2024-08-17T02:19:52.851 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../101-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-08-17T02:19:52.890 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-08-17T02:19:52.996 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-simplejson. 2024-08-17T02:19:53.015 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../112-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-08-17T02:19:53.052 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-08-17T02:19:53.260 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-attr. 2024-08-17T02:19:53.280 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../102-python3-attr_19.3.0-2_all.deb ... 2024-08-17T02:19:53.318 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-08-17T02:19:53.363 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-08-17T02:19:53.381 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../113-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-08-17T02:19:53.421 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-08-17T02:19:53.687 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-webencodings. 2024-08-17T02:19:53.706 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../103-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-08-17T02:19:53.758 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-08-17T02:19:54.081 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-html5lib. 2024-08-17T02:19:54.101 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../104-python3-html5lib_1.0.1-2_all.deb ... 2024-08-17T02:19:54.139 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-08-17T02:19:54.158 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package radosgw. 2024-08-17T02:19:54.179 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../114-radosgw_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:19:54.218 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking radosgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:54.492 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-08-17T02:19:54.513 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../105-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-08-17T02:19:54.584 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-08-17T02:19:55.112 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-pastescript. 2024-08-17T02:19:55.130 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-08-17T02:19:55.170 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-08-17T02:19:55.523 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-pluggy. 2024-08-17T02:19:55.540 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-2_all.deb ... 2024-08-17T02:19:55.615 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-08-17T02:19:55.959 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-psutil. 2024-08-17T02:19:55.978 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../108-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-08-17T02:19:56.017 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-08-17T02:19:56.023 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package rbd-fuse. 2024-08-17T02:19:56.041 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../115-rbd-fuse_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:19:56.080 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking rbd-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:56.369 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-attr (19.3.0-2) ... 2024-08-17T02:19:56.437 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-py. 2024-08-17T02:19:56.455 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../109-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-08-17T02:19:56.495 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-08-17T02:19:56.669 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-08-17T02:19:56.795 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-08-17T02:19:56.857 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-pyinotify. 2024-08-17T02:19:56.878 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-08-17T02:19:56.921 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2024-08-17T02:19:56.931 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-08-17T02:19:57.139 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:57.260 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-pytest. 2024-08-17T02:19:57.278 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../111-python3-pytest_4.6.9-1_all.deb ... 2024-08-17T02:19:57.320 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-08-17T02:19:57.698 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package python3-simplejson. 2024-08-17T02:19:57.717 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../112-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-08-17T02:19:57.718 INFO:teuthology.orchestra.run.smithi117.stdout:Adding system user cephadm....done 2024-08-17T02:19:57.756 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-08-17T02:19:57.872 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:19:57.990 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-08-17T02:19:58.050 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-08-17T02:19:58.070 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../113-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-08-17T02:19:58.108 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-08-17T02:19:58.342 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-08-17T02:19:58.634 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:19:58.794 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-08-17T02:19:58.913 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package radosgw. 2024-08-17T02:19:58.920 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-08-17T02:19:58.931 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../114-radosgw_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:19:58.995 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking radosgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:19:59.238 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-08-17T02:19:59.649 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-08-17T02:19:59.993 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-08-17T02:20:00.311 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2024-08-17T02:20:00.612 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-08-17T02:20:00.724 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package rbd-fuse. 2024-08-17T02:20:00.742 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../115-rbd-fuse_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:20:00.781 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking rbd-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:00.896 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-08-17T02:20:01.152 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-attr (19.3.0-2) ... 2024-08-17T02:20:01.164 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-ceph-argparse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:01.455 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-08-17T02:20:01.456 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-08-17T02:20:01.582 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2024-08-17T02:20:01.598 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-08-17T02:20:01.757 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2024-08-17T02:20:01.869 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-08-17T02:20:01.975 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:02.194 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-08-17T02:20:02.502 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-08-17T02:20:02.604 INFO:teuthology.orchestra.run.smithi104.stdout:Adding system user cephadm....done 2024-08-17T02:20:02.628 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-08-17T02:20:02.791 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:20:02.917 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-08-17T02:20:03.015 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-08-17T02:20:03.289 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-08-17T02:20:03.302 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-08-17T02:20:03.590 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-08-17T02:20:03.595 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:20:03.721 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-08-17T02:20:03.888 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-08-17T02:20:03.916 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-08-17T02:20:04.200 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-08-17T02:20:04.215 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-08-17T02:20:04.526 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-08-17T02:20:04.651 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-08-17T02:20:04.811 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-packaging (20.3-1) ... 2024-08-17T02:20:04.960 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-08-17T02:20:05.112 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-08-17T02:20:05.263 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-08-17T02:20:05.277 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2024-08-17T02:20:05.389 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-08-17T02:20:05.620 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-08-17T02:20:05.665 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-08-17T02:20:05.905 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-08-17T02:20:06.100 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2024-08-17T02:20:06.214 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-ceph-argparse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:06.401 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-08-17T02:20:06.507 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-08-17T02:20:06.674 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2024-08-17T02:20:06.761 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-08-17T02:20:06.958 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-08-17T02:20:07.146 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up socat (1.7.3.3-2) ... 2024-08-17T02:20:07.243 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-08-17T02:20:07.263 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:07.527 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-08-17T02:20:07.564 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:20:07.678 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-08-17T02:20:07.699 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-08-17T02:20:08.042 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-08-17T02:20:08.054 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-08-17T02:20:08.176 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-08-17T02:20:08.302 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-08-17T02:20:08.339 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-08-17T02:20:08.587 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-08-17T02:20:08.639 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-08-17T02:20:08.898 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:20:09.024 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-08-17T02:20:09.030 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-08-17T02:20:09.156 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-08-17T02:20:09.317 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-08-17T02:20:09.483 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-08-17T02:20:09.660 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-08-17T02:20:09.784 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-08-17T02:20:10.002 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-packaging (20.3-1) ... 2024-08-17T02:20:10.085 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-08-17T02:20:10.219 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-08-17T02:20:10.296 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-08-17T02:20:10.421 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-08-17T02:20:10.504 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-08-17T02:20:10.572 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-08-17T02:20:10.780 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-08-17T02:20:10.873 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-08-17T02:20:11.055 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-08-17T02:20:11.316 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2024-08-17T02:20:11.433 INFO:teuthology.orchestra.run.smithi117.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-08-17T02:20:11.600 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-08-17T02:20:11.691 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-08-17T02:20:11.834 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-08-17T02:20:11.969 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-08-17T02:20:12.152 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-08-17T02:20:12.378 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up socat (1.7.3.3-2) ... 2024-08-17T02:20:12.504 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-08-17T02:20:12.512 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:12.629 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-08-17T02:20:12.742 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-webob (1:1.8.5-2) ... 2024-08-17T02:20:12.876 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:20:13.006 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-08-17T02:20:13.098 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-08-17T02:20:13.332 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-08-17T02:20:13.391 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up librados2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:13.500 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-08-17T02:20:13.517 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-08-17T02:20:13.659 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-08-17T02:20:13.969 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-08-17T02:20:14.295 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:20:14.463 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-08-17T02:20:14.589 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-08-17T02:20:14.948 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-08-17T02:20:15.022 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libsqlite3-mod-ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:15.148 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:20:15.241 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-08-17T02:20:15.274 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-08-17T02:20:15.534 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-08-17T02:20:15.642 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-08-17T02:20:15.660 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-08-17T02:20:15.935 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-08-17T02:20:16.003 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-08-17T02:20:16.211 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:20:16.295 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-08-17T02:20:16.337 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-08-17T02:20:16.604 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-08-17T02:20:16.680 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libcephfs2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:16.797 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-08-17T02:20:16.962 INFO:teuthology.orchestra.run.smithi104.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-08-17T02:20:17.107 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libradosstriper1 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:17.249 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-08-17T02:20:17.258 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-08-17T02:20:17.408 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-08-17T02:20:17.595 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-08-17T02:20:17.718 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-08-17T02:20:18.110 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-08-17T02:20:18.236 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-08-17T02:20:18.396 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-webob (1:1.8.5-2) ... 2024-08-17T02:20:18.659 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up librbd1 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:18.730 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-08-17T02:20:18.809 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-08-17T02:20:18.927 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-08-17T02:20:19.023 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up librados2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:19.053 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:20:19.179 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-rsa (4.0-3) ... 2024-08-17T02:20:19.182 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-08-17T02:20:19.455 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-08-17T02:20:19.581 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-08-17T02:20:19.967 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr-modules-core (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:20.076 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:20.306 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-17T02:20:20.306 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-17T02:20:20.647 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libsqlite3-mod-ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:20.799 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:20:20.816 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libcephfs-dev (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:20.946 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-08-17T02:20:21.196 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-08-17T02:20:21.351 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-08-17T02:20:21.481 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-08-17T02:20:21.660 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-08-17T02:20:21.824 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-08-17T02:20:22.176 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-rados (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:22.293 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up librgw2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:22.295 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:20:22.420 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up cephfs-top (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:22.420 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-08-17T02:20:22.546 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-rbd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:22.688 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up rbd-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:22.822 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libcephfs2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:22.839 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-routes (2.4.1-2) ... 2024-08-17T02:20:22.948 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-08-17T02:20:23.140 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-08-17T02:20:23.341 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libradosstriper1 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:23.458 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-rgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:23.467 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-08-17T02:20:23.584 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-cephfs (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:23.693 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up cephfs-shell (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:23.852 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-08-17T02:20:23.862 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-08-17T02:20:24.756 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:24.915 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up librbd1 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:25.041 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-08-17T02:20:25.209 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-08-17T02:20:25.317 INFO:teuthology.orchestra.run.smithi117.stdout:Adding group ceph....done 2024-08-17T02:20:25.335 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:20:25.494 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-rsa (4.0-3) ... 2024-08-17T02:20:25.702 INFO:teuthology.orchestra.run.smithi117.stdout:Adding system user ceph....done 2024-08-17T02:20:25.804 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-08-17T02:20:25.861 INFO:teuthology.orchestra.run.smithi117.stdout:Setting system user ceph properties....done 2024-08-17T02:20:25.880 INFO:teuthology.orchestra.run.smithi117.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-08-17T02:20:25.954 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-08-17T02:20:26.025 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-08-17T02:20:26.333 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up ceph-mgr-modules-core (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:26.349 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-08-17T02:20:26.501 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up ceph-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:26.728 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-17T02:20:26.728 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-17T02:20:26.807 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up cephfs-mirror (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:27.035 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:20:27.035 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:20:27.224 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libcephfs-dev (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:27.395 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-08-17T02:20:27.500 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-test (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:27.634 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up radosgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:27.723 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-08-17T02:20:27.905 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:20:27.905 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:20:28.307 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-08-17T02:20:28.544 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-base (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:28.694 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-rados (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:28.820 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up librgw2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:28.950 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-08-17T02:20:28.987 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up cephfs-top (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:29.113 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-rbd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:29.264 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up rbd-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:29.388 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mds (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:29.415 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-routes (2.4.1-2) ... 2024-08-17T02:20:29.640 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-17T02:20:29.640 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-17T02:20:29.725 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-08-17T02:20:30.043 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-rgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:30.081 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:30.195 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-cephfs (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:30.306 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-17T02:20:30.306 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-17T02:20:30.320 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up cephfs-shell (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:30.487 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-08-17T02:20:30.749 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-osd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:31.263 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-17T02:20:31.264 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-17T02:20:31.407 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:31.718 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr-k8sevents (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:31.844 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr-diskprediction-local (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:31.993 INFO:teuthology.orchestra.run.smithi104.stdout:Adding group ceph....done 2024-08-17T02:20:32.012 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mon (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:32.238 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-17T02:20:32.238 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-17T02:20:32.403 INFO:teuthology.orchestra.run.smithi104.stdout:Adding system user ceph....done 2024-08-17T02:20:32.614 INFO:teuthology.orchestra.run.smithi104.stdout:Setting system user ceph properties....done 2024-08-17T02:20:32.639 INFO:teuthology.orchestra.run.smithi104.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-08-17T02:20:32.688 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr-cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:32.792 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-08-17T02:20:32.830 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:32.957 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr-dashboard (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:33.116 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-volume (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:33.117 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-08-17T02:20:33.242 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-08-17T02:20:33.394 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-08-17T02:20:33.601 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up cephfs-mirror (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:33.670 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-08-17T02:20:33.823 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:20:33.823 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:20:34.277 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up ceph-test (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:34.427 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up radosgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:34.705 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:20:34.705 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:20:35.354 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up ceph-base (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:35.754 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-08-17T02:20:36.198 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up ceph-mds (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:36.428 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-17T02:20:36.428 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-17T02:20:36.662 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-08-17T02:20:36.866 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up ceph-mgr (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:37.131 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-17T02:20:37.131 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-17T02:20:37.429 INFO:teuthology.orchestra.run.smithi117.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-17T02:20:37.431 DEBUG:teuthology.orchestra.run.smithi117:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-08-17T02:20:37.506 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2024-08-17T02:20:37.602 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up ceph-osd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:37.722 INFO:teuthology.orchestra.run.smithi117.stdout:Building dependency tree... 2024-08-17T02:20:37.724 INFO:teuthology.orchestra.run.smithi117.stdout:Reading state information... 2024-08-17T02:20:37.938 INFO:teuthology.orchestra.run.smithi117.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-08-17T02:20:37.938 INFO:teuthology.orchestra.run.smithi117.stdout:flex is already the newest version (2.6.4-6.2). 2024-08-17T02:20:37.938 INFO:teuthology.orchestra.run.smithi117.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2024-08-17T02:20:37.938 INFO:teuthology.orchestra.run.smithi117.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-08-17T02:20:37.938 INFO:teuthology.orchestra.run.smithi117.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-08-17T02:20:37.938 INFO:teuthology.orchestra.run.smithi117.stdout:The following packages were automatically installed and are no longer required: 2024-08-17T02:20:37.939 INFO:teuthology.orchestra.run.smithi117.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-08-17T02:20:37.939 INFO:teuthology.orchestra.run.smithi117.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-17T02:20:37.939 INFO:teuthology.orchestra.run.smithi117.stdout:The following additional packages will be installed: 2024-08-17T02:20:37.939 INFO:teuthology.orchestra.run.smithi117.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2024-08-17T02:20:37.940 INFO:teuthology.orchestra.run.smithi117.stdout: libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 2024-08-17T02:20:37.940 INFO:teuthology.orchestra.run.smithi117.stdout: libuuid1 modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2024-08-17T02:20:37.940 INFO:teuthology.orchestra.run.smithi117.stdout: usb-modeswitch-data wpasupplicant 2024-08-17T02:20:37.941 INFO:teuthology.orchestra.run.smithi117.stdout:Suggested packages: 2024-08-17T02:20:37.941 INFO:teuthology.orchestra.run.smithi117.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2024-08-17T02:20:37.942 INFO:teuthology.orchestra.run.smithi117.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-08-17T02:20:37.992 INFO:teuthology.orchestra.run.smithi117.stdout:The following NEW packages will be installed: 2024-08-17T02:20:37.992 INFO:teuthology.orchestra.run.smithi117.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2024-08-17T02:20:37.993 INFO:teuthology.orchestra.run.smithi117.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2024-08-17T02:20:37.993 INFO:teuthology.orchestra.run.smithi117.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2024-08-17T02:20:37.993 INFO:teuthology.orchestra.run.smithi117.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2024-08-17T02:20:37.995 INFO:teuthology.orchestra.run.smithi117.stdout:The following packages will be upgraded: 2024-08-17T02:20:37.995 INFO:teuthology.orchestra.run.smithi117.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2024-08-17T02:20:38.050 INFO:teuthology.orchestra.run.smithi117.stdout:6 upgraded, 23 newly installed, 0 to remove and 289 not upgraded. 2024-08-17T02:20:38.050 INFO:teuthology.orchestra.run.smithi117.stdout:Need to get 10.4 MB of archives. 2024-08-17T02:20:38.050 INFO:teuthology.orchestra.run.smithi117.stdout:After this operation, 33.5 MB of additional disk space will be used. 2024-08-17T02:20:38.050 INFO:teuthology.orchestra.run.smithi117.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.6 [1,022 kB] 2024-08-17T02:20:38.134 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-17T02:20:38.134 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-17T02:20:38.181 INFO:teuthology.orchestra.run.smithi117.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-08-17T02:20:38.183 INFO:teuthology.orchestra.run.smithi117.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-08-17T02:20:38.184 INFO:teuthology.orchestra.run.smithi117.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-08-17T02:20:38.190 INFO:teuthology.orchestra.run.smithi117.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-08-17T02:20:38.190 INFO:teuthology.orchestra.run.smithi117.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.23 [1,323 kB] 2024-08-17T02:20:38.207 INFO:teuthology.orchestra.run.smithi117.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2024-08-17T02:20:38.207 INFO:teuthology.orchestra.run.smithi117.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2024-08-17T02:20:38.209 INFO:teuthology.orchestra.run.smithi117.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2024-08-17T02:20:38.209 INFO:teuthology.orchestra.run.smithi117.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-08-17T02:20:38.209 INFO:teuthology.orchestra.run.smithi117.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.8 [60.6 kB] 2024-08-17T02:20:38.218 INFO:teuthology.orchestra.run.smithi117.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-08-17T02:20:38.218 INFO:teuthology.orchestra.run.smithi117.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2024-08-17T02:20:38.218 INFO:teuthology.orchestra.run.smithi117.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2024-08-17T02:20:38.218 INFO:teuthology.orchestra.run.smithi117.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2024-08-17T02:20:38.232 INFO:teuthology.orchestra.run.smithi117.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libndp0 amd64 1.7-0ubuntu1.1 [11.1 kB] 2024-08-17T02:20:38.233 INFO:teuthology.orchestra.run.smithi117.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.4 [370 kB] 2024-08-17T02:20:38.243 INFO:teuthology.orchestra.run.smithi117.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2024-08-17T02:20:38.250 INFO:teuthology.orchestra.run.smithi117.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2024-08-17T02:20:38.251 INFO:teuthology.orchestra.run.smithi117.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.23 [1,586 kB] 2024-08-17T02:20:38.265 INFO:teuthology.orchestra.run.smithi117.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2024-08-17T02:20:38.265 INFO:teuthology.orchestra.run.smithi117.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2024-08-17T02:20:38.273 INFO:teuthology.orchestra.run.smithi117.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.4 [1,184 kB] 2024-08-17T02:20:38.283 INFO:teuthology.orchestra.run.smithi117.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.4 [1,854 kB] 2024-08-17T02:20:38.300 INFO:teuthology.orchestra.run.smithi117.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2024-08-17T02:20:38.301 INFO:teuthology.orchestra.run.smithi117.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2024-08-17T02:20:38.301 INFO:teuthology.orchestra.run.smithi117.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2024-08-17T02:20:38.302 INFO:teuthology.orchestra.run.smithi117.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2024-08-17T02:20:38.302 INFO:teuthology.orchestra.run.smithi117.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2024-08-17T02:20:38.570 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up ceph-mgr-k8sevents (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:38.620 INFO:teuthology.orchestra.run.smithi117.stdout:Preconfiguring packages ... 2024-08-17T02:20:38.697 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up ceph-mgr-diskprediction-local (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:38.761 INFO:teuthology.orchestra.run.smithi117.stdout:Fetched 10.4 MB in 0s (34.8 MB/s) 2024-08-17T02:20:38.863 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up ceph-mon (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:39.049 INFO:teuthology.orchestra.run.smithi117.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152983 files and directories currently installed.) 2024-08-17T02:20:39.051 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.6_amd64.deb ... 2024-08-17T02:20:39.090 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-17T02:20:39.091 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-17T02:20:39.175 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking util-linux (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-08-17T02:20:39.531 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up ceph-mgr-cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:39.665 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:39.825 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up ceph-mgr-dashboard (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:39.968 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up ceph-volume (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:20:40.128 INFO:teuthology.orchestra.run.smithi104.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-08-17T02:20:40.304 INFO:teuthology.orchestra.run.smithi104.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-08-17T02:20:40.324 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up util-linux (2.34-0.1ubuntu9.6) ... 2024-08-17T02:20:40.581 INFO:teuthology.orchestra.run.smithi104.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-08-17T02:20:41.742 INFO:teuthology.orchestra.run.smithi117.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152983 files and directories currently installed.) 2024-08-17T02:20:41.746 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-08-17T02:20:41.921 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-08-17T02:20:42.613 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-08-17T02:20:42.786 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-08-17T02:20:43.120 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-08-17T02:20:43.475 INFO:teuthology.orchestra.run.smithi104.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-08-17T02:20:43.565 INFO:teuthology.orchestra.run.smithi117.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152983 files and directories currently installed.) 2024-08-17T02:20:43.570 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-08-17T02:20:43.702 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-08-17T02:20:44.079 INFO:teuthology.orchestra.run.smithi104.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-17T02:20:44.082 DEBUG:teuthology.orchestra.run.smithi104:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-08-17T02:20:44.159 INFO:teuthology.orchestra.run.smithi104.stdout:Reading package lists... 2024-08-17T02:20:44.168 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-08-17T02:20:44.290 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-08-17T02:20:44.375 INFO:teuthology.orchestra.run.smithi104.stdout:Building dependency tree... 2024-08-17T02:20:44.376 INFO:teuthology.orchestra.run.smithi104.stdout:Reading state information... 2024-08-17T02:20:44.593 INFO:teuthology.orchestra.run.smithi104.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-08-17T02:20:44.593 INFO:teuthology.orchestra.run.smithi104.stdout:flex is already the newest version (2.6.4-6.2). 2024-08-17T02:20:44.593 INFO:teuthology.orchestra.run.smithi104.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2024-08-17T02:20:44.593 INFO:teuthology.orchestra.run.smithi104.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-08-17T02:20:44.593 INFO:teuthology.orchestra.run.smithi104.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-08-17T02:20:44.593 INFO:teuthology.orchestra.run.smithi104.stdout:The following packages were automatically installed and are no longer required: 2024-08-17T02:20:44.594 INFO:teuthology.orchestra.run.smithi104.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-08-17T02:20:44.594 INFO:teuthology.orchestra.run.smithi104.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-17T02:20:44.594 INFO:teuthology.orchestra.run.smithi104.stdout:The following additional packages will be installed: 2024-08-17T02:20:44.595 INFO:teuthology.orchestra.run.smithi104.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2024-08-17T02:20:44.595 INFO:teuthology.orchestra.run.smithi104.stdout: libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 2024-08-17T02:20:44.595 INFO:teuthology.orchestra.run.smithi104.stdout: libuuid1 modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2024-08-17T02:20:44.595 INFO:teuthology.orchestra.run.smithi104.stdout: usb-modeswitch-data wpasupplicant 2024-08-17T02:20:44.596 INFO:teuthology.orchestra.run.smithi104.stdout:Suggested packages: 2024-08-17T02:20:44.596 INFO:teuthology.orchestra.run.smithi104.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2024-08-17T02:20:44.596 INFO:teuthology.orchestra.run.smithi104.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-08-17T02:20:44.648 INFO:teuthology.orchestra.run.smithi104.stdout:The following NEW packages will be installed: 2024-08-17T02:20:44.648 INFO:teuthology.orchestra.run.smithi104.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2024-08-17T02:20:44.648 INFO:teuthology.orchestra.run.smithi104.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2024-08-17T02:20:44.649 INFO:teuthology.orchestra.run.smithi104.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2024-08-17T02:20:44.649 INFO:teuthology.orchestra.run.smithi104.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2024-08-17T02:20:44.650 INFO:teuthology.orchestra.run.smithi104.stdout:The following packages will be upgraded: 2024-08-17T02:20:44.651 INFO:teuthology.orchestra.run.smithi104.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2024-08-17T02:20:44.708 INFO:teuthology.orchestra.run.smithi104.stdout:6 upgraded, 23 newly installed, 0 to remove and 289 not upgraded. 2024-08-17T02:20:44.709 INFO:teuthology.orchestra.run.smithi104.stdout:Need to get 10.4 MB of archives. 2024-08-17T02:20:44.709 INFO:teuthology.orchestra.run.smithi104.stdout:After this operation, 33.5 MB of additional disk space will be used. 2024-08-17T02:20:44.709 INFO:teuthology.orchestra.run.smithi104.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.6 [1,022 kB] 2024-08-17T02:20:44.772 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-08-17T02:20:44.843 INFO:teuthology.orchestra.run.smithi104.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-08-17T02:20:44.844 INFO:teuthology.orchestra.run.smithi104.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-08-17T02:20:44.844 INFO:teuthology.orchestra.run.smithi104.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-08-17T02:20:44.849 INFO:teuthology.orchestra.run.smithi104.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-08-17T02:20:44.854 INFO:teuthology.orchestra.run.smithi104.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.23 [1,323 kB] 2024-08-17T02:20:44.868 INFO:teuthology.orchestra.run.smithi104.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2024-08-17T02:20:44.868 INFO:teuthology.orchestra.run.smithi104.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2024-08-17T02:20:44.869 INFO:teuthology.orchestra.run.smithi104.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2024-08-17T02:20:44.871 INFO:teuthology.orchestra.run.smithi104.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-08-17T02:20:44.872 INFO:teuthology.orchestra.run.smithi104.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.8 [60.6 kB] 2024-08-17T02:20:44.876 INFO:teuthology.orchestra.run.smithi104.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-08-17T02:20:44.877 INFO:teuthology.orchestra.run.smithi104.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2024-08-17T02:20:44.878 INFO:teuthology.orchestra.run.smithi104.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2024-08-17T02:20:44.878 INFO:teuthology.orchestra.run.smithi104.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2024-08-17T02:20:44.894 INFO:teuthology.orchestra.run.smithi104.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libndp0 amd64 1.7-0ubuntu1.1 [11.1 kB] 2024-08-17T02:20:44.894 INFO:teuthology.orchestra.run.smithi104.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.4 [370 kB] 2024-08-17T02:20:44.900 INFO:teuthology.orchestra.run.smithi104.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2024-08-17T02:20:44.902 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.23) over (1.1.1f-1ubuntu2.16) ... 2024-08-17T02:20:44.907 INFO:teuthology.orchestra.run.smithi104.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2024-08-17T02:20:44.908 INFO:teuthology.orchestra.run.smithi104.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.23 [1,586 kB] 2024-08-17T02:20:44.921 INFO:teuthology.orchestra.run.smithi104.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2024-08-17T02:20:44.921 INFO:teuthology.orchestra.run.smithi104.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2024-08-17T02:20:44.928 INFO:teuthology.orchestra.run.smithi104.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.4 [1,184 kB] 2024-08-17T02:20:44.938 INFO:teuthology.orchestra.run.smithi104.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.4 [1,854 kB] 2024-08-17T02:20:44.953 INFO:teuthology.orchestra.run.smithi104.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2024-08-17T02:20:44.956 INFO:teuthology.orchestra.run.smithi104.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2024-08-17T02:20:44.956 INFO:teuthology.orchestra.run.smithi104.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2024-08-17T02:20:44.957 INFO:teuthology.orchestra.run.smithi104.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2024-08-17T02:20:44.957 INFO:teuthology.orchestra.run.smithi104.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2024-08-17T02:20:45.271 INFO:teuthology.orchestra.run.smithi104.stdout:Preconfiguring packages ... 2024-08-17T02:20:45.397 INFO:teuthology.orchestra.run.smithi104.stdout:Fetched 10.4 MB in 0s (34.9 MB/s) 2024-08-17T02:20:45.440 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-08-17T02:20:45.458 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2024-08-17T02:20:45.498 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2024-08-17T02:20:45.708 INFO:teuthology.orchestra.run.smithi104.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152983 files and directories currently installed.) 2024-08-17T02:20:45.712 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.6_amd64.deb ... 2024-08-17T02:20:45.876 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package dump. 2024-08-17T02:20:45.885 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking util-linux (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-08-17T02:20:45.893 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2024-08-17T02:20:45.934 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking dump (0.4b46-6) ... 2024-08-17T02:20:46.263 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package indent. 2024-08-17T02:20:46.282 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2024-08-17T02:20:46.321 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2024-08-17T02:20:46.632 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-08-17T02:20:46.649 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2024-08-17T02:20:46.707 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-08-17T02:20:47.010 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-08-17T02:20:47.027 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.8_amd64.deb ... 2024-08-17T02:20:47.058 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up util-linux (2.34-0.1ubuntu9.6) ... 2024-08-17T02:20:47.068 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-08-17T02:20:47.446 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-08-17T02:20:47.467 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-08-17T02:20:47.688 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:20:48.167 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-08-17T02:20:48.185 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:20:48.225 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:20:48.511 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libmbim-proxy. 2024-08-17T02:20:48.529 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:20:48.544 INFO:teuthology.orchestra.run.smithi104.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152983 files and directories currently installed.) 2024-08-17T02:20:48.549 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-08-17T02:20:48.569 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:20:48.708 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-08-17T02:20:48.922 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-08-17T02:20:48.939 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:20:48.980 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:20:49.191 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-08-17T02:20:49.333 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libndp0:amd64. 2024-08-17T02:20:49.350 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1.1_amd64.deb ... 2024-08-17T02:20:49.355 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-08-17T02:20:49.417 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-08-17T02:20:49.703 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libnm0:amd64. 2024-08-17T02:20:49.724 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.4_amd64.deb ... 2024-08-17T02:20:49.742 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-08-17T02:20:49.753 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-08-17T02:20:50.158 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-08-17T02:20:50.173 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../14-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:20:50.199 INFO:teuthology.orchestra.run.smithi104.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152983 files and directories currently installed.) 2024-08-17T02:20:50.204 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-08-17T02:20:50.213 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:20:50.346 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-08-17T02:20:50.566 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libqmi-proxy. 2024-08-17T02:20:50.585 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../15-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:20:50.624 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:20:50.853 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-08-17T02:20:50.877 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-08-17T02:20:50.896 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../16-libssl-dev_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-08-17T02:20:50.935 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-08-17T02:20:50.960 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-08-17T02:20:51.422 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-08-17T02:20:51.438 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../17-libteamdctl0_1.30-1_amd64.deb ... 2024-08-17T02:20:51.479 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2024-08-17T02:20:51.483 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-08-17T02:20:51.648 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.23) over (1.1.1f-1ubuntu2.16) ... 2024-08-17T02:20:51.866 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package modemmanager. 2024-08-17T02:20:51.887 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../18-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:20:51.935 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:20:52.160 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-08-17T02:20:52.179 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2024-08-17T02:20:52.210 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2024-08-17T02:20:52.513 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package dump. 2024-08-17T02:20:52.531 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2024-08-17T02:20:52.555 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package wpasupplicant. 2024-08-17T02:20:52.573 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../19-wpasupplicant_2%3a2.9-1ubuntu4.4_amd64.deb ... 2024-08-17T02:20:52.589 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking dump (0.4b46-6) ... 2024-08-17T02:20:52.613 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-08-17T02:20:53.094 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package indent. 2024-08-17T02:20:53.114 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2024-08-17T02:20:53.336 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2024-08-17T02:20:53.611 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package network-manager. 2024-08-17T02:20:53.632 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../20-network-manager_1.22.10-1ubuntu2.4_amd64.deb ... 2024-08-17T02:20:54.004 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-08-17T02:20:54.020 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2024-08-17T02:20:54.046 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking network-manager (1.22.10-1ubuntu2.4) ... 2024-08-17T02:20:54.053 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-08-17T02:20:54.373 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-08-17T02:20:54.392 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.8_amd64.deb ... 2024-08-17T02:20:54.432 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-08-17T02:20:54.743 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-08-17T02:20:54.762 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-08-17T02:20:54.819 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ppp. 2024-08-17T02:20:54.826 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:20:54.837 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../21-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2024-08-17T02:20:55.104 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-08-17T02:20:55.179 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-08-17T02:20:55.196 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:20:55.229 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:20:55.432 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package pptp-linux. 2024-08-17T02:20:55.450 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../22-pptp-linux_1.10.0-1build1_amd64.deb ... 2024-08-17T02:20:55.490 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libmbim-proxy. 2024-08-17T02:20:55.511 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:20:55.515 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2024-08-17T02:20:55.568 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:20:55.868 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package network-manager-pptp. 2024-08-17T02:20:55.885 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../23-network-manager-pptp_1.2.8-2_amd64.deb ... 2024-08-17T02:20:55.926 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-08-17T02:20:55.944 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:20:55.944 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2024-08-17T02:20:55.984 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:20:56.230 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-08-17T02:20:56.249 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../24-usb-modeswitch-data_20191128-3_all.deb ... 2024-08-17T02:20:56.288 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2024-08-17T02:20:56.412 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libndp0:amd64. 2024-08-17T02:20:56.431 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1.1_amd64.deb ... 2024-08-17T02:20:56.470 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-08-17T02:20:56.691 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package usb-modeswitch. 2024-08-17T02:20:56.709 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../25-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2024-08-17T02:20:56.759 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-08-17T02:20:56.764 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libnm0:amd64. 2024-08-17T02:20:56.785 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.4_amd64.deb ... 2024-08-17T02:20:56.814 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-08-17T02:20:57.052 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.23) ... 2024-08-17T02:20:57.251 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-08-17T02:20:57.268 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../14-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:20:57.309 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:20:57.363 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2024-08-17T02:20:57.489 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-08-17T02:20:57.598 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-08-17T02:20:57.705 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libqmi-proxy. 2024-08-17T02:20:57.721 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../15-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:20:57.761 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:20:58.011 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-08-17T02:20:58.011 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-08-17T02:20:58.030 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-08-17T02:20:58.048 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../16-libssl-dev_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-08-17T02:20:58.089 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-08-17T02:20:58.485 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-08-17T02:20:58.611 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2024-08-17T02:20:58.626 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-08-17T02:20:58.644 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../17-libteamdctl0_1.30-1_amd64.deb ... 2024-08-17T02:20:58.709 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2024-08-17T02:20:58.764 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-08-17T02:20:58.879 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2024-08-17T02:20:59.005 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-08-17T02:20:59.198 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-08-17T02:20:59.297 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package modemmanager. 2024-08-17T02:20:59.315 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../18-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:20:59.366 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:21:00.028 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package wpasupplicant. 2024-08-17T02:21:00.049 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../19-wpasupplicant_2%3a2.9-1ubuntu4.4_amd64.deb ... 2024-08-17T02:21:00.086 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-08-17T02:21:00.502 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2024-08-17T02:21:00.667 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package network-manager. 2024-08-17T02:21:00.687 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../20-network-manager_1.22.10-1ubuntu2.4_amd64.deb ... 2024-08-17T02:21:00.739 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up dump (0.4b46-6) ... 2024-08-17T02:21:00.752 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking network-manager (1.22.10-1ubuntu2.4) ... 2024-08-17T02:21:00.833 INFO:teuthology.orchestra.run.smithi117.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-08-17T02:21:00.898 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:21:01.041 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-08-17T02:21:01.175 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2024-08-17T02:21:01.302 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-08-17T02:21:01.453 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-08-17T02:21:01.578 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:21:01.582 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package ppp. 2024-08-17T02:21:01.599 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../21-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2024-08-17T02:21:01.688 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:21:01.814 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2024-08-17T02:21:01.865 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-08-17T02:21:01.981 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:21:02.132 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up network-manager (1.22.10-1ubuntu2.4) ... 2024-08-17T02:21:02.204 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package pptp-linux. 2024-08-17T02:21:02.221 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../22-pptp-linux_1.10.0-1build1_amd64.deb ... 2024-08-17T02:21:02.262 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2024-08-17T02:21:02.691 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package network-manager-pptp. 2024-08-17T02:21:02.708 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../23-network-manager-pptp_1.2.8-2_amd64.deb ... 2024-08-17T02:21:02.766 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2024-08-17T02:21:02.810 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-17T02:21:02.810 INFO:teuthology.orchestra.run.smithi117.stdout:The following network interfaces were found in /etc/network/interfaces 2024-08-17T02:21:02.810 INFO:teuthology.orchestra.run.smithi117.stdout:which means they are currently configured by ifupdown: 2024-08-17T02:21:02.810 INFO:teuthology.orchestra.run.smithi117.stdout:- enp3s0f1 2024-08-17T02:21:02.810 INFO:teuthology.orchestra.run.smithi117.stdout:If you want to manage those interfaces with NetworkManager instead 2024-08-17T02:21:02.810 INFO:teuthology.orchestra.run.smithi117.stdout:remove their configuration from /etc/network/interfaces. 2024-08-17T02:21:02.810 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-17T02:21:02.974 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-08-17T02:21:03.035 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-08-17T02:21:03.054 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../24-usb-modeswitch-data_20191128-3_all.deb ... 2024-08-17T02:21:03.112 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2024-08-17T02:21:03.313 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-08-17T02:21:03.530 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package usb-modeswitch. 2024-08-17T02:21:03.548 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../25-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2024-08-17T02:21:03.598 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-08-17T02:21:03.862 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-08-17T02:21:04.072 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.23) ... 2024-08-17T02:21:04.344 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:21:04.445 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2024-08-17T02:21:04.470 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2024-08-17T02:21:04.596 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-08-17T02:21:04.613 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:21:04.722 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-08-17T02:21:04.739 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:21:04.978 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:21:05.125 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:21:05.170 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-08-17T02:21:05.170 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-08-17T02:21:05.395 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-08-17T02:21:05.395 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-08-17T02:21:05.633 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-08-17T02:21:05.759 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2024-08-17T02:21:05.910 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-08-17T02:21:05.952 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2024-08-17T02:21:06.036 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2024-08-17T02:21:06.061 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-08-17T02:21:06.162 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-08-17T02:21:06.187 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-08-17T02:21:06.305 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-08-17T02:21:06.313 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-08-17T02:21:06.590 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-08-17T02:21:07.373 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2024-08-17T02:21:07.596 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up dump (0.4b46-6) ... 2024-08-17T02:21:07.714 INFO:teuthology.orchestra.run.smithi104.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-08-17T02:21:07.779 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:21:07.939 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-08-17T02:21:08.065 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2024-08-17T02:21:08.232 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-08-17T02:21:08.409 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-08-17T02:21:08.568 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:21:08.728 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:21:08.853 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2024-08-17T02:21:09.046 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:21:09.172 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up network-manager (1.22.10-1ubuntu2.4) ... 2024-08-17T02:21:10.073 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:21:10.073 INFO:teuthology.orchestra.run.smithi104.stdout:The following network interfaces were found in /etc/network/interfaces 2024-08-17T02:21:10.073 INFO:teuthology.orchestra.run.smithi104.stdout:which means they are currently configured by ifupdown: 2024-08-17T02:21:10.074 INFO:teuthology.orchestra.run.smithi104.stdout:- enp3s0f1 2024-08-17T02:21:10.074 INFO:teuthology.orchestra.run.smithi104.stdout:If you want to manage those interfaces with NetworkManager instead 2024-08-17T02:21:10.074 INFO:teuthology.orchestra.run.smithi104.stdout:remove their configuration from /etc/network/interfaces. 2024-08-17T02:21:10.074 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:21:10.234 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-08-17T02:21:10.559 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-08-17T02:21:10.584 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2024-08-17T02:21:10.684 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2024-08-17T02:21:11.070 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-08-17T02:21:11.525 INFO:teuthology.orchestra.run.smithi117.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-17T02:21:11.530 DEBUG:teuthology.parallel:result is None 2024-08-17T02:21:11.553 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:21:11.729 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2024-08-17T02:21:11.888 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:21:12.014 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:21:12.181 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:21:12.307 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:21:12.607 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-08-17T02:21:12.607 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-08-17T02:21:13.139 INFO:teuthology.orchestra.run.smithi104.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2024-08-17T02:21:13.253 INFO:teuthology.orchestra.run.smithi104.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-08-17T02:21:13.400 INFO:teuthology.orchestra.run.smithi104.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-08-17T02:21:13.555 INFO:teuthology.orchestra.run.smithi104.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-08-17T02:21:13.831 INFO:teuthology.orchestra.run.smithi104.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-08-17T02:21:17.767 INFO:teuthology.orchestra.run.smithi104.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2024-08-17T02:21:17.867 INFO:teuthology.orchestra.run.smithi104.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2024-08-17T02:21:18.765 INFO:teuthology.orchestra.run.smithi104.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-17T02:21:18.770 DEBUG:teuthology.parallel:result is None 2024-08-17T02:21:18.771 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:21:18.913 DEBUG:teuthology.orchestra.run.smithi104:> dpkg-query -W -f '${Version}' ceph 2024-08-17T02:21:18.937 INFO:teuthology.orchestra.run.smithi104.stdout:17.2.7-1375-g2577e813-1focal 2024-08-17T02:21:18.938 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1375-g2577e813-1focal 2024-08-17T02:21:18.938 INFO:teuthology.task.install:The correct ceph version 17.2.7-1375-g2577e813-1focal is installed. 2024-08-17T02:21:18.940 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:21:19.080 DEBUG:teuthology.orchestra.run.smithi117:> dpkg-query -W -f '${Version}' ceph 2024-08-17T02:21:19.103 INFO:teuthology.orchestra.run.smithi117.stdout:17.2.7-1375-g2577e813-1focal 2024-08-17T02:21:19.104 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1375-g2577e813-1focal 2024-08-17T02:21:19.104 INFO:teuthology.task.install:The correct ceph version 17.2.7-1375-g2577e813-1focal is installed. 2024-08-17T02:21:19.106 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-17T02:21:19.106 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-08-17T02:21:19.106 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-17T02:21:19.122 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-17T02:21:19.122 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-17T02:21:19.160 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-17T02:21:19.160 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-08-17T02:21:19.160 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/usr/bin/daemon-helper 2024-08-17T02:21:19.179 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-17T02:21:19.191 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-17T02:21:19.191 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/daemon-helper 2024-08-17T02:21:19.208 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-17T02:21:19.217 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-17T02:21:19.218 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-08-17T02:21:19.218 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-17T02:21:19.245 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-17T02:21:19.259 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-17T02:21:19.259 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-17T02:21:19.275 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-17T02:21:19.287 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-17T02:21:19.287 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-08-17T02:21:19.287 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/usr/bin/stdin-killer 2024-08-17T02:21:19.303 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-17T02:21:19.314 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-17T02:21:19.315 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/stdin-killer 2024-08-17T02:21:19.329 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-17T02:21:19.388 INFO:teuthology.run_tasks:Running task ceph... 2024-08-17T02:21:19.463 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-08-17T02:21:19.463 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 777 /var/log/ceph 2024-08-17T02:21:19.473 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 777 /var/log/ceph 2024-08-17T02:21:19.492 INFO:tasks.ceph:Disabling ceph logrotate... 2024-08-17T02:21:19.493 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-17T02:21:19.497 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-17T02:21:19.510 INFO:tasks.ceph:Creating extra log directories... 2024-08-17T02:21:19.511 DEBUG:teuthology.orchestra.run.smithi104:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-17T02:21:19.556 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-17T02:21:19.606 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-08-17T02:21:19.606 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-08-17T02:21:19.606 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-08-17T02:21:19.606 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-08-17T02:21:19.606 DEBUG:teuthology.orchestra.run.smithi104:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-17T02:21:19.668 DEBUG:teuthology.orchestra.run.smithi104:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-17T02:21:19.708 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-17T02:21:19.708 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-17T02:21:19.716 DEBUG:teuthology.orchestra.run.smithi117:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-17T02:21:19.772 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-08-17T02:21:19.772 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-08-17T02:21:19.772 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858240', 'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}}', 'email': 'mchangir@redhat.com', 'first_in_suite': False, 'job_id': '7858240', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, 'owner': 'scheduled_mchangir@teuthology', 'priority': 25, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 5995, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'targets': {'smithi104.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi117.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestVolumes', 'tasks.cephfs.test_volumes.TestSubvolumeGroups', 'tasks.cephfs.test_volumes.TestSubvolumes']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '67db276914d29505c9707d04f3a3b8fb9d8aee4b', 'timestamp': '2024-08-17_01:02:08', 'tube': 'smithi', 'user': 'mchangir', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-08-17T02:21:19.773 DEBUG:teuthology.orchestra.run.smithi104:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-17T02:21:19.775 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-17T02:21:19.820 DEBUG:teuthology.orchestra.run.smithi104:> sudo install -d -m0777 -- /var/run/ceph 2024-08-17T02:21:19.822 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -d -m0777 -- /var/run/ceph 2024-08-17T02:21:19.837 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-08-17T02:21:19.837 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/scratch_devs of=/dev/stdout 2024-08-17T02:21:19.886 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-17T02:21:19.887 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_1 2024-08-17T02:21:19.895 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-17T02:21:19.895 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:21:19.895 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 6h/6d Inode: 361 Links: 1 2024-08-17T02:21:19.895 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:21:19.895 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-08-17 02:16:51.186891050 +0000 2024-08-17T02:21:19.895 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-08-17 02:16:50.982895755 +0000 2024-08-17T02:21:19.895 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-08-17 02:16:50.982895755 +0000 2024-08-17T02:21:19.895 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: - 2024-08-17T02:21:19.896 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-17T02:21:19.910 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-08-17T02:21:19.910 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-08-17T02:21:19.910 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.00042755 s, 1.2 MB/s 2024-08-17T02:21:19.912 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-17T02:21:19.964 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_2 2024-08-17T02:21:19.972 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-17T02:21:19.972 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:21:19.973 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 6h/6d Inode: 365 Links: 1 2024-08-17T02:21:19.973 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:21:19.973 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-08-17 02:16:51.606881365 +0000 2024-08-17T02:21:19.973 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-08-17 02:16:51.422885608 +0000 2024-08-17T02:21:19.973 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-08-17 02:16:51.422885608 +0000 2024-08-17T02:21:19.973 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: - 2024-08-17T02:21:19.974 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-17T02:21:19.990 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-08-17T02:21:19.991 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-08-17T02:21:19.991 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000402421 s, 1.3 MB/s 2024-08-17T02:21:19.991 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-17T02:21:20.040 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_3 2024-08-17T02:21:20.049 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-17T02:21:20.049 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:21:20.049 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 6h/6d Inode: 373 Links: 1 2024-08-17T02:21:20.049 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:21:20.049 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-08-17 02:16:52.046871218 +0000 2024-08-17T02:21:20.049 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-08-17 02:16:51.826876291 +0000 2024-08-17T02:21:20.049 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-08-17 02:16:51.826876291 +0000 2024-08-17T02:21:20.050 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: - 2024-08-17T02:21:20.050 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-17T02:21:20.111 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-08-17T02:21:20.111 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-08-17T02:21:20.111 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.00043045 s, 1.2 MB/s 2024-08-17T02:21:20.112 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-17T02:21:20.120 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_4 2024-08-17T02:21:20.175 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-17T02:21:20.175 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:21:20.175 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 6h/6d Inode: 379 Links: 1 2024-08-17T02:21:20.176 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:21:20.176 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-08-17 02:16:52.466861532 +0000 2024-08-17T02:21:20.176 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-08-17 02:16:52.274865960 +0000 2024-08-17T02:21:20.176 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-08-17 02:16:52.274865960 +0000 2024-08-17T02:21:20.176 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: - 2024-08-17T02:21:20.176 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-17T02:21:20.187 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-08-17T02:21:20.187 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-08-17T02:21:20.187 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000372076 s, 1.4 MB/s 2024-08-17T02:21:20.189 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-17T02:21:20.198 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:21:20.198 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-17T02:21:20.198 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/scratch_devs of=/dev/stdout 2024-08-17T02:21:20.206 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-17T02:21:20.207 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_1 2024-08-17T02:21:20.214 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-17T02:21:20.215 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:21:20.215 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 6h/6d Inode: 361 Links: 1 2024-08-17T02:21:20.215 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:21:20.215 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-08-17 02:16:40.833097563 +0000 2024-08-17T02:21:20.215 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-08-17 02:16:40.605102821 +0000 2024-08-17T02:21:20.215 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-08-17 02:16:40.605102821 +0000 2024-08-17T02:21:20.215 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2024-08-17T02:21:20.215 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-17T02:21:20.227 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-08-17T02:21:20.227 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-08-17T02:21:20.227 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000416414 s, 1.2 MB/s 2024-08-17T02:21:20.228 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-17T02:21:20.278 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_2 2024-08-17T02:21:20.286 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-17T02:21:20.286 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:21:20.287 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 6h/6d Inode: 368 Links: 1 2024-08-17T02:21:20.287 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:21:20.287 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-08-17 02:16:41.241088154 +0000 2024-08-17T02:21:20.287 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-08-17 02:16:41.061092305 +0000 2024-08-17T02:21:20.287 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-08-17 02:16:41.061092305 +0000 2024-08-17T02:21:20.287 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2024-08-17T02:21:20.287 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-17T02:21:20.302 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-08-17T02:21:20.302 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-08-17T02:21:20.302 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000409187 s, 1.3 MB/s 2024-08-17T02:21:20.306 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-17T02:21:20.315 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_3 2024-08-17T02:21:20.322 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-17T02:21:20.323 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:21:20.323 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 6h/6d Inode: 374 Links: 1 2024-08-17T02:21:20.323 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:21:20.323 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-08-17 02:16:41.649078746 +0000 2024-08-17T02:21:20.323 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-08-17 02:16:41.461083081 +0000 2024-08-17T02:21:20.323 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-08-17 02:16:41.461083081 +0000 2024-08-17T02:21:20.323 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2024-08-17T02:21:20.324 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-17T02:21:20.378 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-08-17T02:21:20.378 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-08-17T02:21:20.378 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000425151 s, 1.2 MB/s 2024-08-17T02:21:20.379 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-17T02:21:20.387 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_4 2024-08-17T02:21:20.394 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-17T02:21:20.394 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:21:20.394 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 6h/6d Inode: 380 Links: 1 2024-08-17T02:21:20.394 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:21:20.394 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-08-17 02:16:42.077068875 +0000 2024-08-17T02:21:20.394 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-08-17 02:16:41.861073856 +0000 2024-08-17T02:21:20.395 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-08-17 02:16:41.861073856 +0000 2024-08-17T02:21:20.395 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2024-08-17T02:21:20.395 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-17T02:21:20.409 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-08-17T02:21:20.409 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-08-17T02:21:20.409 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000396822 s, 1.3 MB/s 2024-08-17T02:21:20.410 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-17T02:21:20.419 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:21:20.419 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi104.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi117.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-17T02:21:20.419 INFO:tasks.ceph:Generating config... 2024-08-17T02:21:20.420 INFO:tasks.ceph:[client] client mount timeout = 600 2024-08-17T02:21:20.420 INFO:tasks.ceph:[client] debug client = 20 2024-08-17T02:21:20.420 INFO:tasks.ceph:[client] debug ms = 1 2024-08-17T02:21:20.420 INFO:tasks.ceph:[client] pid file = 2024-08-17T02:21:20.421 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-08-17T02:21:20.421 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-08-17T02:21:20.421 INFO:tasks.ceph:[mds] debug mds = 20 2024-08-17T02:21:20.421 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-08-17T02:21:20.421 INFO:tasks.ceph:[mds] debug ms = 1 2024-08-17T02:21:20.421 INFO:tasks.ceph:[mds] mds debug frag = True 2024-08-17T02:21:20.421 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-08-17T02:21:20.421 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-08-17T02:21:20.421 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-08-17T02:21:20.421 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-08-17T02:21:20.421 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-08-17T02:21:20.421 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-08-17T02:21:20.421 INFO:tasks.ceph:[mgr] debug client = 20 2024-08-17T02:21:20.422 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-08-17T02:21:20.422 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-08-17T02:21:20.422 INFO:tasks.ceph:[mgr] debug ms = 1 2024-08-17T02:21:20.422 INFO:tasks.ceph:[mon] debug mon = 20 2024-08-17T02:21:20.422 INFO:tasks.ceph:[mon] debug ms = 1 2024-08-17T02:21:20.422 INFO:tasks.ceph:[mon] debug paxos = 20 2024-08-17T02:21:20.422 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-08-17T02:21:20.422 INFO:tasks.ceph:[osd] bdev async discard = True 2024-08-17T02:21:20.422 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-08-17T02:21:20.422 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-08-17T02:21:20.422 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-08-17T02:21:20.422 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-08-17T02:21:20.422 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-08-17T02:21:20.423 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-08-17T02:21:20.423 INFO:tasks.ceph:[osd] debug ms = 1 2024-08-17T02:21:20.423 INFO:tasks.ceph:[osd] debug osd = 20 2024-08-17T02:21:20.423 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-08-17T02:21:20.423 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-08-17T02:21:20.423 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-08-17T02:21:20.423 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-08-17T02:21:20.423 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-08-17T02:21:20.423 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-08-17T02:21:20.423 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-08-17T02:21:20.423 INFO:tasks.ceph:Setting up mon.a... 2024-08-17T02:21:20.423 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-08-17T02:21:20.457 INFO:teuthology.orchestra.run.smithi104.stdout:creating /etc/ceph/ceph.keyring 2024-08-17T02:21:20.459 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-08-17T02:21:20.491 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:21:20.503 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.104'), ('mon.b', '172.21.15.117'), ('mon.c', '[v2:172.21.15.117:3301,v1:172.21.15.117:6790]')] 2024-08-17T02:21:20.503 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.104,172.21.15.117,[v2:172.21.15.117:3301,v1:172.21.15.117:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-08-17T02:21:20.504 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-08-17T02:21:20.504 DEBUG:teuthology.orchestra.run.smithi104:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-08-17T02:21:20.550 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.104 --add b 172.21.15.117 --addv c '[v2:172.21.15.117:3301,v1:172.21.15.117:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:21:20.587 INFO:teuthology.orchestra.run.smithi104.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:21:20.587 INFO:teuthology.orchestra.run.smithi104.stdout:monmaptool: generated fsid fd5f7fb8-d34b-49bb-89a8-62b7dad1bc25 2024-08-17T02:21:20.588 INFO:teuthology.orchestra.run.smithi104.stdout:setting min_mon_release = octopus 2024-08-17T02:21:20.588 INFO:teuthology.orchestra.run.smithi104.stdout:epoch 0 2024-08-17T02:21:20.588 INFO:teuthology.orchestra.run.smithi104.stdout:fsid fd5f7fb8-d34b-49bb-89a8-62b7dad1bc25 2024-08-17T02:21:20.588 INFO:teuthology.orchestra.run.smithi104.stdout:last_changed 2024-08-17T02:21:20.585744+0000 2024-08-17T02:21:20.588 INFO:teuthology.orchestra.run.smithi104.stdout:created 2024-08-17T02:21:20.585744+0000 2024-08-17T02:21:20.588 INFO:teuthology.orchestra.run.smithi104.stdout:min_mon_release 15 (octopus) 2024-08-17T02:21:20.588 INFO:teuthology.orchestra.run.smithi104.stdout:election_strategy: 1 2024-08-17T02:21:20.588 INFO:teuthology.orchestra.run.smithi104.stdout:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-08-17T02:21:20.588 INFO:teuthology.orchestra.run.smithi104.stdout:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-08-17T02:21:20.588 INFO:teuthology.orchestra.run.smithi104.stdout:2: [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] mon.c 2024-08-17T02:21:20.588 INFO:teuthology.orchestra.run.smithi104.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-08-17T02:21:20.589 DEBUG:teuthology.orchestra.run.smithi104:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-08-17T02:21:20.594 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID fd5f7fb8-d34b-49bb-89a8-62b7dad1bc25... 2024-08-17T02:21:20.596 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-17T02:21:20.599 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-17T02:21:20.631 INFO:teuthology.orchestra.run.smithi104.stdout:[global] 2024-08-17T02:21:20.632 INFO:teuthology.orchestra.run.smithi104.stdout: chdir = "" 2024-08-17T02:21:20.632 INFO:teuthology.orchestra.run.smithi104.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-17T02:21:20.632 INFO:teuthology.orchestra.run.smithi104.stdout: auth supported = cephx 2024-08-17T02:21:20.632 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:21:20.632 INFO:teuthology.orchestra.run.smithi104.stdout: filestore xattr use omap = true 2024-08-17T02:21:20.632 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:21:20.632 INFO:teuthology.orchestra.run.smithi104.stdout: mon clock drift allowed = 1.000 2024-08-17T02:21:20.632 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:21:20.632 INFO:teuthology.orchestra.run.smithi104.stdout: osd crush chooseleaf type = 0 2024-08-17T02:21:20.632 INFO:teuthology.orchestra.run.smithi104.stdout: auth debug = true 2024-08-17T02:21:20.632 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:21:20.633 INFO:teuthology.orchestra.run.smithi104.stdout: ms die on old message = true 2024-08-17T02:21:20.633 INFO:teuthology.orchestra.run.smithi104.stdout: ms die on bug = true 2024-08-17T02:21:20.633 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:21:20.633 INFO:teuthology.orchestra.run.smithi104.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-17T02:21:20.633 INFO:teuthology.orchestra.run.smithi104.stdout: mon pg warn max object skew = 0 2024-08-17T02:21:20.633 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:21:20.633 INFO:teuthology.orchestra.run.smithi104.stdout: # disable pg_autoscaler by default for new pools 2024-08-17T02:21:20.633 INFO:teuthology.orchestra.run.smithi104.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-17T02:21:20.633 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:21:20.633 INFO:teuthology.orchestra.run.smithi104.stdout: osd pool default size = 2 2024-08-17T02:21:20.633 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:21:20.634 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd allow primary affinity = true 2024-08-17T02:21:20.634 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd allow pg remap = true 2024-08-17T02:21:20.634 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on legacy crush tunables = false 2024-08-17T02:21:20.634 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on crush straw calc version zero = false 2024-08-17T02:21:20.634 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on no sortbitwise = false 2024-08-17T02:21:20.634 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on osd down out interval zero = false 2024-08-17T02:21:20.634 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on too few osds = false 2024-08-17T02:21:20.634 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-17T02:21:20.634 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-17T02:21:20.634 INFO:teuthology.orchestra.run.smithi104.stdout: mon_allow_pool_size_one = true 2024-08-17T02:21:20.634 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:21:20.634 INFO:teuthology.orchestra.run.smithi104.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-17T02:21:20.635 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:21:20.635 INFO:teuthology.orchestra.run.smithi104.stdout: osd default data pool replay window = 5 2024-08-17T02:21:20.635 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:21:20.635 INFO:teuthology.orchestra.run.smithi104.stdout: mon allow pool delete = true 2024-08-17T02:21:20.635 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:21:20.635 INFO:teuthology.orchestra.run.smithi104.stdout: mon cluster log file level = debug 2024-08-17T02:21:20.635 INFO:teuthology.orchestra.run.smithi104.stdout: debug asserts on shutdown = true 2024-08-17T02:21:20.635 INFO:teuthology.orchestra.run.smithi104.stdout: mon health detail to clog = false 2024-08-17T02:21:20.636 INFO:teuthology.orchestra.run.smithi104.stdout: mon host = "172.21.15.104,172.21.15.117,[v2:172.21.15.117:3301,v1:172.21.15.117:6790]" 2024-08-17T02:21:20.636 INFO:teuthology.orchestra.run.smithi104.stdout: fsid = fd5f7fb8-d34b-49bb-89a8-62b7dad1bc25 2024-08-17T02:21:20.636 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:21:20.636 INFO:teuthology.orchestra.run.smithi104.stdout:[osd] 2024-08-17T02:21:20.636 INFO:teuthology.orchestra.run.smithi104.stdout: osd journal size = 100 2024-08-17T02:21:20.636 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:21:20.636 INFO:teuthology.orchestra.run.smithi104.stdout: osd scrub load threshold = 5.0 2024-08-17T02:21:20.636 INFO:teuthology.orchestra.run.smithi104.stdout: osd scrub max interval = 600 2024-08-17T02:21:20.636 INFO:teuthology.orchestra.run.smithi104.stdout: osd mclock profile = high_recovery_ops 2024-08-17T02:21:20.636 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:21:20.637 INFO:teuthology.orchestra.run.smithi104.stdout: osd recover clone overlap = true 2024-08-17T02:21:20.637 INFO:teuthology.orchestra.run.smithi104.stdout: osd recovery max chunk = 1048576 2024-08-17T02:21:20.637 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:21:20.637 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug shutdown = true 2024-08-17T02:21:20.637 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug op order = true 2024-08-17T02:21:20.637 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug verify stray on activate = true 2024-08-17T02:21:20.637 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:21:20.637 INFO:teuthology.orchestra.run.smithi104.stdout: osd open classes on start = true 2024-08-17T02:21:20.637 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug pg log writeout = true 2024-08-17T02:21:20.637 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:21:20.637 INFO:teuthology.orchestra.run.smithi104.stdout: osd deep scrub update digest min age = 30 2024-08-17T02:21:20.637 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:21:20.637 INFO:teuthology.orchestra.run.smithi104.stdout: osd map max advance = 10 2024-08-17T02:21:20.638 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:21:20.638 INFO:teuthology.orchestra.run.smithi104.stdout: journal zero on create = true 2024-08-17T02:21:20.638 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:21:20.638 INFO:teuthology.orchestra.run.smithi104.stdout: filestore ondisk finisher threads = 3 2024-08-17T02:21:20.638 INFO:teuthology.orchestra.run.smithi104.stdout: filestore apply finisher threads = 3 2024-08-17T02:21:20.638 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:21:20.638 INFO:teuthology.orchestra.run.smithi104.stdout: bdev debug aio = true 2024-08-17T02:21:20.638 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug misdirected ops = true 2024-08-17T02:21:20.638 INFO:teuthology.orchestra.run.smithi104.stdout: bdev async discard = True 2024-08-17T02:21:20.639 INFO:teuthology.orchestra.run.smithi104.stdout: bdev enable discard = True 2024-08-17T02:21:20.639 INFO:teuthology.orchestra.run.smithi104.stdout: bluestore allocator = bitmap 2024-08-17T02:21:20.639 INFO:teuthology.orchestra.run.smithi104.stdout: bluestore block size = 96636764160 2024-08-17T02:21:20.639 INFO:teuthology.orchestra.run.smithi104.stdout: bluestore fsck on mount = True 2024-08-17T02:21:20.639 INFO:teuthology.orchestra.run.smithi104.stdout: debug bluefs = 1/20 2024-08-17T02:21:20.639 INFO:teuthology.orchestra.run.smithi104.stdout: debug bluestore = 1/20 2024-08-17T02:21:20.639 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2024-08-17T02:21:20.639 INFO:teuthology.orchestra.run.smithi104.stdout: debug osd = 20 2024-08-17T02:21:20.639 INFO:teuthology.orchestra.run.smithi104.stdout: debug rocksdb = 4/10 2024-08-17T02:21:20.639 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd backfillfull_ratio = 0.85 2024-08-17T02:21:20.639 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd full ratio = 0.9 2024-08-17T02:21:20.639 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd nearfull ratio = 0.8 2024-08-17T02:21:20.640 INFO:teuthology.orchestra.run.smithi104.stdout: osd failsafe full ratio = 0.95 2024-08-17T02:21:20.640 INFO:teuthology.orchestra.run.smithi104.stdout: osd objectstore = bluestore 2024-08-17T02:21:20.640 INFO:teuthology.orchestra.run.smithi104.stdout: osd op complaint time = 180 2024-08-17T02:21:20.640 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:21:20.640 INFO:teuthology.orchestra.run.smithi104.stdout:[mgr] 2024-08-17T02:21:20.640 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2024-08-17T02:21:20.640 INFO:teuthology.orchestra.run.smithi104.stdout: debug mgr = 20 2024-08-17T02:21:20.640 INFO:teuthology.orchestra.run.smithi104.stdout: debug mon = 20 2024-08-17T02:21:20.640 INFO:teuthology.orchestra.run.smithi104.stdout: debug auth = 20 2024-08-17T02:21:20.640 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:21:20.640 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:21:20.640 INFO:teuthology.orchestra.run.smithi104.stdout: mgr/telemetry/nag = false 2024-08-17T02:21:20.640 INFO:teuthology.orchestra.run.smithi104.stdout: debug client = 20 2024-08-17T02:21:20.641 INFO:teuthology.orchestra.run.smithi104.stdout: debug finisher = 20 2024-08-17T02:21:20.641 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:21:20.641 INFO:teuthology.orchestra.run.smithi104.stdout:[mon] 2024-08-17T02:21:20.641 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2024-08-17T02:21:20.641 INFO:teuthology.orchestra.run.smithi104.stdout: debug mon = 20 2024-08-17T02:21:20.641 INFO:teuthology.orchestra.run.smithi104.stdout: debug paxos = 20 2024-08-17T02:21:20.641 INFO:teuthology.orchestra.run.smithi104.stdout: debug auth = 20 2024-08-17T02:21:20.641 INFO:teuthology.orchestra.run.smithi104.stdout: mon data avail warn = 5 2024-08-17T02:21:20.641 INFO:teuthology.orchestra.run.smithi104.stdout: mon mgr mkfs grace = 240 2024-08-17T02:21:20.641 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:21:20.641 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd reporter subtree level = osd 2024-08-17T02:21:20.641 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd prime pg temp = true 2024-08-17T02:21:20.641 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:21:20.641 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:21:20.642 INFO:teuthology.orchestra.run.smithi104.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-17T02:21:20.642 INFO:teuthology.orchestra.run.smithi104.stdout: auth mon ticket ttl = 660 # 11m 2024-08-17T02:21:20.642 INFO:teuthology.orchestra.run.smithi104.stdout: auth service ticket ttl = 240 # 4m 2024-08-17T02:21:20.642 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:21:20.642 INFO:teuthology.orchestra.run.smithi104.stdout: # don't complain about insecure global_id in the test suite 2024-08-17T02:21:20.642 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-17T02:21:20.642 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-17T02:21:20.642 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:21:20.642 INFO:teuthology.orchestra.run.smithi104.stdout: # 1m isn't quite enough 2024-08-17T02:21:20.642 INFO:teuthology.orchestra.run.smithi104.stdout: mon_down_mkfs_grace = 2m 2024-08-17T02:21:20.642 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:21:20.642 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_filestore_osds = false 2024-08-17T02:21:20.643 INFO:teuthology.orchestra.run.smithi104.stdout: mon op complaint time = 120 2024-08-17T02:21:20.643 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:21:20.643 INFO:teuthology.orchestra.run.smithi104.stdout:[client] 2024-08-17T02:21:20.643 INFO:teuthology.orchestra.run.smithi104.stdout: rgw cache enabled = true 2024-08-17T02:21:20.643 INFO:teuthology.orchestra.run.smithi104.stdout: rgw enable ops log = true 2024-08-17T02:21:20.643 INFO:teuthology.orchestra.run.smithi104.stdout: rgw enable usage log = true 2024-08-17T02:21:20.643 INFO:teuthology.orchestra.run.smithi104.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-17T02:21:20.643 INFO:teuthology.orchestra.run.smithi104.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-17T02:21:20.643 INFO:teuthology.orchestra.run.smithi104.stdout: client mount timeout = 600 2024-08-17T02:21:20.643 INFO:teuthology.orchestra.run.smithi104.stdout: debug client = 20 2024-08-17T02:21:20.643 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2024-08-17T02:21:20.643 INFO:teuthology.orchestra.run.smithi104.stdout: pid file = "" 2024-08-17T02:21:20.643 INFO:teuthology.orchestra.run.smithi104.stdout: rados mon op timeout = 900 2024-08-17T02:21:20.644 INFO:teuthology.orchestra.run.smithi104.stdout: rados osd op timeout = 900 2024-08-17T02:21:20.644 INFO:teuthology.orchestra.run.smithi104.stdout:[mon.a] 2024-08-17T02:21:20.644 INFO:teuthology.orchestra.run.smithi104.stdout:[mon.b] 2024-08-17T02:21:20.644 INFO:teuthology.orchestra.run.smithi104.stdout:[mon.c] 2024-08-17T02:21:20.644 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.a] 2024-08-17T02:21:20.644 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.c] 2024-08-17T02:21:20.644 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.b] 2024-08-17T02:21:20.644 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.d] 2024-08-17T02:21:20.644 INFO:teuthology.orchestra.run.smithi104.stdout:[mds] 2024-08-17T02:21:20.644 INFO:teuthology.orchestra.run.smithi104.stdout: debug mds = 20 2024-08-17T02:21:20.644 INFO:teuthology.orchestra.run.smithi104.stdout: debug mds balancer = 20 2024-08-17T02:21:20.644 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2024-08-17T02:21:20.645 INFO:teuthology.orchestra.run.smithi104.stdout: mds debug frag = True 2024-08-17T02:21:20.645 INFO:teuthology.orchestra.run.smithi104.stdout: mds debug scatterstat = True 2024-08-17T02:21:20.645 INFO:teuthology.orchestra.run.smithi104.stdout: mds op complaint time = 180 2024-08-17T02:21:20.645 INFO:teuthology.orchestra.run.smithi104.stdout: mds verify scatter = True 2024-08-17T02:21:20.645 INFO:teuthology.orchestra.run.smithi104.stdout: osd op complaint time = 180 2024-08-17T02:21:20.645 INFO:teuthology.orchestra.run.smithi104.stdout: rados mon op timeout = 900 2024-08-17T02:21:20.645 INFO:teuthology.orchestra.run.smithi104.stdout: rados osd op timeout = 900 2024-08-17T02:21:20.647 INFO:teuthology.orchestra.run.smithi117.stdout:[global] 2024-08-17T02:21:20.647 INFO:teuthology.orchestra.run.smithi117.stdout: chdir = "" 2024-08-17T02:21:20.647 INFO:teuthology.orchestra.run.smithi117.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-17T02:21:20.647 INFO:teuthology.orchestra.run.smithi117.stdout: auth supported = cephx 2024-08-17T02:21:20.647 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-17T02:21:20.647 INFO:teuthology.orchestra.run.smithi117.stdout: filestore xattr use omap = true 2024-08-17T02:21:20.648 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-17T02:21:20.648 INFO:teuthology.orchestra.run.smithi117.stdout: mon clock drift allowed = 1.000 2024-08-17T02:21:20.648 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-17T02:21:20.648 INFO:teuthology.orchestra.run.smithi117.stdout: osd crush chooseleaf type = 0 2024-08-17T02:21:20.648 INFO:teuthology.orchestra.run.smithi117.stdout: auth debug = true 2024-08-17T02:21:20.648 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-17T02:21:20.648 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on old message = true 2024-08-17T02:21:20.648 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on bug = true 2024-08-17T02:21:20.648 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-17T02:21:20.648 INFO:teuthology.orchestra.run.smithi117.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-17T02:21:20.648 INFO:teuthology.orchestra.run.smithi117.stdout: mon pg warn max object skew = 0 2024-08-17T02:21:20.648 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-17T02:21:20.649 INFO:teuthology.orchestra.run.smithi117.stdout: # disable pg_autoscaler by default for new pools 2024-08-17T02:21:20.649 INFO:teuthology.orchestra.run.smithi117.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-17T02:21:20.649 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-17T02:21:20.649 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default size = 2 2024-08-17T02:21:20.649 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-17T02:21:20.649 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow primary affinity = true 2024-08-17T02:21:20.649 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow pg remap = true 2024-08-17T02:21:20.649 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on legacy crush tunables = false 2024-08-17T02:21:20.649 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on crush straw calc version zero = false 2024-08-17T02:21:20.649 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on no sortbitwise = false 2024-08-17T02:21:20.649 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on osd down out interval zero = false 2024-08-17T02:21:20.650 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on too few osds = false 2024-08-17T02:21:20.650 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-17T02:21:20.650 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-17T02:21:20.650 INFO:teuthology.orchestra.run.smithi117.stdout: mon_allow_pool_size_one = true 2024-08-17T02:21:20.650 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-17T02:21:20.650 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-17T02:21:20.650 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-17T02:21:20.650 INFO:teuthology.orchestra.run.smithi117.stdout: osd default data pool replay window = 5 2024-08-17T02:21:20.650 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-17T02:21:20.650 INFO:teuthology.orchestra.run.smithi117.stdout: mon allow pool delete = true 2024-08-17T02:21:20.650 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-17T02:21:20.650 INFO:teuthology.orchestra.run.smithi117.stdout: mon cluster log file level = debug 2024-08-17T02:21:20.651 INFO:teuthology.orchestra.run.smithi117.stdout: debug asserts on shutdown = true 2024-08-17T02:21:20.651 INFO:teuthology.orchestra.run.smithi117.stdout: mon health detail to clog = false 2024-08-17T02:21:20.651 INFO:teuthology.orchestra.run.smithi117.stdout: mon host = "172.21.15.104,172.21.15.117,[v2:172.21.15.117:3301,v1:172.21.15.117:6790]" 2024-08-17T02:21:20.651 INFO:teuthology.orchestra.run.smithi117.stdout: fsid = fd5f7fb8-d34b-49bb-89a8-62b7dad1bc25 2024-08-17T02:21:20.651 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-17T02:21:20.651 INFO:teuthology.orchestra.run.smithi117.stdout:[osd] 2024-08-17T02:21:20.651 INFO:teuthology.orchestra.run.smithi117.stdout: osd journal size = 100 2024-08-17T02:21:20.651 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-17T02:21:20.651 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub load threshold = 5.0 2024-08-17T02:21:20.651 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub max interval = 600 2024-08-17T02:21:20.651 INFO:teuthology.orchestra.run.smithi117.stdout: osd mclock profile = high_recovery_ops 2024-08-17T02:21:20.651 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-17T02:21:20.651 INFO:teuthology.orchestra.run.smithi117.stdout: osd recover clone overlap = true 2024-08-17T02:21:20.652 INFO:teuthology.orchestra.run.smithi117.stdout: osd recovery max chunk = 1048576 2024-08-17T02:21:20.652 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-17T02:21:20.652 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug shutdown = true 2024-08-17T02:21:20.652 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug op order = true 2024-08-17T02:21:20.652 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug verify stray on activate = true 2024-08-17T02:21:20.652 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-17T02:21:20.652 INFO:teuthology.orchestra.run.smithi117.stdout: osd open classes on start = true 2024-08-17T02:21:20.652 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug pg log writeout = true 2024-08-17T02:21:20.652 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-17T02:21:20.652 INFO:teuthology.orchestra.run.smithi117.stdout: osd deep scrub update digest min age = 30 2024-08-17T02:21:20.652 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-17T02:21:20.652 INFO:teuthology.orchestra.run.smithi117.stdout: osd map max advance = 10 2024-08-17T02:21:20.653 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-17T02:21:20.653 INFO:teuthology.orchestra.run.smithi117.stdout: journal zero on create = true 2024-08-17T02:21:20.653 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-17T02:21:20.653 INFO:teuthology.orchestra.run.smithi117.stdout: filestore ondisk finisher threads = 3 2024-08-17T02:21:20.653 INFO:teuthology.orchestra.run.smithi117.stdout: filestore apply finisher threads = 3 2024-08-17T02:21:20.653 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-17T02:21:20.654 INFO:teuthology.orchestra.run.smithi117.stdout: bdev debug aio = true 2024-08-17T02:21:20.654 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug misdirected ops = true 2024-08-17T02:21:20.654 INFO:teuthology.orchestra.run.smithi117.stdout: bdev async discard = True 2024-08-17T02:21:20.654 INFO:teuthology.orchestra.run.smithi117.stdout: bdev enable discard = True 2024-08-17T02:21:20.654 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore allocator = bitmap 2024-08-17T02:21:20.654 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore block size = 96636764160 2024-08-17T02:21:20.654 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore fsck on mount = True 2024-08-17T02:21:20.654 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluefs = 1/20 2024-08-17T02:21:20.655 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluestore = 1/20 2024-08-17T02:21:20.655 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-08-17T02:21:20.655 INFO:teuthology.orchestra.run.smithi117.stdout: debug osd = 20 2024-08-17T02:21:20.655 INFO:teuthology.orchestra.run.smithi117.stdout: debug rocksdb = 4/10 2024-08-17T02:21:20.655 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd backfillfull_ratio = 0.85 2024-08-17T02:21:20.655 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd full ratio = 0.9 2024-08-17T02:21:20.655 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd nearfull ratio = 0.8 2024-08-17T02:21:20.655 INFO:teuthology.orchestra.run.smithi117.stdout: osd failsafe full ratio = 0.95 2024-08-17T02:21:20.655 INFO:teuthology.orchestra.run.smithi117.stdout: osd objectstore = bluestore 2024-08-17T02:21:20.655 INFO:teuthology.orchestra.run.smithi117.stdout: osd op complaint time = 180 2024-08-17T02:21:20.655 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-17T02:21:20.655 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr] 2024-08-17T02:21:20.656 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-08-17T02:21:20.656 INFO:teuthology.orchestra.run.smithi117.stdout: debug mgr = 20 2024-08-17T02:21:20.656 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2024-08-17T02:21:20.656 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2024-08-17T02:21:20.656 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:21:20.656 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:21:20.656 INFO:teuthology.orchestra.run.smithi117.stdout: mgr/telemetry/nag = false 2024-08-17T02:21:20.656 INFO:teuthology.orchestra.run.smithi117.stdout: debug client = 20 2024-08-17T02:21:20.656 INFO:teuthology.orchestra.run.smithi117.stdout: debug finisher = 20 2024-08-17T02:21:20.657 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-17T02:21:20.657 INFO:teuthology.orchestra.run.smithi117.stdout:[mon] 2024-08-17T02:21:20.657 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-08-17T02:21:20.657 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2024-08-17T02:21:20.657 INFO:teuthology.orchestra.run.smithi117.stdout: debug paxos = 20 2024-08-17T02:21:20.657 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2024-08-17T02:21:20.657 INFO:teuthology.orchestra.run.smithi117.stdout: mon data avail warn = 5 2024-08-17T02:21:20.657 INFO:teuthology.orchestra.run.smithi117.stdout: mon mgr mkfs grace = 240 2024-08-17T02:21:20.657 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:21:20.658 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd reporter subtree level = osd 2024-08-17T02:21:20.658 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd prime pg temp = true 2024-08-17T02:21:20.658 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:21:20.658 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-17T02:21:20.658 INFO:teuthology.orchestra.run.smithi117.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-17T02:21:20.658 INFO:teuthology.orchestra.run.smithi117.stdout: auth mon ticket ttl = 660 # 11m 2024-08-17T02:21:20.658 INFO:teuthology.orchestra.run.smithi117.stdout: auth service ticket ttl = 240 # 4m 2024-08-17T02:21:20.658 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-17T02:21:20.658 INFO:teuthology.orchestra.run.smithi117.stdout: # don't complain about insecure global_id in the test suite 2024-08-17T02:21:20.658 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-17T02:21:20.658 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-17T02:21:20.659 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-17T02:21:20.659 INFO:teuthology.orchestra.run.smithi117.stdout: # 1m isn't quite enough 2024-08-17T02:21:20.659 INFO:teuthology.orchestra.run.smithi117.stdout: mon_down_mkfs_grace = 2m 2024-08-17T02:21:20.659 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-17T02:21:20.659 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_filestore_osds = false 2024-08-17T02:21:20.659 INFO:teuthology.orchestra.run.smithi117.stdout: mon op complaint time = 120 2024-08-17T02:21:20.659 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-17T02:21:20.659 INFO:teuthology.orchestra.run.smithi117.stdout:[client] 2024-08-17T02:21:20.660 INFO:teuthology.orchestra.run.smithi117.stdout: rgw cache enabled = true 2024-08-17T02:21:20.660 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable ops log = true 2024-08-17T02:21:20.660 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable usage log = true 2024-08-17T02:21:20.660 INFO:teuthology.orchestra.run.smithi117.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-17T02:21:20.660 INFO:teuthology.orchestra.run.smithi117.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-17T02:21:20.660 INFO:teuthology.orchestra.run.smithi117.stdout: client mount timeout = 600 2024-08-17T02:21:20.660 INFO:teuthology.orchestra.run.smithi117.stdout: debug client = 20 2024-08-17T02:21:20.660 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-08-17T02:21:20.660 INFO:teuthology.orchestra.run.smithi117.stdout: pid file = "" 2024-08-17T02:21:20.660 INFO:teuthology.orchestra.run.smithi117.stdout: rados mon op timeout = 900 2024-08-17T02:21:20.660 INFO:teuthology.orchestra.run.smithi117.stdout: rados osd op timeout = 900 2024-08-17T02:21:20.660 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.a] 2024-08-17T02:21:20.661 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.b] 2024-08-17T02:21:20.661 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.c] 2024-08-17T02:21:20.661 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.a] 2024-08-17T02:21:20.661 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.c] 2024-08-17T02:21:20.661 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.b] 2024-08-17T02:21:20.661 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.d] 2024-08-17T02:21:20.661 INFO:teuthology.orchestra.run.smithi117.stdout:[mds] 2024-08-17T02:21:20.661 INFO:teuthology.orchestra.run.smithi117.stdout: debug mds = 20 2024-08-17T02:21:20.661 INFO:teuthology.orchestra.run.smithi117.stdout: debug mds balancer = 20 2024-08-17T02:21:20.661 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-08-17T02:21:20.661 INFO:teuthology.orchestra.run.smithi117.stdout: mds debug frag = True 2024-08-17T02:21:20.661 INFO:teuthology.orchestra.run.smithi117.stdout: mds debug scatterstat = True 2024-08-17T02:21:20.661 INFO:teuthology.orchestra.run.smithi117.stdout: mds op complaint time = 180 2024-08-17T02:21:20.661 INFO:teuthology.orchestra.run.smithi117.stdout: mds verify scatter = True 2024-08-17T02:21:20.662 INFO:teuthology.orchestra.run.smithi117.stdout: osd op complaint time = 180 2024-08-17T02:21:20.662 INFO:teuthology.orchestra.run.smithi117.stdout: rados mon op timeout = 900 2024-08-17T02:21:20.662 INFO:teuthology.orchestra.run.smithi117.stdout: rados osd op timeout = 900 2024-08-17T02:21:20.662 INFO:tasks.ceph:Creating admin key on mon.a... 2024-08-17T02:21:20.662 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-08-17T02:21:20.735 INFO:tasks.ceph:Copying monmap to all nodes... 2024-08-17T02:21:20.736 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-08-17T02:21:20.736 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-08-17T02:21:20.743 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-08-17T02:21:20.743 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-08-17T02:21:20.750 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi104.front.sepia.ceph.com 2024-08-17T02:21:20.751 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-08-17T02:21:20.751 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-17T02:21:20.751 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:21:20.819 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-08-17T02:21:20.819 DEBUG:teuthology.orchestra.run.smithi104:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:21:20.824 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi117.front.sepia.ceph.com 2024-08-17T02:21:20.825 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-17T02:21:20.825 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-17T02:21:20.825 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:21:20.852 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-17T02:21:20.853 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:21:20.858 INFO:tasks.ceph:Setting up mon nodes... 2024-08-17T02:21:20.858 INFO:tasks.ceph:Setting up mgr nodes... 2024-08-17T02:21:20.859 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-08-17T02:21:20.912 INFO:teuthology.orchestra.run.smithi104.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-08-17T02:21:20.915 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-08-17T02:21:20.959 INFO:teuthology.orchestra.run.smithi117.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-08-17T02:21:20.961 INFO:tasks.ceph:Setting up mds nodes... 2024-08-17T02:21:20.961 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-08-17T02:21:21.006 INFO:teuthology.orchestra.run.smithi104.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-08-17T02:21:21.008 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-08-17T02:21:21.019 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-08-17T02:21:21.058 INFO:teuthology.orchestra.run.smithi104.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-08-17T02:21:21.061 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-08-17T02:21:21.075 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-08-17T02:21:21.127 INFO:teuthology.orchestra.run.smithi117.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-08-17T02:21:21.127 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-08-17T02:21:21.140 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-08-17T02:21:21.178 INFO:teuthology.orchestra.run.smithi117.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-08-17T02:21:21.181 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-08-17T02:21:21.192 INFO:tasks.ceph_client:Setting up client nodes... 2024-08-17T02:21:21.193 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-17T02:21:21.229 INFO:teuthology.orchestra.run.smithi104.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-08-17T02:21:21.242 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-08-17T02:21:21.275 INFO:teuthology.orchestra.run.smithi104.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-08-17T02:21:21.287 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-08-17T02:21:21.323 INFO:teuthology.orchestra.run.smithi117.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-08-17T02:21:21.336 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-08-17T02:21:21.412 INFO:teuthology.orchestra.run.smithi117.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-08-17T02:21:21.425 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-08-17T02:21:21.425 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi104.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi117.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-17T02:21:21.425 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-08-17T02:21:21.442 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:21:21.442 INFO:tasks.ceph:role: osd.0 2024-08-17T02:21:21.442 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi104.front.sepia.ceph.com 2024-08-17T02:21:21.442 DEBUG:teuthology.orchestra.run.smithi104:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-17T02:21:21.998 INFO:teuthology.orchestra.run.smithi104.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:21:21.998 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:21:21.998 INFO:teuthology.orchestra.run.smithi104.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:21:21.998 INFO:teuthology.orchestra.run.smithi104.stdout: = reflink=1 2024-08-17T02:21:21.998 INFO:teuthology.orchestra.run.smithi104.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:21:21.998 INFO:teuthology.orchestra.run.smithi104.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:21:21.998 INFO:teuthology.orchestra.run.smithi104.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:21:21.998 INFO:teuthology.orchestra.run.smithi104.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:21:21.998 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:21:21.999 INFO:teuthology.orchestra.run.smithi104.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:21:22.000 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi104.front.sepia.ceph.com -o noatime 2024-08-17T02:21:22.000 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-08-17T02:21:22.085 DEBUG:teuthology.orchestra.run.smithi104:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-08-17T02:21:22.098 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:21:22.098 INFO:teuthology.orchestra.run.smithi104.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:21:22.099 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-08-17T02:21:22.109 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:21:22.109 INFO:tasks.ceph:role: osd.1 2024-08-17T02:21:22.109 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi104.front.sepia.ceph.com 2024-08-17T02:21:22.109 DEBUG:teuthology.orchestra.run.smithi104:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-17T02:21:22.687 INFO:teuthology.orchestra.run.smithi104.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:21:22.687 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:21:22.687 INFO:teuthology.orchestra.run.smithi104.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:21:22.687 INFO:teuthology.orchestra.run.smithi104.stdout: = reflink=1 2024-08-17T02:21:22.687 INFO:teuthology.orchestra.run.smithi104.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:21:22.687 INFO:teuthology.orchestra.run.smithi104.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:21:22.687 INFO:teuthology.orchestra.run.smithi104.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:21:22.687 INFO:teuthology.orchestra.run.smithi104.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:21:22.687 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:21:22.687 INFO:teuthology.orchestra.run.smithi104.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:21:22.688 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi104.front.sepia.ceph.com -o noatime 2024-08-17T02:21:22.689 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-08-17T02:21:22.727 DEBUG:teuthology.orchestra.run.smithi104:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-08-17T02:21:22.737 INFO:teuthology.orchestra.run.smithi104.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:21:22.737 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:21:22.738 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-08-17T02:21:22.749 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:21:22.749 INFO:tasks.ceph:role: osd.2 2024-08-17T02:21:22.749 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi104.front.sepia.ceph.com 2024-08-17T02:21:22.749 DEBUG:teuthology.orchestra.run.smithi104:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-17T02:21:23.204 INFO:teuthology.orchestra.run.smithi104.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:21:23.204 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:21:23.204 INFO:teuthology.orchestra.run.smithi104.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:21:23.204 INFO:teuthology.orchestra.run.smithi104.stdout: = reflink=1 2024-08-17T02:21:23.205 INFO:teuthology.orchestra.run.smithi104.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:21:23.205 INFO:teuthology.orchestra.run.smithi104.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:21:23.205 INFO:teuthology.orchestra.run.smithi104.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:21:23.205 INFO:teuthology.orchestra.run.smithi104.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:21:23.205 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:21:23.205 INFO:teuthology.orchestra.run.smithi104.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:21:23.207 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi104.front.sepia.ceph.com -o noatime 2024-08-17T02:21:23.207 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-08-17T02:21:23.267 DEBUG:teuthology.orchestra.run.smithi104:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-08-17T02:21:23.278 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:21:23.279 INFO:teuthology.orchestra.run.smithi104.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:21:23.279 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-08-17T02:21:23.290 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:21:23.290 INFO:tasks.ceph:role: osd.3 2024-08-17T02:21:23.290 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi104.front.sepia.ceph.com 2024-08-17T02:21:23.290 DEBUG:teuthology.orchestra.run.smithi104:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-17T02:21:23.796 INFO:teuthology.orchestra.run.smithi104.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:21:23.796 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:21:23.796 INFO:teuthology.orchestra.run.smithi104.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:21:23.796 INFO:teuthology.orchestra.run.smithi104.stdout: = reflink=1 2024-08-17T02:21:23.796 INFO:teuthology.orchestra.run.smithi104.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:21:23.796 INFO:teuthology.orchestra.run.smithi104.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:21:23.797 INFO:teuthology.orchestra.run.smithi104.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:21:23.797 INFO:teuthology.orchestra.run.smithi104.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:21:23.797 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:21:23.797 INFO:teuthology.orchestra.run.smithi104.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:21:23.798 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi104.front.sepia.ceph.com -o noatime 2024-08-17T02:21:23.798 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-08-17T02:21:23.862 DEBUG:teuthology.orchestra.run.smithi104:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-08-17T02:21:23.873 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:21:23.874 INFO:teuthology.orchestra.run.smithi104.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:21:23.874 DEBUG:teuthology.orchestra.run.smithi104:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:21:23.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:23.942+0000 7f690410b3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-08-17T02:21:23.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:23.942+0000 7f690410b3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-08-17T02:21:23.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:23.942+0000 7f690410b3c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:21:23.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:23.942+0000 7f690410b3c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:21:23.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:23.942+0000 7f690410b3c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:21:23.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:23.942+0000 7f690410b3c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-08-17T02:21:24.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:24.514+0000 7f690410b3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:21:25.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:25.290+0000 7f690410b3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:21:26.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:26.070+0000 7f690410b3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:21:26.928 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-17T02:21:26.941 DEBUG:teuthology.orchestra.run.smithi104:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:21:26.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:26.974+0000 7f825b0e23c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-08-17T02:21:26.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:26.974+0000 7f825b0e23c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-08-17T02:21:26.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:26.974+0000 7f825b0e23c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:21:26.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:26.974+0000 7f825b0e23c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:21:26.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:26.974+0000 7f825b0e23c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:21:26.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:26.974+0000 7f825b0e23c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-08-17T02:21:27.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:27.538+0000 7f825b0e23c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:21:28.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:28.322+0000 7f825b0e23c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:21:29.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:29.102+0000 7f825b0e23c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:21:29.968 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-17T02:21:29.985 DEBUG:teuthology.orchestra.run.smithi104:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:21:30.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:30.066+0000 7f71b6c193c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-08-17T02:21:30.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:30.066+0000 7f71b6c193c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-08-17T02:21:30.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:30.066+0000 7f71b6c193c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:21:30.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:30.066+0000 7f71b6c193c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:21:30.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:30.066+0000 7f71b6c193c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:21:30.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:30.066+0000 7f71b6c193c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-08-17T02:21:30.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:30.638+0000 7f71b6c193c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:21:31.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:31.422+0000 7f71b6c193c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:21:32.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:32.197+0000 7f71b6c193c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:21:33.075 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-17T02:21:33.092 DEBUG:teuthology.orchestra.run.smithi104:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:21:33.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:33.121+0000 7fd40becc3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-08-17T02:21:33.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:33.121+0000 7fd40becc3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-08-17T02:21:33.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:33.121+0000 7fd40becc3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:21:33.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:33.121+0000 7fd40becc3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:21:33.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:33.121+0000 7fd40becc3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:21:33.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:33.121+0000 7fd40becc3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-08-17T02:21:33.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:33.681+0000 7fd40becc3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:21:34.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:34.461+0000 7fd40becc3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:21:35.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:35.241+0000 7fd40becc3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:21:36.099 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-17T02:21:36.156 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-08-17T02:21:36.173 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:21:36.173 INFO:tasks.ceph:role: osd.4 2024-08-17T02:21:36.173 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi117.front.sepia.ceph.com 2024-08-17T02:21:36.173 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-17T02:21:36.694 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:21:36.694 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:21:36.695 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:21:36.695 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 2024-08-17T02:21:36.695 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:21:36.695 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:21:36.695 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:21:36.695 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:21:36.695 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:21:36.695 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:21:36.696 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2024-08-17T02:21:36.697 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-08-17T02:21:36.788 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-08-17T02:21:36.801 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:21:36.801 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:21:36.802 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-08-17T02:21:36.818 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:21:36.818 INFO:tasks.ceph:role: osd.5 2024-08-17T02:21:36.818 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi117.front.sepia.ceph.com 2024-08-17T02:21:36.818 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-17T02:21:37.332 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:21:37.332 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:21:37.332 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:21:37.332 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 2024-08-17T02:21:37.332 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:21:37.332 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:21:37.332 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:21:37.333 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:21:37.333 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:21:37.333 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:21:37.334 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2024-08-17T02:21:37.334 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-08-17T02:21:37.390 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-08-17T02:21:37.402 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:21:37.402 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:21:37.403 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-08-17T02:21:37.412 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:21:37.413 INFO:tasks.ceph:role: osd.6 2024-08-17T02:21:37.413 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi117.front.sepia.ceph.com 2024-08-17T02:21:37.413 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-17T02:21:37.913 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:21:37.913 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:21:37.913 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:21:37.913 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 2024-08-17T02:21:37.913 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:21:37.914 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:21:37.914 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:21:37.914 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:21:37.914 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:21:37.914 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:21:37.915 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2024-08-17T02:21:37.915 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-08-17T02:21:37.971 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-08-17T02:21:37.984 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:21:37.984 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:21:37.985 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-08-17T02:21:37.995 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:21:37.996 INFO:tasks.ceph:role: osd.7 2024-08-17T02:21:37.996 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi117.front.sepia.ceph.com 2024-08-17T02:21:37.996 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-17T02:21:38.510 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:21:38.511 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:21:38.511 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:21:38.511 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 2024-08-17T02:21:38.511 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:21:38.511 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:21:38.511 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:21:38.511 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:21:38.511 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:21:38.511 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:21:38.513 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2024-08-17T02:21:38.513 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-08-17T02:21:38.579 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-08-17T02:21:38.590 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:21:38.590 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:21:38.591 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:21:38.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:38.658+0000 7f13dadc63c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-08-17T02:21:38.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:38.662+0000 7f13dadc63c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-08-17T02:21:38.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:38.662+0000 7f13dadc63c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:21:38.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:38.662+0000 7f13dadc63c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:21:38.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:38.662+0000 7f13dadc63c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:21:38.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:38.662+0000 7f13dadc63c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-08-17T02:21:39.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:39.222+0000 7f13dadc63c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:21:40.010 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:40.006+0000 7f13dadc63c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:21:40.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:40.778+0000 7f13dadc63c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:21:41.633 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-17T02:21:41.651 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:21:41.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:41.682+0000 7fe346ccd3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-08-17T02:21:41.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:41.682+0000 7fe346ccd3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-08-17T02:21:41.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:41.682+0000 7fe346ccd3c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:21:41.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:41.682+0000 7fe346ccd3c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:21:41.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:41.682+0000 7fe346ccd3c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:21:41.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:41.682+0000 7fe346ccd3c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-08-17T02:21:42.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:42.238+0000 7fe346ccd3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:21:43.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:43.026+0000 7fe346ccd3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:21:43.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:43.814+0000 7fe346ccd3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:21:44.665 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-17T02:21:44.726 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:21:44.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:44.762+0000 7fba52d8f3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-08-17T02:21:44.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:44.762+0000 7fba52d8f3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-08-17T02:21:44.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:44.762+0000 7fba52d8f3c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:21:44.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:44.762+0000 7fba52d8f3c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:21:44.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:44.762+0000 7fba52d8f3c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:21:44.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:44.762+0000 7fba52d8f3c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-08-17T02:21:45.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:45.314+0000 7fba52d8f3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:21:46.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:46.098+0000 7fba52d8f3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:21:46.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:46.878+0000 7fba52d8f3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:21:47.741 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-08-17T02:21:47.758 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:21:47.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:47.838+0000 7f4fbee113c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-08-17T02:21:47.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:47.838+0000 7f4fbee113c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-08-17T02:21:47.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:47.838+0000 7f4fbee113c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:21:47.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:47.838+0000 7f4fbee113c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:21:47.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:47.838+0000 7f4fbee113c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:21:47.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:47.838+0000 7f4fbee113c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-08-17T02:21:48.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:48.410+0000 7f4fbee113c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:21:49.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:49.194+0000 7f4fbee113c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:21:49.774 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:21:49.777 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:21:49.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:49.974+0000 7f4fbee113c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:21:50.828 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-08-17T02:21:50.843 INFO:tasks.ceph:Reading keys from all nodes... 2024-08-17T02:21:50.844 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-08-17T02:21:50.844 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-08-17T02:21:50.861 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-08-17T02:21:50.862 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-08-17T02:21:50.877 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-08-17T02:21:50.877 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-08-17T02:21:50.892 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-08-17T02:21:50.892 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-08-17T02:21:50.951 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-08-17T02:21:50.951 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-08-17T02:21:50.961 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-08-17T02:21:50.962 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-08-17T02:21:50.975 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-08-17T02:21:50.975 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-08-17T02:21:51.032 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-17T02:21:51.032 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-08-17T02:21:51.048 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-17T02:21:51.048 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-08-17T02:21:51.060 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-17T02:21:51.060 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-08-17T02:21:51.071 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-17T02:21:51.071 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-08-17T02:21:51.128 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-17T02:21:51.128 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-08-17T02:21:51.139 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-17T02:21:51.140 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-08-17T02:21:51.151 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-17T02:21:51.151 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-08-17T02:21:51.209 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-08-17T02:21:51.209 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-08-17T02:21:51.216 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-08-17T02:21:51.217 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-08-17T02:21:51.224 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-17T02:21:51.224 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-08-17T02:21:51.231 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-17T02:21:51.231 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-08-17T02:21:51.238 INFO:tasks.ceph:Adding keys to all mons... 2024-08-17T02:21:51.238 DEBUG:teuthology.orchestra.run.smithi104:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-17T02:21:51.269 DEBUG:teuthology.orchestra.run.smithi117:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-17T02:21:51.282 INFO:teuthology.orchestra.run.smithi104.stdout:[mgr.y] 2024-08-17T02:21:51.282 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQAgCcBmIPdDNhAAj3Eob8uWRA+tPv6sdo8Dkg== 2024-08-17T02:21:51.282 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.a] 2024-08-17T02:21:51.282 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQAhCcBmDbpBABAAUmID7XhUQDBm+L94n9esyg== 2024-08-17T02:21:51.282 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.c] 2024-08-17T02:21:51.282 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQAhCcBm/udiAxAA1K2ANrUuNmQOfrcynTS+RA== 2024-08-17T02:21:51.282 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.0] 2024-08-17T02:21:51.283 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQAjCcBm/3suOBAAyxBjstycyfsr8beMKRxfKQ== 2024-08-17T02:21:51.283 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.1] 2024-08-17T02:21:51.283 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQAmCcBmea8zOhAAfOPbwQTzP9LmMtt2Jscz3A== 2024-08-17T02:21:51.283 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.2] 2024-08-17T02:21:51.283 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQAqCcBm+CANBBAAWsByvoejX1yztveba17DLA== 2024-08-17T02:21:51.283 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.3] 2024-08-17T02:21:51.283 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQAtCcBmxaFsBxAAjNBy/KSF80ElAuQo+4m7/Q== 2024-08-17T02:21:51.283 INFO:teuthology.orchestra.run.smithi104.stdout:[mgr.x] 2024-08-17T02:21:51.283 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQAgCcBmKT4qORAA8RmWfPRvKrIgatfaJFYcxQ== 2024-08-17T02:21:51.283 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.b] 2024-08-17T02:21:51.283 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQAhCcBmb1J0BxAAT7dMMS4PPwRpwxaG7641ig== 2024-08-17T02:21:51.283 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.d] 2024-08-17T02:21:51.283 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQAhCcBmYJypChAAPoQjjYW497n+RdXMj7dMfg== 2024-08-17T02:21:51.284 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.4] 2024-08-17T02:21:51.284 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQAyCcBmB7CnJxAACtG2PU/jmmUK3uqCry9G8g== 2024-08-17T02:21:51.284 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.5] 2024-08-17T02:21:51.284 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQA1CcBmKR/5KBAA0ru8bq7qKQNgpt0E6rtSOw== 2024-08-17T02:21:51.284 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.6] 2024-08-17T02:21:51.284 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQA4CcBmuaS0LRAAbY5vhocCAXeNKczOWFK13w== 2024-08-17T02:21:51.284 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.7] 2024-08-17T02:21:51.284 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQA7CcBmUZ9HMhAAe+ELd8Y6t2BKg8kojYYMqg== 2024-08-17T02:21:51.285 INFO:teuthology.orchestra.run.smithi104.stdout:[client.0] 2024-08-17T02:21:51.285 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQAhCcBmu02NDRAA0N4TaUHvOE2jwscxvIEMEA== 2024-08-17T02:21:51.285 INFO:teuthology.orchestra.run.smithi104.stdout:[client.2] 2024-08-17T02:21:51.285 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQAhCcBm+mFUEBAA2oxoEOrku7/H/+vbhE43Gg== 2024-08-17T02:21:51.285 INFO:teuthology.orchestra.run.smithi104.stdout:[client.1] 2024-08-17T02:21:51.285 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQAhCcBmk59FExAAgtpMGiCPrqo2TowB76IS1g== 2024-08-17T02:21:51.285 INFO:teuthology.orchestra.run.smithi104.stdout:[client.3] 2024-08-17T02:21:51.285 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQAhCcBmKh6dGBAA51WmpSLd+0Csj7lnE/uOHw== 2024-08-17T02:21:51.287 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr.y] 2024-08-17T02:21:51.287 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAgCcBmIPdDNhAAj3Eob8uWRA+tPv6sdo8Dkg== 2024-08-17T02:21:51.287 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.a] 2024-08-17T02:21:51.287 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAhCcBmDbpBABAAUmID7XhUQDBm+L94n9esyg== 2024-08-17T02:21:51.287 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.c] 2024-08-17T02:21:51.287 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAhCcBm/udiAxAA1K2ANrUuNmQOfrcynTS+RA== 2024-08-17T02:21:51.287 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.0] 2024-08-17T02:21:51.287 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAjCcBm/3suOBAAyxBjstycyfsr8beMKRxfKQ== 2024-08-17T02:21:51.287 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.1] 2024-08-17T02:21:51.288 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAmCcBmea8zOhAAfOPbwQTzP9LmMtt2Jscz3A== 2024-08-17T02:21:51.288 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.2] 2024-08-17T02:21:51.288 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAqCcBm+CANBBAAWsByvoejX1yztveba17DLA== 2024-08-17T02:21:51.288 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.3] 2024-08-17T02:21:51.288 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAtCcBmxaFsBxAAjNBy/KSF80ElAuQo+4m7/Q== 2024-08-17T02:21:51.288 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr.x] 2024-08-17T02:21:51.288 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAgCcBmKT4qORAA8RmWfPRvKrIgatfaJFYcxQ== 2024-08-17T02:21:51.288 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.b] 2024-08-17T02:21:51.288 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAhCcBmb1J0BxAAT7dMMS4PPwRpwxaG7641ig== 2024-08-17T02:21:51.288 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.d] 2024-08-17T02:21:51.289 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAhCcBmYJypChAAPoQjjYW497n+RdXMj7dMfg== 2024-08-17T02:21:51.289 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.4] 2024-08-17T02:21:51.289 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAyCcBmB7CnJxAACtG2PU/jmmUK3uqCry9G8g== 2024-08-17T02:21:51.289 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.5] 2024-08-17T02:21:51.289 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQA1CcBmKR/5KBAA0ru8bq7qKQNgpt0E6rtSOw== 2024-08-17T02:21:51.289 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.6] 2024-08-17T02:21:51.289 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQA4CcBmuaS0LRAAbY5vhocCAXeNKczOWFK13w== 2024-08-17T02:21:51.289 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.7] 2024-08-17T02:21:51.289 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQA7CcBmUZ9HMhAAe+ELd8Y6t2BKg8kojYYMqg== 2024-08-17T02:21:51.289 INFO:teuthology.orchestra.run.smithi117.stdout:[client.0] 2024-08-17T02:21:51.289 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAhCcBmu02NDRAA0N4TaUHvOE2jwscxvIEMEA== 2024-08-17T02:21:51.289 INFO:teuthology.orchestra.run.smithi117.stdout:[client.2] 2024-08-17T02:21:51.289 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAhCcBm+mFUEBAA2oxoEOrku7/H/+vbhE43Gg== 2024-08-17T02:21:51.290 INFO:teuthology.orchestra.run.smithi117.stdout:[client.1] 2024-08-17T02:21:51.290 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAhCcBmk59FExAAgtpMGiCPrqo2TowB76IS1g== 2024-08-17T02:21:51.290 INFO:teuthology.orchestra.run.smithi117.stdout:[client.3] 2024-08-17T02:21:51.290 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAhCcBmKh6dGBAA51WmpSLd+0Csj7lnE/uOHw== 2024-08-17T02:21:51.290 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:21:51.292 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:21:51.374 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:21:51.376 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:21:51.424 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:21:51.427 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:21:51.472 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:21:51.474 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:21:51.560 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:21:51.563 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:21:51.605 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:21:51.608 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:21:51.651 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:21:51.653 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:21:51.737 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:21:51.742 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:21:51.785 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:21:51.788 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:21:51.833 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:21:51.837 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:21:51.925 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:21:51.927 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:21:51.973 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:21:51.975 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:21:52.018 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:21:52.021 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:21:52.105 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:21:52.108 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:21:52.154 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:21:52.157 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:21:52.205 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:21:52.208 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:21:52.297 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:21:52.300 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:21:52.347 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:21:52.350 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:21:52.394 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-08-17T02:21:52.394 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-08-17T02:21:52.406 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:21:52.458 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-08-17T02:21:52.470 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-08-17T02:21:52.487 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:21:52.537 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-08-17T02:21:52.550 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-08-17T02:21:52.608 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:21:52.659 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-08-17T02:21:52.672 DEBUG:teuthology.orchestra.run.smithi104:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:21:52.675 DEBUG:teuthology.orchestra.run.smithi117:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:21:52.681 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-08-17T02:21:52.681 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-17T02:21:52.682 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-17T02:21:52.721 INFO:tasks.ceph.mon.a:Started 2024-08-17T02:21:52.721 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-17T02:21:52.722 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-17T02:21:52.726 INFO:tasks.ceph.mon.b:Started 2024-08-17T02:21:52.726 INFO:tasks.ceph.mon.c:Restarting daemon 2024-08-17T02:21:52.726 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-08-17T02:21:52.729 INFO:tasks.ceph.mon.c:Started 2024-08-17T02:21:52.730 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-08-17T02:21:52.730 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-08-17T02:21:52.730 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-08-17T02:21:52.733 INFO:tasks.ceph.mgr.y:Started 2024-08-17T02:21:52.733 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-08-17T02:21:52.733 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-08-17T02:21:52.735 INFO:tasks.ceph.mgr.x:Started 2024-08-17T02:21:52.735 INFO:tasks.ceph:Setting crush tunables to default 2024-08-17T02:21:52.735 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph osd crush tunables default 2024-08-17T02:21:52.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:52.837+0000 7f2729d46700 1 Processor -- start 2024-08-17T02:21:52.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:52.837+0000 7f2729d46700 1 -- start start 2024-08-17T02:21:52.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:52.841+0000 7f2729d46700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27241501e0 0x7f27240ab7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:21:52.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:52.841+0000 7f2729d46700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f27240abd30 0x7f27240686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:21:52.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:52.841+0000 7f2729d46700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f27241505b0 0x7f2724068be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:21:52.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:52.841+0000 7f2729d46700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2724157160 con 0x7f27240abd30 2024-08-17T02:21:52.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:52.841+0000 7f2729d46700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2724156550 con 0x7f27241505b0 2024-08-17T02:21:52.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:52.841+0000 7f2729d46700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2724156830 con 0x7f27241501e0 2024-08-17T02:21:52.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:52.841+0000 7f2723fff700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f27240abd30 0x7f27240686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:52.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:52.841+0000 7f2723fff700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f27240abd30 0x7f27240686a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33912/0 (socket says 172.21.15.104:33912) 2024-08-17T02:21:52.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:52.841+0000 7f2723fff700 1 -- 172.21.15.104:0/1503272634 learned_addr learned my addr 172.21.15.104:0/1503272634 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:21:52.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:52.841+0000 7f2729545700 1 --2- 172.21.15.104:0/1503272634 >> v2:172.21.15.117:3300/0 conn(0x7f27241505b0 0x7f2724068be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:52.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:52.841+0000 7f2728d44700 1 --2- 172.21.15.104:0/1503272634 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27241501e0 0x7f27240ab7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:52.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:52.841+0000 7f2723fff700 1 -- 172.21.15.104:0/1503272634 >> v2:172.21.15.104:3300/0 conn(0x7f27240abd30 msgr2=0x7f27240686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:21:52.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:52.841+0000 7f2723fff700 1 -- 172.21.15.104:0/1503272634 >> v2:172.21.15.104:3300/0 conn(0x7f27240abd30 msgr2=0x7f27240686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:21:52.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:52.841+0000 7f2723fff700 1 --2- 172.21.15.104:0/1503272634 >> v2:172.21.15.104:3300/0 conn(0x7f27240abd30 0x7f27240686a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:21:52.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:52.841+0000 7f2723fff700 1 --2- 172.21.15.104:0/1503272634 >> v2:172.21.15.104:3300/0 conn(0x7f27240abd30 0x7f27240686a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:21:52.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:52.841+0000 7f2729545700 1 -- 172.21.15.104:0/1503272634 >> v2:172.21.15.117:3300/0 conn(0x7f27241505b0 msgr2=0x7f2724068be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:21:52.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:52.841+0000 7f2729545700 1 -- 172.21.15.104:0/1503272634 >> v2:172.21.15.117:3300/0 conn(0x7f27241505b0 msgr2=0x7f2724068be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:21:52.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:52.841+0000 7f2728d44700 1 -- 172.21.15.104:0/1503272634 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27241501e0 msgr2=0x7f27240ab7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:21:52.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:52.841+0000 7f2729545700 1 --2- 172.21.15.104:0/1503272634 >> v2:172.21.15.117:3300/0 conn(0x7f27241505b0 0x7f2724068be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:21:52.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:52.841+0000 7f2728d44700 1 -- 172.21.15.104:0/1503272634 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27241501e0 msgr2=0x7f27240ab7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:21:52.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:52.841+0000 7f2728d44700 1 --2- 172.21.15.104:0/1503272634 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27241501e0 0x7f27240ab7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:21:52.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:52.841+0000 7f2729545700 1 --2- 172.21.15.104:0/1503272634 >> v2:172.21.15.117:3300/0 conn(0x7f27241505b0 0x7f2724068be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:21:52.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:52.841+0000 7f2728d44700 1 --2- 172.21.15.104:0/1503272634 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27241501e0 0x7f27240ab7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:21:53.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:53.041+0000 7f2723fff700 1 --2- 172.21.15.104:0/1503272634 >> v2:172.21.15.104:3300/0 conn(0x7f27240abd30 0x7f27240686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:53.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:53.041+0000 7f2728d44700 1 --2- 172.21.15.104:0/1503272634 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27241501e0 0x7f27240ab7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:53.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:53.041+0000 7f2723fff700 1 -- 172.21.15.104:0/1503272634 >> v2:172.21.15.104:3300/0 conn(0x7f27240abd30 msgr2=0x7f27240686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:21:53.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:53.041+0000 7f2729545700 1 --2- 172.21.15.104:0/1503272634 >> v2:172.21.15.117:3300/0 conn(0x7f27241505b0 0x7f2724068be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:53.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:53.041+0000 7f2723fff700 1 -- 172.21.15.104:0/1503272634 >> v2:172.21.15.104:3300/0 conn(0x7f27240abd30 msgr2=0x7f27240686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:21:53.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:53.041+0000 7f2723fff700 1 --2- 172.21.15.104:0/1503272634 >> v2:172.21.15.104:3300/0 conn(0x7f27240abd30 0x7f27240686a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:21:53.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:53.041+0000 7f2723fff700 1 --2- 172.21.15.104:0/1503272634 >> v2:172.21.15.104:3300/0 conn(0x7f27240abd30 0x7f27240686a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:21:53.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:53.041+0000 7f2728d44700 1 -- 172.21.15.104:0/1503272634 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27241501e0 msgr2=0x7f27240ab7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:21:53.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:53.041+0000 7f2729545700 1 -- 172.21.15.104:0/1503272634 >> v2:172.21.15.117:3300/0 conn(0x7f27241505b0 msgr2=0x7f2724068be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:21:53.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:53.041+0000 7f2729545700 1 -- 172.21.15.104:0/1503272634 >> v2:172.21.15.117:3300/0 conn(0x7f27241505b0 msgr2=0x7f2724068be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:21:53.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:53.041+0000 7f2728d44700 1 -- 172.21.15.104:0/1503272634 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27241501e0 msgr2=0x7f27240ab7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:21:53.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:53.041+0000 7f2729545700 1 --2- 172.21.15.104:0/1503272634 >> v2:172.21.15.117:3300/0 conn(0x7f27241505b0 0x7f2724068be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:21:53.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:53.041+0000 7f2728d44700 1 --2- 172.21.15.104:0/1503272634 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27241501e0 0x7f27240ab7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:21:53.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:53.041+0000 7f2729545700 1 --2- 172.21.15.104:0/1503272634 >> v2:172.21.15.117:3300/0 conn(0x7f27241505b0 0x7f2724068be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:21:53.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:53.041+0000 7f2728d44700 1 --2- 172.21.15.104:0/1503272634 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27241501e0 0x7f27240ab7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:21:53.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:53.441+0000 7f2723fff700 1 --2- 172.21.15.104:0/1503272634 >> v2:172.21.15.104:3300/0 conn(0x7f27240abd30 0x7f27240686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:53.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:53.441+0000 7f2723fff700 1 -- 172.21.15.104:0/1503272634 >> v2:172.21.15.104:3300/0 conn(0x7f27240abd30 msgr2=0x7f27240686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:21:53.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:53.441+0000 7f2723fff700 1 -- 172.21.15.104:0/1503272634 >> v2:172.21.15.104:3300/0 conn(0x7f27240abd30 msgr2=0x7f27240686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:21:53.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:53.441+0000 7f2723fff700 1 --2- 172.21.15.104:0/1503272634 >> v2:172.21.15.104:3300/0 conn(0x7f27240abd30 0x7f27240686a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:21:53.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:53.441+0000 7f2729545700 1 --2- 172.21.15.104:0/1503272634 >> v2:172.21.15.117:3300/0 conn(0x7f27241505b0 0x7f2724068be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:53.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:53.441+0000 7f2723fff700 1 --2- 172.21.15.104:0/1503272634 >> v2:172.21.15.104:3300/0 conn(0x7f27240abd30 0x7f27240686a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-17T02:21:53.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:53.441+0000 7f2728d44700 1 --2- 172.21.15.104:0/1503272634 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27241501e0 0x7f27240ab7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:53.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:53.441+0000 7f2729545700 1 -- 172.21.15.104:0/1503272634 >> v2:172.21.15.117:3300/0 conn(0x7f27241505b0 msgr2=0x7f2724068be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:21:53.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:53.441+0000 7f2729545700 1 -- 172.21.15.104:0/1503272634 >> v2:172.21.15.117:3300/0 conn(0x7f27241505b0 msgr2=0x7f2724068be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:21:53.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:53.441+0000 7f2729545700 1 --2- 172.21.15.104:0/1503272634 >> v2:172.21.15.117:3300/0 conn(0x7f27241505b0 0x7f2724068be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:21:53.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:53.441+0000 7f2728d44700 1 -- 172.21.15.104:0/1503272634 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27241501e0 msgr2=0x7f27240ab7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:21:53.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:53.441+0000 7f2728d44700 1 -- 172.21.15.104:0/1503272634 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27241501e0 msgr2=0x7f27240ab7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:21:53.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:53.441+0000 7f2728d44700 1 --2- 172.21.15.104:0/1503272634 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27241501e0 0x7f27240ab7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:21:53.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:53.441+0000 7f2729545700 1 --2- 172.21.15.104:0/1503272634 >> v2:172.21.15.117:3300/0 conn(0x7f27241505b0 0x7f2724068be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-17T02:21:53.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:53.441+0000 7f2728d44700 1 --2- 172.21.15.104:0/1503272634 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27241501e0 0x7f27240ab7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-17T02:21:54.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:54.241+0000 7f2723fff700 1 --2- 172.21.15.104:0/1503272634 >> v2:172.21.15.104:3300/0 conn(0x7f27240abd30 0x7f27240686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:54.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:54.245+0000 7f2723fff700 1 -- 172.21.15.104:0/1503272634 >> v2:172.21.15.104:3300/0 conn(0x7f27240abd30 msgr2=0x7f27240686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:21:54.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:54.245+0000 7f2723fff700 1 -- 172.21.15.104:0/1503272634 >> v2:172.21.15.104:3300/0 conn(0x7f27240abd30 msgr2=0x7f27240686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:21:54.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:54.245+0000 7f2723fff700 1 --2- 172.21.15.104:0/1503272634 >> v2:172.21.15.104:3300/0 conn(0x7f27240abd30 0x7f27240686a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:21:54.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:54.245+0000 7f2723fff700 1 --2- 172.21.15.104:0/1503272634 >> v2:172.21.15.104:3300/0 conn(0x7f27240abd30 0x7f27240686a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-17T02:21:54.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:54.245+0000 7f2728d44700 1 --2- 172.21.15.104:0/1503272634 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27241501e0 0x7f27240ab7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:54.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:54.245+0000 7f2729545700 1 --2- 172.21.15.104:0/1503272634 >> v2:172.21.15.117:3300/0 conn(0x7f27241505b0 0x7f2724068be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:54.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:54.245+0000 7f2728d44700 1 -- 172.21.15.104:0/1503272634 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27241501e0 msgr2=0x7f27240ab7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:21:54.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:54.245+0000 7f2728d44700 1 -- 172.21.15.104:0/1503272634 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27241501e0 msgr2=0x7f27240ab7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:21:54.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:54.245+0000 7f2728d44700 1 --2- 172.21.15.104:0/1503272634 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27241501e0 0x7f27240ab7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:21:54.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:54.245+0000 7f2729545700 1 -- 172.21.15.104:0/1503272634 >> v2:172.21.15.117:3300/0 conn(0x7f27241505b0 msgr2=0x7f2724068be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:21:54.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:54.245+0000 7f2728d44700 1 --2- 172.21.15.104:0/1503272634 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27241501e0 0x7f27240ab7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-17T02:21:54.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:54.245+0000 7f2729545700 1 -- 172.21.15.104:0/1503272634 >> v2:172.21.15.117:3300/0 conn(0x7f27241505b0 msgr2=0x7f2724068be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:21:54.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:54.245+0000 7f2729545700 1 --2- 172.21.15.104:0/1503272634 >> v2:172.21.15.117:3300/0 conn(0x7f27241505b0 0x7f2724068be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:21:54.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:54.245+0000 7f2729545700 1 --2- 172.21.15.104:0/1503272634 >> v2:172.21.15.117:3300/0 conn(0x7f27241505b0 0x7f2724068be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-17T02:21:55.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:55.841+0000 7f27227fc700 1 -- 172.21.15.104:0/1503272634 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27241501e0 msgr2=0x7f27240ab7f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:21:55.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:55.841+0000 7f27227fc700 1 --2- 172.21.15.104:0/1503272634 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27241501e0 0x7f27240ab7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:55.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:55.841+0000 7f27227fc700 1 -- 172.21.15.104:0/1503272634 >> v2:172.21.15.117:3300/0 conn(0x7f27241505b0 msgr2=0x7f2724068be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:21:55.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:55.841+0000 7f27227fc700 1 --2- 172.21.15.104:0/1503272634 >> v2:172.21.15.117:3300/0 conn(0x7f27241505b0 0x7f2724068be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:55.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:55.841+0000 7f27227fc700 1 -- 172.21.15.104:0/1503272634 >> v2:172.21.15.104:3300/0 conn(0x7f27240abd30 msgr2=0x7f27240686a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:21:55.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:55.841+0000 7f27227fc700 1 --2- 172.21.15.104:0/1503272634 >> v2:172.21.15.104:3300/0 conn(0x7f27240abd30 0x7f27240686a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:55.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:55.841+0000 7f27227fc700 1 -- 172.21.15.104:0/1503272634 --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2724156b10 con 0x7f27140036c0 2024-08-17T02:21:55.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:55.841+0000 7f27227fc700 1 -- 172.21.15.104:0/1503272634 --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f271400c0a0 con 0x7f2714007340 2024-08-17T02:21:57.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.913+0000 7f27237fe700 1 -- 172.21.15.104:0/1503272634 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4260665228 0 0) 0x7f2724156b10 con 0x7f27140036c0 2024-08-17T02:21:57.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.913+0000 7f27237fe700 1 -- 172.21.15.104:0/1503272634 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2708003570 con 0x7f27140036c0 2024-08-17T02:21:57.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.913+0000 7f27237fe700 1 -- 172.21.15.104:0/1503272634 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1272175220 0 0) 0x7f271400c0a0 con 0x7f2714007340 2024-08-17T02:21:57.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.913+0000 7f27237fe700 1 -- 172.21.15.104:0/1503272634 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2724156b10 con 0x7f2714007340 2024-08-17T02:21:57.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.913+0000 7f27237fe700 1 -- 172.21.15.104:0/1503272634 <== mon.1 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 815438754 0 0) 0x7f2724156b10 con 0x7f2714007340 2024-08-17T02:21:57.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.913+0000 7f27237fe700 1 -- 172.21.15.104:0/1503272634 >> v1:172.21.15.104:6789/0 conn(0x7f27140036c0 legacy=0x7f2714005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:57.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.913+0000 7f27237fe700 1 -- 172.21.15.104:0/1503272634 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f271400d300 con 0x7f2714007340 2024-08-17T02:21:57.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.913+0000 7f27237fe700 1 -- 172.21.15.104:0/1503272634 <== mon.1 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1279957748 0 0) 0x7f271000c2f0 con 0x7f2714007340 2024-08-17T02:21:57.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.913+0000 7f27237fe700 1 -- 172.21.15.104:0/1503272634 >> v1:172.21.15.117:6789/0 conn(0x7f2714007340 legacy=0x7f27140097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:57.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.913+0000 7f27237fe700 1 --2- 172.21.15.104:0/1503272634 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27241501e0 0x7f2708003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:21:57.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.913+0000 7f27237fe700 1 --2- 172.21.15.104:0/1503272634 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2708004220 0x7f2708004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:21:57.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.913+0000 7f2729545700 1 -- 172.21.15.104:0/1503272634 reap_dead start 2024-08-17T02:21:57.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.913+0000 7f27237fe700 1 --2- 172.21.15.104:0/1503272634 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2708004f00 0x7f270800dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:21:57.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.913+0000 7f27237fe700 1 -- 172.21.15.104:0/1503272634 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27080056c0 con 0x7f2708004f00 2024-08-17T02:21:57.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.913+0000 7f27237fe700 1 -- 172.21.15.104:0/1503272634 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270800e1e0 con 0x7f2708004220 2024-08-17T02:21:57.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.913+0000 7f27237fe700 1 -- 172.21.15.104:0/1503272634 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f270800e3a0 con 0x7f27241501e0 2024-08-17T02:21:57.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.913+0000 7f2729545700 1 --2- 172.21.15.104:0/1503272634 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2708004f00 0x7f270800dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:57.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.913+0000 7f2728d44700 1 --2- 172.21.15.104:0/1503272634 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27241501e0 0x7f2708003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:57.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.913+0000 7f2729545700 1 -- 172.21.15.104:0/1503272634 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27241501e0 msgr2=0x7f2708003c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:21:57.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.913+0000 7f2729545700 1 --2- 172.21.15.104:0/1503272634 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27241501e0 0x7f2708003c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:57.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.913+0000 7f2729545700 1 -- 172.21.15.104:0/1503272634 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2708004220 msgr2=0x7f2708004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:21:57.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.913+0000 7f2729545700 1 --2- 172.21.15.104:0/1503272634 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2708004220 0x7f2708004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:57.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.913+0000 7f2729545700 1 -- 172.21.15.104:0/1503272634 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2724156b10 con 0x7f2708004f00 2024-08-17T02:21:57.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.917+0000 7f2729545700 1 --2- 172.21.15.104:0/1503272634 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2708004f00 0x7f270800dc70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f272406d340 tx=0x7f271c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=850145e0192226b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:21:57.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.917+0000 7f27237fe700 1 -- 172.21.15.104:0/1503272634 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c009950 con 0x7f2708004f00 2024-08-17T02:21:57.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.917+0000 7f27237fe700 1 -- 172.21.15.104:0/1503272634 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271c00f040 con 0x7f2708004f00 2024-08-17T02:21:57.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.917+0000 7f27237fe700 1 -- 172.21.15.104:0/1503272634 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c007de0 con 0x7f2708004f00 2024-08-17T02:21:57.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.921+0000 7f2729d46700 1 -- 172.21.15.104:0/1503272634 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2708004f00 msgr2=0x7f270800dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:57.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.921+0000 7f2729d46700 1 --2- 172.21.15.104:0/1503272634 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2708004f00 0x7f270800dc70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f272406d340 tx=0x7f271c00b040 comp rx=0 tx=0).stop 2024-08-17T02:21:57.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.921+0000 7f2729d46700 1 -- 172.21.15.104:0/1503272634 shutdown_connections 2024-08-17T02:21:57.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.921+0000 7f2729d46700 1 --2- 172.21.15.104:0/1503272634 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2708004f00 0x7f270800dc70 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:57.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.921+0000 7f2729d46700 1 --2- 172.21.15.104:0/1503272634 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2708004220 0x7f2708004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:57.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.921+0000 7f2729d46700 1 --2- 172.21.15.104:0/1503272634 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27241501e0 0x7f2708003c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:57.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.921+0000 7f2729d46700 1 -- 172.21.15.104:0/1503272634 >> 172.21.15.104:0/1503272634 conn(0x7f272406e310 msgr2=0x7f272406b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:21:57.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.921+0000 7f2729d46700 1 -- 172.21.15.104:0/1503272634 shutdown_connections 2024-08-17T02:21:57.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.921+0000 7f2729d46700 1 -- 172.21.15.104:0/1503272634 wait complete. 2024-08-17T02:21:57.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.921+0000 7f2729d46700 1 Processor -- start 2024-08-17T02:21:57.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.925+0000 7f2729d46700 1 -- start start 2024-08-17T02:21:57.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.925+0000 7f2729d46700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2708004220 0x7f2724151c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:21:57.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.925+0000 7f2729d46700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2708004f00 0x7f27240a5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:21:57.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.925+0000 7f2729d46700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27241501e0 0x7f27241540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:21:57.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.925+0000 7f2729d46700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27240ab090 con 0x7f2708004f00 2024-08-17T02:21:57.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.925+0000 7f2729d46700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2724167c00 con 0x7f27241501e0 2024-08-17T02:21:57.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.925+0000 7f2729d46700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2724167ee0 con 0x7f2708004220 2024-08-17T02:21:57.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.925+0000 7f2729545700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27241501e0 0x7f27241540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:57.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.925+0000 7f2729545700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27241501e0 0x7f27241540f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.104:34520/0 (socket says 172.21.15.104:34520) 2024-08-17T02:21:57.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.925+0000 7f2729545700 1 -- 172.21.15.104:0/868642197 learned_addr learned my addr 172.21.15.104:0/868642197 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:21:57.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.925+0000 7f2728d44700 1 --2- 172.21.15.104:0/868642197 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2708004220 0x7f2724151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:57.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.925+0000 7f2729545700 1 -- 172.21.15.104:0/868642197 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2708004220 msgr2=0x7f2724151c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:57.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.925+0000 7f2729545700 1 --2- 172.21.15.104:0/868642197 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2708004220 0x7f2724151c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:57.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.925+0000 7f2729545700 1 -- 172.21.15.104:0/868642197 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2708004f00 msgr2=0x7f27240a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:57.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.925+0000 7f2729545700 1 --2- 172.21.15.104:0/868642197 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2708004f00 0x7f27240a5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:57.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.925+0000 7f2729545700 1 -- 172.21.15.104:0/868642197 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27241681c0 con 0x7f27241501e0 2024-08-17T02:21:57.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.925+0000 7f2729545700 1 --2- 172.21.15.104:0/868642197 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27241501e0 0x7f27241540f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f271c009590 tx=0x7f271c01f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:21:57.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.925+0000 7f2720ff9700 1 -- 172.21.15.104:0/868642197 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c009950 con 0x7f27241501e0 2024-08-17T02:21:57.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.925+0000 7f2720ff9700 1 -- 172.21.15.104:0/868642197 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271c017e40 con 0x7f27241501e0 2024-08-17T02:21:57.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.925+0000 7f2729d46700 1 -- 172.21.15.104:0/868642197 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27241684a0 con 0x7f27241501e0 2024-08-17T02:21:57.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.925+0000 7f2720ff9700 1 -- 172.21.15.104:0/868642197 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c0206c0 con 0x7f27241501e0 2024-08-17T02:21:57.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.925+0000 7f2729d46700 1 -- 172.21.15.104:0/868642197 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2724167820 con 0x7f27241501e0 2024-08-17T02:21:57.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.929+0000 7f2720ff9700 1 -- 172.21.15.104:0/868642197 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f271c003040 con 0x7f27241501e0 2024-08-17T02:21:57.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.929+0000 7f2720ff9700 1 -- 172.21.15.104:0/868642197 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f271c02b820 con 0x7f27241501e0 2024-08-17T02:21:57.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.929+0000 7f2729d46700 1 -- 172.21.15.104:0/868642197 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27240638f0 con 0x7f27241501e0 2024-08-17T02:21:57.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:57.933+0000 7f2720ff9700 1 -- 172.21.15.104:0/868642197 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f271c031060 con 0x7f27241501e0 2024-08-17T02:21:58.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:58.005+0000 7f2729d46700 1 -- 172.21.15.104:0/868642197 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f27240708e0 con 0x7f27241501e0 2024-08-17T02:21:58.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:58.017+0000 7f2720ff9700 1 -- 172.21.15.104:0/868642197 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f271c01b020 con 0x7f27241501e0 2024-08-17T02:21:58.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:58.017+0000 7f2729d46700 1 -- 172.21.15.104:0/868642197 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27241501e0 msgr2=0x7f27241540f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:58.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:58.017+0000 7f2729d46700 1 --2- 172.21.15.104:0/868642197 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27241501e0 0x7f27241540f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f271c009590 tx=0x7f271c01f000 comp rx=0 tx=0).stop 2024-08-17T02:21:58.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:58.017+0000 7f2729d46700 1 -- 172.21.15.104:0/868642197 shutdown_connections 2024-08-17T02:21:58.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:58.017+0000 7f2729d46700 1 --2- 172.21.15.104:0/868642197 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27241501e0 0x7f27241540f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:58.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:58.017+0000 7f2729d46700 1 --2- 172.21.15.104:0/868642197 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2708004f00 0x7f27240a5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:58.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:58.017+0000 7f2729d46700 1 --2- 172.21.15.104:0/868642197 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2708004220 0x7f2724151c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:58.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:58.017+0000 7f2729d46700 1 -- 172.21.15.104:0/868642197 >> 172.21.15.104:0/868642197 conn(0x7f272406e310 msgr2=0x7f27240685b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:21:58.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:58.017+0000 7f2729d46700 1 -- 172.21.15.104:0/868642197 shutdown_connections 2024-08-17T02:21:58.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:21:58.017+0000 7f2729d46700 1 -- 172.21.15.104:0/868642197 wait complete. 2024-08-17T02:21:58.022 INFO:teuthology.orchestra.run.smithi104.stderr:adjusted tunables profile to default 2024-08-17T02:21:58.034 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-08-17T02:21:58.035 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-08-17T02:21:58.035 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-08-17T02:21:58.049 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-08-17T02:21:58.050 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-08-17T02:21:58.061 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-08-17T02:21:58.061 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-08-17T02:21:58.073 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-08-17T02:21:58.074 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-08-17T02:21:58.083 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-17T02:21:58.083 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-08-17T02:21:58.091 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-17T02:21:58.086+0000 7fd04ca4f000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-17T02:21:58.099 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-17T02:21:58.099 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-08-17T02:21:58.112 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-08-17T02:21:58.109+0000 7f89ee2e3000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-17T02:21:58.156 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-17T02:21:58.156 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-08-17T02:21:58.164 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-17T02:21:58.164 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-08-17T02:21:58.173 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 606b9088-590e-4709-aa3a-b0f6e22972ee 0 2024-08-17T02:21:58.327 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.322+0000 7fbe68f5b700 1 Processor -- start 2024-08-17T02:21:58.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.322+0000 7fbe68f5b700 1 -- start start 2024-08-17T02:21:58.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.326+0000 7fbe68f5b700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe640b1f70 0x7fbe640686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:21:58.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.326+0000 7fbe68f5b700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbe64068be0 0x7fbe64160b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:21:58.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.326+0000 7fbe68f5b700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe64069040 con 0x7fbe64156fd0 2024-08-17T02:21:58.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.326+0000 7fbe68f5b700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe640cb250 con 0x7fbe64068be0 2024-08-17T02:21:58.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.326+0000 7fbe68f5b700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe640cb530 con 0x7fbe640b1f70 2024-08-17T02:21:58.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.326+0000 7fbe637fe700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fbe64156fd0 0x7fbe640ca9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:49400/0 (socket says 172.21.15.117:49400) 2024-08-17T02:21:58.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.326+0000 7fbe637fe700 1 -- 172.21.15.117:0/3431617286 learned_addr learned my addr 172.21.15.117:0/3431617286 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-08-17T02:21:58.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.326+0000 7fbe62ffd700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe640b1f70 0x7fbe640686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:58.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.326+0000 7fbe63fff700 1 --2- 172.21.15.117:0/3431617286 >> v2:172.21.15.117:3300/0 conn(0x7fbe64068be0 0x7fbe64160b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:58.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.326+0000 7fbe62ffd700 1 -- 172.21.15.117:0/3431617286 >> v2:172.21.15.117:3300/0 conn(0x7fbe64068be0 msgr2=0x7fbe64160b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:21:58.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.326+0000 7fbe627fc700 1 -- 172.21.15.117:0/3431617286 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3297443035 0 0) 0x7fbe54001110 con 0x7fbe64156fd0 2024-08-17T02:21:58.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.326+0000 7fbe62ffd700 1 --2- 172.21.15.117:0/3431617286 >> v2:172.21.15.117:3300/0 conn(0x7fbe64068be0 0x7fbe64160b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:58.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.326+0000 7fbe62ffd700 1 -- 172.21.15.117:0/3431617286 >> v1:172.21.15.117:6789/0 conn(0x7fbe64156fd0 legacy=0x7fbe640ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:58.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.326+0000 7fbe62ffd700 1 -- 172.21.15.117:0/3431617286 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe640cb810 con 0x7fbe640b1f70 2024-08-17T02:21:58.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.326+0000 7fbe62ffd700 1 --2- 172.21.15.117:0/3431617286 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe640b1f70 0x7fbe640686a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fbe580098e0 tx=0x7fbe580091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45a4e69e83af135a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:21:58.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.326+0000 7fbe627fc700 1 -- 172.21.15.117:0/3431617286 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5800b640 con 0x7fbe640b1f70 2024-08-17T02:21:58.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.326+0000 7fbe627fc700 1 -- 172.21.15.117:0/3431617286 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe5800b7a0 con 0x7fbe640b1f70 2024-08-17T02:21:58.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.326+0000 7fbe627fc700 1 -- 172.21.15.117:0/3431617286 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5800bb40 con 0x7fbe640b1f70 2024-08-17T02:21:58.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.326+0000 7fbe68f5b700 1 -- 172.21.15.117:0/3431617286 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe640b1f70 msgr2=0x7fbe640686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:58.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.326+0000 7fbe68f5b700 1 --2- 172.21.15.117:0/3431617286 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe640b1f70 0x7fbe640686a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fbe580098e0 tx=0x7fbe580091a0 comp rx=0 tx=0).stop 2024-08-17T02:21:58.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.326+0000 7fbe68f5b700 1 -- 172.21.15.117:0/3431617286 shutdown_connections 2024-08-17T02:21:58.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.326+0000 7fbe68f5b700 1 --2- 172.21.15.117:0/3431617286 >> v2:172.21.15.117:3300/0 conn(0x7fbe64068be0 0x7fbe64160b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:58.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.326+0000 7fbe68f5b700 1 --2- 172.21.15.117:0/3431617286 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe640b1f70 0x7fbe640686a0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:58.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.326+0000 7fbe68f5b700 1 -- 172.21.15.117:0/3431617286 >> 172.21.15.117:0/3431617286 conn(0x7fbe6406e310 msgr2=0x7fbe6406b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:21:58.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.326+0000 7fbe68f5b700 1 -- 172.21.15.117:0/3431617286 shutdown_connections 2024-08-17T02:21:58.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.326+0000 7fbe68f5b700 1 -- 172.21.15.117:0/3431617286 wait complete. 2024-08-17T02:21:58.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.330+0000 7fbe68f5b700 1 Processor -- start 2024-08-17T02:21:58.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.330+0000 7fbe68f5b700 1 -- start start 2024-08-17T02:21:58.337 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.330+0000 7fbe68f5b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe64068be0 0x7fbe6416d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:21:58.337 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.330+0000 7fbe68f5b700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe640b1f70 0x7fbe6414b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:21:58.337 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.330+0000 7fbe68f5b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe64156fd0 0x7fbe640b0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:21:58.337 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.330+0000 7fbe68f5b700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6416a6c0 con 0x7fbe64156fd0 2024-08-17T02:21:58.337 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.330+0000 7fbe68f5b700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6416a3e0 con 0x7fbe64068be0 2024-08-17T02:21:58.337 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.330+0000 7fbe68f5b700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6416cea0 con 0x7fbe640b1f70 2024-08-17T02:21:58.337 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.330+0000 7fbe62ffd700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe640b1f70 0x7fbe6414b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:58.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.330+0000 7fbe637fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe64068be0 0x7fbe6416d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:58.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.330+0000 7fbe62ffd700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe640b1f70 0x7fbe6414b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:55140/0 (socket says 172.21.15.117:55140) 2024-08-17T02:21:58.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.330+0000 7fbe62ffd700 1 -- 172.21.15.117:0/3278917284 learned_addr learned my addr 172.21.15.117:0/3278917284 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-08-17T02:21:58.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.330+0000 7fbe63fff700 1 --2- 172.21.15.117:0/3278917284 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe64156fd0 0x7fbe640b0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:58.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.330+0000 7fbe637fe700 1 -- 172.21.15.117:0/3278917284 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe640b1f70 msgr2=0x7fbe6414b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:58.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.330+0000 7fbe637fe700 1 --2- 172.21.15.117:0/3278917284 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe640b1f70 0x7fbe6414b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:58.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.330+0000 7fbe637fe700 1 -- 172.21.15.117:0/3278917284 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe64156fd0 msgr2=0x7fbe640b0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:58.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.330+0000 7fbe637fe700 1 --2- 172.21.15.117:0/3278917284 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe64156fd0 0x7fbe640b0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:58.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.330+0000 7fbe637fe700 1 -- 172.21.15.117:0/3278917284 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe58009420 con 0x7fbe64068be0 2024-08-17T02:21:58.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.330+0000 7fbe62ffd700 1 --2- 172.21.15.117:0/3278917284 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe640b1f70 0x7fbe6414b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:21:58.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.330+0000 7fbe637fe700 1 --2- 172.21.15.117:0/3278917284 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe64068be0 0x7fbe6416d980 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbe5400c810 tx=0x7fbe54007b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:21:58.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.330+0000 7fbe4b7fe700 1 -- 172.21.15.117:0/3278917284 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe54005b30 con 0x7fbe64068be0 2024-08-17T02:21:58.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.330+0000 7fbe4b7fe700 1 -- 172.21.15.117:0/3278917284 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe54005c90 con 0x7fbe64068be0 2024-08-17T02:21:58.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.330+0000 7fbe68f5b700 1 -- 172.21.15.117:0/3278917284 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe6416d180 con 0x7fbe64068be0 2024-08-17T02:21:58.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.330+0000 7fbe4b7fe700 1 -- 172.21.15.117:0/3278917284 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe540072e0 con 0x7fbe64068be0 2024-08-17T02:21:58.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.330+0000 7fbe68f5b700 1 -- 172.21.15.117:0/3278917284 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe6414bef0 con 0x7fbe64068be0 2024-08-17T02:21:58.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.334+0000 7fbe4b7fe700 1 -- 172.21.15.117:0/3278917284 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fbe540076d0 con 0x7fbe64068be0 2024-08-17T02:21:58.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.334+0000 7fbe4b7fe700 1 -- 172.21.15.117:0/3278917284 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7fbe5401cd00 con 0x7fbe64068be0 2024-08-17T02:21:58.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.334+0000 7fbe68f5b700 1 -- 172.21.15.117:0/3278917284 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe6416d680 con 0x7fbe64068be0 2024-08-17T02:21:58.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.338+0000 7fbe4b7fe700 1 -- 172.21.15.117:0/3278917284 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fbe54021060 con 0x7fbe64068be0 2024-08-17T02:21:58.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.410+0000 7fbe68f5b700 1 -- 172.21.15.117:0/3278917284 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd new", "uuid": "606b9088-590e-4709-aa3a-b0f6e22972ee", "id": 0} v 0) v1 -- 0x7fbe640638f0 con 0x7fbe64068be0 2024-08-17T02:21:58.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.422+0000 7fbe4b7fe700 1 -- 172.21.15.117:0/3278917284 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "606b9088-590e-4709-aa3a-b0f6e22972ee", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbe54017070 con 0x7fbe64068be0 2024-08-17T02:21:58.426 INFO:teuthology.orchestra.run.smithi117.stdout:0 2024-08-17T02:21:58.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.422+0000 7fbe68f5b700 1 -- 172.21.15.117:0/3278917284 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe64068be0 msgr2=0x7fbe6416d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:58.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.422+0000 7fbe68f5b700 1 --2- 172.21.15.117:0/3278917284 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe64068be0 0x7fbe6416d980 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbe5400c810 tx=0x7fbe54007b90 comp rx=0 tx=0).stop 2024-08-17T02:21:58.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.422+0000 7fbe68f5b700 1 -- 172.21.15.117:0/3278917284 shutdown_connections 2024-08-17T02:21:58.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.422+0000 7fbe68f5b700 1 --2- 172.21.15.117:0/3278917284 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe64156fd0 0x7fbe640b0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:58.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.422+0000 7fbe68f5b700 1 --2- 172.21.15.117:0/3278917284 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe640b1f70 0x7fbe6414b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:58.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.422+0000 7fbe68f5b700 1 --2- 172.21.15.117:0/3278917284 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe64068be0 0x7fbe6416d980 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:58.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.422+0000 7fbe68f5b700 1 -- 172.21.15.117:0/3278917284 >> 172.21.15.117:0/3278917284 conn(0x7fbe6406e310 msgr2=0x7fbe641545f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:21:58.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.422+0000 7fbe68f5b700 1 -- 172.21.15.117:0/3278917284 shutdown_connections 2024-08-17T02:21:58.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.422+0000 7fbe68f5b700 1 -- 172.21.15.117:0/3278917284 wait complete. 2024-08-17T02:21:58.445 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 9bc6a909-0c2f-4889-afe7-4a47f89b0f64 1 2024-08-17T02:21:58.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.546+0000 7fbfbdb3d700 1 Processor -- start 2024-08-17T02:21:58.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.546+0000 7fbfbdb3d700 1 -- start start 2024-08-17T02:21:58.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.550+0000 7fbfbdb3d700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfb80688d0 0x7fbfb8068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:21:58.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.550+0000 7fbfbdb3d700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfb80ae620 con 0x7fbfb806dfa0 2024-08-17T02:21:58.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.550+0000 7fbfbdb3d700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfb80ae2d0 con 0x7fbfb80c8780 2024-08-17T02:21:58.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.550+0000 7fbfbdb3d700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb806e4a0 con 0x7fbfb80688d0 2024-08-17T02:21:58.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.550+0000 7fbfbcb3b700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfb80688d0 0x7fbfb8068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:58.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.550+0000 7fbfbd33c700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fbfb80c8780 0x7fbfb8156ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:49408/0 (socket says 172.21.15.117:49408) 2024-08-17T02:21:58.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.550+0000 7fbfbd33c700 1 -- 172.21.15.117:0/2524373761 learned_addr learned my addr 172.21.15.117:0/2524373761 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-08-17T02:21:58.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.550+0000 7fbfb77fe700 1 -- 172.21.15.117:0/2524373761 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 581894102 0 0) 0x7fbfb80ae2d0 con 0x7fbfb80c8780 2024-08-17T02:21:58.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.550+0000 7fbfb77fe700 1 -- 172.21.15.117:0/2524373761 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfa8003570 con 0x7fbfb80c8780 2024-08-17T02:21:58.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.550+0000 7fbfbcb3b700 1 -- 172.21.15.117:0/2524373761 >> v1:172.21.15.117:6789/0 conn(0x7fbfb80c8780 legacy=0x7fbfb8156ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:58.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.550+0000 7fbfbcb3b700 1 -- 172.21.15.117:0/2524373761 >> v1:172.21.15.104:6789/0 conn(0x7fbfb806dfa0 legacy=0x7fbfb80aeab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:58.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.550+0000 7fbfbcb3b700 1 -- 172.21.15.117:0/2524373761 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb806e780 con 0x7fbfb80688d0 2024-08-17T02:21:58.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.550+0000 7fbfbcb3b700 1 --2- 172.21.15.117:0/2524373761 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfb80688d0 0x7fbfb8068ca0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbfac009910 tx=0x7fbfac0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=771d3c09e42e3b51 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:21:58.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.550+0000 7fbfb77fe700 1 -- 172.21.15.117:0/2524373761 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfac00b680 con 0x7fbfb80688d0 2024-08-17T02:21:58.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.550+0000 7fbfb77fe700 1 -- 172.21.15.117:0/2524373761 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfac00b7e0 con 0x7fbfb80688d0 2024-08-17T02:21:58.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.550+0000 7fbfb77fe700 1 -- 172.21.15.117:0/2524373761 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfac00bba0 con 0x7fbfb80688d0 2024-08-17T02:21:58.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.550+0000 7fbfbdb3d700 1 -- 172.21.15.117:0/2524373761 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfb80688d0 msgr2=0x7fbfb8068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:58.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.550+0000 7fbfbdb3d700 1 --2- 172.21.15.117:0/2524373761 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfb80688d0 0x7fbfb8068ca0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbfac009910 tx=0x7fbfac0091a0 comp rx=0 tx=0).stop 2024-08-17T02:21:58.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.550+0000 7fbfbdb3d700 1 -- 172.21.15.117:0/2524373761 shutdown_connections 2024-08-17T02:21:58.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.550+0000 7fbfbdb3d700 1 --2- 172.21.15.117:0/2524373761 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfb80688d0 0x7fbfb8068ca0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:58.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.550+0000 7fbfbdb3d700 1 -- 172.21.15.117:0/2524373761 >> 172.21.15.117:0/2524373761 conn(0x7fbfb80ccfc0 msgr2=0x7fbfb806d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:21:58.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.550+0000 7fbfbdb3d700 1 -- 172.21.15.117:0/2524373761 shutdown_connections 2024-08-17T02:21:58.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.550+0000 7fbfbdb3d700 1 -- 172.21.15.117:0/2524373761 wait complete. 2024-08-17T02:21:58.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.554+0000 7fbfbdb3d700 1 Processor -- start 2024-08-17T02:21:58.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.554+0000 7fbfbdb3d700 1 -- start start 2024-08-17T02:21:58.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.558+0000 7fbfbdb3d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbfb80688d0 0x7fbfb81687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:21:58.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.558+0000 7fbfbdb3d700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfb806dfa0 0x7fbfb8156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:21:58.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.558+0000 7fbfbdb3d700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbfb80c8780 0x7fbfb8168020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:21:58.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.558+0000 7fbfbdb3d700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb8168560 con 0x7fbfb80c8780 2024-08-17T02:21:58.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.558+0000 7fbfbdb3d700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb80cb8d0 con 0x7fbfb80688d0 2024-08-17T02:21:58.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.558+0000 7fbfbdb3d700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb80cbbb0 con 0x7fbfb806dfa0 2024-08-17T02:21:58.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.558+0000 7fbfbcb3b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbfb80688d0 0x7fbfb81687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:58.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.558+0000 7fbfbcb3b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbfb80688d0 0x7fbfb81687a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:44400/0 (socket says 172.21.15.117:44400) 2024-08-17T02:21:58.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.558+0000 7fbfbcb3b700 1 -- 172.21.15.117:0/1094963604 learned_addr learned my addr 172.21.15.117:0/1094963604 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-08-17T02:21:58.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.558+0000 7fbfb7fff700 1 --2- 172.21.15.117:0/1094963604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfb806dfa0 0x7fbfb8156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:58.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.558+0000 7fbfbd33c700 1 --2- 172.21.15.117:0/1094963604 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbfb80c8780 0x7fbfb8168020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:58.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.558+0000 7fbfbcb3b700 1 -- 172.21.15.117:0/1094963604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfb806dfa0 msgr2=0x7fbfb8156b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:58.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.558+0000 7fbfbcb3b700 1 --2- 172.21.15.117:0/1094963604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfb806dfa0 0x7fbfb8156b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:58.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.558+0000 7fbfbcb3b700 1 -- 172.21.15.117:0/1094963604 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbfb80c8780 msgr2=0x7fbfb8168020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:58.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.558+0000 7fbfbcb3b700 1 --2- 172.21.15.117:0/1094963604 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbfb80c8780 0x7fbfb8168020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:58.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.558+0000 7fbfbcb3b700 1 -- 172.21.15.117:0/1094963604 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfac009420 con 0x7fbfb80688d0 2024-08-17T02:21:58.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.558+0000 7fbfbcb3b700 1 --2- 172.21.15.117:0/1094963604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbfb80688d0 0x7fbfb81687a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbfb805f0e0 tx=0x7fbfac017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:21:58.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.558+0000 7fbfb4ff9700 1 -- 172.21.15.117:0/1094963604 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfac00bb60 con 0x7fbfb80688d0 2024-08-17T02:21:58.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.558+0000 7fbfb4ff9700 1 -- 172.21.15.117:0/1094963604 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfac000c90 con 0x7fbfb80688d0 2024-08-17T02:21:58.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.558+0000 7fbfb4ff9700 1 -- 172.21.15.117:0/1094963604 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfac01a660 con 0x7fbfb80688d0 2024-08-17T02:21:58.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.558+0000 7fbfbdb3d700 1 -- 172.21.15.117:0/1094963604 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfb80cbe90 con 0x7fbfb80688d0 2024-08-17T02:21:58.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.558+0000 7fbfbdb3d700 1 -- 172.21.15.117:0/1094963604 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfb8152330 con 0x7fbfb80688d0 2024-08-17T02:21:58.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.558+0000 7fbfb4ff9700 1 -- 172.21.15.117:0/1094963604 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fbfac01a9d0 con 0x7fbfb80688d0 2024-08-17T02:21:58.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.558+0000 7fbfb4ff9700 1 -- 172.21.15.117:0/1094963604 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7fbfac011900 con 0x7fbfb80688d0 2024-08-17T02:21:58.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.558+0000 7fbfbdb3d700 1 -- 172.21.15.117:0/1094963604 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfb8152550 con 0x7fbfb80688d0 2024-08-17T02:21:58.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.562+0000 7fbfb4ff9700 1 -- 172.21.15.117:0/1094963604 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fbfac034060 con 0x7fbfb80688d0 2024-08-17T02:21:58.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.638+0000 7fbfbdb3d700 1 -- 172.21.15.117:0/1094963604 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9bc6a909-0c2f-4889-afe7-4a47f89b0f64", "id": 1} v 0) v1 -- 0x7fbfb80638f0 con 0x7fbfb80688d0 2024-08-17T02:21:58.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.646+0000 7fbfb4ff9700 1 -- 172.21.15.117:0/1094963604 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9bc6a909-0c2f-4889-afe7-4a47f89b0f64", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbfac015020 con 0x7fbfb80688d0 2024-08-17T02:21:58.651 INFO:teuthology.orchestra.run.smithi117.stdout:1 2024-08-17T02:21:58.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.646+0000 7fbfbdb3d700 1 -- 172.21.15.117:0/1094963604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbfb80688d0 msgr2=0x7fbfb81687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:58.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.646+0000 7fbfbdb3d700 1 --2- 172.21.15.117:0/1094963604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbfb80688d0 0x7fbfb81687a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbfb805f0e0 tx=0x7fbfac017000 comp rx=0 tx=0).stop 2024-08-17T02:21:58.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.646+0000 7fbfbdb3d700 1 -- 172.21.15.117:0/1094963604 shutdown_connections 2024-08-17T02:21:58.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.646+0000 7fbfbdb3d700 1 --2- 172.21.15.117:0/1094963604 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbfb80c8780 0x7fbfb8168020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:58.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.646+0000 7fbfbdb3d700 1 --2- 172.21.15.117:0/1094963604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfb806dfa0 0x7fbfb8156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:58.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.646+0000 7fbfbdb3d700 1 --2- 172.21.15.117:0/1094963604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbfb80688d0 0x7fbfb81687a0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:58.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.646+0000 7fbfbdb3d700 1 -- 172.21.15.117:0/1094963604 >> 172.21.15.117:0/1094963604 conn(0x7fbfb80ccfc0 msgr2=0x7fbfb8150e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:21:58.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.646+0000 7fbfbdb3d700 1 -- 172.21.15.117:0/1094963604 shutdown_connections 2024-08-17T02:21:58.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.646+0000 7fbfbdb3d700 1 -- 172.21.15.117:0/1094963604 wait complete. 2024-08-17T02:21:58.665 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 23da31d5-aefb-4edb-b79d-fa05e1becef7 2 2024-08-17T02:21:58.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.766+0000 7fe2cdccf700 1 Processor -- start 2024-08-17T02:21:58.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.766+0000 7fe2cdccf700 1 -- start start 2024-08-17T02:21:58.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.766+0000 7fe2cdccf700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2c81501e0 0x7fe2c80ab7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:21:58.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.766+0000 7fe2cdccf700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe2c8068db0 0x7fe2c80af5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:21:58.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.766+0000 7fe2cdccf700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2c8157160 con 0x7fe2c80abd30 2024-08-17T02:21:58.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.766+0000 7fe2cdccf700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2c8156550 con 0x7fe2c8068db0 2024-08-17T02:21:58.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.766+0000 7fe2cdccf700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c8156830 con 0x7fe2c81501e0 2024-08-17T02:21:58.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.770+0000 7fe2cd4ce700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe2c8068db0 0x7fe2c80af5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:58.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.770+0000 7fe2ccccd700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2c81501e0 0x7fe2c80ab7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:58.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.770+0000 7fe2cd4ce700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe2c8068db0 0x7fe2c80af5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:44402/0 (socket says 172.21.15.117:44402) 2024-08-17T02:21:58.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.770+0000 7fe2c7fff700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fe2c80abd30 0x7fe2c80686a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:49420/0 (socket says 172.21.15.117:49420) 2024-08-17T02:21:58.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.770+0000 7fe2cd4ce700 1 -- 172.21.15.117:0/3164355177 learned_addr learned my addr 172.21.15.117:0/3164355177 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-08-17T02:21:58.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.770+0000 7fe2c77fe700 1 -- 172.21.15.117:0/3164355177 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2793233391 0 0) 0x7fe2c8157160 con 0x7fe2c80abd30 2024-08-17T02:21:58.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.770+0000 7fe2ccccd700 1 -- 172.21.15.117:0/3164355177 >> v2:172.21.15.117:3300/0 conn(0x7fe2c8068db0 msgr2=0x7fe2c80af5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:21:58.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.770+0000 7fe2ccccd700 1 --2- 172.21.15.117:0/3164355177 >> v2:172.21.15.117:3300/0 conn(0x7fe2c8068db0 0x7fe2c80af5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:58.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.770+0000 7fe2ccccd700 1 -- 172.21.15.117:0/3164355177 >> v1:172.21.15.117:6789/0 conn(0x7fe2c80abd30 legacy=0x7fe2c80686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:58.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.770+0000 7fe2ccccd700 1 -- 172.21.15.117:0/3164355177 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c8156b10 con 0x7fe2c81501e0 2024-08-17T02:21:58.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.770+0000 7fe2ccccd700 1 --2- 172.21.15.117:0/3164355177 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2c81501e0 0x7fe2c80ab7f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe2b40098e0 tx=0x7fe2b40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fdc5de479c07a7a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:21:58.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.770+0000 7fe2c77fe700 1 -- 172.21.15.117:0/3164355177 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b400b640 con 0x7fe2c81501e0 2024-08-17T02:21:58.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.770+0000 7fe2c77fe700 1 -- 172.21.15.117:0/3164355177 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b400b7a0 con 0x7fe2c81501e0 2024-08-17T02:21:58.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.770+0000 7fe2c77fe700 1 -- 172.21.15.117:0/3164355177 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b400bb40 con 0x7fe2c81501e0 2024-08-17T02:21:58.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.770+0000 7fe2cdccf700 1 -- 172.21.15.117:0/3164355177 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2c81501e0 msgr2=0x7fe2c80ab7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:58.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.770+0000 7fe2cdccf700 1 --2- 172.21.15.117:0/3164355177 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2c81501e0 0x7fe2c80ab7f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe2b40098e0 tx=0x7fe2b40091a0 comp rx=0 tx=0).stop 2024-08-17T02:21:58.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.770+0000 7fe2cdccf700 1 -- 172.21.15.117:0/3164355177 shutdown_connections 2024-08-17T02:21:58.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.770+0000 7fe2cdccf700 1 --2- 172.21.15.117:0/3164355177 >> v2:172.21.15.117:3300/0 conn(0x7fe2c8068db0 0x7fe2c80af5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:58.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.770+0000 7fe2cdccf700 1 --2- 172.21.15.117:0/3164355177 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2c81501e0 0x7fe2c80ab7f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:58.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.770+0000 7fe2cdccf700 1 -- 172.21.15.117:0/3164355177 >> 172.21.15.117:0/3164355177 conn(0x7fe2c806e310 msgr2=0x7fe2c806b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:21:58.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.770+0000 7fe2cdccf700 1 -- 172.21.15.117:0/3164355177 shutdown_connections 2024-08-17T02:21:58.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.770+0000 7fe2cdccf700 1 -- 172.21.15.117:0/3164355177 wait complete. 2024-08-17T02:21:58.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.770+0000 7fe2cdccf700 1 Processor -- start 2024-08-17T02:21:58.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.770+0000 7fe2cdccf700 1 -- start start 2024-08-17T02:21:58.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.774+0000 7fe2cdccf700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2c8068db0 0x7fe2c8151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:21:58.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.774+0000 7fe2cdccf700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2c80abd30 0x7fe2c813ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:21:58.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.774+0000 7fe2cdccf700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe2c81501e0 0x7fe2c8151d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:21:58.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.774+0000 7fe2cdccf700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c8152890 con 0x7fe2c81501e0 2024-08-17T02:21:58.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.774+0000 7fe2cdccf700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c8149a80 con 0x7fe2c80abd30 2024-08-17T02:21:58.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.774+0000 7fe2cdccf700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c8150750 con 0x7fe2c8068db0 2024-08-17T02:21:58.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.774+0000 7fe2ccccd700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2c8068db0 0x7fe2c8151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:58.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.774+0000 7fe2ccccd700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2c8068db0 0x7fe2c8151510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:55178/0 (socket says 172.21.15.117:55178) 2024-08-17T02:21:58.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.774+0000 7fe2ccccd700 1 -- 172.21.15.117:0/3747246993 learned_addr learned my addr 172.21.15.117:0/3747246993 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-08-17T02:21:58.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.774+0000 7fe2c7fff700 1 --2- 172.21.15.117:0/3747246993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2c80abd30 0x7fe2c813ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:58.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.774+0000 7fe2cd4ce700 1 --2- 172.21.15.117:0/3747246993 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe2c81501e0 0x7fe2c8151d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:58.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.774+0000 7fe2ccccd700 1 -- 172.21.15.117:0/3747246993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2c80abd30 msgr2=0x7fe2c813ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:58.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.774+0000 7fe2ccccd700 1 --2- 172.21.15.117:0/3747246993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2c80abd30 0x7fe2c813ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:58.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.774+0000 7fe2ccccd700 1 -- 172.21.15.117:0/3747246993 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe2c81501e0 msgr2=0x7fe2c8151d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:58.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.774+0000 7fe2ccccd700 1 --2- 172.21.15.117:0/3747246993 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe2c81501e0 0x7fe2c8151d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:58.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.774+0000 7fe2ccccd700 1 -- 172.21.15.117:0/3747246993 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b4009420 con 0x7fe2c8068db0 2024-08-17T02:21:58.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.774+0000 7fe2cd4ce700 1 --2- 172.21.15.117:0/3747246993 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe2c81501e0 0x7fe2c8151d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:21:58.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.774+0000 7fe2ccccd700 1 --2- 172.21.15.117:0/3747246993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2c8068db0 0x7fe2c8151510 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe2b40093f0 tx=0x7fe2b4017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:21:58.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.774+0000 7fe2c4ff9700 1 -- 172.21.15.117:0/3747246993 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b400bb20 con 0x7fe2c8068db0 2024-08-17T02:21:58.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.774+0000 7fe2c4ff9700 1 -- 172.21.15.117:0/3747246993 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b4011420 con 0x7fe2c8068db0 2024-08-17T02:21:58.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.774+0000 7fe2cdccf700 1 -- 172.21.15.117:0/3747246993 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2c8150a30 con 0x7fe2c8068db0 2024-08-17T02:21:58.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.774+0000 7fe2c4ff9700 1 -- 172.21.15.117:0/3747246993 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b40117c0 con 0x7fe2c8068db0 2024-08-17T02:21:58.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.774+0000 7fe2cdccf700 1 -- 172.21.15.117:0/3747246993 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2c8150ff0 con 0x7fe2c8068db0 2024-08-17T02:21:58.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.774+0000 7fe2c4ff9700 1 -- 172.21.15.117:0/3747246993 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fe2b4011bf0 con 0x7fe2c8068db0 2024-08-17T02:21:58.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.774+0000 7fe2c4ff9700 1 -- 172.21.15.117:0/3747246993 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7fe2b402eaf0 con 0x7fe2c8068db0 2024-08-17T02:21:58.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.774+0000 7fe2cdccf700 1 -- 172.21.15.117:0/3747246993 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2c81511e0 con 0x7fe2c8068db0 2024-08-17T02:21:58.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.778+0000 7fe2c4ff9700 1 -- 172.21.15.117:0/3747246993 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fe2b4033060 con 0x7fe2c8068db0 2024-08-17T02:21:58.790 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-17T02:21:58.786+0000 7fd04ca4f000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-17T02:21:58.846 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-17T02:21:58.842+0000 7fd04ca4f000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-17T02:21:58.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.858+0000 7fe2cdccf700 1 -- 172.21.15.117:0/3747246993 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd new", "uuid": "23da31d5-aefb-4edb-b79d-fa05e1becef7", "id": 2} v 0) v1 -- 0x7fe2c80638f0 con 0x7fe2c8068db0 2024-08-17T02:21:58.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.866+0000 7fe2c4ff9700 1 -- 172.21.15.117:0/3747246993 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "23da31d5-aefb-4edb-b79d-fa05e1becef7", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe2b4015020 con 0x7fe2c8068db0 2024-08-17T02:21:58.873 INFO:teuthology.orchestra.run.smithi117.stdout:2 2024-08-17T02:21:58.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.870+0000 7fe2cdccf700 1 -- 172.21.15.117:0/3747246993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2c8068db0 msgr2=0x7fe2c8151510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:58.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.870+0000 7fe2cdccf700 1 --2- 172.21.15.117:0/3747246993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2c8068db0 0x7fe2c8151510 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe2b40093f0 tx=0x7fe2b4017000 comp rx=0 tx=0).stop 2024-08-17T02:21:58.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.870+0000 7fe2cdccf700 1 -- 172.21.15.117:0/3747246993 shutdown_connections 2024-08-17T02:21:58.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.870+0000 7fe2cdccf700 1 --2- 172.21.15.117:0/3747246993 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe2c81501e0 0x7fe2c8151d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:58.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.870+0000 7fe2cdccf700 1 --2- 172.21.15.117:0/3747246993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2c80abd30 0x7fe2c813ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:58.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.870+0000 7fe2cdccf700 1 --2- 172.21.15.117:0/3747246993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2c8068db0 0x7fe2c8151510 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:58.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.870+0000 7fe2cdccf700 1 -- 172.21.15.117:0/3747246993 >> 172.21.15.117:0/3747246993 conn(0x7fe2c806e310 msgr2=0x7fe2c814a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:21:58.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.870+0000 7fe2cdccf700 1 -- 172.21.15.117:0/3747246993 shutdown_connections 2024-08-17T02:21:58.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.870+0000 7fe2cdccf700 1 -- 172.21.15.117:0/3747246993 wait complete. 2024-08-17T02:21:58.882 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-08-17T02:21:58.877+0000 7f89ee2e3000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-17T02:21:58.886 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 6e4a5ec2-b415-45ef-8381-61a59eb65224 3 2024-08-17T02:21:58.939 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-08-17T02:21:58.933+0000 7f89ee2e3000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-17T02:21:58.963 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-17T02:21:58.958+0000 7fd04ca4f000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:21:58.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.990+0000 7f1addcf3700 1 Processor -- start 2024-08-17T02:21:58.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.990+0000 7f1addcf3700 1 -- start start 2024-08-17T02:21:58.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.994+0000 7f1addcf3700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f1ad81501b0 0x7f1ad8150580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:21:58.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.994+0000 7f1addcf3700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ad80ab860 0x7f1ad8156e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:21:58.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.994+0000 7f1addcf3700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1ad80686a0 0x7f1ad8068b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:21:58.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.994+0000 7f1addcf3700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad8069040 con 0x7f1ad81501b0 2024-08-17T02:21:58.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.994+0000 7f1addcf3700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad815a3b0 con 0x7f1ad80686a0 2024-08-17T02:21:58.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.994+0000 7f1addcf3700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad8157390 con 0x7f1ad80ab860 2024-08-17T02:21:58.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.994+0000 7f1ad7fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ad80ab860 0x7f1ad8156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:58.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.994+0000 7f1ad7fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ad80ab860 0x7f1ad8156e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:55184/0 (socket says 172.21.15.117:55184) 2024-08-17T02:21:58.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.994+0000 7f1ad7fff700 1 -- 172.21.15.117:0/1132651874 learned_addr learned my addr 172.21.15.117:0/1132651874 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-08-17T02:21:58.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.994+0000 7f1add4f2700 1 --2- 172.21.15.117:0/1132651874 >> v2:172.21.15.117:3300/0 conn(0x7f1ad80686a0 0x7f1ad8068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:58.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.994+0000 7f1adccf1700 1 --2- 172.21.15.117:0/1132651874 >> v2:172.21.15.104:3300/0 conn(0x7f1ad81501b0 0x7f1ad8150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:58.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.994+0000 7f1add4f2700 1 -- 172.21.15.117:0/1132651874 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ad80ab860 msgr2=0x7f1ad8156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:21:58.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.994+0000 7f1add4f2700 1 --2- 172.21.15.117:0/1132651874 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ad80ab860 0x7f1ad8156e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:58.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.994+0000 7f1add4f2700 1 -- 172.21.15.117:0/1132651874 >> v2:172.21.15.104:3300/0 conn(0x7f1ad81501b0 msgr2=0x7f1ad8150580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:21:58.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.994+0000 7f1add4f2700 1 --2- 172.21.15.117:0/1132651874 >> v2:172.21.15.104:3300/0 conn(0x7f1ad81501b0 0x7f1ad8150580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:58.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.994+0000 7f1add4f2700 1 -- 172.21.15.117:0/1132651874 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad8159ac0 con 0x7f1ad80686a0 2024-08-17T02:21:58.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.994+0000 7f1ad7fff700 1 --2- 172.21.15.117:0/1132651874 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ad80ab860 0x7f1ad8156e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:21:58.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.994+0000 7f1add4f2700 1 --2- 172.21.15.117:0/1132651874 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ad80686a0 0x7f1ad8068b00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8153ff0 tx=0x7f1ad0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea3383728f2b58f7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:21:59.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.994+0000 7f1ad77fe700 1 -- 172.21.15.117:0/1132651874 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad000e070 con 0x7f1ad80686a0 2024-08-17T02:21:59.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.994+0000 7f1ad77fe700 1 -- 172.21.15.117:0/1132651874 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad000bab0 con 0x7f1ad80686a0 2024-08-17T02:21:59.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.994+0000 7f1ad77fe700 1 -- 172.21.15.117:0/1132651874 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad000be70 con 0x7f1ad80686a0 2024-08-17T02:21:59.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.994+0000 7f1addcf3700 1 -- 172.21.15.117:0/1132651874 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ad80686a0 msgr2=0x7f1ad8068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:59.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.994+0000 7f1addcf3700 1 --2- 172.21.15.117:0/1132651874 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ad80686a0 0x7f1ad8068b00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8153ff0 tx=0x7f1ad0009780 comp rx=0 tx=0).stop 2024-08-17T02:21:59.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.994+0000 7f1addcf3700 1 -- 172.21.15.117:0/1132651874 shutdown_connections 2024-08-17T02:21:59.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.994+0000 7f1addcf3700 1 --2- 172.21.15.117:0/1132651874 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ad80686a0 0x7f1ad8068b00 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:59.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.994+0000 7f1addcf3700 1 --2- 172.21.15.117:0/1132651874 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ad80ab860 0x7f1ad8156e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:59.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.994+0000 7f1addcf3700 1 --2- 172.21.15.117:0/1132651874 >> v2:172.21.15.104:3300/0 conn(0x7f1ad81501b0 0x7f1ad8150580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:59.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.994+0000 7f1addcf3700 1 -- 172.21.15.117:0/1132651874 >> 172.21.15.117:0/1132651874 conn(0x7f1ad806e350 msgr2=0x7f1ad806b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:21:59.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.994+0000 7f1addcf3700 1 -- 172.21.15.117:0/1132651874 shutdown_connections 2024-08-17T02:21:59.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.994+0000 7f1addcf3700 1 -- 172.21.15.117:0/1132651874 wait complete. 2024-08-17T02:21:59.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.998+0000 7f1addcf3700 1 Processor -- start 2024-08-17T02:21:59.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.998+0000 7f1addcf3700 1 -- start start 2024-08-17T02:21:59.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.998+0000 7f1addcf3700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ad80686a0 0x7f1ad814d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:21:59.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.998+0000 7f1addcf3700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1ad80ab860 0x7f1ad8151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:21:59.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.998+0000 7f1addcf3700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ad81501b0 0x7f1ad80b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:21:59.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.998+0000 7f1addcf3700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad8150e70 con 0x7f1ad80ab860 2024-08-17T02:21:59.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.998+0000 7f1addcf3700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad806b600 con 0x7f1ad80686a0 2024-08-17T02:21:59.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.998+0000 7f1addcf3700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad8150820 con 0x7f1ad81501b0 2024-08-17T02:21:59.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.998+0000 7f1add4f2700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ad81501b0 0x7f1ad80b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:59.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.998+0000 7f1adccf1700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ad80686a0 0x7f1ad814d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:59.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.998+0000 7f1add4f2700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ad81501b0 0x7f1ad80b0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:55194/0 (socket says 172.21.15.117:55194) 2024-08-17T02:21:59.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.998+0000 7f1add4f2700 1 -- 172.21.15.117:0/785354085 learned_addr learned my addr 172.21.15.117:0/785354085 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-08-17T02:21:59.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.998+0000 7f1ad7fff700 1 --2- 172.21.15.117:0/785354085 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1ad80ab860 0x7f1ad8151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:59.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.998+0000 7f1add4f2700 1 -- 172.21.15.117:0/785354085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ad80686a0 msgr2=0x7f1ad814d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:59.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.998+0000 7f1add4f2700 1 --2- 172.21.15.117:0/785354085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ad80686a0 0x7f1ad814d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:59.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.998+0000 7f1add4f2700 1 -- 172.21.15.117:0/785354085 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1ad80ab860 msgr2=0x7f1ad8151300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:59.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.998+0000 7f1add4f2700 1 --2- 172.21.15.117:0/785354085 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1ad80ab860 0x7f1ad8151300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:59.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.998+0000 7f1add4f2700 1 -- 172.21.15.117:0/785354085 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac400b790 con 0x7f1ad81501b0 2024-08-17T02:21:59.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.998+0000 7f1add4f2700 1 --2- 172.21.15.117:0/785354085 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ad81501b0 0x7f1ad80b0230 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1ad00097c0 tx=0x7f1ad0019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:21:59.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.998+0000 7f1ad4ff9700 1 -- 172.21.15.117:0/785354085 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad0012db0 con 0x7f1ad81501b0 2024-08-17T02:21:59.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.998+0000 7f1ad4ff9700 1 -- 172.21.15.117:0/785354085 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad0027470 con 0x7f1ad81501b0 2024-08-17T02:21:59.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.998+0000 7f1ad4ff9700 1 -- 172.21.15.117:0/785354085 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad0027830 con 0x7f1ad81501b0 2024-08-17T02:21:59.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.998+0000 7f1addcf3700 1 -- 172.21.15.117:0/785354085 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad0009a20 con 0x7f1ad81501b0 2024-08-17T02:21:59.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.998+0000 7f1addcf3700 1 -- 172.21.15.117:0/785354085 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad814d550 con 0x7f1ad81501b0 2024-08-17T02:21:59.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.998+0000 7f1ad4ff9700 1 -- 172.21.15.117:0/785354085 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f1ad0024070 con 0x7f1ad81501b0 2024-08-17T02:21:59.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:58.998+0000 7f1ad4ff9700 1 -- 172.21.15.117:0/785354085 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f1ad001db90 con 0x7f1ad81501b0 2024-08-17T02:21:59.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.002+0000 7f1addcf3700 1 -- 172.21.15.117:0/785354085 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad8150680 con 0x7f1ad81501b0 2024-08-17T02:21:59.010 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.006+0000 7f1ad4ff9700 1 -- 172.21.15.117:0/785354085 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f1ad00477a0 con 0x7f1ad81501b0 2024-08-17T02:21:59.054 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-08-17T02:21:59.049+0000 7f89ee2e3000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:21:59.089 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.082+0000 7f1addcf3700 1 -- 172.21.15.117:0/785354085 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6e4a5ec2-b415-45ef-8381-61a59eb65224", "id": 3} v 0) v1 -- 0x7f1ad8150fe0 con 0x7f1ad81501b0 2024-08-17T02:21:59.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.090+0000 7f1ad4ff9700 1 -- 172.21.15.117:0/785354085 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6e4a5ec2-b415-45ef-8381-61a59eb65224", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1ad0036030 con 0x7f1ad81501b0 2024-08-17T02:21:59.097 INFO:teuthology.orchestra.run.smithi117.stdout:3 2024-08-17T02:21:59.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.094+0000 7f1addcf3700 1 -- 172.21.15.117:0/785354085 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ad81501b0 msgr2=0x7f1ad80b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:59.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.094+0000 7f1addcf3700 1 --2- 172.21.15.117:0/785354085 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ad81501b0 0x7f1ad80b0230 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1ad00097c0 tx=0x7f1ad0019000 comp rx=0 tx=0).stop 2024-08-17T02:21:59.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.094+0000 7f1addcf3700 1 -- 172.21.15.117:0/785354085 shutdown_connections 2024-08-17T02:21:59.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.094+0000 7f1addcf3700 1 --2- 172.21.15.117:0/785354085 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ad81501b0 0x7f1ad80b0230 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:59.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.094+0000 7f1addcf3700 1 --2- 172.21.15.117:0/785354085 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1ad80ab860 0x7f1ad8151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:59.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.094+0000 7f1addcf3700 1 --2- 172.21.15.117:0/785354085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ad80686a0 0x7f1ad814d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:59.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.094+0000 7f1addcf3700 1 -- 172.21.15.117:0/785354085 >> 172.21.15.117:0/785354085 conn(0x7f1ad806e350 msgr2=0x7f1ad81558b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:21:59.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.094+0000 7f1addcf3700 1 -- 172.21.15.117:0/785354085 shutdown_connections 2024-08-17T02:21:59.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.094+0000 7f1addcf3700 1 -- 172.21.15.117:0/785354085 wait complete. 2024-08-17T02:21:59.111 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 8d5bea2d-9039-4013-8c99-2c046c5b8a17 4 2024-08-17T02:21:59.190 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-17T02:21:59.186+0000 7fd04ca4f000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-17T02:21:59.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.210+0000 7fb54b23b700 1 Processor -- start 2024-08-17T02:21:59.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.210+0000 7fb54b23b700 1 -- start start 2024-08-17T02:21:59.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.210+0000 7fb54b23b700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb544159380 0x7fb5440c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:21:59.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.210+0000 7fb54b23b700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb54406a3b0 con 0x7fb544158fb0 2024-08-17T02:21:59.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.210+0000 7fb54b23b700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5440a9fe0 con 0x7fb544068db0 2024-08-17T02:21:59.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.210+0000 7fb54b23b700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb54406a0d0 con 0x7fb544159380 2024-08-17T02:21:59.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.210+0000 7fb543fff700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fb544068db0 0x7fb5440aa470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:49436/0 (socket says 172.21.15.117:49436) 2024-08-17T02:21:59.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.210+0000 7fb543fff700 1 -- 172.21.15.117:0/147732978 learned_addr learned my addr 172.21.15.117:0/147732978 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-08-17T02:21:59.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.210+0000 7fb5497d8700 1 --2- 172.21.15.117:0/147732978 >> v2:172.21.15.104:3300/0 conn(0x7fb544159380 0x7fb5440c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:59.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.210+0000 7fb5437fe700 1 -- 172.21.15.117:0/147732978 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2096382915 0 0) 0x7fb5440a9fe0 con 0x7fb544068db0 2024-08-17T02:21:59.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.210+0000 7fb5437fe700 1 -- 172.21.15.117:0/147732978 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb534003570 con 0x7fb544068db0 2024-08-17T02:21:59.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.210+0000 7fb5437fe700 1 -- 172.21.15.117:0/147732978 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4034881548 0 0) 0x7fb54406a3b0 con 0x7fb544158fb0 2024-08-17T02:21:59.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.210+0000 7fb5437fe700 1 -- 172.21.15.117:0/147732978 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5440a9fe0 con 0x7fb544158fb0 2024-08-17T02:21:59.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.210+0000 7fb5497d8700 1 -- 172.21.15.117:0/147732978 >> v1:172.21.15.117:6789/0 conn(0x7fb544068db0 legacy=0x7fb5440aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:59.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.210+0000 7fb5497d8700 1 -- 172.21.15.117:0/147732978 >> v1:172.21.15.104:6789/0 conn(0x7fb544158fb0 legacy=0x7fb5440686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:59.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.210+0000 7fb5497d8700 1 -- 172.21.15.117:0/147732978 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5440a9990 con 0x7fb544159380 2024-08-17T02:21:59.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.214+0000 7fb5497d8700 1 --2- 172.21.15.117:0/147732978 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb544159380 0x7fb5440c8b70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb53c009e60 tx=0x7fb53c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a469ba1ba0d3f6f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:21:59.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.214+0000 7fb5437fe700 1 -- 172.21.15.117:0/147732978 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53c00e070 con 0x7fb544159380 2024-08-17T02:21:59.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.214+0000 7fb5437fe700 1 -- 172.21.15.117:0/147732978 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb53c00bab0 con 0x7fb544159380 2024-08-17T02:21:59.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.214+0000 7fb5437fe700 1 -- 172.21.15.117:0/147732978 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53c00be70 con 0x7fb544159380 2024-08-17T02:21:59.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.214+0000 7fb54b23b700 1 -- 172.21.15.117:0/147732978 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb544159380 msgr2=0x7fb5440c8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:59.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.214+0000 7fb54b23b700 1 --2- 172.21.15.117:0/147732978 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb544159380 0x7fb5440c8b70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb53c009e60 tx=0x7fb53c009780 comp rx=0 tx=0).stop 2024-08-17T02:21:59.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.214+0000 7fb54b23b700 1 -- 172.21.15.117:0/147732978 shutdown_connections 2024-08-17T02:21:59.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.214+0000 7fb54b23b700 1 --2- 172.21.15.117:0/147732978 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb544159380 0x7fb5440c8b70 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:59.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.214+0000 7fb54b23b700 1 -- 172.21.15.117:0/147732978 >> 172.21.15.117:0/147732978 conn(0x7fb5440c9bf0 msgr2=0x7fb54406d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:21:59.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.214+0000 7fb54b23b700 1 -- 172.21.15.117:0/147732978 shutdown_connections 2024-08-17T02:21:59.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.214+0000 7fb54b23b700 1 -- 172.21.15.117:0/147732978 wait complete. 2024-08-17T02:21:59.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.214+0000 7fb54b23b700 1 Processor -- start 2024-08-17T02:21:59.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.214+0000 7fb54b23b700 1 -- start start 2024-08-17T02:21:59.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.218+0000 7fb54b23b700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb544068db0 0x7fb544151c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:21:59.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.218+0000 7fb54b23b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb544158fb0 0x7fb544151500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:21:59.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.218+0000 7fb54b23b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb544159380 0x7fb544156da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:21:59.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.218+0000 7fb54b23b700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5440aa850 con 0x7fb544158fb0 2024-08-17T02:21:59.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.218+0000 7fb54b23b700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54415c250 con 0x7fb544159380 2024-08-17T02:21:59.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.218+0000 7fb54b23b700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb544151a40 con 0x7fb544068db0 2024-08-17T02:21:59.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.218+0000 7fb548fd7700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb544068db0 0x7fb544151c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:59.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.218+0000 7fb5497d8700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb544159380 0x7fb544156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:59.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.218+0000 7fb548fd7700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb544068db0 0x7fb544151c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:55204/0 (socket says 172.21.15.117:55204) 2024-08-17T02:21:59.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.218+0000 7fb548fd7700 1 -- 172.21.15.117:0/1422697499 learned_addr learned my addr 172.21.15.117:0/1422697499 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-08-17T02:21:59.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.218+0000 7fb543fff700 1 --2- 172.21.15.117:0/1422697499 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb544158fb0 0x7fb544151500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:59.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.218+0000 7fb5497d8700 1 -- 172.21.15.117:0/1422697499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb544068db0 msgr2=0x7fb544151c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:59.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.218+0000 7fb5497d8700 1 --2- 172.21.15.117:0/1422697499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb544068db0 0x7fb544151c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:59.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.218+0000 7fb5497d8700 1 -- 172.21.15.117:0/1422697499 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb544158fb0 msgr2=0x7fb544151500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:59.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.218+0000 7fb5497d8700 1 --2- 172.21.15.117:0/1422697499 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb544158fb0 0x7fb544151500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:59.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.218+0000 7fb5497d8700 1 -- 172.21.15.117:0/1422697499 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb53c009a20 con 0x7fb544159380 2024-08-17T02:21:59.225 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.218+0000 7fb548fd7700 1 --2- 172.21.15.117:0/1422697499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb544068db0 0x7fb544151c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:21:59.225 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.218+0000 7fb5497d8700 1 --2- 172.21.15.117:0/1422697499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb544159380 0x7fb544156da0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb53c016000 tx=0x7fb53c019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:21:59.225 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.218+0000 7fb540ff9700 1 -- 172.21.15.117:0/1422697499 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53c012db0 con 0x7fb544159380 2024-08-17T02:21:59.225 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.218+0000 7fb540ff9700 1 -- 172.21.15.117:0/1422697499 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb53c026480 con 0x7fb544159380 2024-08-17T02:21:59.225 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.218+0000 7fb54b23b700 1 -- 172.21.15.117:0/1422697499 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb54415b920 con 0x7fb544159380 2024-08-17T02:21:59.225 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.218+0000 7fb540ff9700 1 -- 172.21.15.117:0/1422697499 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53c026840 con 0x7fb544159380 2024-08-17T02:21:59.225 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.218+0000 7fb54b23b700 1 -- 172.21.15.117:0/1422697499 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb54415bee0 con 0x7fb544159380 2024-08-17T02:21:59.225 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.218+0000 7fb540ff9700 1 -- 172.21.15.117:0/1422697499 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fb53c01c400 con 0x7fb544159380 2024-08-17T02:21:59.225 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.218+0000 7fb540ff9700 1 -- 172.21.15.117:0/1422697499 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7fb53c026e40 con 0x7fb544159380 2024-08-17T02:21:59.225 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.218+0000 7fb54b23b700 1 -- 172.21.15.117:0/1422697499 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5440645c0 con 0x7fb544159380 2024-08-17T02:21:59.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.226+0000 7fb540ff9700 1 -- 172.21.15.117:0/1422697499 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fb53c0457a0 con 0x7fb544159380 2024-08-17T02:21:59.242 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-17T02:21:59.234+0000 7fd04ca4f000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-17T02:21:59.292 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-08-17T02:21:59.289+0000 7f89ee2e3000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-17T02:21:59.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.294+0000 7fb54b23b700 1 -- 172.21.15.117:0/1422697499 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8d5bea2d-9039-4013-8c99-2c046c5b8a17", "id": 4} v 0) v1 -- 0x7fb54415c390 con 0x7fb544159380 2024-08-17T02:21:59.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.302+0000 7fb540ff9700 1 -- 172.21.15.117:0/1422697499 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8d5bea2d-9039-4013-8c99-2c046c5b8a17", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb53c034070 con 0x7fb544159380 2024-08-17T02:21:59.308 INFO:teuthology.orchestra.run.smithi117.stdout:4 2024-08-17T02:21:59.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.306+0000 7fb54b23b700 1 -- 172.21.15.117:0/1422697499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb544159380 msgr2=0x7fb544156da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:59.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.306+0000 7fb54b23b700 1 --2- 172.21.15.117:0/1422697499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb544159380 0x7fb544156da0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb53c016000 tx=0x7fb53c019000 comp rx=0 tx=0).stop 2024-08-17T02:21:59.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.306+0000 7fb54b23b700 1 -- 172.21.15.117:0/1422697499 shutdown_connections 2024-08-17T02:21:59.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.306+0000 7fb54b23b700 1 --2- 172.21.15.117:0/1422697499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb544159380 0x7fb544156da0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:59.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.306+0000 7fb54b23b700 1 --2- 172.21.15.117:0/1422697499 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb544158fb0 0x7fb544151500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:59.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.306+0000 7fb54b23b700 1 --2- 172.21.15.117:0/1422697499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb544068db0 0x7fb544151c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:59.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.306+0000 7fb54b23b700 1 -- 172.21.15.117:0/1422697499 >> 172.21.15.117:0/1422697499 conn(0x7fb5440c9bf0 msgr2=0x7fb5440cb650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:21:59.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.306+0000 7fb54b23b700 1 -- 172.21.15.117:0/1422697499 shutdown_connections 2024-08-17T02:21:59.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.306+0000 7fb54b23b700 1 -- 172.21.15.117:0/1422697499 wait complete. 2024-08-17T02:21:59.322 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new de8b36fc-121c-4f05-8f5b-28f513d9f21f 5 2024-08-17T02:21:59.344 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-08-17T02:21:59.341+0000 7f89ee2e3000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-17T02:21:59.419 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-17T02:21:59.414+0000 7fd04ca4f000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-17T02:21:59.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.426+0000 7f2e854e5700 1 Processor -- start 2024-08-17T02:21:59.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.426+0000 7f2e854e5700 1 -- start start 2024-08-17T02:21:59.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.426+0000 7f2e854e5700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2e80069c90 0x7f2e800b0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:21:59.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.426+0000 7f2e854e5700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e80069800 con 0x7f2e800cbc00 2024-08-17T02:21:59.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.426+0000 7f2e854e5700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e800c89c0 con 0x7f2e8006a0e0 2024-08-17T02:21:59.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.426+0000 7f2e854e5700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e800c8ca0 con 0x7f2e80069c90 2024-08-17T02:21:59.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.426+0000 7f2e7f7fe700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f2e8006a0e0 0x7f2e800cbfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:49444/0 (socket says 172.21.15.117:49444) 2024-08-17T02:21:59.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.426+0000 7f2e7f7fe700 1 -- 172.21.15.117:0/2833475351 learned_addr learned my addr 172.21.15.117:0/2833475351 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-08-17T02:21:59.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.426+0000 7f2e77fff700 1 --2- 172.21.15.117:0/2833475351 >> v2:172.21.15.104:3300/0 conn(0x7f2e80069c90 0x7f2e800b0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:59.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.426+0000 7f2e7e7fc700 1 -- 172.21.15.117:0/2833475351 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3591716233 0 0) 0x7f2e80069800 con 0x7f2e800cbc00 2024-08-17T02:21:59.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.426+0000 7f2e7e7fc700 1 -- 172.21.15.117:0/2833475351 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e6c003570 con 0x7f2e800cbc00 2024-08-17T02:21:59.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.426+0000 7f2e7e7fc700 1 -- 172.21.15.117:0/2833475351 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3018435722 0 0) 0x7f2e800c89c0 con 0x7f2e8006a0e0 2024-08-17T02:21:59.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.426+0000 7f2e7e7fc700 1 -- 172.21.15.117:0/2833475351 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e80069800 con 0x7f2e8006a0e0 2024-08-17T02:21:59.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.426+0000 7f2e77fff700 1 -- 172.21.15.117:0/2833475351 >> v1:172.21.15.117:6789/0 conn(0x7f2e8006a0e0 legacy=0x7f2e800cbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:59.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.426+0000 7f2e77fff700 1 -- 172.21.15.117:0/2833475351 >> v1:172.21.15.104:6789/0 conn(0x7f2e800cbc00 legacy=0x7f2e800ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:59.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.426+0000 7f2e77fff700 1 -- 172.21.15.117:0/2833475351 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e80069490 con 0x7f2e80069c90 2024-08-17T02:21:59.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.426+0000 7f2e77fff700 1 --2- 172.21.15.117:0/2833475351 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2e80069c90 0x7f2e800b0ed0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2e680098e0 tx=0x7f2e680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5992e65290542dd3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:21:59.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.426+0000 7f2e7e7fc700 1 -- 172.21.15.117:0/2833475351 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e68011630 con 0x7f2e80069c90 2024-08-17T02:21:59.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.426+0000 7f2e7e7fc700 1 -- 172.21.15.117:0/2833475351 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e68011790 con 0x7f2e80069c90 2024-08-17T02:21:59.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.426+0000 7f2e7e7fc700 1 -- 172.21.15.117:0/2833475351 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e68011b30 con 0x7f2e80069c90 2024-08-17T02:21:59.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.426+0000 7f2e854e5700 1 -- 172.21.15.117:0/2833475351 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2e80069c90 msgr2=0x7f2e800b0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:59.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.426+0000 7f2e854e5700 1 --2- 172.21.15.117:0/2833475351 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2e80069c90 0x7f2e800b0ed0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2e680098e0 tx=0x7f2e680091a0 comp rx=0 tx=0).stop 2024-08-17T02:21:59.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.426+0000 7f2e854e5700 1 -- 172.21.15.117:0/2833475351 shutdown_connections 2024-08-17T02:21:59.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.426+0000 7f2e854e5700 1 --2- 172.21.15.117:0/2833475351 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2e80069c90 0x7f2e800b0ed0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:59.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.426+0000 7f2e854e5700 1 -- 172.21.15.117:0/2833475351 >> 172.21.15.117:0/2833475351 conn(0x7f2e800caab0 msgr2=0x7f2e800caeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:21:59.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.430+0000 7f2e854e5700 1 -- 172.21.15.117:0/2833475351 shutdown_connections 2024-08-17T02:21:59.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.430+0000 7f2e854e5700 1 -- 172.21.15.117:0/2833475351 wait complete. 2024-08-17T02:21:59.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.430+0000 7f2e854e5700 1 Processor -- start 2024-08-17T02:21:59.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.430+0000 7f2e854e5700 1 -- start start 2024-08-17T02:21:59.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.430+0000 7f2e854e5700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e80069c90 0x7f2e800c5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:21:59.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.430+0000 7f2e854e5700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e8006a0e0 0x7f2e800c17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:21:59.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.430+0000 7f2e854e5700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2e800cbc00 0x7f2e800c1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:21:59.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.430+0000 7f2e854e5700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e80156ac0 con 0x7f2e800cbc00 2024-08-17T02:21:59.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.430+0000 7f2e854e5700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e800c3330 con 0x7f2e80069c90 2024-08-17T02:21:59.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.430+0000 7f2e854e5700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e800c2440 con 0x7f2e8006a0e0 2024-08-17T02:21:59.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.430+0000 7f2e7effd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e80069c90 0x7f2e800c5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:59.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.430+0000 7f2e77fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e8006a0e0 0x7f2e800c17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:59.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.430+0000 7f2e77fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e8006a0e0 0x7f2e800c17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:55212/0 (socket says 172.21.15.117:55212) 2024-08-17T02:21:59.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.430+0000 7f2e77fff700 1 -- 172.21.15.117:0/504234772 learned_addr learned my addr 172.21.15.117:0/504234772 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-08-17T02:21:59.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.430+0000 7f2e7f7fe700 1 --2- 172.21.15.117:0/504234772 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2e800cbc00 0x7f2e800c1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:59.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.430+0000 7f2e77fff700 1 -- 172.21.15.117:0/504234772 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e80069c90 msgr2=0x7f2e800c5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:59.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.430+0000 7f2e77fff700 1 --2- 172.21.15.117:0/504234772 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e80069c90 0x7f2e800c5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:59.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.430+0000 7f2e77fff700 1 -- 172.21.15.117:0/504234772 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2e800cbc00 msgr2=0x7f2e800c1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:59.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.430+0000 7f2e77fff700 1 --2- 172.21.15.117:0/504234772 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2e800cbc00 0x7f2e800c1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:59.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.430+0000 7f2e77fff700 1 -- 172.21.15.117:0/504234772 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e68009420 con 0x7f2e8006a0e0 2024-08-17T02:21:59.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.430+0000 7f2e7f7fe700 1 --2- 172.21.15.117:0/504234772 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2e800cbc00 0x7f2e800c1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:21:59.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.430+0000 7f2e77fff700 1 --2- 172.21.15.117:0/504234772 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e8006a0e0 0x7f2e800c17f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2e68009ed0 tx=0x7f2e68017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:21:59.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.430+0000 7f2e76ffd700 1 -- 172.21.15.117:0/504234772 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6801f070 con 0x7f2e8006a0e0 2024-08-17T02:21:59.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.430+0000 7f2e76ffd700 1 -- 172.21.15.117:0/504234772 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e68011900 con 0x7f2e8006a0e0 2024-08-17T02:21:59.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.430+0000 7f2e854e5700 1 -- 172.21.15.117:0/504234772 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e800c2720 con 0x7f2e8006a0e0 2024-08-17T02:21:59.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.430+0000 7f2e76ffd700 1 -- 172.21.15.117:0/504234772 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e68023430 con 0x7f2e8006a0e0 2024-08-17T02:21:59.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.430+0000 7f2e854e5700 1 -- 172.21.15.117:0/504234772 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e800c2fc0 con 0x7f2e8006a0e0 2024-08-17T02:21:59.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.430+0000 7f2e76ffd700 1 -- 172.21.15.117:0/504234772 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f2e68023840 con 0x7f2e8006a0e0 2024-08-17T02:21:59.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.430+0000 7f2e76ffd700 1 -- 172.21.15.117:0/504234772 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f2e68023af0 con 0x7f2e8006a0e0 2024-08-17T02:21:59.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.434+0000 7f2e854e5700 1 -- 172.21.15.117:0/504234772 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e800645c0 con 0x7f2e8006a0e0 2024-08-17T02:21:59.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.438+0000 7f2e76ffd700 1 -- 172.21.15.117:0/504234772 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f2e68028070 con 0x7f2e8006a0e0 2024-08-17T02:21:59.482 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-17T02:21:59.478+0000 7fd04ca4f000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-17T02:21:59.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.506+0000 7f2e854e5700 1 -- 172.21.15.117:0/504234772 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd new", "uuid": "de8b36fc-121c-4f05-8f5b-28f513d9f21f", "id": 5} v 0) v1 -- 0x7f2e8006dd70 con 0x7f2e8006a0e0 2024-08-17T02:21:59.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.514+0000 7f2e76ffd700 1 -- 172.21.15.117:0/504234772 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "de8b36fc-121c-4f05-8f5b-28f513d9f21f", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2e68015020 con 0x7f2e8006a0e0 2024-08-17T02:21:59.519 INFO:teuthology.orchestra.run.smithi117.stdout:5 2024-08-17T02:21:59.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.514+0000 7f2e854e5700 1 -- 172.21.15.117:0/504234772 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e8006a0e0 msgr2=0x7f2e800c17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:59.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.514+0000 7f2e854e5700 1 --2- 172.21.15.117:0/504234772 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e8006a0e0 0x7f2e800c17f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2e68009ed0 tx=0x7f2e68017000 comp rx=0 tx=0).stop 2024-08-17T02:21:59.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.514+0000 7f2e854e5700 1 -- 172.21.15.117:0/504234772 shutdown_connections 2024-08-17T02:21:59.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.514+0000 7f2e854e5700 1 --2- 172.21.15.117:0/504234772 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2e800cbc00 0x7f2e800c1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:59.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.514+0000 7f2e854e5700 1 --2- 172.21.15.117:0/504234772 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e8006a0e0 0x7f2e800c17f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:59.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.514+0000 7f2e854e5700 1 --2- 172.21.15.117:0/504234772 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e80069c90 0x7f2e800c5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:59.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.514+0000 7f2e854e5700 1 -- 172.21.15.117:0/504234772 >> 172.21.15.117:0/504234772 conn(0x7f2e800caab0 msgr2=0x7f2e8006a880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:21:59.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.514+0000 7f2e854e5700 1 -- 172.21.15.117:0/504234772 shutdown_connections 2024-08-17T02:21:59.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.514+0000 7f2e854e5700 1 -- 172.21.15.117:0/504234772 wait complete. 2024-08-17T02:21:59.524 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-08-17T02:21:59.521+0000 7f89ee2e3000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-17T02:21:59.532 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 6a87f09f-7bf7-4f7a-be87-530ac1ff8ea7 6 2024-08-17T02:21:59.546 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-17T02:21:59.542+0000 7fd04ca4f000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-17T02:21:59.586 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-08-17T02:21:59.581+0000 7f89ee2e3000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-17T02:21:59.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.626+0000 7ffbf3fff700 1 Processor -- start 2024-08-17T02:21:59.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.626+0000 7ffbf3fff700 1 -- start start 2024-08-17T02:21:59.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.626+0000 7ffbf3fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffbf41501e0 0x7ffbf40ab7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:21:59.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.626+0000 7ffbf3fff700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ffbf4068db0 0x7ffbf40af5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:21:59.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.626+0000 7ffbf3fff700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbf4157160 con 0x7ffbf40abd30 2024-08-17T02:21:59.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.626+0000 7ffbf3fff700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbf4156550 con 0x7ffbf4068db0 2024-08-17T02:21:59.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.626+0000 7ffbf3fff700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbf4156830 con 0x7ffbf41501e0 2024-08-17T02:21:59.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.626+0000 7ffbf27fc700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7ffbf40abd30 0x7ffbf40686a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:49456/0 (socket says 172.21.15.117:49456) 2024-08-17T02:21:59.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.626+0000 7ffbf27fc700 1 -- 172.21.15.117:0/3136888231 learned_addr learned my addr 172.21.15.117:0/3136888231 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-08-17T02:21:59.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.630+0000 7ffbf2ffd700 1 --2- 172.21.15.117:0/3136888231 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffbf41501e0 0x7ffbf40ab7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:59.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.630+0000 7ffbf37fe700 1 --2- 172.21.15.117:0/3136888231 >> v2:172.21.15.104:3300/0 conn(0x7ffbf4068db0 0x7ffbf40af5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:59.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.630+0000 7ffbf1ffb700 1 -- 172.21.15.117:0/3136888231 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1060111304 0 0) 0x7ffbf4157160 con 0x7ffbf40abd30 2024-08-17T02:21:59.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.630+0000 7ffbf1ffb700 1 -- 172.21.15.117:0/3136888231 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbdc003570 con 0x7ffbf40abd30 2024-08-17T02:21:59.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.630+0000 7ffbf2ffd700 1 -- 172.21.15.117:0/3136888231 >> v2:172.21.15.104:3300/0 conn(0x7ffbf4068db0 msgr2=0x7ffbf40af5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:21:59.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.630+0000 7ffbf2ffd700 1 --2- 172.21.15.117:0/3136888231 >> v2:172.21.15.104:3300/0 conn(0x7ffbf4068db0 0x7ffbf40af5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:59.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.630+0000 7ffbf2ffd700 1 -- 172.21.15.117:0/3136888231 >> v1:172.21.15.117:6789/0 conn(0x7ffbf40abd30 legacy=0x7ffbf40686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:59.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.630+0000 7ffbf2ffd700 1 -- 172.21.15.117:0/3136888231 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbf4156b10 con 0x7ffbf41501e0 2024-08-17T02:21:59.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.630+0000 7ffbf2ffd700 1 --2- 172.21.15.117:0/3136888231 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffbf41501e0 0x7ffbf40ab7f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ffbe40098e0 tx=0x7ffbe40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8c09469f3a0f5ef server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:21:59.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.630+0000 7ffbf1ffb700 1 -- 172.21.15.117:0/3136888231 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbe4011630 con 0x7ffbf41501e0 2024-08-17T02:21:59.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.630+0000 7ffbf1ffb700 1 -- 172.21.15.117:0/3136888231 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbe4011790 con 0x7ffbf41501e0 2024-08-17T02:21:59.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.630+0000 7ffbf1ffb700 1 -- 172.21.15.117:0/3136888231 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbe4011b30 con 0x7ffbf41501e0 2024-08-17T02:21:59.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.630+0000 7ffbf3fff700 1 -- 172.21.15.117:0/3136888231 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffbf41501e0 msgr2=0x7ffbf40ab7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:59.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.630+0000 7ffbf3fff700 1 --2- 172.21.15.117:0/3136888231 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffbf41501e0 0x7ffbf40ab7f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ffbe40098e0 tx=0x7ffbe40091a0 comp rx=0 tx=0).stop 2024-08-17T02:21:59.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.630+0000 7ffbf3fff700 1 -- 172.21.15.117:0/3136888231 shutdown_connections 2024-08-17T02:21:59.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.630+0000 7ffbf3fff700 1 --2- 172.21.15.117:0/3136888231 >> v2:172.21.15.104:3300/0 conn(0x7ffbf4068db0 0x7ffbf40af5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:59.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.630+0000 7ffbf3fff700 1 --2- 172.21.15.117:0/3136888231 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffbf41501e0 0x7ffbf40ab7f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:59.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.630+0000 7ffbf3fff700 1 -- 172.21.15.117:0/3136888231 >> 172.21.15.117:0/3136888231 conn(0x7ffbf406e310 msgr2=0x7ffbf406b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:21:59.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.630+0000 7ffbf3fff700 1 -- 172.21.15.117:0/3136888231 shutdown_connections 2024-08-17T02:21:59.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.630+0000 7ffbf3fff700 1 -- 172.21.15.117:0/3136888231 wait complete. 2024-08-17T02:21:59.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.634+0000 7ffbf3fff700 1 Processor -- start 2024-08-17T02:21:59.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.634+0000 7ffbf3fff700 1 -- start start 2024-08-17T02:21:59.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.634+0000 7ffbf3fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbf4068db0 0x7ffbf4145200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:21:59.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.634+0000 7ffbf3fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffbf40abd30 0x7ffbf413fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:21:59.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.634+0000 7ffbf3fff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffbf41501e0 0x7ffbf4152b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:21:59.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.634+0000 7ffbf3fff700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbf4142e30 con 0x7ffbf41501e0 2024-08-17T02:21:59.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.634+0000 7ffbf3fff700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbf4143c90 con 0x7ffbf4068db0 2024-08-17T02:21:59.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.634+0000 7ffbf3fff700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbf4143080 con 0x7ffbf40abd30 2024-08-17T02:21:59.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.634+0000 7ffbf27fc700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffbf40abd30 0x7ffbf413fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:59.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.634+0000 7ffbf2ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbf4068db0 0x7ffbf4145200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:59.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.634+0000 7ffbf2ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbf4068db0 0x7ffbf4145200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:44462/0 (socket says 172.21.15.117:44462) 2024-08-17T02:21:59.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.634+0000 7ffbf27fc700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffbf40abd30 0x7ffbf413fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:55220/0 (socket says 172.21.15.117:55220) 2024-08-17T02:21:59.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.634+0000 7ffbf2ffd700 1 -- 172.21.15.117:0/2955669207 learned_addr learned my addr 172.21.15.117:0/2955669207 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-08-17T02:21:59.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.634+0000 7ffbf37fe700 1 --2- 172.21.15.117:0/2955669207 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffbf41501e0 0x7ffbf4152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:59.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.634+0000 7ffbf27fc700 1 -- 172.21.15.117:0/2955669207 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbf4068db0 msgr2=0x7ffbf4145200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:59.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.634+0000 7ffbf27fc700 1 --2- 172.21.15.117:0/2955669207 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbf4068db0 0x7ffbf4145200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:59.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.634+0000 7ffbf27fc700 1 -- 172.21.15.117:0/2955669207 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffbf41501e0 msgr2=0x7ffbf4152b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:59.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.634+0000 7ffbf27fc700 1 --2- 172.21.15.117:0/2955669207 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffbf41501e0 0x7ffbf4152b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:59.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.634+0000 7ffbf27fc700 1 -- 172.21.15.117:0/2955669207 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbe4009420 con 0x7ffbf40abd30 2024-08-17T02:21:59.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.634+0000 7ffbf27fc700 1 --2- 172.21.15.117:0/2955669207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffbf40abd30 0x7ffbf413fda0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ffbe800c580 tx=0x7ffbe8007d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:21:59.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.634+0000 7ffbdaffd700 1 -- 172.21.15.117:0/2955669207 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbe8005b30 con 0x7ffbf40abd30 2024-08-17T02:21:59.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.634+0000 7ffbdaffd700 1 -- 172.21.15.117:0/2955669207 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbe8005c90 con 0x7ffbf40abd30 2024-08-17T02:21:59.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.634+0000 7ffbdaffd700 1 -- 172.21.15.117:0/2955669207 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbe8007320 con 0x7ffbf40abd30 2024-08-17T02:21:59.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.634+0000 7ffbf3fff700 1 -- 172.21.15.117:0/2955669207 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbf4143360 con 0x7ffbf40abd30 2024-08-17T02:21:59.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.634+0000 7ffbf3fff700 1 -- 172.21.15.117:0/2955669207 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbf4143920 con 0x7ffbf40abd30 2024-08-17T02:21:59.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.638+0000 7ffbdaffd700 1 -- 172.21.15.117:0/2955669207 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7ffbe801c440 con 0x7ffbf40abd30 2024-08-17T02:21:59.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.638+0000 7ffbdaffd700 1 -- 172.21.15.117:0/2955669207 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7ffbe8005e00 con 0x7ffbf40abd30 2024-08-17T02:21:59.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.638+0000 7ffbf3fff700 1 -- 172.21.15.117:0/2955669207 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbf4143e00 con 0x7ffbf40abd30 2024-08-17T02:21:59.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.638+0000 7ffbdaffd700 1 -- 172.21.15.117:0/2955669207 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7ffbe8017070 con 0x7ffbf40abd30 2024-08-17T02:21:59.650 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-08-17T02:21:59.641+0000 7f89ee2e3000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-17T02:21:59.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.714+0000 7ffbf3fff700 1 -- 172.21.15.117:0/2955669207 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6a87f09f-7bf7-4f7a-be87-530ac1ff8ea7", "id": 6} v 0) v1 -- 0x7ffbf40638f0 con 0x7ffbf40abd30 2024-08-17T02:21:59.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.722+0000 7ffbdaffd700 1 -- 172.21.15.117:0/2955669207 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6a87f09f-7bf7-4f7a-be87-530ac1ff8ea7", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7ffbe8007710 con 0x7ffbf40abd30 2024-08-17T02:21:59.729 INFO:teuthology.orchestra.run.smithi117.stdout:6 2024-08-17T02:21:59.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.726+0000 7ffbf3fff700 1 -- 172.21.15.117:0/2955669207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffbf40abd30 msgr2=0x7ffbf413fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:59.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.726+0000 7ffbf3fff700 1 --2- 172.21.15.117:0/2955669207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffbf40abd30 0x7ffbf413fda0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ffbe800c580 tx=0x7ffbe8007d50 comp rx=0 tx=0).stop 2024-08-17T02:21:59.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.726+0000 7ffbf3fff700 1 -- 172.21.15.117:0/2955669207 shutdown_connections 2024-08-17T02:21:59.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.726+0000 7ffbf3fff700 1 --2- 172.21.15.117:0/2955669207 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffbf41501e0 0x7ffbf4152b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:59.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.726+0000 7ffbf3fff700 1 --2- 172.21.15.117:0/2955669207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffbf40abd30 0x7ffbf413fda0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:59.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.726+0000 7ffbf3fff700 1 --2- 172.21.15.117:0/2955669207 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbf4068db0 0x7ffbf4145200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:59.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.726+0000 7ffbf3fff700 1 -- 172.21.15.117:0/2955669207 >> 172.21.15.117:0/2955669207 conn(0x7ffbf406e310 msgr2=0x7ffbf414ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:21:59.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.726+0000 7ffbf3fff700 1 -- 172.21.15.117:0/2955669207 shutdown_connections 2024-08-17T02:21:59.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.726+0000 7ffbf3fff700 1 -- 172.21.15.117:0/2955669207 wait complete. 2024-08-17T02:21:59.741 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new e31d8041-1aa1-4b5d-83b3-0a373426dd9f 7 2024-08-17T02:21:59.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.838+0000 7fbd752e9700 1 Processor -- start 2024-08-17T02:21:59.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.838+0000 7fbd752e9700 1 -- start start 2024-08-17T02:21:59.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.842+0000 7fbd752e9700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbd700b5750 0x7fbd700b2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:21:59.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.842+0000 7fbd752e9700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd70159ce0 con 0x7fbd700cc840 2024-08-17T02:21:59.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.842+0000 7fbd752e9700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd70159fc0 con 0x7fbd700b2210 2024-08-17T02:21:59.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.842+0000 7fbd752e9700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd700af570 con 0x7fbd700b5750 2024-08-17T02:21:59.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.842+0000 7fbd6f7fe700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbd700b5750 0x7fbd700b2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:59.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.842+0000 7fbd6f7fe700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbd700b5750 0x7fbd700b2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:44472/0 (socket says 172.21.15.117:44472) 2024-08-17T02:21:59.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.842+0000 7fbd6e7fc700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fbd700b2210 0x7fbd700b5040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:49462/0 (socket says 172.21.15.117:49462) 2024-08-17T02:21:59.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.842+0000 7fbd6f7fe700 1 -- 172.21.15.117:0/4216410491 learned_addr learned my addr 172.21.15.117:0/4216410491 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-08-17T02:21:59.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.842+0000 7fbd6f7fe700 1 -- 172.21.15.117:0/4216410491 >> v1:172.21.15.117:6789/0 conn(0x7fbd700b2210 legacy=0x7fbd700b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:59.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.842+0000 7fbd6f7fe700 1 -- 172.21.15.117:0/4216410491 >> v1:172.21.15.104:6789/0 conn(0x7fbd700cc840 legacy=0x7fbd700ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:59.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.842+0000 7fbd6f7fe700 1 -- 172.21.15.117:0/4216410491 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd7015a2a0 con 0x7fbd700b5750 2024-08-17T02:21:59.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.842+0000 7fbd6f7fe700 1 --2- 172.21.15.117:0/4216410491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd700b5750 0x7fbd700b2670 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbd68009f20 tx=0x7fbd68009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=828d510c0d5524a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:21:59.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.842+0000 7fbd6dffb700 1 -- 172.21.15.117:0/4216410491 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6800e070 con 0x7fbd700b5750 2024-08-17T02:21:59.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.842+0000 7fbd6dffb700 1 -- 172.21.15.117:0/4216410491 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd6800ba80 con 0x7fbd700b5750 2024-08-17T02:21:59.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.842+0000 7fbd6dffb700 1 -- 172.21.15.117:0/4216410491 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd680092e0 con 0x7fbd700b5750 2024-08-17T02:21:59.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.842+0000 7fbd752e9700 1 -- 172.21.15.117:0/4216410491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd700b5750 msgr2=0x7fbd700b2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:59.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.842+0000 7fbd752e9700 1 --2- 172.21.15.117:0/4216410491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd700b5750 0x7fbd700b2670 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbd68009f20 tx=0x7fbd68009840 comp rx=0 tx=0).stop 2024-08-17T02:21:59.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.842+0000 7fbd752e9700 1 -- 172.21.15.117:0/4216410491 shutdown_connections 2024-08-17T02:21:59.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.842+0000 7fbd752e9700 1 --2- 172.21.15.117:0/4216410491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd700b5750 0x7fbd700b2670 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:59.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.842+0000 7fbd752e9700 1 -- 172.21.15.117:0/4216410491 >> 172.21.15.117:0/4216410491 conn(0x7fbd700682c0 msgr2=0x7fbd700686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:21:59.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.842+0000 7fbd752e9700 1 -- 172.21.15.117:0/4216410491 shutdown_connections 2024-08-17T02:21:59.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.842+0000 7fbd752e9700 1 -- 172.21.15.117:0/4216410491 wait complete. 2024-08-17T02:21:59.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.846+0000 7fbd752e9700 1 Processor -- start 2024-08-17T02:21:59.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.846+0000 7fbd752e9700 1 -- start start 2024-08-17T02:21:59.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.846+0000 7fbd752e9700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd700b2210 0x7fbd70156260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:21:59.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.846+0000 7fbd752e9700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd700b5750 0x7fbd70152660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:21:59.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.846+0000 7fbd752e9700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd700cc840 0x7fbd700c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:21:59.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.846+0000 7fbd752e9700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7015ab60 con 0x7fbd700b2210 2024-08-17T02:21:59.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.846+0000 7fbd752e9700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd700c9970 con 0x7fbd700cc840 2024-08-17T02:21:59.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.846+0000 7fbd752e9700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd701567a0 con 0x7fbd700b5750 2024-08-17T02:21:59.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.846+0000 7fbd6f7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd700cc840 0x7fbd700c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:59.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.846+0000 7fbd6e7fc700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd700b5750 0x7fbd70152660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:59.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.846+0000 7fbd6f7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd700cc840 0x7fbd700c8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:44478/0 (socket says 172.21.15.117:44478) 2024-08-17T02:21:59.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.846+0000 7fbd6e7fc700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd700b5750 0x7fbd70152660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:55222/0 (socket says 172.21.15.117:55222) 2024-08-17T02:21:59.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.846+0000 7fbd6f7fe700 1 -- 172.21.15.117:0/530245289 learned_addr learned my addr 172.21.15.117:0/530245289 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-08-17T02:21:59.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.846+0000 7fbd6effd700 1 --2- 172.21.15.117:0/530245289 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd700b2210 0x7fbd70156260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:21:59.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.846+0000 7fbd6e7fc700 1 -- 172.21.15.117:0/530245289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd700cc840 msgr2=0x7fbd700c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:59.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.846+0000 7fbd6e7fc700 1 --2- 172.21.15.117:0/530245289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd700cc840 0x7fbd700c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:59.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.846+0000 7fbd6e7fc700 1 -- 172.21.15.117:0/530245289 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd700b2210 msgr2=0x7fbd70156260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:59.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.846+0000 7fbd6e7fc700 1 --2- 172.21.15.117:0/530245289 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd700b2210 0x7fbd70156260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:59.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.846+0000 7fbd6e7fc700 1 -- 172.21.15.117:0/530245289 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd68009ae0 con 0x7fbd700b5750 2024-08-17T02:21:59.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.846+0000 7fbd6f7fe700 1 --2- 172.21.15.117:0/530245289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd700cc840 0x7fbd700c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:21:59.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.846+0000 7fbd6e7fc700 1 --2- 172.21.15.117:0/530245289 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd700b5750 0x7fbd70152660 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbd6400c7c0 tx=0x7fbd64007eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:21:59.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.846+0000 7fbd56ffd700 1 -- 172.21.15.117:0/530245289 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd64005a70 con 0x7fbd700b5750 2024-08-17T02:21:59.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.846+0000 7fbd56ffd700 1 -- 172.21.15.117:0/530245289 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd64005bd0 con 0x7fbd700b5750 2024-08-17T02:21:59.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.846+0000 7fbd752e9700 1 -- 172.21.15.117:0/530245289 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd700c7820 con 0x7fbd700b5750 2024-08-17T02:21:59.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.846+0000 7fbd56ffd700 1 -- 172.21.15.117:0/530245289 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd640070d0 con 0x7fbd700b5750 2024-08-17T02:21:59.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.846+0000 7fbd752e9700 1 -- 172.21.15.117:0/530245289 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd700c7de0 con 0x7fbd700b5750 2024-08-17T02:21:59.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.846+0000 7fbd56ffd700 1 -- 172.21.15.117:0/530245289 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fbd64007480 con 0x7fbd700b5750 2024-08-17T02:21:59.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.846+0000 7fbd56ffd700 1 -- 172.21.15.117:0/530245289 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7fbd6401c440 con 0x7fbd700b5750 2024-08-17T02:21:59.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.854+0000 7fbd752e9700 1 -- 172.21.15.117:0/530245289 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd7015aca0 con 0x7fbd700b5750 2024-08-17T02:21:59.860 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.854+0000 7fbd56ffd700 1 -- 172.21.15.117:0/530245289 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fbd7015aca0 con 0x7fbd700b5750 2024-08-17T02:21:59.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.934+0000 7fbd752e9700 1 -- 172.21.15.117:0/530245289 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e31d8041-1aa1-4b5d-83b3-0a373426dd9f", "id": 7} v 0) v1 -- 0x7fbd700645c0 con 0x7fbd700b5750 2024-08-17T02:21:59.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.942+0000 7fbd56ffd700 1 -- 172.21.15.117:0/530245289 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e31d8041-1aa1-4b5d-83b3-0a373426dd9f", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbd64017070 con 0x7fbd700b5750 2024-08-17T02:21:59.948 INFO:teuthology.orchestra.run.smithi117.stdout:7 2024-08-17T02:21:59.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.946+0000 7fbd752e9700 1 -- 172.21.15.117:0/530245289 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd700b5750 msgr2=0x7fbd70152660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:21:59.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.946+0000 7fbd752e9700 1 --2- 172.21.15.117:0/530245289 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd700b5750 0x7fbd70152660 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbd6400c7c0 tx=0x7fbd64007eb0 comp rx=0 tx=0).stop 2024-08-17T02:21:59.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.946+0000 7fbd752e9700 1 -- 172.21.15.117:0/530245289 shutdown_connections 2024-08-17T02:21:59.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.946+0000 7fbd752e9700 1 --2- 172.21.15.117:0/530245289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd700cc840 0x7fbd700c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:59.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.946+0000 7fbd752e9700 1 --2- 172.21.15.117:0/530245289 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd700b5750 0x7fbd70152660 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:59.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.946+0000 7fbd752e9700 1 --2- 172.21.15.117:0/530245289 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd700b2210 0x7fbd70156260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:21:59.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.946+0000 7fbd752e9700 1 -- 172.21.15.117:0/530245289 >> 172.21.15.117:0/530245289 conn(0x7fbd700682c0 msgr2=0x7fbd70067690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:21:59.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.946+0000 7fbd752e9700 1 -- 172.21.15.117:0/530245289 shutdown_connections 2024-08-17T02:21:59.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-17T02:21:59.946+0000 7fbd752e9700 1 -- 172.21.15.117:0/530245289 wait complete. 2024-08-17T02:21:59.952 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-17T02:21:59.946+0000 7fd04ca4f000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-17T02:21:59.964 INFO:tasks.ceph.osd.0:Restarting daemon 2024-08-17T02:21:59.964 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-08-17T02:21:59.967 INFO:tasks.ceph.osd.0:Started 2024-08-17T02:21:59.967 INFO:tasks.ceph.osd.1:Restarting daemon 2024-08-17T02:21:59.967 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-08-17T02:21:59.970 INFO:tasks.ceph.osd.1:Started 2024-08-17T02:21:59.970 INFO:tasks.ceph.osd.2:Restarting daemon 2024-08-17T02:21:59.970 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-08-17T02:21:59.972 INFO:tasks.ceph.osd.2:Started 2024-08-17T02:21:59.972 INFO:tasks.ceph.osd.3:Restarting daemon 2024-08-17T02:21:59.972 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-08-17T02:21:59.975 INFO:tasks.ceph.osd.3:Started 2024-08-17T02:21:59.975 INFO:tasks.ceph.osd.4:Restarting daemon 2024-08-17T02:21:59.975 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-08-17T02:21:59.977 INFO:tasks.ceph.osd.4:Started 2024-08-17T02:21:59.977 INFO:tasks.ceph.osd.5:Restarting daemon 2024-08-17T02:21:59.977 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-08-17T02:21:59.979 INFO:tasks.ceph.osd.5:Started 2024-08-17T02:21:59.979 INFO:tasks.ceph.osd.6:Restarting daemon 2024-08-17T02:21:59.979 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-08-17T02:21:59.981 INFO:tasks.ceph.osd.6:Started 2024-08-17T02:21:59.981 INFO:tasks.ceph.osd.7:Restarting daemon 2024-08-17T02:21:59.981 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-08-17T02:21:59.983 INFO:tasks.ceph.osd.7:Started 2024-08-17T02:21:59.984 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:22:00.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.085+0000 7f939cf30700 1 Processor -- start 2024-08-17T02:22:00.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.089+0000 7f939cf30700 1 -- start start 2024-08-17T02:22:00.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.089+0000 7f939cf30700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f93980aac50 0x7f939815aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:00.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.089+0000 7f939cf30700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f939815a2e0 0x7f93981574a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:00.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.089+0000 7f939cf30700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93980b3b30 0x7f93980b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:00.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.089+0000 7f939cf30700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f939815bc90 con 0x7f93980aac50 2024-08-17T02:22:00.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.089+0000 7f939cf30700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93980b4490 con 0x7f939815a2e0 2024-08-17T02:22:00.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.089+0000 7f939cf30700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f939815b010 con 0x7f93980b3b30 2024-08-17T02:22:00.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.089+0000 7f939659c700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f93980aac50 0x7f939815aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:00.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.089+0000 7f939659c700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f93980aac50 0x7f939815aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38166/0 (socket says 172.21.15.104:38166) 2024-08-17T02:22:00.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.089+0000 7f939659c700 1 -- 172.21.15.104:0/229601194 learned_addr learned my addr 172.21.15.104:0/229601194 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:00.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.089+0000 7f9395d9b700 1 --2- 172.21.15.104:0/229601194 >> v2:172.21.15.117:3300/0 conn(0x7f939815a2e0 0x7f93981574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:00.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.089+0000 7f9396d9d700 1 --2- 172.21.15.104:0/229601194 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93980b3b30 0x7f93980b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:00.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.089+0000 7f939659c700 1 -- 172.21.15.104:0/229601194 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93980b3b30 msgr2=0x7f93980b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:00.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.089+0000 7f939659c700 1 --2- 172.21.15.104:0/229601194 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93980b3b30 0x7f93980b3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:00.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.089+0000 7f939659c700 1 -- 172.21.15.104:0/229601194 >> v2:172.21.15.117:3300/0 conn(0x7f939815a2e0 msgr2=0x7f93981574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:00.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.089+0000 7f939659c700 1 --2- 172.21.15.104:0/229601194 >> v2:172.21.15.117:3300/0 conn(0x7f939815a2e0 0x7f93981574a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:00.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.089+0000 7f939659c700 1 -- 172.21.15.104:0/229601194 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f939815b2f0 con 0x7f93980aac50 2024-08-17T02:22:00.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.089+0000 7f939659c700 1 --2- 172.21.15.104:0/229601194 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93980aac50 0x7f939815aa30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f939808a590 tx=0x7f9388009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53a9f42827157bd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:00.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.089+0000 7f939559a700 1 -- 172.21.15.104:0/229601194 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9388005c10 con 0x7f93980aac50 2024-08-17T02:22:00.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.089+0000 7f939559a700 1 -- 172.21.15.104:0/229601194 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9388005d70 con 0x7f93980aac50 2024-08-17T02:22:00.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.089+0000 7f939559a700 1 -- 172.21.15.104:0/229601194 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9388006260 con 0x7f93980aac50 2024-08-17T02:22:00.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.089+0000 7f939cf30700 1 -- 172.21.15.104:0/229601194 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93980aac50 msgr2=0x7f939815aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:00.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.089+0000 7f939cf30700 1 --2- 172.21.15.104:0/229601194 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93980aac50 0x7f939815aa30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f939808a590 tx=0x7f9388009220 comp rx=0 tx=0).stop 2024-08-17T02:22:00.096 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-08-17T02:22:00.089+0000 7f89ee2e3000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-17T02:22:00.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.089+0000 7f939cf30700 1 -- 172.21.15.104:0/229601194 shutdown_connections 2024-08-17T02:22:00.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.089+0000 7f939cf30700 1 --2- 172.21.15.104:0/229601194 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93980b3b30 0x7f93980b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:00.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.089+0000 7f939cf30700 1 --2- 172.21.15.104:0/229601194 >> v2:172.21.15.117:3300/0 conn(0x7f939815a2e0 0x7f93981574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:00.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.089+0000 7f939cf30700 1 --2- 172.21.15.104:0/229601194 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93980aac50 0x7f939815aa30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:00.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.089+0000 7f939cf30700 1 -- 172.21.15.104:0/229601194 >> 172.21.15.104:0/229601194 conn(0x7f93980994d0 msgr2=0x7f93980675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:00.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.089+0000 7f939cf30700 1 -- 172.21.15.104:0/229601194 shutdown_connections 2024-08-17T02:22:00.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.089+0000 7f939cf30700 1 -- 172.21.15.104:0/229601194 wait complete. 2024-08-17T02:22:00.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.093+0000 7f939cf30700 1 Processor -- start 2024-08-17T02:22:00.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.093+0000 7f939cf30700 1 -- start start 2024-08-17T02:22:00.098 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-17T02:22:00.090+0000 7fd04ca4f000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-17T02:22:00.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.093+0000 7f939cf30700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93980aac50 0x7f93981530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:00.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.093+0000 7f939cf30700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93980b3b30 0x7f93980ad070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:00.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.093+0000 7f939cf30700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f939815a2e0 0x7f93980ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:00.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.093+0000 7f939cf30700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93980abbf0 con 0x7f93980b3b30 2024-08-17T02:22:00.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.093+0000 7f939cf30700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93980ab020 con 0x7f93980aac50 2024-08-17T02:22:00.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.093+0000 7f939cf30700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93980ab2c0 con 0x7f939815a2e0 2024-08-17T02:22:00.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.093+0000 7f9395d9b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93980b3b30 0x7f93980ad070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:00.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.093+0000 7f939659c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93980aac50 0x7f93981530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:00.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.093+0000 7f9395d9b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93980b3b30 0x7f93980ad070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38182/0 (socket says 172.21.15.104:38182) 2024-08-17T02:22:00.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.093+0000 7f9396d9d700 1 --2- 172.21.15.104:0/839038451 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f939815a2e0 0x7f93980ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:00.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.093+0000 7f9395d9b700 1 -- 172.21.15.104:0/839038451 learned_addr learned my addr 172.21.15.104:0/839038451 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:00.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.093+0000 7f9396d9d700 1 -- 172.21.15.104:0/839038451 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93980aac50 msgr2=0x7f93981530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:00.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.093+0000 7f9396d9d700 1 --2- 172.21.15.104:0/839038451 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93980aac50 0x7f93981530e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:00.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.093+0000 7f9396d9d700 1 -- 172.21.15.104:0/839038451 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93980b3b30 msgr2=0x7f93980ad070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:00.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.093+0000 7f9396d9d700 1 --2- 172.21.15.104:0/839038451 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93980b3b30 0x7f93980ad070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:00.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.093+0000 7f9396d9d700 1 -- 172.21.15.104:0/839038451 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9388009480 con 0x7f939815a2e0 2024-08-17T02:22:00.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.093+0000 7f9396d9d700 1 --2- 172.21.15.104:0/839038451 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f939815a2e0 0x7f93980ad5b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f939000ecc0 tx=0x7f939000b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:00.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.093+0000 7f93867fc700 1 -- 172.21.15.104:0/839038451 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939000c8c0 con 0x7f939815a2e0 2024-08-17T02:22:00.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.093+0000 7f93867fc700 1 -- 172.21.15.104:0/839038451 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939000f040 con 0x7f939815a2e0 2024-08-17T02:22:00.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.093+0000 7f939cf30700 1 -- 172.21.15.104:0/839038451 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93980ab5a0 con 0x7f939815a2e0 2024-08-17T02:22:00.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.093+0000 7f93867fc700 1 -- 172.21.15.104:0/839038451 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939000cc90 con 0x7f939815a2e0 2024-08-17T02:22:00.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.093+0000 7f939cf30700 1 -- 172.21.15.104:0/839038451 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9398153620 con 0x7f939815a2e0 2024-08-17T02:22:00.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.093+0000 7f93867fc700 1 -- 172.21.15.104:0/839038451 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f9390014920 con 0x7f939815a2e0 2024-08-17T02:22:00.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.093+0000 7f93867fc700 1 -- 172.21.15.104:0/839038451 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f939001dd10 con 0x7f939815a2e0 2024-08-17T02:22:00.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.097+0000 7f939cf30700 1 -- 172.21.15.104:0/839038451 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93980abd60 con 0x7f939815a2e0 2024-08-17T02:22:00.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.101+0000 7f93867fc700 1 -- 172.21.15.104:0/839038451 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f939003b7a0 con 0x7f939815a2e0 2024-08-17T02:22:00.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.165+0000 7f939cf30700 1 -- 172.21.15.104:0/839038451 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93980645c0 con 0x7f939815a2e0 2024-08-17T02:22:00.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.169+0000 7f93867fc700 1 -- 172.21.15.104:0/839038451 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f939002a070 con 0x7f939815a2e0 2024-08-17T02:22:00.172 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:22:00.173 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":10,"fsid":"fd5f7fb8-d34b-49bb-89a8-62b7dad1bc25","created":"2024-08-17T02:21:57.891389+0000","modified":"2024-08-17T02:21:59.938028+0000","last_up_change":"0.000000","last_in_change":"2024-08-17T02:21:59.938028+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"606b9088-590e-4709-aa3a-b0f6e22972ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9bc6a909-0c2f-4889-afe7-4a47f89b0f64","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"23da31d5-aefb-4edb-b79d-fa05e1becef7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6e4a5ec2-b415-45ef-8381-61a59eb65224","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8d5bea2d-9039-4013-8c99-2c046c5b8a17","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"de8b36fc-121c-4f05-8f5b-28f513d9f21f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6a87f09f-7bf7-4f7a-be87-530ac1ff8ea7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e31d8041-1aa1-4b5d-83b3-0a373426dd9f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:22:00.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.169+0000 7f939cf30700 1 -- 172.21.15.104:0/839038451 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f939815a2e0 msgr2=0x7f93980ad5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:00.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.169+0000 7f939cf30700 1 --2- 172.21.15.104:0/839038451 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f939815a2e0 0x7f93980ad5b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f939000ecc0 tx=0x7f939000b040 comp rx=0 tx=0).stop 2024-08-17T02:22:00.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.169+0000 7f939cf30700 1 -- 172.21.15.104:0/839038451 shutdown_connections 2024-08-17T02:22:00.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.169+0000 7f939cf30700 1 --2- 172.21.15.104:0/839038451 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f939815a2e0 0x7f93980ad5b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:00.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.169+0000 7f939cf30700 1 --2- 172.21.15.104:0/839038451 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93980b3b30 0x7f93980ad070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:00.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.169+0000 7f939cf30700 1 --2- 172.21.15.104:0/839038451 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93980aac50 0x7f93981530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:00.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.169+0000 7f939cf30700 1 -- 172.21.15.104:0/839038451 >> 172.21.15.104:0/839038451 conn(0x7f93980994d0 msgr2=0x7f93980b3010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:00.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.169+0000 7f939cf30700 1 -- 172.21.15.104:0/839038451 shutdown_connections 2024-08-17T02:22:00.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:00.169+0000 7f939cf30700 1 -- 172.21.15.104:0/839038451 wait complete. 2024-08-17T02:22:00.185 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-08-17T02:22:00.185 INFO:tasks.ceph:Waiting for OSDs to come up 2024-08-17T02:22:00.204 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-08-17T02:22:00.201+0000 7f89ee2e3000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-17T02:22:00.347 INFO:tasks.ceph.osd.4.smithi117.stderr:2024-08-17T02:22:00.342+0000 7fa04bab93c0 -1 Falling back to public interface 2024-08-17T02:22:00.347 INFO:tasks.ceph.osd.6.smithi117.stderr:2024-08-17T02:22:00.342+0000 7f38665313c0 -1 Falling back to public interface 2024-08-17T02:22:00.361 INFO:tasks.ceph.osd.3.smithi104.stderr:2024-08-17T02:22:00.357+0000 7f8c2a10a3c0 -1 Falling back to public interface 2024-08-17T02:22:00.369 INFO:tasks.ceph.osd.0.smithi104.stderr:2024-08-17T02:22:00.365+0000 7f3d9f0c13c0 -1 Falling back to public interface 2024-08-17T02:22:00.371 INFO:tasks.ceph.osd.5.smithi117.stderr:2024-08-17T02:22:00.366+0000 7ff8b0b693c0 -1 Falling back to public interface 2024-08-17T02:22:00.402 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-17T02:22:00.398+0000 7fd04ca4f000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-17T02:22:00.493 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-08-17T02:22:00.489+0000 7f89ee2e3000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-17T02:22:00.565 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-17T02:22:00.558+0000 7fd04ca4f000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:22:00.599 INFO:tasks.ceph.osd.7.smithi117.stderr:2024-08-17T02:22:00.594+0000 7f19387333c0 -1 Falling back to public interface 2024-08-17T02:22:00.601 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-08-17T02:22:00.597+0000 7f33d42a53c0 -1 Falling back to public interface 2024-08-17T02:22:00.614 INFO:tasks.ceph.osd.1.smithi104.stderr:2024-08-17T02:22:00.609+0000 7f30218993c0 -1 Falling back to public interface 2024-08-17T02:22:00.631 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-17T02:22:00.626+0000 7fd04ca4f000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-17T02:22:00.654 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-08-17T02:22:00.649+0000 7f89ee2e3000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:22:00.684 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-17T02:22:00.678+0000 7fd04ca4f000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-17T02:22:00.721 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-08-17T02:22:00.717+0000 7f89ee2e3000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-17T02:22:00.739 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-17T02:22:00.734+0000 7fd04ca4f000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-17T02:22:00.772 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-08-17T02:22:00.769+0000 7f89ee2e3000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-17T02:22:00.827 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-08-17T02:22:00.822+0000 7f89ee2e3000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-17T02:22:00.901 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-17T02:22:00.894+0000 7fd04ca4f000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-17T02:22:00.991 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:22:01.020 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-08-17T02:22:01.018+0000 7f89ee2e3000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-17T02:22:01.063 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-17T02:22:01.058+0000 7fd04ca4f000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-17T02:22:01.096 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.090+0000 7f9a115e7700 1 Processor -- start 2024-08-17T02:22:01.096 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.090+0000 7f9a115e7700 1 -- start start 2024-08-17T02:22:01.096 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.090+0000 7f9a115e7700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f9a0c13c2c0 0x7f9a0c0c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:01.096 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.090+0000 7f9a115e7700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a0c06cf80 con 0x7f9a0c0c3fe0 2024-08-17T02:22:01.096 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.090+0000 7f9a115e7700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a0c06d990 con 0x7f9a0c06c7a0 2024-08-17T02:22:01.096 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.090+0000 7f9a115e7700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a0c06cca0 con 0x7f9a0c13c2c0 2024-08-17T02:22:01.096 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.090+0000 7f9a0bfff700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f9a0c0c3fe0 0x7f9a0c06c090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:37796/0 (socket says 172.21.15.104:37796) 2024-08-17T02:22:01.096 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.090+0000 7f9a0bfff700 1 -- 172.21.15.104:0/444188495 learned_addr learned my addr 172.21.15.104:0/444188495 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:01.096 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.090+0000 7f9a10de6700 1 --2- 172.21.15.104:0/444188495 >> v2:172.21.15.104:3300/0 conn(0x7f9a0c13c2c0 0x7f9a0c0c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:01.096 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.090+0000 7f9a0affd700 1 -- 172.21.15.104:0/444188495 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1738000609 0 0) 0x7f9a0c06cf80 con 0x7f9a0c0c3fe0 2024-08-17T02:22:01.097 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.090+0000 7f9a0affd700 1 -- 172.21.15.104:0/444188495 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99f4003570 con 0x7f9a0c0c3fe0 2024-08-17T02:22:01.097 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.090+0000 7f9a10de6700 1 -- 172.21.15.104:0/444188495 >> v1:172.21.15.117:6789/0 conn(0x7f9a0c06c7a0 legacy=0x7f9a0c13bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:01.097 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.090+0000 7f9a10de6700 1 -- 172.21.15.104:0/444188495 >> v1:172.21.15.104:6789/0 conn(0x7f9a0c0c3fe0 legacy=0x7f9a0c06c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:01.097 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.090+0000 7f9a0affd700 1 -- 172.21.15.104:0/444188495 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 810213220 0 0) 0x7f99f4003570 con 0x7f9a0c0c3fe0 2024-08-17T02:22:01.097 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.090+0000 7f9a10de6700 1 -- 172.21.15.104:0/444188495 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a0c0c2ad0 con 0x7f9a0c13c2c0 2024-08-17T02:22:01.097 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.090+0000 7f9a10de6700 1 --2- 172.21.15.104:0/444188495 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a0c13c2c0 0x7f9a0c0c43b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9a04009de0 tx=0x7f9a04009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=923ab4674f4b7df5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:01.097 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.090+0000 7f9a0affd700 1 -- 172.21.15.104:0/444188495 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0400e070 con 0x7f9a0c13c2c0 2024-08-17T02:22:01.097 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.090+0000 7f9a0affd700 1 -- 172.21.15.104:0/444188495 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a0400b850 con 0x7f9a0c13c2c0 2024-08-17T02:22:01.097 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.090+0000 7f9a0affd700 1 -- 172.21.15.104:0/444188495 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc001470 con 0x7f9a0c13c2c0 2024-08-17T02:22:01.097 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.090+0000 7f9a115e7700 1 -- 172.21.15.104:0/444188495 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a0c13c2c0 msgr2=0x7f9a0c0c43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:01.097 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.090+0000 7f9a115e7700 1 --2- 172.21.15.104:0/444188495 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a0c13c2c0 0x7f9a0c0c43b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9a04009de0 tx=0x7f9a04009780 comp rx=0 tx=0).stop 2024-08-17T02:22:01.097 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.090+0000 7f9a115e7700 1 -- 172.21.15.104:0/444188495 shutdown_connections 2024-08-17T02:22:01.098 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.090+0000 7f9a115e7700 1 --2- 172.21.15.104:0/444188495 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a0c13c2c0 0x7f9a0c0c43b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:01.098 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.090+0000 7f9a115e7700 1 -- 172.21.15.104:0/444188495 >> 172.21.15.104:0/444188495 conn(0x7f9a0c0678e0 msgr2=0x7f9a0c067ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:01.098 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.094+0000 7f9a115e7700 1 -- 172.21.15.104:0/444188495 shutdown_connections 2024-08-17T02:22:01.098 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.094+0000 7f9a115e7700 1 -- 172.21.15.104:0/444188495 wait complete. 2024-08-17T02:22:01.098 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.094+0000 7f9a115e7700 1 Processor -- start 2024-08-17T02:22:01.098 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.094+0000 7f9a115e7700 1 -- start start 2024-08-17T02:22:01.101 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.094+0000 7f9a115e7700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a0c06c7a0 0x7f9a0c15e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:01.101 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.094+0000 7f9a115e7700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a0c0c3fe0 0x7f9a0c159d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:01.101 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.094+0000 7f9a115e7700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a0c13c2c0 0x7f9a0c16a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:01.101 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.094+0000 7f9a115e7700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c16b330 con 0x7f9a0c13c2c0 2024-08-17T02:22:01.101 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.094+0000 7f9a115e7700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c15a260 con 0x7f9a0c0c3fe0 2024-08-17T02:22:01.101 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.094+0000 7f9a115e7700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c15e790 con 0x7f9a0c06c7a0 2024-08-17T02:22:01.101 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.094+0000 7f9a10de6700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a0c13c2c0 0x7f9a0c16a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:01.101 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.094+0000 7f9a10de6700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a0c13c2c0 0x7f9a0c16a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38194/0 (socket says 172.21.15.104:38194) 2024-08-17T02:22:01.101 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.094+0000 7f9a10de6700 1 -- 172.21.15.104:0/3319412889 learned_addr learned my addr 172.21.15.104:0/3319412889 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:01.101 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.094+0000 7f9a0b7fe700 1 --2- 172.21.15.104:0/3319412889 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a0c0c3fe0 0x7f9a0c159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:01.102 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.094+0000 7f9a0bfff700 1 --2- 172.21.15.104:0/3319412889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a0c06c7a0 0x7f9a0c15e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:01.102 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.098+0000 7f9a10de6700 1 -- 172.21.15.104:0/3319412889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a0c06c7a0 msgr2=0x7f9a0c15e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:01.102 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.098+0000 7f9a10de6700 1 --2- 172.21.15.104:0/3319412889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a0c06c7a0 0x7f9a0c15e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:01.102 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.098+0000 7f9a10de6700 1 -- 172.21.15.104:0/3319412889 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a0c0c3fe0 msgr2=0x7f9a0c159d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:01.102 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.098+0000 7f9a10de6700 1 --2- 172.21.15.104:0/3319412889 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a0c0c3fe0 0x7f9a0c159d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:01.102 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.098+0000 7f9a10de6700 1 -- 172.21.15.104:0/3319412889 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a04009a20 con 0x7f9a0c13c2c0 2024-08-17T02:22:01.102 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.098+0000 7f9a10de6700 1 --2- 172.21.15.104:0/3319412889 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a0c13c2c0 0x7f9a0c16a1c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9a0400b6c0 tx=0x7f9a04017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:01.102 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.098+0000 7f99f3fff700 1 -- 172.21.15.104:0/3319412889 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a04026400 con 0x7f9a0c13c2c0 2024-08-17T02:22:01.102 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.098+0000 7f99f3fff700 1 -- 172.21.15.104:0/3319412889 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a04026580 con 0x7f9a0c13c2c0 2024-08-17T02:22:01.102 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.098+0000 7f9a115e7700 1 -- 172.21.15.104:0/3319412889 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a0c16aa00 con 0x7f9a0c13c2c0 2024-08-17T02:22:01.102 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.098+0000 7f99f3fff700 1 -- 172.21.15.104:0/3319412889 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a04026940 con 0x7f9a0c13c2c0 2024-08-17T02:22:01.102 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.098+0000 7f9a115e7700 1 -- 172.21.15.104:0/3319412889 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a0c16afc0 con 0x7f9a0c13c2c0 2024-08-17T02:22:01.102 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.098+0000 7f99f3fff700 1 -- 172.21.15.104:0/3319412889 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f9a04019030 con 0x7f9a0c13c2c0 2024-08-17T02:22:01.103 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.098+0000 7f99f3fff700 1 -- 172.21.15.104:0/3319412889 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f9a04011a90 con 0x7f9a0c13c2c0 2024-08-17T02:22:01.103 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.098+0000 7f9a115e7700 1 -- 172.21.15.104:0/3319412889 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a0c064ba0 con 0x7f9a0c13c2c0 2024-08-17T02:22:01.105 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.102+0000 7f99f3fff700 1 -- 172.21.15.104:0/3319412889 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f9a04017070 con 0x7f9a0c13c2c0 2024-08-17T02:22:01.127 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-17T02:22:01.122+0000 7fd04ca4f000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-17T02:22:01.168 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.166+0000 7f9a115e7700 1 -- 172.21.15.104:0/3319412889 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a0c06d420 con 0x7f9a0c13c2c0 2024-08-17T02:22:01.169 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.166+0000 7f99f3fff700 1 -- 172.21.15.104:0/3319412889 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f9a04011cf0 con 0x7f9a0c13c2c0 2024-08-17T02:22:01.170 INFO:teuthology.misc.health.smithi104.stdout: 2024-08-17T02:22:01.170 INFO:teuthology.misc.health.smithi104.stdout:{"epoch":10,"fsid":"fd5f7fb8-d34b-49bb-89a8-62b7dad1bc25","created":"2024-08-17T02:21:57.891389+0000","modified":"2024-08-17T02:21:59.938028+0000","last_up_change":"0.000000","last_in_change":"2024-08-17T02:21:59.938028+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"606b9088-590e-4709-aa3a-b0f6e22972ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9bc6a909-0c2f-4889-afe7-4a47f89b0f64","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"23da31d5-aefb-4edb-b79d-fa05e1becef7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6e4a5ec2-b415-45ef-8381-61a59eb65224","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8d5bea2d-9039-4013-8c99-2c046c5b8a17","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"de8b36fc-121c-4f05-8f5b-28f513d9f21f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6a87f09f-7bf7-4f7a-be87-530ac1ff8ea7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e31d8041-1aa1-4b5d-83b3-0a373426dd9f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:22:01.171 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.166+0000 7f9a115e7700 1 -- 172.21.15.104:0/3319412889 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a0c13c2c0 msgr2=0x7f9a0c16a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:01.171 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.166+0000 7f9a115e7700 1 --2- 172.21.15.104:0/3319412889 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a0c13c2c0 0x7f9a0c16a1c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9a0400b6c0 tx=0x7f9a04017000 comp rx=0 tx=0).stop 2024-08-17T02:22:01.171 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.166+0000 7f9a115e7700 1 -- 172.21.15.104:0/3319412889 shutdown_connections 2024-08-17T02:22:01.171 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.166+0000 7f9a115e7700 1 --2- 172.21.15.104:0/3319412889 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a0c13c2c0 0x7f9a0c16a1c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:01.171 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.166+0000 7f9a115e7700 1 --2- 172.21.15.104:0/3319412889 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a0c0c3fe0 0x7f9a0c159d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:01.171 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.166+0000 7f9a115e7700 1 --2- 172.21.15.104:0/3319412889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a0c06c7a0 0x7f9a0c15e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:01.171 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.166+0000 7f9a115e7700 1 -- 172.21.15.104:0/3319412889 >> 172.21.15.104:0/3319412889 conn(0x7f9a0c0678e0 msgr2=0x7f9a0c137650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:01.171 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.166+0000 7f9a115e7700 1 -- 172.21.15.104:0/3319412889 shutdown_connections 2024-08-17T02:22:01.171 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:01.166+0000 7f9a115e7700 1 -- 172.21.15.104:0/3319412889 wait complete. 2024-08-17T02:22:01.181 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-08-17T02:22:01.206 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-08-17T02:22:01.202+0000 7f89ee2e3000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-17T02:22:01.271 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-08-17T02:22:01.266+0000 7f89ee2e3000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-17T02:22:01.287 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-17T02:22:01.282+0000 7fd04ca4f000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-17T02:22:01.348 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-17T02:22:01.342+0000 7fd04ca4f000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-17T02:22:01.445 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-08-17T02:22:01.442+0000 7f89ee2e3000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-17T02:22:01.514 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-08-17T02:22:01.510+0000 7f89ee2e3000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-17T02:22:02.045 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-17T02:22:02.042+0000 7fd04ca4f000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-17T02:22:02.215 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-08-17T02:22:02.210+0000 7f89ee2e3000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-17T02:22:03.092 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-17T02:22:03.086+0000 7fd035ac0700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-08-17T02:22:03.092 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-17T02:22:03.086+0000 7fd035ac0700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-08-17T02:22:03.985 INFO:tasks.ceph.osd.6.smithi117.stderr:2024-08-17T02:22:03.982+0000 7f38665313c0 -1 osd.6 0 log_to_monitors true 2024-08-17T02:22:04.194 INFO:tasks.ceph.osd.4.smithi117.stderr:2024-08-17T02:22:04.190+0000 7fa04bab93c0 -1 osd.4 0 log_to_monitors true 2024-08-17T02:22:04.203 INFO:tasks.ceph.osd.3.smithi104.stderr:2024-08-17T02:22:04.198+0000 7f8c2a10a3c0 -1 osd.3 0 log_to_monitors true 2024-08-17T02:22:04.245 INFO:tasks.ceph.osd.1.smithi104.stderr:2024-08-17T02:22:04.242+0000 7f30218993c0 -1 osd.1 0 log_to_monitors true 2024-08-17T02:22:04.246 INFO:tasks.ceph.osd.0.smithi104.stderr:2024-08-17T02:22:04.242+0000 7f3d9f0c13c0 -1 osd.0 0 log_to_monitors true 2024-08-17T02:22:04.278 INFO:tasks.ceph.osd.5.smithi117.stderr:2024-08-17T02:22:04.274+0000 7ff8b0b693c0 -1 osd.5 0 log_to_monitors true 2024-08-17T02:22:04.403 INFO:tasks.ceph.osd.7.smithi117.stderr:2024-08-17T02:22:04.398+0000 7f19387333c0 -1 osd.7 0 log_to_monitors true 2024-08-17T02:22:04.435 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-08-17T02:22:04.430+0000 7f33d42a53c0 -1 osd.2 0 log_to_monitors true 2024-08-17T02:22:06.865 INFO:tasks.ceph.osd.6.smithi117.stderr:2024-08-17T02:22:06.858+0000 7f3861cd1700 -1 osd.6 0 waiting for initial osdmap 2024-08-17T02:22:06.899 INFO:tasks.ceph.osd.6.smithi117.stderr:2024-08-17T02:22:06.894+0000 7f385aa74700 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:22:07.919 INFO:tasks.ceph.osd.7.smithi117.stderr:2024-08-17T02:22:07.914+0000 7f19356f8700 -1 osd.7 0 waiting for initial osdmap 2024-08-17T02:22:07.924 INFO:tasks.ceph.osd.7.smithi117.stderr:2024-08-17T02:22:07.918+0000 7f192cc76700 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:22:07.970 INFO:tasks.ceph.osd.4.smithi117.stderr:2024-08-17T02:22:07.966+0000 7fa047259700 -1 osd.4 0 waiting for initial osdmap 2024-08-17T02:22:07.983 INFO:tasks.ceph.osd.4.smithi117.stderr:2024-08-17T02:22:07.978+0000 7fa03fffc700 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:22:07.988 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:22:08.009 INFO:tasks.ceph.osd.5.smithi117.stderr:2024-08-17T02:22:08.006+0000 7ff8ac309700 -1 osd.5 0 waiting for initial osdmap 2024-08-17T02:22:08.014 INFO:tasks.ceph.osd.5.smithi117.stderr:2024-08-17T02:22:08.010+0000 7ff8a50ac700 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:22:08.112 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.110+0000 7f85b2a13700 1 Processor -- start 2024-08-17T02:22:08.113 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.110+0000 7f85b2a13700 1 -- start start 2024-08-17T02:22:08.113 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.110+0000 7f85b2a13700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85a4034ff0 0x7f85a40337e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:08.113 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.110+0000 7f85b2a13700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f85a4033d20 0x7f85a40e0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:08.114 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.110+0000 7f85b2a13700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85a4007310 con 0x7f85a40dfda0 2024-08-17T02:22:08.114 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.110+0000 7f85b2a13700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85a40341a0 con 0x7f85a4033d20 2024-08-17T02:22:08.114 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.110+0000 7f85b2a13700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a40077a0 con 0x7f85a4034ff0 2024-08-17T02:22:08.114 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.110+0000 7f85b0fb0700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f85a4033d20 0x7f85a40e0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:08.115 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.110+0000 7f85b0fb0700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f85a4033d20 0x7f85a40e0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54780/0 (socket says 172.21.15.104:54780) 2024-08-17T02:22:08.115 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.110+0000 7f85b0fb0700 1 -- 172.21.15.104:0/366418178 learned_addr learned my addr 172.21.15.104:0/366418178 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:08.115 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.110+0000 7f85ab7fe700 1 --2- 172.21.15.104:0/366418178 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85a4034ff0 0x7f85a40337e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:08.115 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.110+0000 7f85b0fb0700 1 -- 172.21.15.104:0/366418178 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85a4034ff0 msgr2=0x7f85a40337e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:08.115 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.110+0000 7f85b0fb0700 1 --2- 172.21.15.104:0/366418178 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85a4034ff0 0x7f85a40337e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:08.115 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.110+0000 7f85b0fb0700 1 -- 172.21.15.104:0/366418178 >> v1:172.21.15.117:6789/0 conn(0x7f85a40dfda0 legacy=0x7f85a4005eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:08.115 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.110+0000 7f85b0fb0700 1 -- 172.21.15.104:0/366418178 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a4006700 con 0x7f85a4033d20 2024-08-17T02:22:08.115 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.110+0000 7f85b0fb0700 1 --2- 172.21.15.104:0/366418178 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85a4033d20 0x7f85a40e0170 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f85ac066090 tx=0x7f85ac065320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95b70ca77265c408 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:08.116 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.110+0000 7f85aaffd700 1 -- 172.21.15.104:0/366418178 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ac0646b0 con 0x7f85a4033d20 2024-08-17T02:22:08.116 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.110+0000 7f85aaffd700 1 -- 172.21.15.104:0/366418178 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85ac04c190 con 0x7f85a4033d20 2024-08-17T02:22:08.116 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.110+0000 7f85aaffd700 1 -- 172.21.15.104:0/366418178 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ac06f3c0 con 0x7f85a4033d20 2024-08-17T02:22:08.116 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.114+0000 7f85b2a13700 1 -- 172.21.15.104:0/366418178 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85a4033d20 msgr2=0x7f85a40e0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:08.116 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.114+0000 7f85b2a13700 1 --2- 172.21.15.104:0/366418178 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85a4033d20 0x7f85a40e0170 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f85ac066090 tx=0x7f85ac065320 comp rx=0 tx=0).stop 2024-08-17T02:22:08.119 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.114+0000 7f85b2a13700 1 -- 172.21.15.104:0/366418178 shutdown_connections 2024-08-17T02:22:08.119 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.114+0000 7f85b2a13700 1 --2- 172.21.15.104:0/366418178 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85a4033d20 0x7f85a40e0170 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:08.120 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.114+0000 7f85b2a13700 1 --2- 172.21.15.104:0/366418178 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85a4034ff0 0x7f85a40337e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:08.120 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.114+0000 7f85b2a13700 1 -- 172.21.15.104:0/366418178 >> 172.21.15.104:0/366418178 conn(0x7f85a4051690 msgr2=0x7f85a4051a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:08.120 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.118+0000 7f85b2a13700 1 -- 172.21.15.104:0/366418178 shutdown_connections 2024-08-17T02:22:08.120 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.118+0000 7f85b2a13700 1 -- 172.21.15.104:0/366418178 wait complete. 2024-08-17T02:22:08.122 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.118+0000 7f85b2a13700 1 Processor -- start 2024-08-17T02:22:08.122 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.118+0000 7f85b2a13700 1 -- start start 2024-08-17T02:22:08.123 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.118+0000 7f85b2a13700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85a4033d20 0x7f85a40f9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:08.124 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.118+0000 7f85b2a13700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85a4034ff0 0x7f85a40d3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:08.124 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.118+0000 7f85b2a13700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85a40dfda0 0x7f85a40e2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:08.124 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.122+0000 7f85b2a13700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a40d7690 con 0x7f85a4033d20 2024-08-17T02:22:08.124 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.122+0000 7f85b2a13700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a40d7970 con 0x7f85a4034ff0 2024-08-17T02:22:08.124 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.122+0000 7f85b2a13700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a40f9db0 con 0x7f85a40dfda0 2024-08-17T02:22:08.124 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.122+0000 7f85abfff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85a4033d20 0x7f85a40f9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:08.124 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.122+0000 7f85b0fb0700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85a40dfda0 0x7f85a40e2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:08.124 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.122+0000 7f85ab7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85a4034ff0 0x7f85a40d3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:08.124 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.122+0000 7f85b0fb0700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85a40dfda0 0x7f85a40e2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.104:52824/0 (socket says 172.21.15.104:52824) 2024-08-17T02:22:08.124 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.122+0000 7f85abfff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85a4033d20 0x7f85a40f9870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54794/0 (socket says 172.21.15.104:54794) 2024-08-17T02:22:08.124 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.122+0000 7f85b0fb0700 1 -- 172.21.15.104:0/4058215415 learned_addr learned my addr 172.21.15.104:0/4058215415 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:08.125 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.122+0000 7f85b0fb0700 1 -- 172.21.15.104:0/4058215415 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85a4034ff0 msgr2=0x7f85a40d3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:08.125 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.122+0000 7f85b0fb0700 1 --2- 172.21.15.104:0/4058215415 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85a4034ff0 0x7f85a40d3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:08.125 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.122+0000 7f85b0fb0700 1 -- 172.21.15.104:0/4058215415 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85a4033d20 msgr2=0x7f85a40f9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:08.125 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.122+0000 7f85b0fb0700 1 --2- 172.21.15.104:0/4058215415 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85a4033d20 0x7f85a40f9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:08.125 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.122+0000 7f85b0fb0700 1 -- 172.21.15.104:0/4058215415 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ac04beb0 con 0x7f85a40dfda0 2024-08-17T02:22:08.125 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.122+0000 7f85b0fb0700 1 --2- 172.21.15.104:0/4058215415 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85a40dfda0 0x7f85a40e2ad0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f85ac02b300 tx=0x7f85ac094000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:08.126 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.122+0000 7f8593fff700 1 -- 172.21.15.104:0/4058215415 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ac0646b0 con 0x7f85a40dfda0 2024-08-17T02:22:08.126 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.122+0000 7f8593fff700 1 -- 172.21.15.104:0/4058215415 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85ac0949c0 con 0x7f85a40dfda0 2024-08-17T02:22:08.126 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.122+0000 7f8593fff700 1 -- 172.21.15.104:0/4058215415 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ac094d40 con 0x7f85a40dfda0 2024-08-17T02:22:08.126 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.122+0000 7f85b2a13700 1 -- 172.21.15.104:0/4058215415 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85a40fa030 con 0x7f85a40dfda0 2024-08-17T02:22:08.127 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.122+0000 7f85b2a13700 1 -- 172.21.15.104:0/4058215415 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85a40fa5f0 con 0x7f85a40dfda0 2024-08-17T02:22:08.128 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.126+0000 7f85b2a13700 1 -- 172.21.15.104:0/4058215415 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85a40053b0 con 0x7f85a40dfda0 2024-08-17T02:22:08.128 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.126+0000 7f8593fff700 1 -- 172.21.15.104:0/4058215415 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 4) v1 ==== 80087+0+0 (secure 0 0 0) 0x7f85ac09c640 con 0x7f85a40dfda0 2024-08-17T02:22:08.128 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.126+0000 7f8593fff700 1 --2- 172.21.15.104:0/4058215415 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8598060950 0x7f8598062e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:08.128 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.126+0000 7f8593fff700 1 -- 172.21.15.104:0/4058215415 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2507+0+0 (secure 0 0 0) 0x7f85ac0f3e20 con 0x7f85a40dfda0 2024-08-17T02:22:08.129 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.126+0000 7f85abfff700 1 --2- 172.21.15.104:0/4058215415 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8598060950 0x7f8598062e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:08.130 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.126+0000 7f85abfff700 1 --2- 172.21.15.104:0/4058215415 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8598060950 0x7f8598062e00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f859c009ab0 tx=0x7f859c009060 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:08.139 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.138+0000 7f8593fff700 1 -- 172.21.15.104:0/4058215415 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f85ac0f7030 con 0x7f85a40dfda0 2024-08-17T02:22:08.324 INFO:tasks.ceph.osd.3.smithi104.stderr:2024-08-17T02:22:08.322+0000 7f8c258aa700 -1 osd.3 0 waiting for initial osdmap 2024-08-17T02:22:08.328 INFO:tasks.ceph.osd.1.smithi104.stderr:2024-08-17T02:22:08.326+0000 7f301d039700 -1 osd.1 0 waiting for initial osdmap 2024-08-17T02:22:08.334 INFO:tasks.ceph.osd.1.smithi104.stderr:2024-08-17T02:22:08.330+0000 7f3015ddc700 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:22:08.339 INFO:tasks.ceph.osd.3.smithi104.stderr:2024-08-17T02:22:08.326+0000 7f8c1e64d700 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:22:08.370 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-08-17T02:22:08.366+0000 7f33cfa45700 -1 osd.2 0 waiting for initial osdmap 2024-08-17T02:22:08.376 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-08-17T02:22:08.374+0000 7f33c87e8700 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:22:08.388 INFO:tasks.ceph.osd.0.smithi104.stderr:2024-08-17T02:22:08.386+0000 7f3d9a861700 -1 osd.0 0 waiting for initial osdmap 2024-08-17T02:22:08.393 INFO:tasks.ceph.osd.0.smithi104.stderr:2024-08-17T02:22:08.390+0000 7f3d93604700 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:22:08.410 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.406+0000 7f85b2a13700 1 -- 172.21.15.104:0/4058215415 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85a40d7ab0 con 0x7f85a40dfda0 2024-08-17T02:22:08.411 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.410+0000 7f8593fff700 1 -- 172.21.15.104:0/4058215415 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+7462 (secure 0 0 0) 0x7f85ac0c5070 con 0x7f85a40dfda0 2024-08-17T02:22:08.412 INFO:teuthology.misc.health.smithi104.stdout: 2024-08-17T02:22:08.412 INFO:teuthology.misc.health.smithi104.stdout:{"epoch":14,"fsid":"fd5f7fb8-d34b-49bb-89a8-62b7dad1bc25","created":"2024-08-17T02:21:57.891389+0000","modified":"2024-08-17T02:22:07.164677+0000","last_up_change":"2024-08-17T02:22:07.164677+0000","last_in_change":"2024-08-17T02:21:59.938028+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"606b9088-590e-4709-aa3a-b0f6e22972ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9bc6a909-0c2f-4889-afe7-4a47f89b0f64","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"23da31d5-aefb-4edb-b79d-fa05e1becef7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6e4a5ec2-b415-45ef-8381-61a59eb65224","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8d5bea2d-9039-4013-8c99-2c046c5b8a17","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"de8b36fc-121c-4f05-8f5b-28f513d9f21f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6a87f09f-7bf7-4f7a-be87-530ac1ff8ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":24420},{"type":"v1","addr":"172.21.15.117:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6803","nonce":24420},{"type":"v1","addr":"172.21.15.117:6805","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":24420},{"type":"v1","addr":"172.21.15.117:6811","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":24420},{"type":"v1","addr":"172.21.15.117:6808","nonce":24420}]},"public_addr":"172.21.15.117:6801/24420","cluster_addr":"172.21.15.117:6805/24420","heartbeat_back_addr":"172.21.15.117:6811/24420","heartbeat_front_addr":"172.21.15.117:6808/24420","state":["exists","up"]},{"osd":7,"uuid":"e31d8041-1aa1-4b5d-83b3-0a373426dd9f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:22:08.414 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.410+0000 7f85b2a13700 1 -- 172.21.15.104:0/4058215415 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8598060950 msgr2=0x7f8598062e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:08.414 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.410+0000 7f85b2a13700 1 --2- 172.21.15.104:0/4058215415 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8598060950 0x7f8598062e00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f859c009ab0 tx=0x7f859c009060 comp rx=0 tx=0).stop 2024-08-17T02:22:08.414 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.410+0000 7f85b2a13700 1 -- 172.21.15.104:0/4058215415 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85a40dfda0 msgr2=0x7f85a40e2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:08.414 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.410+0000 7f85b2a13700 1 --2- 172.21.15.104:0/4058215415 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85a40dfda0 0x7f85a40e2ad0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f85ac02b300 tx=0x7f85ac094000 comp rx=0 tx=0).stop 2024-08-17T02:22:08.414 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.410+0000 7f85b2a13700 1 -- 172.21.15.104:0/4058215415 shutdown_connections 2024-08-17T02:22:08.414 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.410+0000 7f85b2a13700 1 --2- 172.21.15.104:0/4058215415 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8598060950 0x7f8598062e00 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:08.414 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.410+0000 7f85b2a13700 1 --2- 172.21.15.104:0/4058215415 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85a40dfda0 0x7f85a40e2ad0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:08.415 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.410+0000 7f85b2a13700 1 --2- 172.21.15.104:0/4058215415 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85a4034ff0 0x7f85a40d3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:08.415 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.410+0000 7f85b2a13700 1 --2- 172.21.15.104:0/4058215415 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85a4033d20 0x7f85a40f9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:08.415 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.410+0000 7f85b2a13700 1 -- 172.21.15.104:0/4058215415 >> 172.21.15.104:0/4058215415 conn(0x7f85a4051690 msgr2=0x7f85a404fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:08.415 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.410+0000 7f85b2a13700 1 -- 172.21.15.104:0/4058215415 shutdown_connections 2024-08-17T02:22:08.415 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:08.410+0000 7f85b2a13700 1 -- 172.21.15.104:0/4058215415 wait complete. 2024-08-17T02:22:08.423 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-08-17T02:22:15.230 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:22:15.335 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.330+0000 7f8d85cf6700 1 Processor -- start 2024-08-17T02:22:15.335 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.330+0000 7f8d85cf6700 1 -- start start 2024-08-17T02:22:15.336 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.334+0000 7f8d85cf6700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f8d8015dab0 0x7f8d8006c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:15.336 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.334+0000 7f8d85cf6700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d800afe90 con 0x7f8d8015d6e0 2024-08-17T02:22:15.336 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.334+0000 7f8d85cf6700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d800ad0c0 con 0x7f8d8006c5d0 2024-08-17T02:22:15.336 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.334+0000 7f8d85cf6700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d8006ca50 con 0x7f8d8015dab0 2024-08-17T02:22:15.336 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.334+0000 7f8d7ffff700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f8d8015dab0 0x7f8d8006c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:15.336 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.334+0000 7f8d7ffff700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f8d8015dab0 0x7f8d8006c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54810/0 (socket says 172.21.15.104:54810) 2024-08-17T02:22:15.336 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.334+0000 7f8d7ffff700 1 -- 172.21.15.104:0/3341726277 learned_addr learned my addr 172.21.15.104:0/3341726277 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:15.338 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.334+0000 7f8d7ffff700 1 -- 172.21.15.104:0/3341726277 >> v1:172.21.15.117:6789/0 conn(0x7f8d8006c5d0 legacy=0x7f8d800abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:15.338 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.334+0000 7f8d7ffff700 1 -- 172.21.15.104:0/3341726277 >> v1:172.21.15.104:6789/0 conn(0x7f8d8015d6e0 legacy=0x7f8d80161dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:15.338 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.334+0000 7f8d7ffff700 1 -- 172.21.15.104:0/3341726277 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d800af280 con 0x7f8d8015dab0 2024-08-17T02:22:15.338 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.334+0000 7f8d7ffff700 1 --2- 172.21.15.104:0/3341726277 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d8015dab0 0x7f8d8006c090 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8d740099b0 tx=0x7f8d74009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c696471a4ddbdc0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:15.338 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.334+0000 7f8d7f7fe700 1 -- 172.21.15.104:0/3341726277 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7400b820 con 0x7f8d8015dab0 2024-08-17T02:22:15.338 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.334+0000 7f8d7f7fe700 1 -- 172.21.15.104:0/3341726277 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d7400b980 con 0x7f8d8015dab0 2024-08-17T02:22:15.338 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.334+0000 7f8d7f7fe700 1 -- 172.21.15.104:0/3341726277 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7400bd40 con 0x7f8d8015dab0 2024-08-17T02:22:15.338 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.334+0000 7f8d85cf6700 1 -- 172.21.15.104:0/3341726277 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d8015dab0 msgr2=0x7f8d8006c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:15.339 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.334+0000 7f8d85cf6700 1 --2- 172.21.15.104:0/3341726277 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d8015dab0 0x7f8d8006c090 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8d740099b0 tx=0x7f8d74009250 comp rx=0 tx=0).stop 2024-08-17T02:22:15.339 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.334+0000 7f8d85cf6700 1 -- 172.21.15.104:0/3341726277 shutdown_connections 2024-08-17T02:22:15.339 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.334+0000 7f8d85cf6700 1 --2- 172.21.15.104:0/3341726277 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d8015dab0 0x7f8d8006c090 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:15.339 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.334+0000 7f8d85cf6700 1 -- 172.21.15.104:0/3341726277 >> 172.21.15.104:0/3341726277 conn(0x7f8d80066e10 msgr2=0x7f8d800700f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:15.339 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.334+0000 7f8d85cf6700 1 -- 172.21.15.104:0/3341726277 shutdown_connections 2024-08-17T02:22:15.339 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.334+0000 7f8d85cf6700 1 -- 172.21.15.104:0/3341726277 wait complete. 2024-08-17T02:22:15.341 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.338+0000 7f8d85cf6700 1 Processor -- start 2024-08-17T02:22:15.341 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.338+0000 7f8d85cf6700 1 -- start start 2024-08-17T02:22:15.345 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.338+0000 7f8d85cf6700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d8006c5d0 0x7f8d800a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:15.345 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.338+0000 7f8d85cf6700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d8015d6e0 0x7f8d80069570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:15.345 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.342+0000 7f8d85cf6700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d8015dab0 0x7f8d80069ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:15.345 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.342+0000 7f8d85cf6700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8016fb50 con 0x7f8d8015dab0 2024-08-17T02:22:15.345 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.342+0000 7f8d85cf6700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8016eec0 con 0x7f8d8015d6e0 2024-08-17T02:22:15.345 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.342+0000 7f8d85cf6700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8016f220 con 0x7f8d8006c5d0 2024-08-17T02:22:15.345 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.342+0000 7f8d854f5700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d8015dab0 0x7f8d80069ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:15.345 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.342+0000 7f8d854f5700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d8015dab0 0x7f8d80069ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54818/0 (socket says 172.21.15.104:54818) 2024-08-17T02:22:15.345 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.342+0000 7f8d854f5700 1 -- 172.21.15.104:0/1522529855 learned_addr learned my addr 172.21.15.104:0/1522529855 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:15.346 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.342+0000 7f8d84cf4700 1 --2- 172.21.15.104:0/1522529855 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d8006c5d0 0x7f8d800a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:15.346 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.342+0000 7f8d7ffff700 1 --2- 172.21.15.104:0/1522529855 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d8015d6e0 0x7f8d80069570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:15.346 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.342+0000 7f8d854f5700 1 -- 172.21.15.104:0/1522529855 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d8006c5d0 msgr2=0x7f8d800a5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:15.346 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.342+0000 7f8d854f5700 1 --2- 172.21.15.104:0/1522529855 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d8006c5d0 0x7f8d800a5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:15.346 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.342+0000 7f8d854f5700 1 -- 172.21.15.104:0/1522529855 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d8015d6e0 msgr2=0x7f8d80069570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:15.346 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.342+0000 7f8d854f5700 1 --2- 172.21.15.104:0/1522529855 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d8015d6e0 0x7f8d80069570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:15.346 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.342+0000 7f8d854f5700 1 -- 172.21.15.104:0/1522529855 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d740094f0 con 0x7f8d8015dab0 2024-08-17T02:22:15.346 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.342+0000 7f8d84cf4700 1 --2- 172.21.15.104:0/1522529855 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d8006c5d0 0x7f8d800a5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:22:15.346 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.342+0000 7f8d854f5700 1 --2- 172.21.15.104:0/1522529855 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d8015dab0 0x7f8d80069ab0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8d7800bc30 tx=0x7f8d78009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:15.346 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.342+0000 7f8d7cff9700 1 -- 172.21.15.104:0/1522529855 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7800c9b0 con 0x7f8d8015dab0 2024-08-17T02:22:15.346 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.342+0000 7f8d7cff9700 1 -- 172.21.15.104:0/1522529855 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d7800cb50 con 0x7f8d8015dab0 2024-08-17T02:22:15.346 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.342+0000 7f8d85cf6700 1 -- 172.21.15.104:0/1522529855 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d8016f500 con 0x7f8d8015dab0 2024-08-17T02:22:15.346 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.342+0000 7f8d7cff9700 1 -- 172.21.15.104:0/1522529855 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d78014410 con 0x7f8d8015dab0 2024-08-17T02:22:15.347 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.342+0000 7f8d85cf6700 1 -- 172.21.15.104:0/1522529855 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d800a6130 con 0x7f8d8015dab0 2024-08-17T02:22:15.347 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.342+0000 7f8d85cf6700 1 -- 172.21.15.104:0/1522529855 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d8016fcc0 con 0x7f8d8015dab0 2024-08-17T02:22:15.347 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.342+0000 7f8d7cff9700 1 -- 172.21.15.104:0/1522529855 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8d78014800 con 0x7f8d8015dab0 2024-08-17T02:22:15.347 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.346+0000 7f8d7cff9700 1 --2- 172.21.15.104:0/1522529855 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8d6c060860 0x7f8d6c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:15.347 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.346+0000 7f8d7cff9700 1 -- 172.21.15.104:0/1522529855 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f8d7807ca40 con 0x7f8d8015dab0 2024-08-17T02:22:15.348 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.346+0000 7f8d84cf4700 1 --2- 172.21.15.104:0/1522529855 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8d6c060860 0x7f8d6c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:15.348 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.346+0000 7f8d84cf4700 1 --2- 172.21.15.104:0/1522529855 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8d6c060860 0x7f8d6c062d10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8d70007fd0 tx=0x7f8d70009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:15.354 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.350+0000 7f8d7cff9700 1 -- 172.21.15.104:0/1522529855 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f8d7804b480 con 0x7f8d8015dab0 2024-08-17T02:22:15.520 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.518+0000 7f8d85cf6700 1 -- 172.21.15.104:0/1522529855 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d80064ba0 con 0x7f8d8015dab0 2024-08-17T02:22:15.522 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.518+0000 7f8d7cff9700 1 -- 172.21.15.104:0/1522529855 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12175 (secure 0 0 0) 0x7f8d7804d140 con 0x7f8d8015dab0 2024-08-17T02:22:15.522 INFO:teuthology.misc.health.smithi104.stdout: 2024-08-17T02:22:15.522 INFO:teuthology.misc.health.smithi104.stdout:{"epoch":19,"fsid":"fd5f7fb8-d34b-49bb-89a8-62b7dad1bc25","created":"2024-08-17T02:21:57.891389+0000","modified":"2024-08-17T02:22:12.954891+0000","last_up_change":"2024-08-17T02:22:08.924546+0000","last_in_change":"2024-08-17T02:21:59.938028+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:22:10.143970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"606b9088-590e-4709-aa3a-b0f6e22972ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":24257},{"type":"v1","addr":"172.21.15.104:6809","nonce":24257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":24257},{"type":"v1","addr":"172.21.15.104:6811","nonce":24257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":24257},{"type":"v1","addr":"172.21.15.104:6815","nonce":24257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":24257},{"type":"v1","addr":"172.21.15.104:6813","nonce":24257}]},"public_addr":"172.21.15.104:6809/24257","cluster_addr":"172.21.15.104:6811/24257","heartbeat_back_addr":"172.21.15.104:6815/24257","heartbeat_front_addr":"172.21.15.104:6813/24257","state":["exists","up"]},{"osd":1,"uuid":"9bc6a909-0c2f-4889-afe7-4a47f89b0f64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":24256},{"type":"v1","addr":"172.21.15.104:6825","nonce":24256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":24256},{"type":"v1","addr":"172.21.15.104:6827","nonce":24256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":24256},{"type":"v1","addr":"172.21.15.104:6831","nonce":24256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":24256},{"type":"v1","addr":"172.21.15.104:6829","nonce":24256}]},"public_addr":"172.21.15.104:6825/24256","cluster_addr":"172.21.15.104:6827/24256","heartbeat_back_addr":"172.21.15.104:6831/24256","heartbeat_front_addr":"172.21.15.104:6829/24256","state":["exists","up"]},{"osd":2,"uuid":"23da31d5-aefb-4edb-b79d-fa05e1becef7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":24255},{"type":"v1","addr":"172.21.15.104:6817","nonce":24255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":24255},{"type":"v1","addr":"172.21.15.104:6819","nonce":24255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":24255},{"type":"v1","addr":"172.21.15.104:6823","nonce":24255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":24255},{"type":"v1","addr":"172.21.15.104:6821","nonce":24255}]},"public_addr":"172.21.15.104:6817/24255","cluster_addr":"172.21.15.104:6819/24255","heartbeat_back_addr":"172.21.15.104:6823/24255","heartbeat_front_addr":"172.21.15.104:6821/24255","state":["exists","up"]},{"osd":3,"uuid":"6e4a5ec2-b415-45ef-8381-61a59eb65224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":24254},{"type":"v1","addr":"172.21.15.104:6801","nonce":24254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":24254},{"type":"v1","addr":"172.21.15.104:6803","nonce":24254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":24254},{"type":"v1","addr":"172.21.15.104:6807","nonce":24254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":24254},{"type":"v1","addr":"172.21.15.104:6805","nonce":24254}]},"public_addr":"172.21.15.104:6801/24254","cluster_addr":"172.21.15.104:6803/24254","heartbeat_back_addr":"172.21.15.104:6807/24254","heartbeat_front_addr":"172.21.15.104:6805/24254","state":["exists","up"]},{"osd":4,"uuid":"8d5bea2d-9039-4013-8c99-2c046c5b8a17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":24421},{"type":"v1","addr":"172.21.15.117:6804","nonce":24421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":24421},{"type":"v1","addr":"172.21.15.117:6809","nonce":24421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":24421},{"type":"v1","addr":"172.21.15.117:6815","nonce":24421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":24421},{"type":"v1","addr":"172.21.15.117:6813","nonce":24421}]},"public_addr":"172.21.15.117:6804/24421","cluster_addr":"172.21.15.117:6809/24421","heartbeat_back_addr":"172.21.15.117:6815/24421","heartbeat_front_addr":"172.21.15.117:6813/24421","state":["exists","up"]},{"osd":5,"uuid":"de8b36fc-121c-4f05-8f5b-28f513d9f21f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":24422},{"type":"v1","addr":"172.21.15.117:6817","nonce":24422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":24422},{"type":"v1","addr":"172.21.15.117:6819","nonce":24422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":24422},{"type":"v1","addr":"172.21.15.117:6823","nonce":24422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":24422},{"type":"v1","addr":"172.21.15.117:6821","nonce":24422}]},"public_addr":"172.21.15.117:6817/24422","cluster_addr":"172.21.15.117:6819/24422","heartbeat_back_addr":"172.21.15.117:6823/24422","heartbeat_front_addr":"172.21.15.117:6821/24422","state":["exists","up"]},{"osd":6,"uuid":"6a87f09f-7bf7-4f7a-be87-530ac1ff8ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":24420},{"type":"v1","addr":"172.21.15.117:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6803","nonce":24420},{"type":"v1","addr":"172.21.15.117:6805","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":24420},{"type":"v1","addr":"172.21.15.117:6811","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":24420},{"type":"v1","addr":"172.21.15.117:6808","nonce":24420}]},"public_addr":"172.21.15.117:6801/24420","cluster_addr":"172.21.15.117:6805/24420","heartbeat_back_addr":"172.21.15.117:6811/24420","heartbeat_front_addr":"172.21.15.117:6808/24420","state":["exists","up"]},{"osd":7,"uuid":"e31d8041-1aa1-4b5d-83b3-0a373426dd9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":24423},{"type":"v1","addr":"172.21.15.117:6825","nonce":24423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":24423},{"type":"v1","addr":"172.21.15.117:6827","nonce":24423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":24423},{"type":"v1","addr":"172.21.15.117:6831","nonce":24423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":24423},{"type":"v1","addr":"172.21.15.117:6829","nonce":24423}]},"public_addr":"172.21.15.117:6825/24423","cluster_addr":"172.21.15.117:6827/24423","heartbeat_back_addr":"172.21.15.117:6831/24423","heartbeat_front_addr":"172.21.15.117:6829/24423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.220874+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.210039+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.434762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.247206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.184316+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.306325+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.035719+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.400303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:22:15.524 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.522+0000 7f8d85cf6700 1 -- 172.21.15.104:0/1522529855 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8d6c060860 msgr2=0x7f8d6c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:15.524 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.522+0000 7f8d85cf6700 1 --2- 172.21.15.104:0/1522529855 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8d6c060860 0x7f8d6c062d10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8d70007fd0 tx=0x7f8d70009040 comp rx=0 tx=0).stop 2024-08-17T02:22:15.524 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.522+0000 7f8d85cf6700 1 -- 172.21.15.104:0/1522529855 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d8015dab0 msgr2=0x7f8d80069ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:15.524 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.522+0000 7f8d85cf6700 1 --2- 172.21.15.104:0/1522529855 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d8015dab0 0x7f8d80069ab0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8d7800bc30 tx=0x7f8d78009820 comp rx=0 tx=0).stop 2024-08-17T02:22:15.525 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.522+0000 7f8d85cf6700 1 -- 172.21.15.104:0/1522529855 shutdown_connections 2024-08-17T02:22:15.525 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.522+0000 7f8d85cf6700 1 --2- 172.21.15.104:0/1522529855 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8d6c060860 0x7f8d6c062d10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:15.525 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.522+0000 7f8d85cf6700 1 --2- 172.21.15.104:0/1522529855 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d8015dab0 0x7f8d80069ab0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:15.525 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.522+0000 7f8d85cf6700 1 --2- 172.21.15.104:0/1522529855 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d8015d6e0 0x7f8d80069570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:15.525 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.522+0000 7f8d85cf6700 1 --2- 172.21.15.104:0/1522529855 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d8006c5d0 0x7f8d800a5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:15.525 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.522+0000 7f8d85cf6700 1 -- 172.21.15.104:0/1522529855 >> 172.21.15.104:0/1522529855 conn(0x7f8d80066e10 msgr2=0x7f8d800c9b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:15.525 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.522+0000 7f8d85cf6700 1 -- 172.21.15.104:0/1522529855 shutdown_connections 2024-08-17T02:22:15.525 INFO:teuthology.misc.health.smithi104.stderr:2024-08-17T02:22:15.522+0000 7f8d85cf6700 1 -- 172.21.15.104:0/1522529855 wait complete. 2024-08-17T02:22:15.535 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-08-17T02:22:15.536 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-08-17T02:22:15.536 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-17T02:22:15.536 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-17T02:22:15.538 INFO:tasks.ceph.mds.a:Started 2024-08-17T02:22:15.539 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-17T02:22:15.539 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-17T02:22:15.541 INFO:tasks.ceph.mds.c:Started 2024-08-17T02:22:15.541 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-17T02:22:15.541 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-17T02:22:15.543 INFO:tasks.ceph.mds.b:Started 2024-08-17T02:22:15.544 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-17T02:22:15.544 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-17T02:22:15.546 INFO:tasks.ceph.mds.d:Started 2024-08-17T02:22:15.546 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-08-17T02:22:15.546 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:22:15.609 INFO:tasks.ceph.mds.a.smithi104.stdout:starting mds.a at 2024-08-17T02:22:15.617 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2024-08-17T02:22:15.619 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2024-08-17T02:22:15.629 INFO:tasks.ceph.mds.c.smithi104.stdout:starting mds.c at 2024-08-17T02:22:15.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.646+0000 7f399bf54700 1 Processor -- start 2024-08-17T02:22:15.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.646+0000 7f399bf54700 1 -- start start 2024-08-17T02:22:15.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.646+0000 7f399bf54700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f399406f080 0x7f399406e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:15.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.646+0000 7f399bf54700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39940ac310 con 0x7f399406e690 2024-08-17T02:22:15.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.646+0000 7f399bf54700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39940ac830 con 0x7f39940ae490 2024-08-17T02:22:15.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.646+0000 7f399bf54700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f399406eb30 con 0x7f399406f080 2024-08-17T02:22:15.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.646+0000 7f399a4f1700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f399406e690 0x7f39940af9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:55652/0 (socket says 172.21.15.104:55652) 2024-08-17T02:22:15.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.646+0000 7f399a4f1700 1 -- 172.21.15.104:0/112978659 learned_addr learned my addr 172.21.15.104:0/112978659 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:15.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.646+0000 7f39994ef700 1 --2- 172.21.15.104:0/112978659 >> v2:172.21.15.117:3300/0 conn(0x7f399406f080 0x7f399406e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:15.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.646+0000 7f3998cee700 1 -- 172.21.15.104:0/112978659 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2996439474 0 0) 0x7f39940ac830 con 0x7f39940ae490 2024-08-17T02:22:15.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.646+0000 7f3998cee700 1 -- 172.21.15.104:0/112978659 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3980003570 con 0x7f39940ae490 2024-08-17T02:22:15.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.650+0000 7f39994ef700 1 -- 172.21.15.104:0/112978659 >> v1:172.21.15.117:6789/0 conn(0x7f39940ae490 legacy=0x7f39940abc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:15.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.650+0000 7f39994ef700 1 -- 172.21.15.104:0/112978659 >> v1:172.21.15.104:6789/0 conn(0x7f399406e690 legacy=0x7f39940af9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:15.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.650+0000 7f39994ef700 1 -- 172.21.15.104:0/112978659 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39940af510 con 0x7f399406f080 2024-08-17T02:22:15.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.650+0000 7f39994ef700 1 --2- 172.21.15.104:0/112978659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f399406f080 0x7f399406e150 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f39840098e0 tx=0x7f39840091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c62075ce61add343 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:15.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.650+0000 7f3998cee700 1 -- 172.21.15.104:0/112978659 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398400b640 con 0x7f399406f080 2024-08-17T02:22:15.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.650+0000 7f3998cee700 1 -- 172.21.15.104:0/112978659 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f398400b7a0 con 0x7f399406f080 2024-08-17T02:22:15.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.650+0000 7f3998cee700 1 -- 172.21.15.104:0/112978659 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398400bb20 con 0x7f399406f080 2024-08-17T02:22:15.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.650+0000 7f399bf54700 1 -- 172.21.15.104:0/112978659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f399406f080 msgr2=0x7f399406e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:15.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.650+0000 7f399bf54700 1 --2- 172.21.15.104:0/112978659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f399406f080 0x7f399406e150 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f39840098e0 tx=0x7f39840091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:15.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.650+0000 7f399bf54700 1 -- 172.21.15.104:0/112978659 shutdown_connections 2024-08-17T02:22:15.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.650+0000 7f399bf54700 1 --2- 172.21.15.104:0/112978659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f399406f080 0x7f399406e150 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:15.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.650+0000 7f399bf54700 1 -- 172.21.15.104:0/112978659 >> 172.21.15.104:0/112978659 conn(0x7f39940678c0 msgr2=0x7f3994067c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:15.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.650+0000 7f399bf54700 1 -- 172.21.15.104:0/112978659 shutdown_connections 2024-08-17T02:22:15.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.650+0000 7f399bf54700 1 -- 172.21.15.104:0/112978659 wait complete. 2024-08-17T02:22:15.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.654+0000 7f399bf54700 1 Processor -- start 2024-08-17T02:22:15.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.654+0000 7f399bf54700 1 -- start start 2024-08-17T02:22:15.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.654+0000 7f399bf54700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f399406e690 0x7f39941506a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:15.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.654+0000 7f399bf54700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f399406f080 0x7f39940973d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:15.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.654+0000 7f399bf54700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39940ae490 0x7f39940c7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:15.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.654+0000 7f399bf54700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3994150be0 con 0x7f399406f080 2024-08-17T02:22:15.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.654+0000 7f399bf54700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3994098910 con 0x7f399406e690 2024-08-17T02:22:15.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.654+0000 7f39994ef700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f399406f080 0x7f39940973d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:15.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.654+0000 7f399bf54700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3994097d00 con 0x7f39940ae490 2024-08-17T02:22:15.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.654+0000 7f39994ef700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f399406f080 0x7f39940973d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54860/0 (socket says 172.21.15.104:54860) 2024-08-17T02:22:15.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.654+0000 7f39994ef700 1 -- 172.21.15.104:0/980075636 learned_addr learned my addr 172.21.15.104:0/980075636 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:15.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.654+0000 7f399a4f1700 1 --2- 172.21.15.104:0/980075636 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39940ae490 0x7f39940c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:15.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.654+0000 7f3999cf0700 1 --2- 172.21.15.104:0/980075636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f399406e690 0x7f39941506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:15.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.654+0000 7f39994ef700 1 -- 172.21.15.104:0/980075636 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39940ae490 msgr2=0x7f39940c7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:15.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.654+0000 7f39994ef700 1 --2- 172.21.15.104:0/980075636 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39940ae490 0x7f39940c7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:15.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.654+0000 7f39994ef700 1 -- 172.21.15.104:0/980075636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f399406e690 msgr2=0x7f39941506a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:15.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.654+0000 7f39994ef700 1 --2- 172.21.15.104:0/980075636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f399406e690 0x7f39941506a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:15.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.654+0000 7f39994ef700 1 -- 172.21.15.104:0/980075636 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3984009420 con 0x7f399406f080 2024-08-17T02:22:15.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.658+0000 7f39994ef700 1 --2- 172.21.15.104:0/980075636 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f399406f080 0x7f39940973d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f39840093f0 tx=0x7f3984017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:15.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.658+0000 7f3989ffb700 1 -- 172.21.15.104:0/980075636 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3984000d10 con 0x7f399406f080 2024-08-17T02:22:15.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.658+0000 7f3989ffb700 1 -- 172.21.15.104:0/980075636 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f398400b910 con 0x7f399406f080 2024-08-17T02:22:15.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.658+0000 7f399bf54700 1 -- 172.21.15.104:0/980075636 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3994097fe0 con 0x7f399406f080 2024-08-17T02:22:15.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.658+0000 7f3989ffb700 1 -- 172.21.15.104:0/980075636 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3984025670 con 0x7f399406f080 2024-08-17T02:22:15.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.658+0000 7f399bf54700 1 -- 172.21.15.104:0/980075636 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39940985a0 con 0x7f399406f080 2024-08-17T02:22:15.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.658+0000 7f399bf54700 1 -- 172.21.15.104:0/980075636 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39940644b0 con 0x7f399406f080 2024-08-17T02:22:15.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.662+0000 7f3989ffb700 1 -- 172.21.15.104:0/980075636 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f3984023070 con 0x7f399406f080 2024-08-17T02:22:15.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.662+0000 7f3989ffb700 1 --2- 172.21.15.104:0/980075636 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3978060860 0x7f3978062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:15.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.662+0000 7f3989ffb700 1 -- 172.21.15.104:0/980075636 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f398407e4b0 con 0x7f399406f080 2024-08-17T02:22:15.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.662+0000 7f3999cf0700 1 --2- 172.21.15.104:0/980075636 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3978060860 0x7f3978062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:15.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.666+0000 7f3999cf0700 1 --2- 172.21.15.104:0/980075636 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3978060860 0x7f3978062d10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3990007fd0 tx=0x7f3990007d30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:15.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.666+0000 7f3989ffb700 1 -- 172.21.15.104:0/980075636 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f398404ecd0 con 0x7f399406f080 2024-08-17T02:22:15.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.826+0000 7f399bf54700 1 -- 172.21.15.104:0/980075636 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f399406f930 con 0x7f399406f080 2024-08-17T02:22:15.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.830+0000 7f3989ffb700 1 -- 172.21.15.104:0/980075636 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12175 (secure 0 0 0) 0x7f3984015090 con 0x7f399406f080 2024-08-17T02:22:15.833 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:22:15.833 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":19,"fsid":"fd5f7fb8-d34b-49bb-89a8-62b7dad1bc25","created":"2024-08-17T02:21:57.891389+0000","modified":"2024-08-17T02:22:12.954891+0000","last_up_change":"2024-08-17T02:22:08.924546+0000","last_in_change":"2024-08-17T02:21:59.938028+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:22:10.143970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"606b9088-590e-4709-aa3a-b0f6e22972ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":24257},{"type":"v1","addr":"172.21.15.104:6809","nonce":24257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":24257},{"type":"v1","addr":"172.21.15.104:6811","nonce":24257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":24257},{"type":"v1","addr":"172.21.15.104:6815","nonce":24257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":24257},{"type":"v1","addr":"172.21.15.104:6813","nonce":24257}]},"public_addr":"172.21.15.104:6809/24257","cluster_addr":"172.21.15.104:6811/24257","heartbeat_back_addr":"172.21.15.104:6815/24257","heartbeat_front_addr":"172.21.15.104:6813/24257","state":["exists","up"]},{"osd":1,"uuid":"9bc6a909-0c2f-4889-afe7-4a47f89b0f64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":24256},{"type":"v1","addr":"172.21.15.104:6825","nonce":24256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":24256},{"type":"v1","addr":"172.21.15.104:6827","nonce":24256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":24256},{"type":"v1","addr":"172.21.15.104:6831","nonce":24256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":24256},{"type":"v1","addr":"172.21.15.104:6829","nonce":24256}]},"public_addr":"172.21.15.104:6825/24256","cluster_addr":"172.21.15.104:6827/24256","heartbeat_back_addr":"172.21.15.104:6831/24256","heartbeat_front_addr":"172.21.15.104:6829/24256","state":["exists","up"]},{"osd":2,"uuid":"23da31d5-aefb-4edb-b79d-fa05e1becef7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":24255},{"type":"v1","addr":"172.21.15.104:6817","nonce":24255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":24255},{"type":"v1","addr":"172.21.15.104:6819","nonce":24255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":24255},{"type":"v1","addr":"172.21.15.104:6823","nonce":24255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":24255},{"type":"v1","addr":"172.21.15.104:6821","nonce":24255}]},"public_addr":"172.21.15.104:6817/24255","cluster_addr":"172.21.15.104:6819/24255","heartbeat_back_addr":"172.21.15.104:6823/24255","heartbeat_front_addr":"172.21.15.104:6821/24255","state":["exists","up"]},{"osd":3,"uuid":"6e4a5ec2-b415-45ef-8381-61a59eb65224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":24254},{"type":"v1","addr":"172.21.15.104:6801","nonce":24254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":24254},{"type":"v1","addr":"172.21.15.104:6803","nonce":24254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":24254},{"type":"v1","addr":"172.21.15.104:6807","nonce":24254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":24254},{"type":"v1","addr":"172.21.15.104:6805","nonce":24254}]},"public_addr":"172.21.15.104:6801/24254","cluster_addr":"172.21.15.104:6803/24254","heartbeat_back_addr":"172.21.15.104:6807/24254","heartbeat_front_addr":"172.21.15.104:6805/24254","state":["exists","up"]},{"osd":4,"uuid":"8d5bea2d-9039-4013-8c99-2c046c5b8a17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":24421},{"type":"v1","addr":"172.21.15.117:6804","nonce":24421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":24421},{"type":"v1","addr":"172.21.15.117:6809","nonce":24421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":24421},{"type":"v1","addr":"172.21.15.117:6815","nonce":24421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":24421},{"type":"v1","addr":"172.21.15.117:6813","nonce":24421}]},"public_addr":"172.21.15.117:6804/24421","cluster_addr":"172.21.15.117:6809/24421","heartbeat_back_addr":"172.21.15.117:6815/24421","heartbeat_front_addr":"172.21.15.117:6813/24421","state":["exists","up"]},{"osd":5,"uuid":"de8b36fc-121c-4f05-8f5b-28f513d9f21f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":24422},{"type":"v1","addr":"172.21.15.117:6817","nonce":24422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":24422},{"type":"v1","addr":"172.21.15.117:6819","nonce":24422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":24422},{"type":"v1","addr":"172.21.15.117:6823","nonce":24422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":24422},{"type":"v1","addr":"172.21.15.117:6821","nonce":24422}]},"public_addr":"172.21.15.117:6817/24422","cluster_addr":"172.21.15.117:6819/24422","heartbeat_back_addr":"172.21.15.117:6823/24422","heartbeat_front_addr":"172.21.15.117:6821/24422","state":["exists","up"]},{"osd":6,"uuid":"6a87f09f-7bf7-4f7a-be87-530ac1ff8ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":24420},{"type":"v1","addr":"172.21.15.117:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6803","nonce":24420},{"type":"v1","addr":"172.21.15.117:6805","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":24420},{"type":"v1","addr":"172.21.15.117:6811","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":24420},{"type":"v1","addr":"172.21.15.117:6808","nonce":24420}]},"public_addr":"172.21.15.117:6801/24420","cluster_addr":"172.21.15.117:6805/24420","heartbeat_back_addr":"172.21.15.117:6811/24420","heartbeat_front_addr":"172.21.15.117:6808/24420","state":["exists","up"]},{"osd":7,"uuid":"e31d8041-1aa1-4b5d-83b3-0a373426dd9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":24423},{"type":"v1","addr":"172.21.15.117:6825","nonce":24423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":24423},{"type":"v1","addr":"172.21.15.117:6827","nonce":24423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":24423},{"type":"v1","addr":"172.21.15.117:6831","nonce":24423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":24423},{"type":"v1","addr":"172.21.15.117:6829","nonce":24423}]},"public_addr":"172.21.15.117:6825/24423","cluster_addr":"172.21.15.117:6827/24423","heartbeat_back_addr":"172.21.15.117:6831/24423","heartbeat_front_addr":"172.21.15.117:6829/24423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.220874+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.210039+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.434762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.247206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.184316+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.306325+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.035719+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.400303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:22:15.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.830+0000 7f399bf54700 1 -- 172.21.15.104:0/980075636 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3978060860 msgr2=0x7f3978062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:15.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.830+0000 7f399bf54700 1 --2- 172.21.15.104:0/980075636 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3978060860 0x7f3978062d10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3990007fd0 tx=0x7f3990007d30 comp rx=0 tx=0).stop 2024-08-17T02:22:15.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.830+0000 7f399bf54700 1 -- 172.21.15.104:0/980075636 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f399406f080 msgr2=0x7f39940973d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:15.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.830+0000 7f399bf54700 1 --2- 172.21.15.104:0/980075636 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f399406f080 0x7f39940973d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f39840093f0 tx=0x7f3984017000 comp rx=0 tx=0).stop 2024-08-17T02:22:15.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.830+0000 7f399bf54700 1 -- 172.21.15.104:0/980075636 shutdown_connections 2024-08-17T02:22:15.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.830+0000 7f399bf54700 1 --2- 172.21.15.104:0/980075636 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3978060860 0x7f3978062d10 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:15.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.830+0000 7f399bf54700 1 --2- 172.21.15.104:0/980075636 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39940ae490 0x7f39940c7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:15.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.830+0000 7f399bf54700 1 --2- 172.21.15.104:0/980075636 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f399406f080 0x7f39940973d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:15.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.830+0000 7f399bf54700 1 --2- 172.21.15.104:0/980075636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f399406e690 0x7f39941506a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:15.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.830+0000 7f399bf54700 1 -- 172.21.15.104:0/980075636 >> 172.21.15.104:0/980075636 conn(0x7f39940678c0 msgr2=0x7f39940a8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:15.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.834+0000 7f399bf54700 1 -- 172.21.15.104:0/980075636 shutdown_connections 2024-08-17T02:22:15.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.834+0000 7f399bf54700 1 -- 172.21.15.104:0/980075636 wait complete. 2024-08-17T02:22:15.848 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:22:10.143970+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:22:15.848 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:22:15.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.958+0000 7f62296c4700 1 Processor -- start 2024-08-17T02:22:15.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.958+0000 7f62296c4700 1 -- start start 2024-08-17T02:22:15.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.962+0000 7f62296c4700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6224157140 0x7f62240b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:15.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.962+0000 7f62296c4700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f62240b25a0 0x7f62240698a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:15.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.962+0000 7f62296c4700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62240cba90 con 0x7f6224156d70 2024-08-17T02:22:15.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.962+0000 7f62296c4700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62240b29e0 con 0x7f62240b25a0 2024-08-17T02:22:15.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.962+0000 7f62296c4700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62240cae80 con 0x7f6224157140 2024-08-17T02:22:15.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.962+0000 7f6228ec3700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f62240b25a0 0x7f62240698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:15.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.962+0000 7f6228ec3700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f62240b25a0 0x7f62240698a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54872/0 (socket says 172.21.15.104:54872) 2024-08-17T02:22:15.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.962+0000 7f6228ec3700 1 -- 172.21.15.104:0/1357486623 learned_addr learned my addr 172.21.15.104:0/1357486623 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:15.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.962+0000 7f62237fe700 1 --2- 172.21.15.104:0/1357486623 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6224157140 0x7f62240b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:15.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.962+0000 7f6228ec3700 1 -- 172.21.15.104:0/1357486623 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6224157140 msgr2=0x7f62240b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:15.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.962+0000 7f6228ec3700 1 --2- 172.21.15.104:0/1357486623 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6224157140 0x7f62240b2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:15.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.962+0000 7f6228ec3700 1 -- 172.21.15.104:0/1357486623 >> v1:172.21.15.117:6789/0 conn(0x7f6224156d70 legacy=0x7f62240678c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:15.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.962+0000 7f6228ec3700 1 -- 172.21.15.104:0/1357486623 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62240cb160 con 0x7f62240b25a0 2024-08-17T02:22:15.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.962+0000 7f6228ec3700 1 --2- 172.21.15.104:0/1357486623 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f62240b25a0 0x7f62240698a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f621c009f20 tx=0x7f621c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d448f9fbb507a116 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:15.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.962+0000 7f6222ffd700 1 -- 172.21.15.104:0/1357486623 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621c00e070 con 0x7f62240b25a0 2024-08-17T02:22:15.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.962+0000 7f6222ffd700 1 -- 172.21.15.104:0/1357486623 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621c00b9d0 con 0x7f62240b25a0 2024-08-17T02:22:15.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.962+0000 7f6222ffd700 1 -- 172.21.15.104:0/1357486623 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621c0092e0 con 0x7f62240b25a0 2024-08-17T02:22:15.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.962+0000 7f62296c4700 1 -- 172.21.15.104:0/1357486623 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f62240b25a0 msgr2=0x7f62240698a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:15.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.962+0000 7f62296c4700 1 --2- 172.21.15.104:0/1357486623 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f62240b25a0 0x7f62240698a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f621c009f20 tx=0x7f621c009840 comp rx=0 tx=0).stop 2024-08-17T02:22:15.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.962+0000 7f62296c4700 1 -- 172.21.15.104:0/1357486623 shutdown_connections 2024-08-17T02:22:15.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.962+0000 7f62296c4700 1 --2- 172.21.15.104:0/1357486623 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f62240b25a0 0x7f62240698a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:15.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.962+0000 7f62296c4700 1 --2- 172.21.15.104:0/1357486623 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6224157140 0x7f62240b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:15.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.962+0000 7f62296c4700 1 -- 172.21.15.104:0/1357486623 >> 172.21.15.104:0/1357486623 conn(0x7f622406e170 msgr2=0x7f622406e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:15.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.962+0000 7f62296c4700 1 -- 172.21.15.104:0/1357486623 shutdown_connections 2024-08-17T02:22:15.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.962+0000 7f62296c4700 1 -- 172.21.15.104:0/1357486623 wait complete. 2024-08-17T02:22:15.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.962+0000 7f62296c4700 1 Processor -- start 2024-08-17T02:22:15.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.962+0000 7f62296c4700 1 -- start start 2024-08-17T02:22:15.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.966+0000 7f62296c4700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62240b25a0 0x7f62241577d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:15.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.966+0000 7f62296c4700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6224156d70 0x7f622414eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:15.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.966+0000 7f62296c4700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6224157140 0x7f622414b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:15.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.966+0000 7f62296c4700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6224169eb0 con 0x7f6224157140 2024-08-17T02:22:15.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.966+0000 7f62296c4700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f622414f880 con 0x7f6224156d70 2024-08-17T02:22:15.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.966+0000 7f62296c4700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6224169860 con 0x7f62240b25a0 2024-08-17T02:22:15.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.966+0000 7f6228ec3700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6224157140 0x7f622414b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:15.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.966+0000 7f6228ec3700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6224157140 0x7f622414b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54882/0 (socket says 172.21.15.104:54882) 2024-08-17T02:22:15.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.966+0000 7f6228ec3700 1 -- 172.21.15.104:0/3369161532 learned_addr learned my addr 172.21.15.104:0/3369161532 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:15.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.966+0000 7f6223fff700 1 --2- 172.21.15.104:0/3369161532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62240b25a0 0x7f62241577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:15.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.966+0000 7f62237fe700 1 --2- 172.21.15.104:0/3369161532 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6224156d70 0x7f622414eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:15.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.966+0000 7f6228ec3700 1 -- 172.21.15.104:0/3369161532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62240b25a0 msgr2=0x7f62241577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:15.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.966+0000 7f6228ec3700 1 --2- 172.21.15.104:0/3369161532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62240b25a0 0x7f62241577d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:15.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.966+0000 7f6228ec3700 1 -- 172.21.15.104:0/3369161532 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6224156d70 msgr2=0x7f622414eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:15.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.966+0000 7f6228ec3700 1 --2- 172.21.15.104:0/3369161532 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6224156d70 0x7f622414eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:15.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.966+0000 7f6228ec3700 1 -- 172.21.15.104:0/3369161532 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f621c009ae0 con 0x7f6224157140 2024-08-17T02:22:15.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.966+0000 7f6228ec3700 1 --2- 172.21.15.104:0/3369161532 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6224157140 0x7f622414b810 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f621c00b610 tx=0x7f621c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:15.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.966+0000 7f621bfff700 1 -- 172.21.15.104:0/3369161532 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621c008ad0 con 0x7f6224157140 2024-08-17T02:22:15.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.966+0000 7f621bfff700 1 -- 172.21.15.104:0/3369161532 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621c008c30 con 0x7f6224157140 2024-08-17T02:22:15.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.966+0000 7f62296c4700 1 -- 172.21.15.104:0/3369161532 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6224169b40 con 0x7f6224157140 2024-08-17T02:22:15.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.966+0000 7f621bfff700 1 -- 172.21.15.104:0/3369161532 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621c025460 con 0x7f6224157140 2024-08-17T02:22:15.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.966+0000 7f62296c4700 1 -- 172.21.15.104:0/3369161532 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f622416a340 con 0x7f6224157140 2024-08-17T02:22:15.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.966+0000 7f62296c4700 1 -- 172.21.15.104:0/3369161532 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f622416a060 con 0x7f6224157140 2024-08-17T02:22:15.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.970+0000 7f621bfff700 1 -- 172.21.15.104:0/3369161532 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f621c003040 con 0x7f6224157140 2024-08-17T02:22:15.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.970+0000 7f621bfff700 1 --2- 172.21.15.104:0/3369161532 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f6208060860 0x7f6208062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:15.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.970+0000 7f621bfff700 1 -- 172.21.15.104:0/3369161532 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f621c07e420 con 0x7f6224157140 2024-08-17T02:22:15.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.970+0000 7f6223fff700 1 --2- 172.21.15.104:0/3369161532 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f6208060860 0x7f6208062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:15.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.970+0000 7f6223fff700 1 --2- 172.21.15.104:0/3369161532 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f6208060860 0x7f6208062d10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f622406b570 tx=0x7f6214009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:15.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:15.978+0000 7f621bfff700 1 -- 172.21.15.104:0/3369161532 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f622416a060 con 0x7f6224157140 2024-08-17T02:22:16.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.138+0000 7f62296c4700 1 -- 172.21.15.104:0/3369161532 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f622416a4d0 con 0x7f6224157140 2024-08-17T02:22:16.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.142+0000 7f621bfff700 1 -- 172.21.15.104:0/3369161532 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f621c04ebc0 con 0x7f6224157140 2024-08-17T02:22:16.144 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-08-17T02:22:16.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.142+0000 7f62296c4700 1 -- 172.21.15.104:0/3369161532 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f6208060860 msgr2=0x7f6208062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:16.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.142+0000 7f62296c4700 1 --2- 172.21.15.104:0/3369161532 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f6208060860 0x7f6208062d10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f622406b570 tx=0x7f6214009040 comp rx=0 tx=0).stop 2024-08-17T02:22:16.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.142+0000 7f62296c4700 1 -- 172.21.15.104:0/3369161532 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6224157140 msgr2=0x7f622414b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:16.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.142+0000 7f62296c4700 1 --2- 172.21.15.104:0/3369161532 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6224157140 0x7f622414b810 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f621c00b610 tx=0x7f621c018000 comp rx=0 tx=0).stop 2024-08-17T02:22:16.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.142+0000 7f62296c4700 1 -- 172.21.15.104:0/3369161532 shutdown_connections 2024-08-17T02:22:16.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.142+0000 7f62296c4700 1 --2- 172.21.15.104:0/3369161532 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f6208060860 0x7f6208062d10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:16.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.142+0000 7f62296c4700 1 --2- 172.21.15.104:0/3369161532 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6224157140 0x7f622414b810 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:16.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.142+0000 7f62296c4700 1 --2- 172.21.15.104:0/3369161532 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6224156d70 0x7f622414eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:16.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.142+0000 7f62296c4700 1 --2- 172.21.15.104:0/3369161532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62240b25a0 0x7f62241577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:16.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.142+0000 7f62296c4700 1 -- 172.21.15.104:0/3369161532 >> 172.21.15.104:0/3369161532 conn(0x7f622406e170 msgr2=0x7f6224155f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:16.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.142+0000 7f62296c4700 1 -- 172.21.15.104:0/3369161532 shutdown_connections 2024-08-17T02:22:16.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.142+0000 7f62296c4700 1 -- 172.21.15.104:0/3369161532 wait complete. 2024-08-17T02:22:16.157 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:22:16.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.258+0000 7f2d5714d700 1 Processor -- start 2024-08-17T02:22:16.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.258+0000 7f2d5714d700 1 -- start start 2024-08-17T02:22:16.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.258+0000 7f2d5714d700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d5015d540 0x7f2d500af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:16.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.258+0000 7f2d5714d700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2d500a9430 0x7f2d500b0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:16.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.258+0000 7f2d5714d700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d500b0270 con 0x7f2d5006e830 2024-08-17T02:22:16.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.258+0000 7f2d5714d700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d500af660 con 0x7f2d500a9430 2024-08-17T02:22:16.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.258+0000 7f2d5714d700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d500af940 con 0x7f2d5015d540 2024-08-17T02:22:16.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.258+0000 7f2d556ea700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2d500a9430 0x7f2d500b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:16.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.258+0000 7f2d556ea700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2d500a9430 0x7f2d500b0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54892/0 (socket says 172.21.15.104:54892) 2024-08-17T02:22:16.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.258+0000 7f2d556ea700 1 -- 172.21.15.104:0/368839884 learned_addr learned my addr 172.21.15.104:0/368839884 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:16.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.258+0000 7f2d54ee9700 1 --2- 172.21.15.104:0/368839884 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d5015d540 0x7f2d500af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:16.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.258+0000 7f2d556ea700 1 -- 172.21.15.104:0/368839884 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d5015d540 msgr2=0x7f2d500af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:16.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.258+0000 7f2d556ea700 1 --2- 172.21.15.104:0/368839884 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d5015d540 0x7f2d500af030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:16.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.258+0000 7f2d556ea700 1 -- 172.21.15.104:0/368839884 >> v1:172.21.15.117:6789/0 conn(0x7f2d5006e830 legacy=0x7f2d500a8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:16.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.258+0000 7f2d556ea700 1 -- 172.21.15.104:0/368839884 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d500afc20 con 0x7f2d500a9430 2024-08-17T02:22:16.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.258+0000 7f2d556ea700 1 --2- 172.21.15.104:0/368839884 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d500a9430 0x7f2d500b0700 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2d48009f20 tx=0x7f2d48009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edb815edea72e6c6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:16.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.262+0000 7f2d4f7fe700 1 -- 172.21.15.104:0/368839884 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4800e070 con 0x7f2d500a9430 2024-08-17T02:22:16.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.262+0000 7f2d4f7fe700 1 -- 172.21.15.104:0/368839884 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d4800b9d0 con 0x7f2d500a9430 2024-08-17T02:22:16.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.262+0000 7f2d4f7fe700 1 -- 172.21.15.104:0/368839884 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d480092e0 con 0x7f2d500a9430 2024-08-17T02:22:16.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.262+0000 7f2d5714d700 1 -- 172.21.15.104:0/368839884 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d500a9430 msgr2=0x7f2d500b0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:16.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.262+0000 7f2d5714d700 1 --2- 172.21.15.104:0/368839884 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d500a9430 0x7f2d500b0700 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2d48009f20 tx=0x7f2d48009840 comp rx=0 tx=0).stop 2024-08-17T02:22:16.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.262+0000 7f2d5714d700 1 -- 172.21.15.104:0/368839884 shutdown_connections 2024-08-17T02:22:16.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.262+0000 7f2d5714d700 1 --2- 172.21.15.104:0/368839884 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d500a9430 0x7f2d500b0700 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:16.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.262+0000 7f2d5714d700 1 --2- 172.21.15.104:0/368839884 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d5015d540 0x7f2d500af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:16.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.262+0000 7f2d5714d700 1 -- 172.21.15.104:0/368839884 >> 172.21.15.104:0/368839884 conn(0x7f2d50066e00 msgr2=0x7f2d50067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:16.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.262+0000 7f2d5714d700 1 -- 172.21.15.104:0/368839884 shutdown_connections 2024-08-17T02:22:16.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.262+0000 7f2d5714d700 1 -- 172.21.15.104:0/368839884 wait complete. 2024-08-17T02:22:16.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.262+0000 7f2d5714d700 1 Processor -- start 2024-08-17T02:22:16.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.262+0000 7f2d5714d700 1 -- start start 2024-08-17T02:22:16.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.262+0000 7f2d5714d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d5006e830 0x7f2d5016e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:16.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.262+0000 7f2d5714d700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d500a9430 0x7f2d50151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:16.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.262+0000 7f2d5714d700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d5015d540 0x7f2d5015d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:16.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.262+0000 7f2d5714d700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5016d990 con 0x7f2d5015d540 2024-08-17T02:22:16.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.262+0000 7f2d5714d700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5016df10 con 0x7f2d5006e830 2024-08-17T02:22:16.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.262+0000 7f2d5714d700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5015e2f0 con 0x7f2d500a9430 2024-08-17T02:22:16.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.266+0000 7f2d556ea700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d5015d540 0x7f2d5015d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:16.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.266+0000 7f2d54ee9700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d5006e830 0x7f2d5016e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:16.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.266+0000 7f2d556ea700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d5015d540 0x7f2d5015d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54896/0 (socket says 172.21.15.104:54896) 2024-08-17T02:22:16.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.266+0000 7f2d556ea700 1 -- 172.21.15.104:0/3982651775 learned_addr learned my addr 172.21.15.104:0/3982651775 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:16.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.266+0000 7f2d4ffff700 1 --2- 172.21.15.104:0/3982651775 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d500a9430 0x7f2d50151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:16.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.266+0000 7f2d556ea700 1 -- 172.21.15.104:0/3982651775 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d500a9430 msgr2=0x7f2d50151d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:16.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.266+0000 7f2d556ea700 1 --2- 172.21.15.104:0/3982651775 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d500a9430 0x7f2d50151d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:16.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.266+0000 7f2d556ea700 1 -- 172.21.15.104:0/3982651775 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d5006e830 msgr2=0x7f2d5016e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:16.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.266+0000 7f2d556ea700 1 --2- 172.21.15.104:0/3982651775 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d5006e830 0x7f2d5016e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:16.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.266+0000 7f2d556ea700 1 -- 172.21.15.104:0/3982651775 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d48009ae0 con 0x7f2d5015d540 2024-08-17T02:22:16.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.266+0000 7f2d556ea700 1 --2- 172.21.15.104:0/3982651775 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d5015d540 0x7f2d5015d910 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2d4800b610 tx=0x7f2d48018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:16.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.266+0000 7f2d4cff9700 1 -- 172.21.15.104:0/3982651775 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d48008ad0 con 0x7f2d5015d540 2024-08-17T02:22:16.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.266+0000 7f2d4cff9700 1 -- 172.21.15.104:0/3982651775 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d48008c30 con 0x7f2d5015d540 2024-08-17T02:22:16.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.266+0000 7f2d5714d700 1 -- 172.21.15.104:0/3982651775 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d5015e5d0 con 0x7f2d5015d540 2024-08-17T02:22:16.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.266+0000 7f2d4cff9700 1 -- 172.21.15.104:0/3982651775 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d48026460 con 0x7f2d5015d540 2024-08-17T02:22:16.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.266+0000 7f2d5714d700 1 -- 172.21.15.104:0/3982651775 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d5016e8e0 con 0x7f2d5015d540 2024-08-17T02:22:16.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.266+0000 7f2d5714d700 1 -- 172.21.15.104:0/3982651775 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d5015e810 con 0x7f2d5015d540 2024-08-17T02:22:16.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.270+0000 7f2d4cff9700 1 -- 172.21.15.104:0/3982651775 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2d48003040 con 0x7f2d5015d540 2024-08-17T02:22:16.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.270+0000 7f2d4cff9700 1 --2- 172.21.15.104:0/3982651775 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f2d30060860 0x7f2d30062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:16.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.270+0000 7f2d4cff9700 1 -- 172.21.15.104:0/3982651775 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f2d4807e6e0 con 0x7f2d5015d540 2024-08-17T02:22:16.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.270+0000 7f2d54ee9700 1 --2- 172.21.15.104:0/3982651775 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f2d30060860 0x7f2d30062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:16.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.270+0000 7f2d54ee9700 1 --2- 172.21.15.104:0/3982651775 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f2d30060860 0x7f2d30062d10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2d38009d10 tx=0x7f2d380091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:16.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.278+0000 7f2d4cff9700 1 -- 172.21.15.104:0/3982651775 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f2d5015e810 con 0x7f2d5015d540 2024-08-17T02:22:16.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.474+0000 7f2d5714d700 1 -- 172.21.15.104:0/3982651775 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2d5016e080 con 0x7f2d5015d540 2024-08-17T02:22:16.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.478+0000 7f2d4cff9700 1 -- 172.21.15.104:0/3982651775 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1259 (secure 0 0 0) 0x7f2d4804ee80 con 0x7f2d5015d540 2024-08-17T02:22:16.480 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:22:16.480 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/4197149840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":4197149840},{"type":"v1","addr":"172.21.15.117:6837","nonce":4197149840}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-08-17T02:22:16.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.478+0000 7f2d5714d700 1 -- 172.21.15.104:0/3982651775 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f2d30060860 msgr2=0x7f2d30062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:16.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.478+0000 7f2d5714d700 1 --2- 172.21.15.104:0/3982651775 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f2d30060860 0x7f2d30062d10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2d38009d10 tx=0x7f2d380091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:16.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.478+0000 7f2d5714d700 1 -- 172.21.15.104:0/3982651775 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d5015d540 msgr2=0x7f2d5015d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:16.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.478+0000 7f2d5714d700 1 --2- 172.21.15.104:0/3982651775 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d5015d540 0x7f2d5015d910 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2d4800b610 tx=0x7f2d48018000 comp rx=0 tx=0).stop 2024-08-17T02:22:16.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.478+0000 7f2d5714d700 1 -- 172.21.15.104:0/3982651775 shutdown_connections 2024-08-17T02:22:16.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.478+0000 7f2d5714d700 1 --2- 172.21.15.104:0/3982651775 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f2d30060860 0x7f2d30062d10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:16.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.478+0000 7f2d5714d700 1 --2- 172.21.15.104:0/3982651775 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d5015d540 0x7f2d5015d910 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:16.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.478+0000 7f2d5714d700 1 --2- 172.21.15.104:0/3982651775 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d500a9430 0x7f2d50151d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:16.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.478+0000 7f2d5714d700 1 --2- 172.21.15.104:0/3982651775 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d5006e830 0x7f2d5016e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:16.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.478+0000 7f2d5714d700 1 -- 172.21.15.104:0/3982651775 >> 172.21.15.104:0/3982651775 conn(0x7f2d50066e00 msgr2=0x7f2d5015c660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:16.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.478+0000 7f2d5714d700 1 -- 172.21.15.104:0/3982651775 shutdown_connections 2024-08-17T02:22:16.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:16.478+0000 7f2d5714d700 1 -- 172.21.15.104:0/3982651775 wait complete. 2024-08-17T02:22:16.484 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 2 2024-08-17T02:22:18.494 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:22:18.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.606+0000 7fd2b1c64700 1 Processor -- start 2024-08-17T02:22:18.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.606+0000 7fd2b1c64700 1 -- start start 2024-08-17T02:22:18.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.606+0000 7fd2b1c64700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2ac142c60 0x7fd2ac15cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:18.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.606+0000 7fd2b1c64700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd2ac15d3e0 0x7fd2ac0b0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:18.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.606+0000 7fd2b1c64700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2ac0cc800 con 0x7fd2ac142890 2024-08-17T02:22:18.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.606+0000 7fd2b1c64700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2ac15d860 con 0x7fd2ac15d3e0 2024-08-17T02:22:18.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.606+0000 7fd2b1c64700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ac0cbbf0 con 0x7fd2ac142c60 2024-08-17T02:22:18.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.606+0000 7fd2abfff700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd2ac15d3e0 0x7fd2ac0b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:18.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.606+0000 7fd2aaffd700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2ac142c60 0x7fd2ac15cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:18.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.606+0000 7fd2abfff700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd2ac15d3e0 0x7fd2ac0b0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.104:57518/0 (socket says 172.21.15.104:57518) 2024-08-17T02:22:18.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.606+0000 7fd2abfff700 1 -- 172.21.15.104:0/3146754390 learned_addr learned my addr 172.21.15.104:0/3146754390 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:18.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.606+0000 7fd2ab7fe700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fd2ac142890 0x7fd2ac0cb0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.104:36920/0 (socket says 172.21.15.104:36920) 2024-08-17T02:22:18.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.606+0000 7fd2aaffd700 1 -- 172.21.15.104:0/3146754390 >> v2:172.21.15.117:3300/0 conn(0x7fd2ac15d3e0 msgr2=0x7fd2ac0b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:18.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.606+0000 7fd2aaffd700 1 --2- 172.21.15.104:0/3146754390 >> v2:172.21.15.117:3300/0 conn(0x7fd2ac15d3e0 0x7fd2ac0b0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:18.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.606+0000 7fd2aaffd700 1 -- 172.21.15.104:0/3146754390 >> v1:172.21.15.117:6789/0 conn(0x7fd2ac142890 legacy=0x7fd2ac0cb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:18.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.606+0000 7fd2aaffd700 1 -- 172.21.15.104:0/3146754390 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2ac0cbed0 con 0x7fd2ac142c60 2024-08-17T02:22:18.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.606+0000 7fd2abfff700 1 --2- 172.21.15.104:0/3146754390 >> v2:172.21.15.117:3300/0 conn(0x7fd2ac15d3e0 0x7fd2ac0b0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:22:18.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.606+0000 7fd2aaffd700 1 --2- 172.21.15.104:0/3146754390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2ac142c60 0x7fd2ac15cea0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd2a00098e0 tx=0x7fd2a00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1978aa341c22f0f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:18.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.606+0000 7fd2aa7fc700 1 -- 172.21.15.104:0/3146754390 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a000b640 con 0x7fd2ac142c60 2024-08-17T02:22:18.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.606+0000 7fd2aa7fc700 1 -- 172.21.15.104:0/3146754390 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a000b7a0 con 0x7fd2ac142c60 2024-08-17T02:22:18.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.606+0000 7fd2aa7fc700 1 -- 172.21.15.104:0/3146754390 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a000bb40 con 0x7fd2ac142c60 2024-08-17T02:22:18.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.606+0000 7fd2b1c64700 1 -- 172.21.15.104:0/3146754390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2ac142c60 msgr2=0x7fd2ac15cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:18.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.606+0000 7fd2b1c64700 1 --2- 172.21.15.104:0/3146754390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2ac142c60 0x7fd2ac15cea0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd2a00098e0 tx=0x7fd2a00091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:18.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.606+0000 7fd2b1c64700 1 -- 172.21.15.104:0/3146754390 shutdown_connections 2024-08-17T02:22:18.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.606+0000 7fd2b1c64700 1 --2- 172.21.15.104:0/3146754390 >> v2:172.21.15.117:3300/0 conn(0x7fd2ac15d3e0 0x7fd2ac0b0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:18.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.606+0000 7fd2b1c64700 1 --2- 172.21.15.104:0/3146754390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2ac142c60 0x7fd2ac15cea0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:18.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.606+0000 7fd2b1c64700 1 -- 172.21.15.104:0/3146754390 >> 172.21.15.104:0/3146754390 conn(0x7fd2ac0a9db0 msgr2=0x7fd2ac0ac1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:18.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.606+0000 7fd2b1c64700 1 -- 172.21.15.104:0/3146754390 shutdown_connections 2024-08-17T02:22:18.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.606+0000 7fd2b1c64700 1 -- 172.21.15.104:0/3146754390 wait complete. 2024-08-17T02:22:18.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.614+0000 7fd2b1c64700 1 Processor -- start 2024-08-17T02:22:18.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.614+0000 7fd2b1c64700 1 -- start start 2024-08-17T02:22:18.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.614+0000 7fd2b1c64700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2ac142890 0x7fd2ac15b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:18.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.614+0000 7fd2b1c64700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd2ac142c60 0x7fd2ac15ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:18.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.614+0000 7fd2b1c64700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2ac15d3e0 0x7fd2ac1372e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:18.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.614+0000 7fd2b1c64700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ac139240 con 0x7fd2ac142c60 2024-08-17T02:22:18.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.614+0000 7fd2b1c64700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ac138630 con 0x7fd2ac15d3e0 2024-08-17T02:22:18.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.614+0000 7fd2b1c64700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ac138910 con 0x7fd2ac142890 2024-08-17T02:22:18.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.614+0000 7fd2aaffd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd2ac142c60 0x7fd2ac15ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:18.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.614+0000 7fd2aaffd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd2ac142c60 0x7fd2ac15ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45506/0 (socket says 172.21.15.104:45506) 2024-08-17T02:22:18.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.614+0000 7fd2aaffd700 1 -- 172.21.15.104:0/2986087641 learned_addr learned my addr 172.21.15.104:0/2986087641 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:18.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.614+0000 7fd2ab7fe700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2ac142890 0x7fd2ac15b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:18.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.614+0000 7fd2abfff700 1 --2- 172.21.15.104:0/2986087641 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2ac15d3e0 0x7fd2ac1372e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:18.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.614+0000 7fd2aaffd700 1 -- 172.21.15.104:0/2986087641 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2ac142890 msgr2=0x7fd2ac15b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:18.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.614+0000 7fd2aaffd700 1 --2- 172.21.15.104:0/2986087641 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2ac142890 0x7fd2ac15b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:18.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.614+0000 7fd2aaffd700 1 -- 172.21.15.104:0/2986087641 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2ac15d3e0 msgr2=0x7fd2ac1372e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:18.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.614+0000 7fd2aaffd700 1 --2- 172.21.15.104:0/2986087641 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2ac15d3e0 0x7fd2ac1372e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:18.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.614+0000 7fd2aaffd700 1 -- 172.21.15.104:0/2986087641 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a4009ae0 con 0x7fd2ac142c60 2024-08-17T02:22:18.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.614+0000 7fd2aaffd700 1 --2- 172.21.15.104:0/2986087641 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd2ac142c60 0x7fd2ac15ba60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac0cbd30 tx=0x7fd2a0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:18.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.614+0000 7fd2937fe700 1 -- 172.21.15.104:0/2986087641 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a001bb70 con 0x7fd2ac142c60 2024-08-17T02:22:18.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.614+0000 7fd2937fe700 1 -- 172.21.15.104:0/2986087641 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a001bcd0 con 0x7fd2ac142c60 2024-08-17T02:22:18.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.614+0000 7fd2937fe700 1 -- 172.21.15.104:0/2986087641 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a0011670 con 0x7fd2ac142c60 2024-08-17T02:22:18.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.614+0000 7fd2b1c64700 1 -- 172.21.15.104:0/2986087641 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2a0009420 con 0x7fd2ac142c60 2024-08-17T02:22:18.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.614+0000 7fd2b1c64700 1 -- 172.21.15.104:0/2986087641 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2ac138f50 con 0x7fd2ac142c60 2024-08-17T02:22:18.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.614+0000 7fd2b1c64700 1 -- 172.21.15.104:0/2986087641 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2ac1393f0 con 0x7fd2ac142c60 2024-08-17T02:22:18.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.614+0000 7fd2937fe700 1 -- 172.21.15.104:0/2986087641 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd2a0011a20 con 0x7fd2ac142c60 2024-08-17T02:22:18.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.614+0000 7fd2937fe700 1 --2- 172.21.15.104:0/2986087641 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fd298060860 0x7fd298062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:18.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.614+0000 7fd2937fe700 1 -- 172.21.15.104:0/2986087641 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd2a007dc50 con 0x7fd2ac142c60 2024-08-17T02:22:18.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.614+0000 7fd2ab7fe700 1 --2- 172.21.15.104:0/2986087641 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fd298060860 0x7fd298062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:18.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.614+0000 7fd2ab7fe700 1 --2- 172.21.15.104:0/2986087641 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fd298060860 0x7fd298062d10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac0ad0e0 tx=0x7fd29c007eb0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:18.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.622+0000 7fd2937fe700 1 -- 172.21.15.104:0/2986087641 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd2ac1393f0 con 0x7fd2ac142c60 2024-08-17T02:22:18.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.818+0000 7fd2b1c64700 1 -- 172.21.15.104:0/2986087641 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd2ac0645c0 con 0x7fd2ac142c60 2024-08-17T02:22:18.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.818+0000 7fd2937fe700 1 -- 172.21.15.104:0/2986087641 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3536 (secure 0 0 0) 0x7fd2a0015de0 con 0x7fd2ac142c60 2024-08-17T02:22:18.826 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:22:18.826 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/1242386459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":1242386459},{"type":"v1","addr":"172.21.15.104:6835","nonce":1242386459}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/2581980475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2581980475},{"type":"v1","addr":"172.21.15.104:6833","nonce":2581980475}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1039240942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1039240942},{"type":"v1","addr":"172.21.15.117:6835","nonce":1039240942}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/4197149840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":4197149840},{"type":"v1","addr":"172.21.15.117:6837","nonce":4197149840}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-08-17T02:22:18.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.822+0000 7fd2b1c64700 1 -- 172.21.15.104:0/2986087641 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fd298060860 msgr2=0x7fd298062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:18.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.822+0000 7fd2b1c64700 1 --2- 172.21.15.104:0/2986087641 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fd298060860 0x7fd298062d10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac0ad0e0 tx=0x7fd29c007eb0 comp rx=0 tx=0).stop 2024-08-17T02:22:18.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.822+0000 7fd2b1c64700 1 -- 172.21.15.104:0/2986087641 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd2ac142c60 msgr2=0x7fd2ac15ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:18.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.822+0000 7fd2b1c64700 1 --2- 172.21.15.104:0/2986087641 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd2ac142c60 0x7fd2ac15ba60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac0cbd30 tx=0x7fd2a0017000 comp rx=0 tx=0).stop 2024-08-17T02:22:18.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.822+0000 7fd2b1c64700 1 -- 172.21.15.104:0/2986087641 shutdown_connections 2024-08-17T02:22:18.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.822+0000 7fd2b1c64700 1 --2- 172.21.15.104:0/2986087641 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fd298060860 0x7fd298062d10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:18.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.822+0000 7fd2b1c64700 1 --2- 172.21.15.104:0/2986087641 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2ac15d3e0 0x7fd2ac1372e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:18.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.822+0000 7fd2b1c64700 1 --2- 172.21.15.104:0/2986087641 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd2ac142c60 0x7fd2ac15ba60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:18.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.822+0000 7fd2b1c64700 1 --2- 172.21.15.104:0/2986087641 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2ac142890 0x7fd2ac15b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:18.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.822+0000 7fd2b1c64700 1 -- 172.21.15.104:0/2986087641 >> 172.21.15.104:0/2986087641 conn(0x7fd2ac0a9db0 msgr2=0x7fd2ac0c9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:18.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.822+0000 7fd2b1c64700 1 -- 172.21.15.104:0/2986087641 shutdown_connections 2024-08-17T02:22:18.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.822+0000 7fd2b1c64700 1 -- 172.21.15.104:0/2986087641 wait complete. 2024-08-17T02:22:18.829 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 3 2024-08-17T02:22:18.839 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:22:18.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.938+0000 7f208db84700 1 Processor -- start 2024-08-17T02:22:18.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.938+0000 7f208db84700 1 -- start start 2024-08-17T02:22:18.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.938+0000 7f208db84700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f20880b0d20 0x7f208806df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:18.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.938+0000 7f208db84700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f208806e450 0x7f20880b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:18.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.938+0000 7f208db84700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2088141a00 con 0x7f20880b1630 2024-08-17T02:22:18.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.938+0000 7f208db84700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f208806e8a0 con 0x7f208806e450 2024-08-17T02:22:18.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.938+0000 7f208db84700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2088140b10 con 0x7f20880b0d20 2024-08-17T02:22:18.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.938+0000 7f2087fff700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f208806e450 0x7f20880b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:18.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.938+0000 7f2087fff700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f208806e450 0x7f20880b10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45520/0 (socket says 172.21.15.104:45520) 2024-08-17T02:22:18.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.938+0000 7f2087fff700 1 -- 172.21.15.104:0/936465411 learned_addr learned my addr 172.21.15.104:0/936465411 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:18.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.938+0000 7f208cb82700 1 --2- 172.21.15.104:0/936465411 >> v2:172.21.15.117:3300/0 conn(0x7f20880b0d20 0x7f208806df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:18.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.938+0000 7f2087fff700 1 -- 172.21.15.104:0/936465411 >> v2:172.21.15.117:3300/0 conn(0x7f20880b0d20 msgr2=0x7f208806df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:18.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.938+0000 7f2087fff700 1 --2- 172.21.15.104:0/936465411 >> v2:172.21.15.117:3300/0 conn(0x7f20880b0d20 0x7f208806df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:18.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.938+0000 7f2087fff700 1 -- 172.21.15.104:0/936465411 >> v1:172.21.15.117:6789/0 conn(0x7f20880b1630 legacy=0x7f20881610f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:18.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.938+0000 7f2087fff700 1 -- 172.21.15.104:0/936465411 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2088140df0 con 0x7f208806e450 2024-08-17T02:22:18.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.938+0000 7f2087fff700 1 --2- 172.21.15.104:0/936465411 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f208806e450 0x7f20880b10f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f208806bd20 tx=0x7f2078009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c486bc7241642907 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:18.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.938+0000 7f20877fe700 1 -- 172.21.15.104:0/936465411 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207800e070 con 0x7f208806e450 2024-08-17T02:22:18.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.938+0000 7f20877fe700 1 -- 172.21.15.104:0/936465411 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f207800ba50 con 0x7f208806e450 2024-08-17T02:22:18.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.938+0000 7f20877fe700 1 -- 172.21.15.104:0/936465411 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20780092e0 con 0x7f208806e450 2024-08-17T02:22:18.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.938+0000 7f208db84700 1 -- 172.21.15.104:0/936465411 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f208806e450 msgr2=0x7f20880b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:18.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.938+0000 7f208db84700 1 --2- 172.21.15.104:0/936465411 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f208806e450 0x7f20880b10f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f208806bd20 tx=0x7f2078009840 comp rx=0 tx=0).stop 2024-08-17T02:22:18.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.938+0000 7f208db84700 1 -- 172.21.15.104:0/936465411 shutdown_connections 2024-08-17T02:22:18.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.938+0000 7f208db84700 1 --2- 172.21.15.104:0/936465411 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f208806e450 0x7f20880b10f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:18.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.938+0000 7f208db84700 1 --2- 172.21.15.104:0/936465411 >> v2:172.21.15.117:3300/0 conn(0x7f20880b0d20 0x7f208806df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:18.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.938+0000 7f208db84700 1 -- 172.21.15.104:0/936465411 >> 172.21.15.104:0/936465411 conn(0x7f20880678d0 msgr2=0x7f2088067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:18.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.938+0000 7f208db84700 1 -- 172.21.15.104:0/936465411 shutdown_connections 2024-08-17T02:22:18.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.938+0000 7f208db84700 1 -- 172.21.15.104:0/936465411 wait complete. 2024-08-17T02:22:18.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.942+0000 7f208db84700 1 Processor -- start 2024-08-17T02:22:18.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.942+0000 7f208db84700 1 -- start start 2024-08-17T02:22:18.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.942+0000 7f208db84700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f208806e450 0x7f20880a9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:18.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.942+0000 7f208db84700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20880b0d20 0x7f208816ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:18.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.942+0000 7f208db84700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f20880b1630 0x7f208816b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:18.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.942+0000 7f208db84700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20881702e0 con 0x7f20880b1630 2024-08-17T02:22:18.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.942+0000 7f208db84700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208816f470 con 0x7f20880b0d20 2024-08-17T02:22:18.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.942+0000 7f208db84700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f208816f660 con 0x7f208806e450 2024-08-17T02:22:18.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.942+0000 7f208d383700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f20880b1630 0x7f208816b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:18.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.942+0000 7f208d383700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f20880b1630 0x7f208816b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45522/0 (socket says 172.21.15.104:45522) 2024-08-17T02:22:18.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.942+0000 7f208d383700 1 -- 172.21.15.104:0/1820108132 learned_addr learned my addr 172.21.15.104:0/1820108132 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:18.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.942+0000 7f2087fff700 1 --2- 172.21.15.104:0/1820108132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20880b0d20 0x7f208816ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:18.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.942+0000 7f208cb82700 1 --2- 172.21.15.104:0/1820108132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f208806e450 0x7f20880a9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:18.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.942+0000 7f208d383700 1 -- 172.21.15.104:0/1820108132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f208806e450 msgr2=0x7f20880a9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:18.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.942+0000 7f208d383700 1 --2- 172.21.15.104:0/1820108132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f208806e450 0x7f20880a9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:18.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.942+0000 7f208d383700 1 -- 172.21.15.104:0/1820108132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20880b0d20 msgr2=0x7f208816ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:18.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.942+0000 7f208d383700 1 --2- 172.21.15.104:0/1820108132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20880b0d20 0x7f208816ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:18.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.942+0000 7f208d383700 1 -- 172.21.15.104:0/1820108132 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2078009ae0 con 0x7f20880b1630 2024-08-17T02:22:18.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.942+0000 7f208d383700 1 --2- 172.21.15.104:0/1820108132 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f20880b1630 0x7f208816b9a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f208000c4c0 tx=0x7f2080007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:18.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.942+0000 7f2084ff9700 1 -- 172.21.15.104:0/1820108132 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208000ce70 con 0x7f20880b1630 2024-08-17T02:22:18.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.942+0000 7f2084ff9700 1 -- 172.21.15.104:0/1820108132 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2080011590 con 0x7f20880b1630 2024-08-17T02:22:18.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.942+0000 7f208db84700 1 -- 172.21.15.104:0/1820108132 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f208816f940 con 0x7f20880b1630 2024-08-17T02:22:18.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.942+0000 7f2084ff9700 1 -- 172.21.15.104:0/1820108132 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2080011970 con 0x7f20880b1630 2024-08-17T02:22:18.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.942+0000 7f208db84700 1 -- 172.21.15.104:0/1820108132 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f208816ff00 con 0x7f20880b1630 2024-08-17T02:22:18.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.946+0000 7f208db84700 1 -- 172.21.15.104:0/1820108132 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2088140970 con 0x7f20880b1630 2024-08-17T02:22:18.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.946+0000 7f2084ff9700 1 -- 172.21.15.104:0/1820108132 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2080011ce0 con 0x7f20880b1630 2024-08-17T02:22:18.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.946+0000 7f2084ff9700 1 --2- 172.21.15.104:0/1820108132 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f2074060860 0x7f2074062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:18.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.946+0000 7f2084ff9700 1 -- 172.21.15.104:0/1820108132 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f208007bb90 con 0x7f20880b1630 2024-08-17T02:22:18.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.946+0000 7f208cb82700 1 --2- 172.21.15.104:0/1820108132 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f2074060860 0x7f2074062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:18.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.950+0000 7f208cb82700 1 --2- 172.21.15.104:0/1820108132 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f2074060860 0x7f2074062d10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f20880aa950 tx=0x7f207c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:18.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:18.954+0000 7f2084ff9700 1 -- 172.21.15.104:0/1820108132 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f2088140970 con 0x7f20880b1630 2024-08-17T02:22:19.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.118+0000 7f208db84700 1 -- 172.21.15.104:0/1820108132 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2088170420 con 0x7f20880b1630 2024-08-17T02:22:19.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.118+0000 7f2084ff9700 1 -- 172.21.15.104:0/1820108132 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12175 (secure 0 0 0) 0x7f2088170420 con 0x7f20880b1630 2024-08-17T02:22:19.126 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:22:19.126 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":19,"fsid":"fd5f7fb8-d34b-49bb-89a8-62b7dad1bc25","created":"2024-08-17T02:21:57.891389+0000","modified":"2024-08-17T02:22:12.954891+0000","last_up_change":"2024-08-17T02:22:08.924546+0000","last_in_change":"2024-08-17T02:21:59.938028+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:22:10.143970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"606b9088-590e-4709-aa3a-b0f6e22972ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":24257},{"type":"v1","addr":"172.21.15.104:6809","nonce":24257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":24257},{"type":"v1","addr":"172.21.15.104:6811","nonce":24257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":24257},{"type":"v1","addr":"172.21.15.104:6815","nonce":24257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":24257},{"type":"v1","addr":"172.21.15.104:6813","nonce":24257}]},"public_addr":"172.21.15.104:6809/24257","cluster_addr":"172.21.15.104:6811/24257","heartbeat_back_addr":"172.21.15.104:6815/24257","heartbeat_front_addr":"172.21.15.104:6813/24257","state":["exists","up"]},{"osd":1,"uuid":"9bc6a909-0c2f-4889-afe7-4a47f89b0f64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":24256},{"type":"v1","addr":"172.21.15.104:6825","nonce":24256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":24256},{"type":"v1","addr":"172.21.15.104:6827","nonce":24256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":24256},{"type":"v1","addr":"172.21.15.104:6831","nonce":24256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":24256},{"type":"v1","addr":"172.21.15.104:6829","nonce":24256}]},"public_addr":"172.21.15.104:6825/24256","cluster_addr":"172.21.15.104:6827/24256","heartbeat_back_addr":"172.21.15.104:6831/24256","heartbeat_front_addr":"172.21.15.104:6829/24256","state":["exists","up"]},{"osd":2,"uuid":"23da31d5-aefb-4edb-b79d-fa05e1becef7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":24255},{"type":"v1","addr":"172.21.15.104:6817","nonce":24255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":24255},{"type":"v1","addr":"172.21.15.104:6819","nonce":24255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":24255},{"type":"v1","addr":"172.21.15.104:6823","nonce":24255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":24255},{"type":"v1","addr":"172.21.15.104:6821","nonce":24255}]},"public_addr":"172.21.15.104:6817/24255","cluster_addr":"172.21.15.104:6819/24255","heartbeat_back_addr":"172.21.15.104:6823/24255","heartbeat_front_addr":"172.21.15.104:6821/24255","state":["exists","up"]},{"osd":3,"uuid":"6e4a5ec2-b415-45ef-8381-61a59eb65224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":24254},{"type":"v1","addr":"172.21.15.104:6801","nonce":24254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":24254},{"type":"v1","addr":"172.21.15.104:6803","nonce":24254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":24254},{"type":"v1","addr":"172.21.15.104:6807","nonce":24254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":24254},{"type":"v1","addr":"172.21.15.104:6805","nonce":24254}]},"public_addr":"172.21.15.104:6801/24254","cluster_addr":"172.21.15.104:6803/24254","heartbeat_back_addr":"172.21.15.104:6807/24254","heartbeat_front_addr":"172.21.15.104:6805/24254","state":["exists","up"]},{"osd":4,"uuid":"8d5bea2d-9039-4013-8c99-2c046c5b8a17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":24421},{"type":"v1","addr":"172.21.15.117:6804","nonce":24421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":24421},{"type":"v1","addr":"172.21.15.117:6809","nonce":24421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":24421},{"type":"v1","addr":"172.21.15.117:6815","nonce":24421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":24421},{"type":"v1","addr":"172.21.15.117:6813","nonce":24421}]},"public_addr":"172.21.15.117:6804/24421","cluster_addr":"172.21.15.117:6809/24421","heartbeat_back_addr":"172.21.15.117:6815/24421","heartbeat_front_addr":"172.21.15.117:6813/24421","state":["exists","up"]},{"osd":5,"uuid":"de8b36fc-121c-4f05-8f5b-28f513d9f21f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":24422},{"type":"v1","addr":"172.21.15.117:6817","nonce":24422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":24422},{"type":"v1","addr":"172.21.15.117:6819","nonce":24422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":24422},{"type":"v1","addr":"172.21.15.117:6823","nonce":24422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":24422},{"type":"v1","addr":"172.21.15.117:6821","nonce":24422}]},"public_addr":"172.21.15.117:6817/24422","cluster_addr":"172.21.15.117:6819/24422","heartbeat_back_addr":"172.21.15.117:6823/24422","heartbeat_front_addr":"172.21.15.117:6821/24422","state":["exists","up"]},{"osd":6,"uuid":"6a87f09f-7bf7-4f7a-be87-530ac1ff8ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":24420},{"type":"v1","addr":"172.21.15.117:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6803","nonce":24420},{"type":"v1","addr":"172.21.15.117:6805","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":24420},{"type":"v1","addr":"172.21.15.117:6811","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":24420},{"type":"v1","addr":"172.21.15.117:6808","nonce":24420}]},"public_addr":"172.21.15.117:6801/24420","cluster_addr":"172.21.15.117:6805/24420","heartbeat_back_addr":"172.21.15.117:6811/24420","heartbeat_front_addr":"172.21.15.117:6808/24420","state":["exists","up"]},{"osd":7,"uuid":"e31d8041-1aa1-4b5d-83b3-0a373426dd9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":24423},{"type":"v1","addr":"172.21.15.117:6825","nonce":24423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":24423},{"type":"v1","addr":"172.21.15.117:6827","nonce":24423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":24423},{"type":"v1","addr":"172.21.15.117:6831","nonce":24423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":24423},{"type":"v1","addr":"172.21.15.117:6829","nonce":24423}]},"public_addr":"172.21.15.117:6825/24423","cluster_addr":"172.21.15.117:6827/24423","heartbeat_back_addr":"172.21.15.117:6831/24423","heartbeat_front_addr":"172.21.15.117:6829/24423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.220874+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.210039+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.434762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.247206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.184316+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.306325+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.035719+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.400303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:22:19.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.122+0000 7f208db84700 1 -- 172.21.15.104:0/1820108132 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f2074060860 msgr2=0x7f2074062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:19.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.122+0000 7f208db84700 1 --2- 172.21.15.104:0/1820108132 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f2074060860 0x7f2074062d10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f20880aa950 tx=0x7f207c008040 comp rx=0 tx=0).stop 2024-08-17T02:22:19.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.122+0000 7f208db84700 1 -- 172.21.15.104:0/1820108132 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f20880b1630 msgr2=0x7f208816b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:19.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.122+0000 7f208db84700 1 --2- 172.21.15.104:0/1820108132 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f20880b1630 0x7f208816b9a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f208000c4c0 tx=0x7f2080007f50 comp rx=0 tx=0).stop 2024-08-17T02:22:19.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.122+0000 7f208db84700 1 -- 172.21.15.104:0/1820108132 shutdown_connections 2024-08-17T02:22:19.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.122+0000 7f208db84700 1 --2- 172.21.15.104:0/1820108132 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f2074060860 0x7f2074062d10 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:19.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.122+0000 7f208db84700 1 --2- 172.21.15.104:0/1820108132 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f20880b1630 0x7f208816b9a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:19.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.122+0000 7f208db84700 1 --2- 172.21.15.104:0/1820108132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20880b0d20 0x7f208816ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:19.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.122+0000 7f208db84700 1 --2- 172.21.15.104:0/1820108132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f208806e450 0x7f20880a9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:19.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.122+0000 7f208db84700 1 -- 172.21.15.104:0/1820108132 >> 172.21.15.104:0/1820108132 conn(0x7f20880678d0 msgr2=0x7f208815de60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:19.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.122+0000 7f208db84700 1 -- 172.21.15.104:0/1820108132 shutdown_connections 2024-08-17T02:22:19.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.122+0000 7f208db84700 1 -- 172.21.15.104:0/1820108132 wait complete. 2024-08-17T02:22:19.140 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:22:10.143970+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:22:19.141 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:22:19.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.250+0000 7f1827fff700 1 Processor -- start 2024-08-17T02:22:19.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.250+0000 7f1827fff700 1 -- start start 2024-08-17T02:22:19.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.250+0000 7f1827fff700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f18281501e0 0x7f18280ab7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:19.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.250+0000 7f1827fff700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1828157160 con 0x7f1828068db0 2024-08-17T02:22:19.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.250+0000 7f1827fff700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1828156550 con 0x7f18280abd30 2024-08-17T02:22:19.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.250+0000 7f1827fff700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1828156830 con 0x7f18281501e0 2024-08-17T02:22:19.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.250+0000 7f1826ffd700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f18281501e0 0x7f18280ab7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:19.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.250+0000 7f18277fe700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f1828068db0 0x7f18280af5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:41940/0 (socket says 172.21.15.104:41940) 2024-08-17T02:22:19.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.250+0000 7f1826ffd700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f18281501e0 0x7f18280ab7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45526/0 (socket says 172.21.15.104:45526) 2024-08-17T02:22:19.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.250+0000 7f1826ffd700 1 -- 172.21.15.104:0/2437632979 learned_addr learned my addr 172.21.15.104:0/2437632979 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:19.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.250+0000 7f1826ffd700 1 -- 172.21.15.104:0/2437632979 >> v1:172.21.15.117:6789/0 conn(0x7f18280abd30 legacy=0x7f18280686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:19.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.250+0000 7f1826ffd700 1 -- 172.21.15.104:0/2437632979 >> v1:172.21.15.104:6789/0 conn(0x7f1828068db0 legacy=0x7f18280af5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:19.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.250+0000 7f1826ffd700 1 -- 172.21.15.104:0/2437632979 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1828156b10 con 0x7f18281501e0 2024-08-17T02:22:19.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.250+0000 7f1826ffd700 1 --2- 172.21.15.104:0/2437632979 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18281501e0 0x7f18280ab7f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f18180099b0 tx=0x7f1818009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55a2eed32151ea6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:19.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.250+0000 7f1825ffb700 1 -- 172.21.15.104:0/2437632979 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181800b860 con 0x7f18281501e0 2024-08-17T02:22:19.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.250+0000 7f1825ffb700 1 -- 172.21.15.104:0/2437632979 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f181800b9c0 con 0x7f18281501e0 2024-08-17T02:22:19.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.250+0000 7f1825ffb700 1 -- 172.21.15.104:0/2437632979 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181800bd60 con 0x7f18281501e0 2024-08-17T02:22:19.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.250+0000 7f1827fff700 1 -- 172.21.15.104:0/2437632979 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18281501e0 msgr2=0x7f18280ab7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:19.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.250+0000 7f1827fff700 1 --2- 172.21.15.104:0/2437632979 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18281501e0 0x7f18280ab7f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f18180099b0 tx=0x7f1818009250 comp rx=0 tx=0).stop 2024-08-17T02:22:19.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.250+0000 7f1827fff700 1 -- 172.21.15.104:0/2437632979 shutdown_connections 2024-08-17T02:22:19.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.250+0000 7f1827fff700 1 --2- 172.21.15.104:0/2437632979 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18281501e0 0x7f18280ab7f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:19.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.250+0000 7f1827fff700 1 -- 172.21.15.104:0/2437632979 >> 172.21.15.104:0/2437632979 conn(0x7f182806e310 msgr2=0x7f182806b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:19.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.250+0000 7f1827fff700 1 -- 172.21.15.104:0/2437632979 shutdown_connections 2024-08-17T02:22:19.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.250+0000 7f1827fff700 1 -- 172.21.15.104:0/2437632979 wait complete. 2024-08-17T02:22:19.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.250+0000 7f1827fff700 1 Processor -- start 2024-08-17T02:22:19.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.250+0000 7f1827fff700 1 -- start start 2024-08-17T02:22:19.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.250+0000 7f1827fff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1828068db0 0x7f18281527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:19.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.250+0000 7f1827fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18280abd30 0x7f1828152d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:19.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.250+0000 7f1827fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18281501e0 0x7f1828146d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:19.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.250+0000 7f1827fff700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1828167360 con 0x7f1828068db0 2024-08-17T02:22:19.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.250+0000 7f1827fff700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1828147ac0 con 0x7f18280abd30 2024-08-17T02:22:19.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.250+0000 7f1827fff700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1828147da0 con 0x7f18281501e0 2024-08-17T02:22:19.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.254+0000 7f1826ffd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1828068db0 0x7f18281527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:19.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.254+0000 7f1826ffd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1828068db0 0x7f18281527c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45542/0 (socket says 172.21.15.104:45542) 2024-08-17T02:22:19.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.254+0000 7f1826ffd700 1 -- 172.21.15.104:0/4250563834 learned_addr learned my addr 172.21.15.104:0/4250563834 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:19.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.254+0000 7f18267fc700 1 --2- 172.21.15.104:0/4250563834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18280abd30 0x7f1828152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:19.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.254+0000 7f18277fe700 1 --2- 172.21.15.104:0/4250563834 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18281501e0 0x7f1828146d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:19.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.254+0000 7f1826ffd700 1 -- 172.21.15.104:0/4250563834 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18281501e0 msgr2=0x7f1828146d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:19.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.254+0000 7f1826ffd700 1 --2- 172.21.15.104:0/4250563834 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18281501e0 0x7f1828146d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:19.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.254+0000 7f1826ffd700 1 -- 172.21.15.104:0/4250563834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18280abd30 msgr2=0x7f1828152d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:19.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.254+0000 7f1826ffd700 1 --2- 172.21.15.104:0/4250563834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18280abd30 0x7f1828152d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:19.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.254+0000 7f1826ffd700 1 -- 172.21.15.104:0/4250563834 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18180094f0 con 0x7f1828068db0 2024-08-17T02:22:19.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.254+0000 7f1826ffd700 1 --2- 172.21.15.104:0/4250563834 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1828068db0 0x7f18281527c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1828064ce0 tx=0x7f1818017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:19.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.254+0000 7f180effd700 1 -- 172.21.15.104:0/4250563834 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1818024440 con 0x7f1828068db0 2024-08-17T02:22:19.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.254+0000 7f180effd700 1 -- 172.21.15.104:0/4250563834 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18180245a0 con 0x7f1828068db0 2024-08-17T02:22:19.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.254+0000 7f1827fff700 1 -- 172.21.15.104:0/4250563834 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1828148080 con 0x7f1828068db0 2024-08-17T02:22:19.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.254+0000 7f180effd700 1 -- 172.21.15.104:0/4250563834 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1818024920 con 0x7f1828068db0 2024-08-17T02:22:19.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.254+0000 7f1827fff700 1 -- 172.21.15.104:0/4250563834 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1828146500 con 0x7f1828068db0 2024-08-17T02:22:19.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.254+0000 7f1827fff700 1 -- 172.21.15.104:0/4250563834 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18280638f0 con 0x7f1828068db0 2024-08-17T02:22:19.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.254+0000 7f180effd700 1 -- 172.21.15.104:0/4250563834 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f181801a420 con 0x7f1828068db0 2024-08-17T02:22:19.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.258+0000 7f180effd700 1 --2- 172.21.15.104:0/4250563834 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f1814060860 0x7f1814062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:19.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.258+0000 7f180effd700 1 -- 172.21.15.104:0/4250563834 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f181807e800 con 0x7f1828068db0 2024-08-17T02:22:19.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.258+0000 7f18267fc700 1 --2- 172.21.15.104:0/4250563834 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f1814060860 0x7f1814062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:19.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.258+0000 7f18267fc700 1 --2- 172.21.15.104:0/4250563834 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f1814060860 0x7f1814062d10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f182814c590 tx=0x7f181c007ec0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:19.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.270+0000 7f180effd700 1 -- 172.21.15.104:0/4250563834 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f181804efa0 con 0x7f1828068db0 2024-08-17T02:22:19.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.430+0000 7f1827fff700 1 -- 172.21.15.104:0/4250563834 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f18280abaf0 con 0x7f1828068db0 2024-08-17T02:22:19.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.430+0000 7f180effd700 1 -- 172.21.15.104:0/4250563834 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f18180150a0 con 0x7f1828068db0 2024-08-17T02:22:19.438 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-08-17T02:22:19.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.434+0000 7f1827fff700 1 -- 172.21.15.104:0/4250563834 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f1814060860 msgr2=0x7f1814062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:19.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.434+0000 7f1827fff700 1 --2- 172.21.15.104:0/4250563834 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f1814060860 0x7f1814062d10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f182814c590 tx=0x7f181c007ec0 comp rx=0 tx=0).stop 2024-08-17T02:22:19.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.434+0000 7f1827fff700 1 -- 172.21.15.104:0/4250563834 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1828068db0 msgr2=0x7f18281527c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:19.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.434+0000 7f1827fff700 1 --2- 172.21.15.104:0/4250563834 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1828068db0 0x7f18281527c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1828064ce0 tx=0x7f1818017000 comp rx=0 tx=0).stop 2024-08-17T02:22:19.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.434+0000 7f1827fff700 1 -- 172.21.15.104:0/4250563834 shutdown_connections 2024-08-17T02:22:19.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.434+0000 7f1827fff700 1 --2- 172.21.15.104:0/4250563834 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f1814060860 0x7f1814062d10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:19.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.434+0000 7f1827fff700 1 --2- 172.21.15.104:0/4250563834 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18281501e0 0x7f1828146d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:19.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.434+0000 7f1827fff700 1 --2- 172.21.15.104:0/4250563834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18280abd30 0x7f1828152d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:19.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.434+0000 7f1827fff700 1 --2- 172.21.15.104:0/4250563834 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1828068db0 0x7f18281527c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:19.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.434+0000 7f1827fff700 1 -- 172.21.15.104:0/4250563834 >> 172.21.15.104:0/4250563834 conn(0x7f182806e310 msgr2=0x7f1828154e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:19.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.434+0000 7f1827fff700 1 -- 172.21.15.104:0/4250563834 shutdown_connections 2024-08-17T02:22:19.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.434+0000 7f1827fff700 1 -- 172.21.15.104:0/4250563834 wait complete. 2024-08-17T02:22:19.451 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-17T02:22:19.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.550+0000 7f1dc56fc700 1 Processor -- start 2024-08-17T02:22:19.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.550+0000 7f1dc56fc700 1 -- start start 2024-08-17T02:22:19.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.550+0000 7f1dc56fc700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dc015d540 0x7f1dc00af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:19.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.550+0000 7f1dc56fc700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f1dc006e830 0x7f1dc00a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:19.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.550+0000 7f1dc56fc700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dc00b0270 con 0x7f1dc00a9260 2024-08-17T02:22:19.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.550+0000 7f1dc56fc700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dc00af660 con 0x7f1dc006e830 2024-08-17T02:22:19.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.550+0000 7f1dc56fc700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc00af940 con 0x7f1dc015d540 2024-08-17T02:22:19.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.550+0000 7f1dbe7fc700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f1dc006e830 0x7f1dc00a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:19.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.550+0000 7f1dbe7fc700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f1dc006e830 0x7f1dc00a8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45548/0 (socket says 172.21.15.104:45548) 2024-08-17T02:22:19.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.550+0000 7f1dbe7fc700 1 -- 172.21.15.104:0/1185151156 learned_addr learned my addr 172.21.15.104:0/1185151156 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:19.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.550+0000 7f1dbeffd700 1 --2- 172.21.15.104:0/1185151156 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dc015d540 0x7f1dc00af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:19.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.550+0000 7f1dbe7fc700 1 -- 172.21.15.104:0/1185151156 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dc015d540 msgr2=0x7f1dc00af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:19.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.550+0000 7f1dbe7fc700 1 --2- 172.21.15.104:0/1185151156 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dc015d540 0x7f1dc00af030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:19.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.550+0000 7f1dbe7fc700 1 -- 172.21.15.104:0/1185151156 >> v1:172.21.15.104:6789/0 conn(0x7f1dc00a9260 legacy=0x7f1dc00b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:19.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.550+0000 7f1dbe7fc700 1 -- 172.21.15.104:0/1185151156 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc00afc20 con 0x7f1dc006e830 2024-08-17T02:22:19.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.550+0000 7f1dbeffd700 1 --2- 172.21.15.104:0/1185151156 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dc015d540 0x7f1dc00af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:22:19.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.550+0000 7f1dbe7fc700 1 --2- 172.21.15.104:0/1185151156 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dc006e830 0x7f1dc00a8d20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1db8009f20 tx=0x7f1db8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b74a96d6a6c2685a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:19.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.550+0000 7f1dbdffb700 1 -- 172.21.15.104:0/1185151156 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db800e070 con 0x7f1dc006e830 2024-08-17T02:22:19.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.550+0000 7f1dbdffb700 1 -- 172.21.15.104:0/1185151156 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db800ba80 con 0x7f1dc006e830 2024-08-17T02:22:19.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.550+0000 7f1dbdffb700 1 -- 172.21.15.104:0/1185151156 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db80092e0 con 0x7f1dc006e830 2024-08-17T02:22:19.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.550+0000 7f1dc56fc700 1 -- 172.21.15.104:0/1185151156 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dc006e830 msgr2=0x7f1dc00a8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:19.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.550+0000 7f1dc56fc700 1 --2- 172.21.15.104:0/1185151156 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dc006e830 0x7f1dc00a8d20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1db8009f20 tx=0x7f1db8009840 comp rx=0 tx=0).stop 2024-08-17T02:22:19.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.550+0000 7f1dc56fc700 1 -- 172.21.15.104:0/1185151156 shutdown_connections 2024-08-17T02:22:19.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.550+0000 7f1dc56fc700 1 --2- 172.21.15.104:0/1185151156 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dc006e830 0x7f1dc00a8d20 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:19.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.550+0000 7f1dc56fc700 1 --2- 172.21.15.104:0/1185151156 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dc015d540 0x7f1dc00af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:19.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.550+0000 7f1dc56fc700 1 -- 172.21.15.104:0/1185151156 >> 172.21.15.104:0/1185151156 conn(0x7f1dc0066e00 msgr2=0x7f1dc0067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:19.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.550+0000 7f1dc56fc700 1 -- 172.21.15.104:0/1185151156 shutdown_connections 2024-08-17T02:22:19.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.550+0000 7f1dc56fc700 1 -- 172.21.15.104:0/1185151156 wait complete. 2024-08-17T02:22:19.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.550+0000 7f1dc56fc700 1 Processor -- start 2024-08-17T02:22:19.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.550+0000 7f1dc56fc700 1 -- start start 2024-08-17T02:22:19.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.554+0000 7f1dc56fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1dc006e830 0x7f1dc00cb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:19.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.554+0000 7f1dc56fc700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dc00a9260 0x7f1dc0099000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:19.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.554+0000 7f1dc56fc700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dc015d540 0x7f1dc015b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:19.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.554+0000 7f1dc56fc700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc00c89e0 con 0x7f1dc00a9260 2024-08-17T02:22:19.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.554+0000 7f1dc56fc700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc0099540 con 0x7f1dc006e830 2024-08-17T02:22:19.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.554+0000 7f1dc56fc700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc00997e0 con 0x7f1dc015d540 2024-08-17T02:22:19.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.554+0000 7f1dbe7fc700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dc00a9260 0x7f1dc0099000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:19.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.554+0000 7f1dbe7fc700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dc00a9260 0x7f1dc0099000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45554/0 (socket says 172.21.15.104:45554) 2024-08-17T02:22:19.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.554+0000 7f1dbe7fc700 1 -- 172.21.15.104:0/3367223112 learned_addr learned my addr 172.21.15.104:0/3367223112 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:19.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.554+0000 7f1dbeffd700 1 --2- 172.21.15.104:0/3367223112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1dc006e830 0x7f1dc00cb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:19.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.554+0000 7f1dbf7fe700 1 --2- 172.21.15.104:0/3367223112 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dc015d540 0x7f1dc015b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:19.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.554+0000 7f1dbe7fc700 1 -- 172.21.15.104:0/3367223112 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dc015d540 msgr2=0x7f1dc015b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:19.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.554+0000 7f1dbe7fc700 1 --2- 172.21.15.104:0/3367223112 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dc015d540 0x7f1dc015b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:19.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.554+0000 7f1dbe7fc700 1 -- 172.21.15.104:0/3367223112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1dc006e830 msgr2=0x7f1dc00cb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:19.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.554+0000 7f1dbe7fc700 1 --2- 172.21.15.104:0/3367223112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1dc006e830 0x7f1dc00cb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:19.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.554+0000 7f1dbe7fc700 1 -- 172.21.15.104:0/3367223112 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db8009ae0 con 0x7f1dc00a9260 2024-08-17T02:22:19.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.554+0000 7f1dbe7fc700 1 --2- 172.21.15.104:0/3367223112 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dc00a9260 0x7f1dc0099000 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1db800b6c0 tx=0x7f1db8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:19.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.554+0000 7f1da6ffd700 1 -- 172.21.15.104:0/3367223112 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db8008a80 con 0x7f1dc00a9260 2024-08-17T02:22:19.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.554+0000 7f1dc56fc700 1 -- 172.21.15.104:0/3367223112 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dc0097440 con 0x7f1dc00a9260 2024-08-17T02:22:19.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.554+0000 7f1da6ffd700 1 -- 172.21.15.104:0/3367223112 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db8008be0 con 0x7f1dc00a9260 2024-08-17T02:22:19.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.554+0000 7f1da6ffd700 1 -- 172.21.15.104:0/3367223112 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db8026460 con 0x7f1dc00a9260 2024-08-17T02:22:19.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.554+0000 7f1dc56fc700 1 -- 172.21.15.104:0/3367223112 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dc0097a00 con 0x7f1dc00a9260 2024-08-17T02:22:19.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.558+0000 7f1dc56fc700 1 -- 172.21.15.104:0/3367223112 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dc00c8b90 con 0x7f1dc00a9260 2024-08-17T02:22:19.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.558+0000 7f1da6ffd700 1 -- 172.21.15.104:0/3367223112 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1db8003040 con 0x7f1dc00a9260 2024-08-17T02:22:19.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.558+0000 7f1da6ffd700 1 --2- 172.21.15.104:0/3367223112 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f1dac060860 0x7f1dac062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:19.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.558+0000 7f1da6ffd700 1 -- 172.21.15.104:0/3367223112 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1db807e4b0 con 0x7f1dc00a9260 2024-08-17T02:22:19.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.558+0000 7f1dbeffd700 1 --2- 172.21.15.104:0/3367223112 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f1dac060860 0x7f1dac062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:19.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.558+0000 7f1dbeffd700 1 --2- 172.21.15.104:0/3367223112 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f1dac060860 0x7f1dac062d10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1db4006fd0 tx=0x7f1db4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:19.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.570+0000 7f1da6ffd700 1 -- 172.21.15.104:0/3367223112 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f1dc00c8b90 con 0x7f1dc00a9260 2024-08-17T02:22:19.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.730+0000 7f1dc56fc700 1 -- 172.21.15.104:0/3367223112 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1dc00645c0 con 0x7f1dc00a9260 2024-08-17T02:22:19.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.730+0000 7f1da6ffd700 1 -- 172.21.15.104:0/3367223112 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+65 (secure 0 0 0) 0x7f1db8021090 con 0x7f1dc00a9260 2024-08-17T02:22:19.736 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:22:19.736 INFO:teuthology.orchestra.run.smithi104.stdout:[ 2024-08-17T02:22:19.736 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-08-17T02:22:19.736 INFO:teuthology.orchestra.run.smithi104.stdout: "poolnum": 1, 2024-08-17T02:22:19.737 INFO:teuthology.orchestra.run.smithi104.stdout: "poolname": ".mgr" 2024-08-17T02:22:19.737 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-08-17T02:22:19.737 INFO:teuthology.orchestra.run.smithi104.stdout:] 2024-08-17T02:22:19.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.730+0000 7f1dc56fc700 1 -- 172.21.15.104:0/3367223112 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f1dac060860 msgr2=0x7f1dac062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:19.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.730+0000 7f1dc56fc700 1 --2- 172.21.15.104:0/3367223112 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f1dac060860 0x7f1dac062d10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1db4006fd0 tx=0x7f1db4008040 comp rx=0 tx=0).stop 2024-08-17T02:22:19.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.730+0000 7f1dc56fc700 1 -- 172.21.15.104:0/3367223112 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dc00a9260 msgr2=0x7f1dc0099000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:19.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.730+0000 7f1dc56fc700 1 --2- 172.21.15.104:0/3367223112 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dc00a9260 0x7f1dc0099000 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1db800b6c0 tx=0x7f1db8018000 comp rx=0 tx=0).stop 2024-08-17T02:22:19.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.730+0000 7f1dc56fc700 1 -- 172.21.15.104:0/3367223112 shutdown_connections 2024-08-17T02:22:19.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.730+0000 7f1dc56fc700 1 --2- 172.21.15.104:0/3367223112 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f1dac060860 0x7f1dac062d10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:19.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.730+0000 7f1dc56fc700 1 --2- 172.21.15.104:0/3367223112 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dc015d540 0x7f1dc015b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:19.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.730+0000 7f1dc56fc700 1 --2- 172.21.15.104:0/3367223112 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dc00a9260 0x7f1dc0099000 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:19.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.730+0000 7f1dc56fc700 1 --2- 172.21.15.104:0/3367223112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1dc006e830 0x7f1dc00cb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:19.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.730+0000 7f1dc56fc700 1 -- 172.21.15.104:0/3367223112 >> 172.21.15.104:0/3367223112 conn(0x7f1dc0066e00 msgr2=0x7f1dc01598d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:19.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.730+0000 7f1dc56fc700 1 -- 172.21.15.104:0/3367223112 shutdown_connections 2024-08-17T02:22:19.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.730+0000 7f1dc56fc700 1 -- 172.21.15.104:0/3367223112 wait complete. 2024-08-17T02:22:19.750 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-17T02:22:19.751 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-17T02:22:19.843 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:22:19.846 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:22:19.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.858+0000 7f0b869b5700 1 Processor -- start 2024-08-17T02:22:19.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.858+0000 7f0b869b5700 1 -- start start 2024-08-17T02:22:19.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.858+0000 7f0b869b5700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0b80157740 0x7f0b800c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:19.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.858+0000 7f0b869b5700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f0b80158220 0x7f0b80160d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:19.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.858+0000 7f0b869b5700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b800c4510 con 0x7f0b800c8c10 2024-08-17T02:22:19.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.858+0000 7f0b869b5700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b800c49a0 con 0x7f0b80158220 2024-08-17T02:22:19.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.858+0000 7f0b869b5700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b800c3900 con 0x7f0b80157740 2024-08-17T02:22:19.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.858+0000 7f0b7f7fe700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f0b800c8c10 0x7f0b80157b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:41964/0 (socket says 172.21.15.104:41964) 2024-08-17T02:22:19.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.858+0000 7f0b7f7fe700 1 -- 172.21.15.104:0/2804723656 learned_addr learned my addr 172.21.15.104:0/2804723656 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:19.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.858+0000 7f0b84f52700 1 --2- 172.21.15.104:0/2804723656 >> v2:172.21.15.104:3300/0 conn(0x7f0b80158220 0x7f0b80160d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:19.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.858+0000 7f0b7ffff700 1 --2- 172.21.15.104:0/2804723656 >> v2:172.21.15.117:3300/0 conn(0x7f0b80157740 0x7f0b800c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:19.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.858+0000 7f0b7effd700 1 -- 172.21.15.104:0/2804723656 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1981654519 0 0) 0x7f0b800c4510 con 0x7f0b800c8c10 2024-08-17T02:22:19.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.858+0000 7f0b7effd700 1 -- 172.21.15.104:0/2804723656 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b6c003570 con 0x7f0b800c8c10 2024-08-17T02:22:19.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.858+0000 7f0b84f52700 1 -- 172.21.15.104:0/2804723656 >> v2:172.21.15.117:3300/0 conn(0x7f0b80157740 msgr2=0x7f0b800c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:19.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.858+0000 7f0b84f52700 1 --2- 172.21.15.104:0/2804723656 >> v2:172.21.15.117:3300/0 conn(0x7f0b80157740 0x7f0b800c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:19.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.858+0000 7f0b84f52700 1 -- 172.21.15.104:0/2804723656 >> v1:172.21.15.104:6789/0 conn(0x7f0b800c8c10 legacy=0x7f0b80157b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:19.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.858+0000 7f0b84f52700 1 -- 172.21.15.104:0/2804723656 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b800c3be0 con 0x7f0b80158220 2024-08-17T02:22:19.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.858+0000 7f0b84f52700 1 --2- 172.21.15.104:0/2804723656 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b80158220 0x7f0b80160d00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0b800c50f0 tx=0x7f0b780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=199737f44758a614 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:19.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.858+0000 7f0b7effd700 1 -- 172.21.15.104:0/2804723656 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b78011630 con 0x7f0b80158220 2024-08-17T02:22:19.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.858+0000 7f0b7effd700 1 -- 172.21.15.104:0/2804723656 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b780117b0 con 0x7f0b80158220 2024-08-17T02:22:19.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.858+0000 7f0b7effd700 1 -- 172.21.15.104:0/2804723656 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b78011b70 con 0x7f0b80158220 2024-08-17T02:22:19.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.862+0000 7f0b869b5700 1 -- 172.21.15.104:0/2804723656 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b80158220 msgr2=0x7f0b80160d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:19.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.862+0000 7f0b869b5700 1 --2- 172.21.15.104:0/2804723656 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b80158220 0x7f0b80160d00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0b800c50f0 tx=0x7f0b780091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:19.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.862+0000 7f0b869b5700 1 -- 172.21.15.104:0/2804723656 shutdown_connections 2024-08-17T02:22:19.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.862+0000 7f0b869b5700 1 --2- 172.21.15.104:0/2804723656 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b80158220 0x7f0b80160d00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:19.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.862+0000 7f0b869b5700 1 --2- 172.21.15.104:0/2804723656 >> v2:172.21.15.117:3300/0 conn(0x7f0b80157740 0x7f0b800c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:19.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.862+0000 7f0b869b5700 1 -- 172.21.15.104:0/2804723656 >> 172.21.15.104:0/2804723656 conn(0x7f0b800cab00 msgr2=0x7f0b800caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:19.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.862+0000 7f0b869b5700 1 -- 172.21.15.104:0/2804723656 shutdown_connections 2024-08-17T02:22:19.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.862+0000 7f0b869b5700 1 -- 172.21.15.104:0/2804723656 wait complete. 2024-08-17T02:22:19.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.862+0000 7f0b869b5700 1 Processor -- start 2024-08-17T02:22:19.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.862+0000 7f0b869b5700 1 -- start start 2024-08-17T02:22:19.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.866+0000 7f0b869b5700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b800c8c10 0x7f0b800a5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:19.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.866+0000 7f0b869b5700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b80157740 0x7f0b80155350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:19.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.866+0000 7f0b869b5700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b80158220 0x7f0b80167300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:19.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.866+0000 7f0b869b5700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b800a5450 con 0x7f0b800c8c10 2024-08-17T02:22:19.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.866+0000 7f0b869b5700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b800a6d80 con 0x7f0b80158220 2024-08-17T02:22:19.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.866+0000 7f0b869b5700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b80167dc0 con 0x7f0b80157740 2024-08-17T02:22:19.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.866+0000 7f0b7ffff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b800c8c10 0x7f0b800a5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:19.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.866+0000 7f0b7ffff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b800c8c10 0x7f0b800a5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45570/0 (socket says 172.21.15.104:45570) 2024-08-17T02:22:19.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.866+0000 7f0b7ffff700 1 -- 172.21.15.104:0/2633415408 learned_addr learned my addr 172.21.15.104:0/2633415408 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:19.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.866+0000 7f0b84f52700 1 --2- 172.21.15.104:0/2633415408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b80158220 0x7f0b80167300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:19.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.866+0000 7f0b7f7fe700 1 --2- 172.21.15.104:0/2633415408 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b80157740 0x7f0b80155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:19.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.866+0000 7f0b7ffff700 1 -- 172.21.15.104:0/2633415408 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b80157740 msgr2=0x7f0b80155350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:19.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.866+0000 7f0b7ffff700 1 --2- 172.21.15.104:0/2633415408 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b80157740 0x7f0b80155350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:19.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.866+0000 7f0b7ffff700 1 -- 172.21.15.104:0/2633415408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b80158220 msgr2=0x7f0b80167300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:19.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.866+0000 7f0b7ffff700 1 --2- 172.21.15.104:0/2633415408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b80158220 0x7f0b80167300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:19.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.866+0000 7f0b7ffff700 1 -- 172.21.15.104:0/2633415408 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b78009420 con 0x7f0b800c8c10 2024-08-17T02:22:19.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.866+0000 7f0b7f7fe700 1 --2- 172.21.15.104:0/2633415408 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b80157740 0x7f0b80155350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:22:19.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.866+0000 7f0b7ffff700 1 --2- 172.21.15.104:0/2633415408 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b800c8c10 0x7f0b800a5ea0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0b70009ef0 tx=0x7f0b7000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:19.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.866+0000 7f0b77fff700 1 -- 172.21.15.104:0/2633415408 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7000cc20 con 0x7f0b800c8c10 2024-08-17T02:22:19.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.866+0000 7f0b77fff700 1 -- 172.21.15.104:0/2633415408 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b7000f040 con 0x7f0b800c8c10 2024-08-17T02:22:19.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.866+0000 7f0b77fff700 1 -- 172.21.15.104:0/2633415408 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b70014480 con 0x7f0b800c8c10 2024-08-17T02:22:19.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.866+0000 7f0b869b5700 1 -- 172.21.15.104:0/2633415408 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b801680a0 con 0x7f0b800c8c10 2024-08-17T02:22:19.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.866+0000 7f0b869b5700 1 -- 172.21.15.104:0/2633415408 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b800a5980 con 0x7f0b800c8c10 2024-08-17T02:22:19.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.866+0000 7f0b77fff700 1 -- 172.21.15.104:0/2633415408 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f0b700147f0 con 0x7f0b800c8c10 2024-08-17T02:22:19.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.866+0000 7f0b869b5700 1 -- 172.21.15.104:0/2633415408 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b800638f0 con 0x7f0b800c8c10 2024-08-17T02:22:19.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.870+0000 7f0b77fff700 1 --2- 172.21.15.104:0/2633415408 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f0b60060860 0x7f0b60062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:19.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.870+0000 7f0b77fff700 1 -- 172.21.15.104:0/2633415408 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0b7007d4e0 con 0x7f0b800c8c10 2024-08-17T02:22:19.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.870+0000 7f0b7f7fe700 1 --2- 172.21.15.104:0/2633415408 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f0b60060860 0x7f0b60062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:19.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.870+0000 7f0b7f7fe700 1 --2- 172.21.15.104:0/2633415408 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f0b60060860 0x7f0b60062d10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0b8006f7f0 tx=0x7f0b68009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:19.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:19.874+0000 7f0b77fff700 1 -- 172.21.15.104:0/2633415408 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f0b7004dc80 con 0x7f0b800c8c10 2024-08-17T02:22:20.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.034+0000 7f0b869b5700 1 -- 172.21.15.104:0/2633415408 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f0b80067ed0 con 0x7f0b800c8c10 2024-08-17T02:22:20.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.146+0000 7f0b77fff700 1 -- 172.21.15.104:0/2633415408 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0b7007d020 con 0x7f0b800c8c10 2024-08-17T02:22:20.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.154+0000 7f0b869b5700 1 -- 172.21.15.104:0/2633415408 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f0b60060860 msgr2=0x7f0b60062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:20.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.154+0000 7f0b869b5700 1 --2- 172.21.15.104:0/2633415408 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f0b60060860 0x7f0b60062d10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0b8006f7f0 tx=0x7f0b68009040 comp rx=0 tx=0).stop 2024-08-17T02:22:20.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.154+0000 7f0b869b5700 1 -- 172.21.15.104:0/2633415408 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b800c8c10 msgr2=0x7f0b800a5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:20.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.154+0000 7f0b869b5700 1 --2- 172.21.15.104:0/2633415408 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b800c8c10 0x7f0b800a5ea0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0b70009ef0 tx=0x7f0b7000b040 comp rx=0 tx=0).stop 2024-08-17T02:22:20.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.154+0000 7f0b869b5700 1 -- 172.21.15.104:0/2633415408 shutdown_connections 2024-08-17T02:22:20.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.154+0000 7f0b869b5700 1 --2- 172.21.15.104:0/2633415408 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f0b60060860 0x7f0b60062d10 secure :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0b8006f7f0 tx=0x7f0b68009040 comp rx=0 tx=0).stop 2024-08-17T02:22:20.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.154+0000 7f0b869b5700 1 --2- 172.21.15.104:0/2633415408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b80158220 0x7f0b80167300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:20.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.154+0000 7f0b869b5700 1 --2- 172.21.15.104:0/2633415408 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b80157740 0x7f0b80155350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:20.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.154+0000 7f0b869b5700 1 --2- 172.21.15.104:0/2633415408 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b800c8c10 0x7f0b800a5ea0 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0b70009ef0 tx=0x7f0b7000b040 comp rx=0 tx=0).stop 2024-08-17T02:22:20.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.154+0000 7f0b869b5700 1 -- 172.21.15.104:0/2633415408 >> 172.21.15.104:0/2633415408 conn(0x7f0b800cab00 msgr2=0x7f0b800cbc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:20.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.158+0000 7f0b869b5700 1 -- 172.21.15.104:0/2633415408 shutdown_connections 2024-08-17T02:22:20.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.158+0000 7f0b869b5700 1 -- 172.21.15.104:0/2633415408 wait complete. 2024-08-17T02:22:20.165 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_metadata' created 2024-08-17T02:22:20.175 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-17T02:22:20.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.286+0000 7ff29e52d700 1 Processor -- start 2024-08-17T02:22:20.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.286+0000 7ff29e52d700 1 -- start start 2024-08-17T02:22:20.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.286+0000 7ff29e52d700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff2980b3b30 0x7ff2980cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:20.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.286+0000 7ff29e52d700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2980af580 con 0x7ff2980cced0 2024-08-17T02:22:20.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.286+0000 7ff29e52d700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2980cd4b0 con 0x7ff298140bc0 2024-08-17T02:22:20.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.286+0000 7ff29e52d700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2980aec50 con 0x7ff2980b3b30 2024-08-17T02:22:20.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.286+0000 7ff29dd2c700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff2980b3b30 0x7ff2980cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:20.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.286+0000 7ff29cd2a700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7ff2980cced0 0x7ff2980b3420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:41970/0 (socket says 172.21.15.104:41970) 2024-08-17T02:22:20.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.286+0000 7ff29cd2a700 1 -- 172.21.15.104:0/2252293179 learned_addr learned my addr 172.21.15.104:0/2252293179 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:20.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.286+0000 7ff29dd2c700 1 -- 172.21.15.104:0/2252293179 >> v1:172.21.15.117:6789/0 conn(0x7ff298140bc0 legacy=0x7ff2980b0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:20.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.286+0000 7ff29dd2c700 1 -- 172.21.15.104:0/2252293179 >> v1:172.21.15.104:6789/0 conn(0x7ff2980cced0 legacy=0x7ff2980b3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:20.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.286+0000 7ff29dd2c700 1 -- 172.21.15.104:0/2252293179 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2980aef30 con 0x7ff2980b3b30 2024-08-17T02:22:20.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.286+0000 7ff29dd2c700 1 --2- 172.21.15.104:0/2252293179 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2980b3b30 0x7ff2980cbeb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff290009e90 tx=0x7ff290009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4753da1386d653e6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:20.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.286+0000 7ff28ffff700 1 -- 172.21.15.104:0/2252293179 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29000e070 con 0x7ff2980b3b30 2024-08-17T02:22:20.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.286+0000 7ff28ffff700 1 -- 172.21.15.104:0/2252293179 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29000bbf0 con 0x7ff2980b3b30 2024-08-17T02:22:20.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.286+0000 7ff28ffff700 1 -- 172.21.15.104:0/2252293179 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff290012430 con 0x7ff2980b3b30 2024-08-17T02:22:20.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.286+0000 7ff29e52d700 1 -- 172.21.15.104:0/2252293179 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2980b3b30 msgr2=0x7ff2980cbeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:20.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.286+0000 7ff29e52d700 1 --2- 172.21.15.104:0/2252293179 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2980b3b30 0x7ff2980cbeb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff290009e90 tx=0x7ff290009780 comp rx=0 tx=0).stop 2024-08-17T02:22:20.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.286+0000 7ff29e52d700 1 -- 172.21.15.104:0/2252293179 shutdown_connections 2024-08-17T02:22:20.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.286+0000 7ff29e52d700 1 --2- 172.21.15.104:0/2252293179 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2980b3b30 0x7ff2980cbeb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:20.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.286+0000 7ff29e52d700 1 -- 172.21.15.104:0/2252293179 >> 172.21.15.104:0/2252293179 conn(0x7ff2980ce120 msgr2=0x7ff2980ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:20.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.286+0000 7ff29e52d700 1 -- 172.21.15.104:0/2252293179 shutdown_connections 2024-08-17T02:22:20.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.286+0000 7ff29e52d700 1 -- 172.21.15.104:0/2252293179 wait complete. 2024-08-17T02:22:20.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.290+0000 7ff29e52d700 1 Processor -- start 2024-08-17T02:22:20.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.290+0000 7ff29e52d700 1 -- start start 2024-08-17T02:22:20.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.290+0000 7ff29e52d700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2980b3b30 0x7ff2980c40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:20.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.290+0000 7ff29e52d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2980cced0 0x7ff29815c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:20.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.290+0000 7ff29e52d700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff298140bc0 0x7ff298156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:20.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.290+0000 7ff29e52d700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff298167440 con 0x7ff298140bc0 2024-08-17T02:22:20.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.290+0000 7ff29e52d700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29815cdb0 con 0x7ff2980cced0 2024-08-17T02:22:20.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.290+0000 7ff29e52d700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff29815d050 con 0x7ff2980b3b30 2024-08-17T02:22:20.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.290+0000 7ff29dd2c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff298140bc0 0x7ff298156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:20.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.290+0000 7ff29dd2c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff298140bc0 0x7ff298156810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45578/0 (socket says 172.21.15.104:45578) 2024-08-17T02:22:20.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.290+0000 7ff29dd2c700 1 -- 172.21.15.104:0/3473546513 learned_addr learned my addr 172.21.15.104:0/3473546513 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:20.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.290+0000 7ff29cd2a700 1 --2- 172.21.15.104:0/3473546513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2980cced0 0x7ff29815c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:20.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.290+0000 7ff29d52b700 1 --2- 172.21.15.104:0/3473546513 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2980b3b30 0x7ff2980c40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:20.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.290+0000 7ff29dd2c700 1 -- 172.21.15.104:0/3473546513 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2980b3b30 msgr2=0x7ff2980c40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:20.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.290+0000 7ff29dd2c700 1 --2- 172.21.15.104:0/3473546513 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2980b3b30 0x7ff2980c40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:20.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.290+0000 7ff29dd2c700 1 -- 172.21.15.104:0/3473546513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2980cced0 msgr2=0x7ff29815c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:20.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.290+0000 7ff29dd2c700 1 --2- 172.21.15.104:0/3473546513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2980cced0 0x7ff29815c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:20.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.290+0000 7ff29dd2c700 1 -- 172.21.15.104:0/3473546513 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff290009a20 con 0x7ff298140bc0 2024-08-17T02:22:20.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.290+0000 7ff29cd2a700 1 --2- 172.21.15.104:0/3473546513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2980cced0 0x7ff29815c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:22:20.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.294+0000 7ff29dd2c700 1 --2- 172.21.15.104:0/3473546513 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff298140bc0 0x7ff298156810 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff290013000 tx=0x7ff290019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:20.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.294+0000 7ff28d7fa700 1 -- 172.21.15.104:0/3473546513 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff290012e30 con 0x7ff298140bc0 2024-08-17T02:22:20.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.294+0000 7ff28d7fa700 1 -- 172.21.15.104:0/3473546513 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29001e630 con 0x7ff298140bc0 2024-08-17T02:22:20.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.294+0000 7ff29e52d700 1 -- 172.21.15.104:0/3473546513 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff29815d330 con 0x7ff298140bc0 2024-08-17T02:22:20.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.294+0000 7ff28d7fa700 1 -- 172.21.15.104:0/3473546513 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29001e9f0 con 0x7ff298140bc0 2024-08-17T02:22:20.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.294+0000 7ff29e52d700 1 -- 172.21.15.104:0/3473546513 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff29815d8f0 con 0x7ff298140bc0 2024-08-17T02:22:20.303 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.294+0000 7ff29e52d700 1 -- 172.21.15.104:0/3473546513 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2981675b0 con 0x7ff298140bc0 2024-08-17T02:22:20.303 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.294+0000 7ff28d7fa700 1 -- 172.21.15.104:0/3473546513 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff290024070 con 0x7ff298140bc0 2024-08-17T02:22:20.303 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.298+0000 7ff28d7fa700 1 --2- 172.21.15.104:0/3473546513 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff27c060890 0x7ff27c062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:20.304 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.298+0000 7ff28d7fa700 1 -- 172.21.15.104:0/3473546513 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5223+0+0 (secure 0 0 0) 0x7ff29007f280 con 0x7ff298140bc0 2024-08-17T02:22:20.304 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.298+0000 7ff29d52b700 1 --2- 172.21.15.104:0/3473546513 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff27c060890 0x7ff27c062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:20.304 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.298+0000 7ff29d52b700 1 --2- 172.21.15.104:0/3473546513 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff27c060890 0x7ff27c062d40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff288003aa0 tx=0x7ff288000bc0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:20.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.310+0000 7ff28d7fa700 1 -- 172.21.15.104:0/3473546513 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff290053340 con 0x7ff298140bc0 2024-08-17T02:22:20.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:20.474+0000 7ff29e52d700 1 -- 172.21.15.104:0/3473546513 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff2980638f0 con 0x7ff298140bc0 2024-08-17T02:22:21.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.154+0000 7ff28d7fa700 1 -- 172.21.15.104:0/3473546513 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v21) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff290009880 con 0x7ff298140bc0 2024-08-17T02:22:21.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.174+0000 7ff29e52d700 1 -- 172.21.15.104:0/3473546513 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff27c060890 msgr2=0x7ff27c062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:21.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.174+0000 7ff29e52d700 1 --2- 172.21.15.104:0/3473546513 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff27c060890 0x7ff27c062d40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff288003aa0 tx=0x7ff288000bc0 comp rx=0 tx=0).stop 2024-08-17T02:22:21.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.174+0000 7ff29e52d700 1 -- 172.21.15.104:0/3473546513 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff298140bc0 msgr2=0x7ff298156810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:21.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.174+0000 7ff29e52d700 1 --2- 172.21.15.104:0/3473546513 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff298140bc0 0x7ff298156810 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff290013000 tx=0x7ff290019000 comp rx=0 tx=0).stop 2024-08-17T02:22:21.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.174+0000 7ff29e52d700 1 -- 172.21.15.104:0/3473546513 shutdown_connections 2024-08-17T02:22:21.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.174+0000 7ff29e52d700 1 --2- 172.21.15.104:0/3473546513 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff27c060890 0x7ff27c062d40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:21.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.174+0000 7ff29e52d700 1 --2- 172.21.15.104:0/3473546513 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff298140bc0 0x7ff298156810 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:21.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.174+0000 7ff29e52d700 1 --2- 172.21.15.104:0/3473546513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2980cced0 0x7ff29815c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:21.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.174+0000 7ff29e52d700 1 --2- 172.21.15.104:0/3473546513 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2980b3b30 0x7ff2980c40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:21.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.174+0000 7ff29e52d700 1 -- 172.21.15.104:0/3473546513 >> 172.21.15.104:0/3473546513 conn(0x7ff2980ce120 msgr2=0x7ff2980ce4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:21.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.174+0000 7ff29e52d700 1 -- 172.21.15.104:0/3473546513 shutdown_connections 2024-08-17T02:22:21.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.174+0000 7ff29e52d700 1 -- 172.21.15.104:0/3473546513 wait complete. 2024-08-17T02:22:21.201 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_data' created 2024-08-17T02:22:21.201 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-17T02:22:21.308 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.302+0000 7ff61bc53700 1 Processor -- start 2024-08-17T02:22:21.309 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.302+0000 7ff61bc53700 1 -- start start 2024-08-17T02:22:21.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.302+0000 7ff61bc53700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff6140c8dc0 0x7ff6140cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:21.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.302+0000 7ff61bc53700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff614069b80 con 0x7ff6140c2e10 2024-08-17T02:22:21.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.302+0000 7ff61bc53700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6140cc2b0 con 0x7ff6140cbc40 2024-08-17T02:22:21.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.302+0000 7ff61bc53700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6140cc090 con 0x7ff6140c8dc0 2024-08-17T02:22:21.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.302+0000 7ff6199ef700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7ff6140c2e10 0x7ff61406a010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:41982/0 (socket says 172.21.15.104:41982) 2024-08-17T02:22:21.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.302+0000 7ff6199ef700 1 -- 172.21.15.104:0/728355722 learned_addr learned my addr 172.21.15.104:0/728355722 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:21.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.302+0000 7ff61a1f0700 1 --2- 172.21.15.104:0/728355722 >> v2:172.21.15.104:3300/0 conn(0x7ff6140c8dc0 0x7ff6140cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:21.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.302+0000 7ff61a1f0700 1 -- 172.21.15.104:0/728355722 >> v1:172.21.15.117:6789/0 conn(0x7ff6140cbc40 legacy=0x7ff6140c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:21.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.302+0000 7ff61a1f0700 1 -- 172.21.15.104:0/728355722 >> v1:172.21.15.104:6789/0 conn(0x7ff6140c2e10 legacy=0x7ff61406a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:21.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.302+0000 7ff61a1f0700 1 -- 172.21.15.104:0/728355722 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff614069250 con 0x7ff6140c8dc0 2024-08-17T02:22:21.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.306+0000 7ff61a1f0700 1 --2- 172.21.15.104:0/728355722 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6140c8dc0 0x7ff6140cd9b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff60c009e60 tx=0x7ff60c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfe81c5fbfa025ca server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:21.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.306+0000 7ff6189ed700 1 -- 172.21.15.104:0/728355722 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60c00e070 con 0x7ff6140c8dc0 2024-08-17T02:22:21.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.306+0000 7ff6189ed700 1 -- 172.21.15.104:0/728355722 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff60c00bc30 con 0x7ff6140c8dc0 2024-08-17T02:22:21.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.306+0000 7ff6189ed700 1 -- 172.21.15.104:0/728355722 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60c012430 con 0x7ff6140c8dc0 2024-08-17T02:22:21.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.306+0000 7ff61bc53700 1 -- 172.21.15.104:0/728355722 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6140c8dc0 msgr2=0x7ff6140cd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:21.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.306+0000 7ff61bc53700 1 --2- 172.21.15.104:0/728355722 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6140c8dc0 0x7ff6140cd9b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff60c009e60 tx=0x7ff60c009780 comp rx=0 tx=0).stop 2024-08-17T02:22:21.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.306+0000 7ff61bc53700 1 -- 172.21.15.104:0/728355722 shutdown_connections 2024-08-17T02:22:21.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.306+0000 7ff61bc53700 1 --2- 172.21.15.104:0/728355722 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6140c8dc0 0x7ff6140cd9b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:21.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.306+0000 7ff61bc53700 1 -- 172.21.15.104:0/728355722 >> 172.21.15.104:0/728355722 conn(0x7ff6140caae0 msgr2=0x7ff6140caee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:21.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.306+0000 7ff61bc53700 1 -- 172.21.15.104:0/728355722 shutdown_connections 2024-08-17T02:22:21.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.306+0000 7ff61bc53700 1 -- 172.21.15.104:0/728355722 wait complete. 2024-08-17T02:22:21.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.306+0000 7ff61bc53700 1 Processor -- start 2024-08-17T02:22:21.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.306+0000 7ff61bc53700 1 -- start start 2024-08-17T02:22:21.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.306+0000 7ff61bc53700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6140c2e10 0x7ff614158410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:21.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.306+0000 7ff61bc53700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6140c8dc0 0x7ff6140c5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:21.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.306+0000 7ff61bc53700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6140cbc40 0x7ff6140aee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:21.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.306+0000 7ff61bc53700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6140c64a0 con 0x7ff6140c8dc0 2024-08-17T02:22:21.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.306+0000 7ff61bc53700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6140c6780 con 0x7ff6140c2e10 2024-08-17T02:22:21.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.306+0000 7ff61bc53700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6140c6a60 con 0x7ff6140cbc40 2024-08-17T02:22:21.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.306+0000 7ff6191ee700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6140c8dc0 0x7ff6140c5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:21.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.306+0000 7ff6191ee700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6140c8dc0 0x7ff6140c5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45590/0 (socket says 172.21.15.104:45590) 2024-08-17T02:22:21.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.306+0000 7ff6191ee700 1 -- 172.21.15.104:0/893206182 learned_addr learned my addr 172.21.15.104:0/893206182 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:21.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.310+0000 7ff6199ef700 1 --2- 172.21.15.104:0/893206182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6140c2e10 0x7ff614158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:21.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.310+0000 7ff6191ee700 1 -- 172.21.15.104:0/893206182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6140cbc40 msgr2=0x7ff6140aee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:21.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.310+0000 7ff6191ee700 1 --2- 172.21.15.104:0/893206182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6140cbc40 0x7ff6140aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:21.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.310+0000 7ff6191ee700 1 -- 172.21.15.104:0/893206182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6140c2e10 msgr2=0x7ff614158410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:21.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.310+0000 7ff6191ee700 1 --2- 172.21.15.104:0/893206182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6140c2e10 0x7ff614158410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:21.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.310+0000 7ff6191ee700 1 -- 172.21.15.104:0/893206182 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff60c009a20 con 0x7ff6140c8dc0 2024-08-17T02:22:21.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.310+0000 7ff6199ef700 1 --2- 172.21.15.104:0/893206182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6140c2e10 0x7ff614158410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:22:21.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.310+0000 7ff6191ee700 1 --2- 172.21.15.104:0/893206182 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6140c8dc0 0x7ff6140c5ae0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff60400c4e0 tx=0x7ff60400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:21.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.310+0000 7ff609ffb700 1 -- 172.21.15.104:0/893206182 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff604011590 con 0x7ff6140c8dc0 2024-08-17T02:22:21.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.310+0000 7ff609ffb700 1 -- 172.21.15.104:0/893206182 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff604011710 con 0x7ff6140c8dc0 2024-08-17T02:22:21.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.310+0000 7ff609ffb700 1 -- 172.21.15.104:0/893206182 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff604011ad0 con 0x7ff6140c8dc0 2024-08-17T02:22:21.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.310+0000 7ff61bc53700 1 -- 172.21.15.104:0/893206182 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6140c6d40 con 0x7ff6140c8dc0 2024-08-17T02:22:21.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.310+0000 7ff61bc53700 1 -- 172.21.15.104:0/893206182 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff614158950 con 0x7ff6140c8dc0 2024-08-17T02:22:21.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.310+0000 7ff609ffb700 1 -- 172.21.15.104:0/893206182 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff60401b3b0 con 0x7ff6140c8dc0 2024-08-17T02:22:21.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.310+0000 7ff61bc53700 1 -- 172.21.15.104:0/893206182 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6140c7240 con 0x7ff6140c8dc0 2024-08-17T02:22:21.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.310+0000 7ff609ffb700 1 --2- 172.21.15.104:0/893206182 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff5f8060860 0x7ff5f8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:21.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.314+0000 7ff609ffb700 1 -- 172.21.15.104:0/893206182 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5605+0+0 (secure 0 0 0) 0x7ff60407c110 con 0x7ff6140c8dc0 2024-08-17T02:22:21.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.314+0000 7ff6199ef700 1 --2- 172.21.15.104:0/893206182 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff5f8060860 0x7ff5f8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:21.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.314+0000 7ff6199ef700 1 --2- 172.21.15.104:0/893206182 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff5f8060860 0x7ff5f8062d10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff610001820 tx=0x7ff610009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:21.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.322+0000 7ff609ffb700 1 -- 172.21.15.104:0/893206182 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff60404c520 con 0x7ff6140c8dc0 2024-08-17T02:22:21.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:21.518+0000 7ff61bc53700 1 -- 172.21.15.104:0/893206182 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff6140645c0 con 0x7ff6140c8dc0 2024-08-17T02:22:22.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.210+0000 7ff609ffb700 1 -- 172.21.15.104:0/893206182 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7ff60404fb40 con 0x7ff6140c8dc0 2024-08-17T02:22:22.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.210+0000 7ff61bc53700 1 -- 172.21.15.104:0/893206182 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff5f8060860 msgr2=0x7ff5f8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:22.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.210+0000 7ff61bc53700 1 --2- 172.21.15.104:0/893206182 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff5f8060860 0x7ff5f8062d10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff610001820 tx=0x7ff610009040 comp rx=0 tx=0).stop 2024-08-17T02:22:22.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.210+0000 7ff61bc53700 1 -- 172.21.15.104:0/893206182 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6140c8dc0 msgr2=0x7ff6140c5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:22.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.210+0000 7ff61bc53700 1 --2- 172.21.15.104:0/893206182 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6140c8dc0 0x7ff6140c5ae0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff60400c4e0 tx=0x7ff60400c8a0 comp rx=0 tx=0).stop 2024-08-17T02:22:22.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.210+0000 7ff61bc53700 1 -- 172.21.15.104:0/893206182 shutdown_connections 2024-08-17T02:22:22.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.210+0000 7ff61bc53700 1 --2- 172.21.15.104:0/893206182 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff5f8060860 0x7ff5f8062d10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:22.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.210+0000 7ff61bc53700 1 --2- 172.21.15.104:0/893206182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6140cbc40 0x7ff6140aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:22.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.210+0000 7ff61bc53700 1 --2- 172.21.15.104:0/893206182 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6140c8dc0 0x7ff6140c5ae0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:22.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.210+0000 7ff61bc53700 1 --2- 172.21.15.104:0/893206182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6140c2e10 0x7ff614158410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:22.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.210+0000 7ff61bc53700 1 -- 172.21.15.104:0/893206182 >> 172.21.15.104:0/893206182 conn(0x7ff6140caae0 msgr2=0x7ff6140b01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:22.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.210+0000 7ff61bc53700 1 -- 172.21.15.104:0/893206182 shutdown_connections 2024-08-17T02:22:22.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.210+0000 7ff61bc53700 1 -- 172.21.15.104:0/893206182 wait complete. 2024-08-17T02:22:22.220 INFO:teuthology.orchestra.run.smithi104.stderr:new fs with metadata pool 2 and data pool 3 2024-08-17T02:22:22.230 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:22:22.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.330+0000 7facb48fd700 1 Processor -- start 2024-08-17T02:22:22.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.330+0000 7facb48fd700 1 -- start start 2024-08-17T02:22:22.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.330+0000 7facb48fd700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facb0158eb0 0x7facb00aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:22.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.330+0000 7facb48fd700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7facb006e620 0x7facb00ac490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:22.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.330+0000 7facb48fd700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facb00ac000 con 0x7facb00aecc0 2024-08-17T02:22:22.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.330+0000 7facb48fd700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facb00ab3f0 con 0x7facb006e620 2024-08-17T02:22:22.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.330+0000 7facb48fd700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb00ab6d0 con 0x7facb0158eb0 2024-08-17T02:22:22.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.330+0000 7facaeffd700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7facb00aecc0 0x7facb006df10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:41984/0 (socket says 172.21.15.104:41984) 2024-08-17T02:22:22.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.330+0000 7facaeffd700 1 -- 172.21.15.104:0/499242084 learned_addr learned my addr 172.21.15.104:0/499242084 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:22.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.330+0000 7facaf7fe700 1 --2- 172.21.15.104:0/499242084 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facb0158eb0 0x7facb00aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:22.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.330+0000 7facaffff700 1 --2- 172.21.15.104:0/499242084 >> v2:172.21.15.117:3300/0 conn(0x7facb006e620 0x7facb00ac490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:22.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.330+0000 7facae7fc700 1 -- 172.21.15.104:0/499242084 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3969478552 0 0) 0x7facb00ac000 con 0x7facb00aecc0 2024-08-17T02:22:22.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.330+0000 7facae7fc700 1 -- 172.21.15.104:0/499242084 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac98003570 con 0x7facb00aecc0 2024-08-17T02:22:22.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.330+0000 7facaf7fe700 1 -- 172.21.15.104:0/499242084 >> v2:172.21.15.117:3300/0 conn(0x7facb006e620 msgr2=0x7facb00ac490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:22.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.330+0000 7facaf7fe700 1 --2- 172.21.15.104:0/499242084 >> v2:172.21.15.117:3300/0 conn(0x7facb006e620 0x7facb00ac490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:22.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.330+0000 7facaf7fe700 1 -- 172.21.15.104:0/499242084 >> v1:172.21.15.104:6789/0 conn(0x7facb00aecc0 legacy=0x7facb006df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:22.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.330+0000 7facaf7fe700 1 -- 172.21.15.104:0/499242084 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb00ab9b0 con 0x7facb0158eb0 2024-08-17T02:22:22.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.330+0000 7facaf7fe700 1 --2- 172.21.15.104:0/499242084 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facb0158eb0 0x7facb00aaa80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7faca8009e60 tx=0x7faca8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21145768f89c62ef server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:22.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.330+0000 7facae7fc700 1 -- 172.21.15.104:0/499242084 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca800e070 con 0x7facb0158eb0 2024-08-17T02:22:22.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.330+0000 7facae7fc700 1 -- 172.21.15.104:0/499242084 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca800bab0 con 0x7facb0158eb0 2024-08-17T02:22:22.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.330+0000 7facae7fc700 1 -- 172.21.15.104:0/499242084 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca800be30 con 0x7facb0158eb0 2024-08-17T02:22:22.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.330+0000 7facb48fd700 1 -- 172.21.15.104:0/499242084 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facb0158eb0 msgr2=0x7facb00aaa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:22.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.330+0000 7facb48fd700 1 --2- 172.21.15.104:0/499242084 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facb0158eb0 0x7facb00aaa80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7faca8009e60 tx=0x7faca8009780 comp rx=0 tx=0).stop 2024-08-17T02:22:22.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.330+0000 7facb48fd700 1 -- 172.21.15.104:0/499242084 shutdown_connections 2024-08-17T02:22:22.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.330+0000 7facb48fd700 1 --2- 172.21.15.104:0/499242084 >> v2:172.21.15.117:3300/0 conn(0x7facb006e620 0x7facb00ac490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:22.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.330+0000 7facb48fd700 1 --2- 172.21.15.104:0/499242084 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facb0158eb0 0x7facb00aaa80 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:22.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.330+0000 7facb48fd700 1 -- 172.21.15.104:0/499242084 >> 172.21.15.104:0/499242084 conn(0x7facb00678d0 msgr2=0x7facb0067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:22.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.330+0000 7facb48fd700 1 -- 172.21.15.104:0/499242084 shutdown_connections 2024-08-17T02:22:22.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.330+0000 7facb48fd700 1 -- 172.21.15.104:0/499242084 wait complete. 2024-08-17T02:22:22.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.334+0000 7facb48fd700 1 Processor -- start 2024-08-17T02:22:22.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.334+0000 7facb48fd700 1 -- start start 2024-08-17T02:22:22.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.334+0000 7facb48fd700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facb006e620 0x7facb015a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:22.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.334+0000 7facb48fd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7facb00aecc0 0x7facb00a9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:22.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.334+0000 7facb48fd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7facb0158eb0 0x7facb016c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:22.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.334+0000 7facb48fd700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb00aaec0 con 0x7facb0158eb0 2024-08-17T02:22:22.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.334+0000 7facb48fd700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb016d910 con 0x7facb00aecc0 2024-08-17T02:22:22.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.334+0000 7facb48fd700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb0155ea0 con 0x7facb006e620 2024-08-17T02:22:22.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.334+0000 7facaffff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7facb0158eb0 0x7facb016c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:22.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.334+0000 7facaffff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7facb0158eb0 0x7facb016c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45604/0 (socket says 172.21.15.104:45604) 2024-08-17T02:22:22.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.334+0000 7facaffff700 1 -- 172.21.15.104:0/2101386896 learned_addr learned my addr 172.21.15.104:0/2101386896 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:22.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.334+0000 7facaf7fe700 1 --2- 172.21.15.104:0/2101386896 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facb006e620 0x7facb015a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:22.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.334+0000 7facaeffd700 1 --2- 172.21.15.104:0/2101386896 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7facb00aecc0 0x7facb00a9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:22.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.338+0000 7facaffff700 1 -- 172.21.15.104:0/2101386896 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facb006e620 msgr2=0x7facb015a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:22.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.338+0000 7facaffff700 1 --2- 172.21.15.104:0/2101386896 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facb006e620 0x7facb015a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:22.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.338+0000 7facaffff700 1 -- 172.21.15.104:0/2101386896 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7facb00aecc0 msgr2=0x7facb00a9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:22.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.338+0000 7facaffff700 1 --2- 172.21.15.104:0/2101386896 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7facb00aecc0 0x7facb00a9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:22.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.338+0000 7facaffff700 1 -- 172.21.15.104:0/2101386896 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca8009a20 con 0x7facb0158eb0 2024-08-17T02:22:22.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.338+0000 7facaffff700 1 --2- 172.21.15.104:0/2101386896 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7facb0158eb0 0x7facb016c9b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faca000e8d0 tx=0x7faca00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:22.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.338+0000 7fac977fe700 1 -- 172.21.15.104:0/2101386896 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca0013680 con 0x7facb0158eb0 2024-08-17T02:22:22.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.338+0000 7facb48fd700 1 -- 172.21.15.104:0/2101386896 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb016d630 con 0x7facb0158eb0 2024-08-17T02:22:22.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.338+0000 7fac977fe700 1 -- 172.21.15.104:0/2101386896 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca0013800 con 0x7facb0158eb0 2024-08-17T02:22:22.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.338+0000 7fac977fe700 1 -- 172.21.15.104:0/2101386896 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca0013bc0 con 0x7facb0158eb0 2024-08-17T02:22:22.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.338+0000 7facb48fd700 1 -- 172.21.15.104:0/2101386896 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb015ac90 con 0x7facb0158eb0 2024-08-17T02:22:22.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.338+0000 7facb48fd700 1 -- 172.21.15.104:0/2101386896 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facb0156050 con 0x7facb0158eb0 2024-08-17T02:22:22.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.338+0000 7fac977fe700 1 -- 172.21.15.104:0/2101386896 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7faca001c450 con 0x7facb0158eb0 2024-08-17T02:22:22.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.338+0000 7fac977fe700 1 --2- 172.21.15.104:0/2101386896 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fac9c060860 0x7fac9c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:22.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.338+0000 7fac977fe700 1 -- 172.21.15.104:0/2101386896 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faca007cc30 con 0x7facb0158eb0 2024-08-17T02:22:22.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.338+0000 7facaf7fe700 1 --2- 172.21.15.104:0/2101386896 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fac9c060860 0x7fac9c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:22.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.342+0000 7facaf7fe700 1 --2- 172.21.15.104:0/2101386896 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fac9c060860 0x7fac9c062d10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faca80097c0 tx=0x7faca8019000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:22.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.342+0000 7fac977fe700 1 -- 172.21.15.104:0/2101386896 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7facb0156050 con 0x7facb0158eb0 2024-08-17T02:22:22.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.510+0000 7facb48fd700 1 -- 172.21.15.104:0/2101386896 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7facb0156010 con 0x7facb0158eb0 2024-08-17T02:22:22.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.510+0000 7fac977fe700 1 -- 172.21.15.104:0/2101386896 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15411 (secure 0 0 0) 0x7faca004d080 con 0x7facb0158eb0 2024-08-17T02:22:22.518 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:22:22.518 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":22,"fsid":"fd5f7fb8-d34b-49bb-89a8-62b7dad1bc25","created":"2024-08-17T02:21:57.891389+0000","modified":"2024-08-17T02:22:21.526490+0000","last_up_change":"2024-08-17T02:22:08.924546+0000","last_in_change":"2024-08-17T02:21:59.938028+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:22:10.143970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:22:20.082708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:22:20.521582+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"606b9088-590e-4709-aa3a-b0f6e22972ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":24257},{"type":"v1","addr":"172.21.15.104:6809","nonce":24257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":24257},{"type":"v1","addr":"172.21.15.104:6811","nonce":24257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":24257},{"type":"v1","addr":"172.21.15.104:6815","nonce":24257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":24257},{"type":"v1","addr":"172.21.15.104:6813","nonce":24257}]},"public_addr":"172.21.15.104:6809/24257","cluster_addr":"172.21.15.104:6811/24257","heartbeat_back_addr":"172.21.15.104:6815/24257","heartbeat_front_addr":"172.21.15.104:6813/24257","state":["exists","up"]},{"osd":1,"uuid":"9bc6a909-0c2f-4889-afe7-4a47f89b0f64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":24256},{"type":"v1","addr":"172.21.15.104:6825","nonce":24256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":24256},{"type":"v1","addr":"172.21.15.104:6827","nonce":24256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":24256},{"type":"v1","addr":"172.21.15.104:6831","nonce":24256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":24256},{"type":"v1","addr":"172.21.15.104:6829","nonce":24256}]},"public_addr":"172.21.15.104:6825/24256","cluster_addr":"172.21.15.104:6827/24256","heartbeat_back_addr":"172.21.15.104:6831/24256","heartbeat_front_addr":"172.21.15.104:6829/24256","state":["exists","up"]},{"osd":2,"uuid":"23da31d5-aefb-4edb-b79d-fa05e1becef7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":24255},{"type":"v1","addr":"172.21.15.104:6817","nonce":24255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":24255},{"type":"v1","addr":"172.21.15.104:6819","nonce":24255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":24255},{"type":"v1","addr":"172.21.15.104:6823","nonce":24255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":24255},{"type":"v1","addr":"172.21.15.104:6821","nonce":24255}]},"public_addr":"172.21.15.104:6817/24255","cluster_addr":"172.21.15.104:6819/24255","heartbeat_back_addr":"172.21.15.104:6823/24255","heartbeat_front_addr":"172.21.15.104:6821/24255","state":["exists","up"]},{"osd":3,"uuid":"6e4a5ec2-b415-45ef-8381-61a59eb65224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":24254},{"type":"v1","addr":"172.21.15.104:6801","nonce":24254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":24254},{"type":"v1","addr":"172.21.15.104:6803","nonce":24254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":24254},{"type":"v1","addr":"172.21.15.104:6807","nonce":24254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":24254},{"type":"v1","addr":"172.21.15.104:6805","nonce":24254}]},"public_addr":"172.21.15.104:6801/24254","cluster_addr":"172.21.15.104:6803/24254","heartbeat_back_addr":"172.21.15.104:6807/24254","heartbeat_front_addr":"172.21.15.104:6805/24254","state":["exists","up"]},{"osd":4,"uuid":"8d5bea2d-9039-4013-8c99-2c046c5b8a17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":24421},{"type":"v1","addr":"172.21.15.117:6804","nonce":24421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":24421},{"type":"v1","addr":"172.21.15.117:6809","nonce":24421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":24421},{"type":"v1","addr":"172.21.15.117:6815","nonce":24421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":24421},{"type":"v1","addr":"172.21.15.117:6813","nonce":24421}]},"public_addr":"172.21.15.117:6804/24421","cluster_addr":"172.21.15.117:6809/24421","heartbeat_back_addr":"172.21.15.117:6815/24421","heartbeat_front_addr":"172.21.15.117:6813/24421","state":["exists","up"]},{"osd":5,"uuid":"de8b36fc-121c-4f05-8f5b-28f513d9f21f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":24422},{"type":"v1","addr":"172.21.15.117:6817","nonce":24422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":24422},{"type":"v1","addr":"172.21.15.117:6819","nonce":24422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":24422},{"type":"v1","addr":"172.21.15.117:6823","nonce":24422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":24422},{"type":"v1","addr":"172.21.15.117:6821","nonce":24422}]},"public_addr":"172.21.15.117:6817/24422","cluster_addr":"172.21.15.117:6819/24422","heartbeat_back_addr":"172.21.15.117:6823/24422","heartbeat_front_addr":"172.21.15.117:6821/24422","state":["exists","up"]},{"osd":6,"uuid":"6a87f09f-7bf7-4f7a-be87-530ac1ff8ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":24420},{"type":"v1","addr":"172.21.15.117:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6803","nonce":24420},{"type":"v1","addr":"172.21.15.117:6805","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":24420},{"type":"v1","addr":"172.21.15.117:6811","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":24420},{"type":"v1","addr":"172.21.15.117:6808","nonce":24420}]},"public_addr":"172.21.15.117:6801/24420","cluster_addr":"172.21.15.117:6805/24420","heartbeat_back_addr":"172.21.15.117:6811/24420","heartbeat_front_addr":"172.21.15.117:6808/24420","state":["exists","up"]},{"osd":7,"uuid":"e31d8041-1aa1-4b5d-83b3-0a373426dd9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":24423},{"type":"v1","addr":"172.21.15.117:6825","nonce":24423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":24423},{"type":"v1","addr":"172.21.15.117:6827","nonce":24423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":24423},{"type":"v1","addr":"172.21.15.117:6831","nonce":24423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":24423},{"type":"v1","addr":"172.21.15.117:6829","nonce":24423}]},"public_addr":"172.21.15.117:6825/24423","cluster_addr":"172.21.15.117:6827/24423","heartbeat_back_addr":"172.21.15.117:6831/24423","heartbeat_front_addr":"172.21.15.117:6829/24423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.220874+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.210039+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.434762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.247206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.184316+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.306325+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.035719+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.400303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:22:22.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.514+0000 7facb48fd700 1 -- 172.21.15.104:0/2101386896 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fac9c060860 msgr2=0x7fac9c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:22.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.514+0000 7facb48fd700 1 --2- 172.21.15.104:0/2101386896 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fac9c060860 0x7fac9c062d10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faca80097c0 tx=0x7faca8019000 comp rx=0 tx=0).stop 2024-08-17T02:22:22.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.514+0000 7facb48fd700 1 -- 172.21.15.104:0/2101386896 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7facb0158eb0 msgr2=0x7facb016c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:22.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.514+0000 7facb48fd700 1 --2- 172.21.15.104:0/2101386896 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7facb0158eb0 0x7facb016c9b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faca000e8d0 tx=0x7faca00091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:22.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.514+0000 7facb48fd700 1 -- 172.21.15.104:0/2101386896 shutdown_connections 2024-08-17T02:22:22.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.514+0000 7facb48fd700 1 --2- 172.21.15.104:0/2101386896 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fac9c060860 0x7fac9c062d10 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:22.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.514+0000 7facb48fd700 1 --2- 172.21.15.104:0/2101386896 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7facb0158eb0 0x7facb016c9b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:22.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.514+0000 7facb48fd700 1 --2- 172.21.15.104:0/2101386896 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7facb00aecc0 0x7facb00a9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:22.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.514+0000 7facb48fd700 1 --2- 172.21.15.104:0/2101386896 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facb006e620 0x7facb015a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:22.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.514+0000 7facb48fd700 1 -- 172.21.15.104:0/2101386896 >> 172.21.15.104:0/2101386896 conn(0x7facb00678d0 msgr2=0x7facb00b1610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:22.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.514+0000 7facb48fd700 1 -- 172.21.15.104:0/2101386896 shutdown_connections 2024-08-17T02:22:22.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.514+0000 7facb48fd700 1 -- 172.21.15.104:0/2101386896 wait complete. 2024-08-17T02:22:22.533 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:22:22.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.630+0000 7f93e3fff700 1 Processor -- start 2024-08-17T02:22:22.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.630+0000 7f93e3fff700 1 -- start start 2024-08-17T02:22:22.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.630+0000 7f93e3fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93e40b0d20 0x7f93e406df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:22.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.630+0000 7f93e3fff700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93e4141a00 con 0x7f93e40b1800 2024-08-17T02:22:22.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.630+0000 7f93e3fff700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93e406e8a0 con 0x7f93e406e450 2024-08-17T02:22:22.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.630+0000 7f93e3fff700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e4140b10 con 0x7f93e40b0d20 2024-08-17T02:22:22.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.630+0000 7f93e37fe700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f93e40b1800 0x7f93e4141e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:41996/0 (socket says 172.21.15.104:41996) 2024-08-17T02:22:22.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.630+0000 7f93e37fe700 1 -- 172.21.15.104:0/1239461775 learned_addr learned my addr 172.21.15.104:0/1239461775 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:22.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.630+0000 7f93e2ffd700 1 --2- 172.21.15.104:0/1239461775 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93e40b0d20 0x7f93e406df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:22.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.630+0000 7f93e1ffb700 1 -- 172.21.15.104:0/1239461775 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1717079498 0 0) 0x7f93e4141a00 con 0x7f93e40b1800 2024-08-17T02:22:22.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.630+0000 7f93e1ffb700 1 -- 172.21.15.104:0/1239461775 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93c4003570 con 0x7f93e40b1800 2024-08-17T02:22:22.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.630+0000 7f93e1ffb700 1 -- 172.21.15.104:0/1239461775 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1553906628 0 0) 0x7f93e406e8a0 con 0x7f93e406e450 2024-08-17T02:22:22.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.630+0000 7f93e1ffb700 1 -- 172.21.15.104:0/1239461775 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93e4141a00 con 0x7f93e406e450 2024-08-17T02:22:22.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.630+0000 7f93e2ffd700 1 -- 172.21.15.104:0/1239461775 >> v1:172.21.15.117:6789/0 conn(0x7f93e406e450 legacy=0x7f93e40b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:22.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.630+0000 7f93e2ffd700 1 -- 172.21.15.104:0/1239461775 >> v1:172.21.15.104:6789/0 conn(0x7f93e40b1800 legacy=0x7f93e4141e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:22.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.630+0000 7f93e2ffd700 1 -- 172.21.15.104:0/1239461775 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e4140df0 con 0x7f93e40b0d20 2024-08-17T02:22:22.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.630+0000 7f93e2ffd700 1 --2- 172.21.15.104:0/1239461775 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93e40b0d20 0x7f93e406df10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f93d4009910 tx=0x7f93d40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49c42018af1f22d8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:22.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.630+0000 7f93e1ffb700 1 -- 172.21.15.104:0/1239461775 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d4011630 con 0x7f93e40b0d20 2024-08-17T02:22:22.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.630+0000 7f93e1ffb700 1 -- 172.21.15.104:0/1239461775 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d4011790 con 0x7f93e40b0d20 2024-08-17T02:22:22.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.630+0000 7f93e1ffb700 1 -- 172.21.15.104:0/1239461775 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d4011b30 con 0x7f93e40b0d20 2024-08-17T02:22:22.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.630+0000 7f93e3fff700 1 -- 172.21.15.104:0/1239461775 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93e40b0d20 msgr2=0x7f93e406df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:22.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.630+0000 7f93e3fff700 1 --2- 172.21.15.104:0/1239461775 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93e40b0d20 0x7f93e406df10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f93d4009910 tx=0x7f93d40091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:22.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.630+0000 7f93e3fff700 1 -- 172.21.15.104:0/1239461775 shutdown_connections 2024-08-17T02:22:22.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.630+0000 7f93e3fff700 1 --2- 172.21.15.104:0/1239461775 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93e40b0d20 0x7f93e406df10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:22.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.630+0000 7f93e3fff700 1 -- 172.21.15.104:0/1239461775 >> 172.21.15.104:0/1239461775 conn(0x7f93e40678d0 msgr2=0x7f93e4067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:22.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.630+0000 7f93e3fff700 1 -- 172.21.15.104:0/1239461775 shutdown_connections 2024-08-17T02:22:22.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.630+0000 7f93e3fff700 1 -- 172.21.15.104:0/1239461775 wait complete. 2024-08-17T02:22:22.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.634+0000 7f93e3fff700 1 Processor -- start 2024-08-17T02:22:22.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.634+0000 7f93e3fff700 1 -- start start 2024-08-17T02:22:22.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.634+0000 7f93e3fff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93e406e450 0x7f93e40ac590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:22.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.634+0000 7f93e3fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93e40b0d20 0x7f93e40acad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:22.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.634+0000 7f93e3fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93e40b1800 0x7f93e40a90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:22.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.634+0000 7f93e3fff700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e40adf00 con 0x7f93e406e450 2024-08-17T02:22:22.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.634+0000 7f93e3fff700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e40ad2f0 con 0x7f93e40b0d20 2024-08-17T02:22:22.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.634+0000 7f93e3fff700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e40ad5d0 con 0x7f93e40b1800 2024-08-17T02:22:22.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.634+0000 7f93e2ffd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93e406e450 0x7f93e40ac590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:22.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.634+0000 7f93e2ffd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93e406e450 0x7f93e40ac590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45620/0 (socket says 172.21.15.104:45620) 2024-08-17T02:22:22.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.634+0000 7f93e2ffd700 1 -- 172.21.15.104:0/1246585952 learned_addr learned my addr 172.21.15.104:0/1246585952 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:22.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.634+0000 7f93e27fc700 1 --2- 172.21.15.104:0/1246585952 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93e40b0d20 0x7f93e40acad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:22.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.634+0000 7f93e37fe700 1 --2- 172.21.15.104:0/1246585952 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93e40b1800 0x7f93e40a90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:22.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.634+0000 7f93e2ffd700 1 -- 172.21.15.104:0/1246585952 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93e40b1800 msgr2=0x7f93e40a90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:22.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.634+0000 7f93e2ffd700 1 --2- 172.21.15.104:0/1246585952 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93e40b1800 0x7f93e40a90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:22.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.634+0000 7f93e2ffd700 1 -- 172.21.15.104:0/1246585952 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93e40b0d20 msgr2=0x7f93e40acad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:22.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.634+0000 7f93e2ffd700 1 --2- 172.21.15.104:0/1246585952 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93e40b0d20 0x7f93e40acad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:22.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.634+0000 7f93e2ffd700 1 -- 172.21.15.104:0/1246585952 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d4009420 con 0x7f93e406e450 2024-08-17T02:22:22.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.634+0000 7f93e2ffd700 1 --2- 172.21.15.104:0/1246585952 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93e406e450 0x7f93e40ac590 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f93d4009f00 tx=0x7f93d4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:22.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.634+0000 7f93daffd700 1 -- 172.21.15.104:0/1246585952 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d401f070 con 0x7f93e406e450 2024-08-17T02:22:22.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.634+0000 7f93e3fff700 1 -- 172.21.15.104:0/1246585952 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e40ad8b0 con 0x7f93e406e450 2024-08-17T02:22:22.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.634+0000 7f93daffd700 1 -- 172.21.15.104:0/1246585952 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d4000bc0 con 0x7f93e406e450 2024-08-17T02:22:22.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.634+0000 7f93e3fff700 1 -- 172.21.15.104:0/1246585952 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e40ad010 con 0x7f93e406e450 2024-08-17T02:22:22.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.634+0000 7f93daffd700 1 -- 172.21.15.104:0/1246585952 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d4011b10 con 0x7f93e406e450 2024-08-17T02:22:22.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.638+0000 7f93e3fff700 1 -- 172.21.15.104:0/1246585952 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e40aed30 con 0x7f93e406e450 2024-08-17T02:22:22.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.638+0000 7f93daffd700 1 -- 172.21.15.104:0/1246585952 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f93d4023070 con 0x7f93e406e450 2024-08-17T02:22:22.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.638+0000 7f93daffd700 1 --2- 172.21.15.104:0/1246585952 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f93c8060890 0x7f93c8062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:22.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.638+0000 7f93daffd700 1 -- 172.21.15.104:0/1246585952 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f93d407dc00 con 0x7f93e406e450 2024-08-17T02:22:22.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.638+0000 7f93e27fc700 1 --2- 172.21.15.104:0/1246585952 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f93c8060890 0x7f93c8062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:22.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.638+0000 7f93e27fc700 1 --2- 172.21.15.104:0/1246585952 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f93c8060890 0x7f93c8062d40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f93e4160780 tx=0x7f93cc007de0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:22.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.642+0000 7f93daffd700 1 -- 172.21.15.104:0/1246585952 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f93d404e100 con 0x7f93e406e450 2024-08-17T02:22:22.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.806+0000 7f93e3fff700 1 -- 172.21.15.104:0/1246585952 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93e40643a0 con 0x7f93e406e450 2024-08-17T02:22:22.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.806+0000 7f93daffd700 1 -- 172.21.15.104:0/1246585952 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15411 (secure 0 0 0) 0x7f93d4051720 con 0x7f93e406e450 2024-08-17T02:22:22.814 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:22:22.814 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":22,"fsid":"fd5f7fb8-d34b-49bb-89a8-62b7dad1bc25","created":"2024-08-17T02:21:57.891389+0000","modified":"2024-08-17T02:22:21.526490+0000","last_up_change":"2024-08-17T02:22:08.924546+0000","last_in_change":"2024-08-17T02:21:59.938028+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:22:10.143970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:22:20.082708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:22:20.521582+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"606b9088-590e-4709-aa3a-b0f6e22972ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":24257},{"type":"v1","addr":"172.21.15.104:6809","nonce":24257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":24257},{"type":"v1","addr":"172.21.15.104:6811","nonce":24257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":24257},{"type":"v1","addr":"172.21.15.104:6815","nonce":24257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":24257},{"type":"v1","addr":"172.21.15.104:6813","nonce":24257}]},"public_addr":"172.21.15.104:6809/24257","cluster_addr":"172.21.15.104:6811/24257","heartbeat_back_addr":"172.21.15.104:6815/24257","heartbeat_front_addr":"172.21.15.104:6813/24257","state":["exists","up"]},{"osd":1,"uuid":"9bc6a909-0c2f-4889-afe7-4a47f89b0f64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":24256},{"type":"v1","addr":"172.21.15.104:6825","nonce":24256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":24256},{"type":"v1","addr":"172.21.15.104:6827","nonce":24256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":24256},{"type":"v1","addr":"172.21.15.104:6831","nonce":24256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":24256},{"type":"v1","addr":"172.21.15.104:6829","nonce":24256}]},"public_addr":"172.21.15.104:6825/24256","cluster_addr":"172.21.15.104:6827/24256","heartbeat_back_addr":"172.21.15.104:6831/24256","heartbeat_front_addr":"172.21.15.104:6829/24256","state":["exists","up"]},{"osd":2,"uuid":"23da31d5-aefb-4edb-b79d-fa05e1becef7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":24255},{"type":"v1","addr":"172.21.15.104:6817","nonce":24255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":24255},{"type":"v1","addr":"172.21.15.104:6819","nonce":24255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":24255},{"type":"v1","addr":"172.21.15.104:6823","nonce":24255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":24255},{"type":"v1","addr":"172.21.15.104:6821","nonce":24255}]},"public_addr":"172.21.15.104:6817/24255","cluster_addr":"172.21.15.104:6819/24255","heartbeat_back_addr":"172.21.15.104:6823/24255","heartbeat_front_addr":"172.21.15.104:6821/24255","state":["exists","up"]},{"osd":3,"uuid":"6e4a5ec2-b415-45ef-8381-61a59eb65224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":24254},{"type":"v1","addr":"172.21.15.104:6801","nonce":24254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":24254},{"type":"v1","addr":"172.21.15.104:6803","nonce":24254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":24254},{"type":"v1","addr":"172.21.15.104:6807","nonce":24254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":24254},{"type":"v1","addr":"172.21.15.104:6805","nonce":24254}]},"public_addr":"172.21.15.104:6801/24254","cluster_addr":"172.21.15.104:6803/24254","heartbeat_back_addr":"172.21.15.104:6807/24254","heartbeat_front_addr":"172.21.15.104:6805/24254","state":["exists","up"]},{"osd":4,"uuid":"8d5bea2d-9039-4013-8c99-2c046c5b8a17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":24421},{"type":"v1","addr":"172.21.15.117:6804","nonce":24421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":24421},{"type":"v1","addr":"172.21.15.117:6809","nonce":24421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":24421},{"type":"v1","addr":"172.21.15.117:6815","nonce":24421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":24421},{"type":"v1","addr":"172.21.15.117:6813","nonce":24421}]},"public_addr":"172.21.15.117:6804/24421","cluster_addr":"172.21.15.117:6809/24421","heartbeat_back_addr":"172.21.15.117:6815/24421","heartbeat_front_addr":"172.21.15.117:6813/24421","state":["exists","up"]},{"osd":5,"uuid":"de8b36fc-121c-4f05-8f5b-28f513d9f21f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":24422},{"type":"v1","addr":"172.21.15.117:6817","nonce":24422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":24422},{"type":"v1","addr":"172.21.15.117:6819","nonce":24422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":24422},{"type":"v1","addr":"172.21.15.117:6823","nonce":24422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":24422},{"type":"v1","addr":"172.21.15.117:6821","nonce":24422}]},"public_addr":"172.21.15.117:6817/24422","cluster_addr":"172.21.15.117:6819/24422","heartbeat_back_addr":"172.21.15.117:6823/24422","heartbeat_front_addr":"172.21.15.117:6821/24422","state":["exists","up"]},{"osd":6,"uuid":"6a87f09f-7bf7-4f7a-be87-530ac1ff8ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":24420},{"type":"v1","addr":"172.21.15.117:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6803","nonce":24420},{"type":"v1","addr":"172.21.15.117:6805","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":24420},{"type":"v1","addr":"172.21.15.117:6811","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":24420},{"type":"v1","addr":"172.21.15.117:6808","nonce":24420}]},"public_addr":"172.21.15.117:6801/24420","cluster_addr":"172.21.15.117:6805/24420","heartbeat_back_addr":"172.21.15.117:6811/24420","heartbeat_front_addr":"172.21.15.117:6808/24420","state":["exists","up"]},{"osd":7,"uuid":"e31d8041-1aa1-4b5d-83b3-0a373426dd9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":24423},{"type":"v1","addr":"172.21.15.117:6825","nonce":24423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":24423},{"type":"v1","addr":"172.21.15.117:6827","nonce":24423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":24423},{"type":"v1","addr":"172.21.15.117:6831","nonce":24423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":24423},{"type":"v1","addr":"172.21.15.117:6829","nonce":24423}]},"public_addr":"172.21.15.117:6825/24423","cluster_addr":"172.21.15.117:6827/24423","heartbeat_back_addr":"172.21.15.117:6831/24423","heartbeat_front_addr":"172.21.15.117:6829/24423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.220874+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.210039+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.434762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.247206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.184316+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.306325+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.035719+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.400303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:22:22.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.810+0000 7f93e3fff700 1 -- 172.21.15.104:0/1246585952 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f93c8060890 msgr2=0x7f93c8062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:22.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.810+0000 7f93e3fff700 1 --2- 172.21.15.104:0/1246585952 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f93c8060890 0x7f93c8062d40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f93e4160780 tx=0x7f93cc007de0 comp rx=0 tx=0).stop 2024-08-17T02:22:22.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.810+0000 7f93e3fff700 1 -- 172.21.15.104:0/1246585952 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93e406e450 msgr2=0x7f93e40ac590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:22.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.810+0000 7f93e3fff700 1 --2- 172.21.15.104:0/1246585952 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93e406e450 0x7f93e40ac590 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f93d4009f00 tx=0x7f93d4017000 comp rx=0 tx=0).stop 2024-08-17T02:22:22.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.810+0000 7f93e3fff700 1 -- 172.21.15.104:0/1246585952 shutdown_connections 2024-08-17T02:22:22.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.810+0000 7f93e3fff700 1 --2- 172.21.15.104:0/1246585952 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f93c8060890 0x7f93c8062d40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:22.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.810+0000 7f93e3fff700 1 --2- 172.21.15.104:0/1246585952 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93e40b1800 0x7f93e40a90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:22.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.810+0000 7f93e3fff700 1 --2- 172.21.15.104:0/1246585952 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93e40b0d20 0x7f93e40acad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:22.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.810+0000 7f93e3fff700 1 --2- 172.21.15.104:0/1246585952 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93e406e450 0x7f93e40ac590 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:22.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.810+0000 7f93e3fff700 1 -- 172.21.15.104:0/1246585952 >> 172.21.15.104:0/1246585952 conn(0x7f93e40678d0 msgr2=0x7f93e4141e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:22.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.810+0000 7f93e3fff700 1 -- 172.21.15.104:0/1246585952 shutdown_connections 2024-08-17T02:22:22.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.810+0000 7f93e3fff700 1 -- 172.21.15.104:0/1246585952 wait complete. 2024-08-17T02:22:22.829 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-17T02:22:22.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.938+0000 7efc8272a700 1 Processor -- start 2024-08-17T02:22:22.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.938+0000 7efc8272a700 1 -- start start 2024-08-17T02:22:22.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.938+0000 7efc8272a700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7efc7c1514d0 0x7efc7c06ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:22.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.938+0000 7efc8272a700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7efc7c1574f0 0x7efc7c157990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:22.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.938+0000 7efc8272a700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc7c06e010 con 0x7efc7c0b0d90 2024-08-17T02:22:22.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.938+0000 7efc8272a700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc7c06efa0 con 0x7efc7c1574f0 2024-08-17T02:22:22.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.938+0000 7efc8272a700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc7c157fb0 con 0x7efc7c1514d0 2024-08-17T02:22:22.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.938+0000 7efc80f27700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7efc7c1574f0 0x7efc7c157990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:22.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.938+0000 7efc81f29700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7efc7c0b0d90 0x7efc7c0c96d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:42012/0 (socket says 172.21.15.104:42012) 2024-08-17T02:22:22.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.938+0000 7efc81f29700 1 -- 172.21.15.104:0/2473584207 learned_addr learned my addr 172.21.15.104:0/2473584207 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:22.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.938+0000 7efc81728700 1 --2- 172.21.15.104:0/2473584207 >> v2:172.21.15.117:3300/0 conn(0x7efc7c1514d0 0x7efc7c06ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:22.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.938+0000 7efc80f27700 1 -- 172.21.15.104:0/2473584207 >> v2:172.21.15.117:3300/0 conn(0x7efc7c1514d0 msgr2=0x7efc7c06ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:22.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.938+0000 7efc80f27700 1 --2- 172.21.15.104:0/2473584207 >> v2:172.21.15.117:3300/0 conn(0x7efc7c1514d0 0x7efc7c06ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:22.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.938+0000 7efc80f27700 1 -- 172.21.15.104:0/2473584207 >> v1:172.21.15.104:6789/0 conn(0x7efc7c0b0d90 legacy=0x7efc7c0c96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:22.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.938+0000 7efc73fff700 1 -- 172.21.15.104:0/2473584207 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1990877260 0 0) 0x7efc7c06e010 con 0x7efc7c0b0d90 2024-08-17T02:22:22.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.938+0000 7efc80f27700 1 -- 172.21.15.104:0/2473584207 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc7c158290 con 0x7efc7c1574f0 2024-08-17T02:22:22.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.938+0000 7efc81728700 1 --2- 172.21.15.104:0/2473584207 >> v2:172.21.15.117:3300/0 conn(0x7efc7c1514d0 0x7efc7c06ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:22:22.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.938+0000 7efc80f27700 1 --2- 172.21.15.104:0/2473584207 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc7c1574f0 0x7efc7c157990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efc7c05f080 tx=0x7efc780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1759821e0d755046 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:22.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.938+0000 7efc73fff700 1 -- 172.21.15.104:0/2473584207 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7800b6b0 con 0x7efc7c1574f0 2024-08-17T02:22:22.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.938+0000 7efc73fff700 1 -- 172.21.15.104:0/2473584207 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc7800b810 con 0x7efc7c1574f0 2024-08-17T02:22:22.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.938+0000 7efc73fff700 1 -- 172.21.15.104:0/2473584207 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7800bbb0 con 0x7efc7c1574f0 2024-08-17T02:22:22.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.938+0000 7efc8272a700 1 -- 172.21.15.104:0/2473584207 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc7c1574f0 msgr2=0x7efc7c157990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:22.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.938+0000 7efc8272a700 1 --2- 172.21.15.104:0/2473584207 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc7c1574f0 0x7efc7c157990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efc7c05f080 tx=0x7efc780091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:22.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.938+0000 7efc8272a700 1 -- 172.21.15.104:0/2473584207 shutdown_connections 2024-08-17T02:22:22.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.938+0000 7efc8272a700 1 --2- 172.21.15.104:0/2473584207 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc7c1574f0 0x7efc7c157990 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:22.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.938+0000 7efc8272a700 1 --2- 172.21.15.104:0/2473584207 >> v2:172.21.15.117:3300/0 conn(0x7efc7c1514d0 0x7efc7c06ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:22.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.938+0000 7efc8272a700 1 -- 172.21.15.104:0/2473584207 >> 172.21.15.104:0/2473584207 conn(0x7efc7c0678a0 msgr2=0x7efc7c067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:22.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.938+0000 7efc8272a700 1 -- 172.21.15.104:0/2473584207 shutdown_connections 2024-08-17T02:22:22.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.938+0000 7efc8272a700 1 -- 172.21.15.104:0/2473584207 wait complete. 2024-08-17T02:22:22.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.938+0000 7efc8272a700 1 Processor -- start 2024-08-17T02:22:22.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.938+0000 7efc8272a700 1 -- start start 2024-08-17T02:22:22.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.938+0000 7efc8272a700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc7c0b0d90 0x7efc7c14e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:22.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.938+0000 7efc8272a700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc7c1514d0 0x7efc7c0a85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:22.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.938+0000 7efc8272a700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc7c1574f0 0x7efc7c0af530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:22.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.938+0000 7efc8272a700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c0a6200 con 0x7efc7c1574f0 2024-08-17T02:22:22.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.938+0000 7efc8272a700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c0a55f0 con 0x7efc7c0b0d90 2024-08-17T02:22:22.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.938+0000 7efc8272a700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c0a58d0 con 0x7efc7c1514d0 2024-08-17T02:22:22.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.938+0000 7efc81f29700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc7c1574f0 0x7efc7c0af530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:22.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.938+0000 7efc81f29700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc7c1574f0 0x7efc7c0af530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45642/0 (socket says 172.21.15.104:45642) 2024-08-17T02:22:22.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.938+0000 7efc81f29700 1 -- 172.21.15.104:0/2947852813 learned_addr learned my addr 172.21.15.104:0/2947852813 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:22.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.942+0000 7efc81728700 1 --2- 172.21.15.104:0/2947852813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc7c0b0d90 0x7efc7c14e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:22.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.942+0000 7efc80f27700 1 --2- 172.21.15.104:0/2947852813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc7c1514d0 0x7efc7c0a85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:22.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.942+0000 7efc81f29700 1 -- 172.21.15.104:0/2947852813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc7c1514d0 msgr2=0x7efc7c0a85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:22.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.942+0000 7efc81f29700 1 --2- 172.21.15.104:0/2947852813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc7c1514d0 0x7efc7c0a85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:22.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.942+0000 7efc81f29700 1 -- 172.21.15.104:0/2947852813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc7c0b0d90 msgr2=0x7efc7c14e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:22.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.942+0000 7efc81f29700 1 --2- 172.21.15.104:0/2947852813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc7c0b0d90 0x7efc7c14e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:22.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.942+0000 7efc81f29700 1 -- 172.21.15.104:0/2947852813 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc78009420 con 0x7efc7c1574f0 2024-08-17T02:22:22.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.942+0000 7efc81f29700 1 --2- 172.21.15.104:0/2947852813 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc7c1574f0 0x7efc7c0af530 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efc7400cc90 tx=0x7efc74001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:22.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.942+0000 7efc717fa700 1 -- 172.21.15.104:0/2947852813 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7400cea0 con 0x7efc7c1574f0 2024-08-17T02:22:22.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.942+0000 7efc717fa700 1 -- 172.21.15.104:0/2947852813 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc7400ab70 con 0x7efc7c1574f0 2024-08-17T02:22:22.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.942+0000 7efc8272a700 1 -- 172.21.15.104:0/2947852813 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc7c0a5bb0 con 0x7efc7c1574f0 2024-08-17T02:22:22.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.942+0000 7efc717fa700 1 -- 172.21.15.104:0/2947852813 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc740070f0 con 0x7efc7c1574f0 2024-08-17T02:22:22.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.942+0000 7efc8272a700 1 -- 172.21.15.104:0/2947852813 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc7c14e980 con 0x7efc7c1574f0 2024-08-17T02:22:22.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.942+0000 7efc8272a700 1 -- 172.21.15.104:0/2947852813 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc7c0a6370 con 0x7efc7c1574f0 2024-08-17T02:22:22.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.942+0000 7efc717fa700 1 -- 172.21.15.104:0/2947852813 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7efc740074a0 con 0x7efc7c1574f0 2024-08-17T02:22:22.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.942+0000 7efc717fa700 1 --2- 172.21.15.104:0/2947852813 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7efc680608e0 0x7efc68062d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:22.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.942+0000 7efc717fa700 1 -- 172.21.15.104:0/2947852813 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efc7407d0f0 con 0x7efc7c1574f0 2024-08-17T02:22:22.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.942+0000 7efc81728700 1 --2- 172.21.15.104:0/2947852813 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7efc680608e0 0x7efc68062d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:22.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.946+0000 7efc81728700 1 --2- 172.21.15.104:0/2947852813 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7efc680608e0 0x7efc68062d90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efc6c006f00 tx=0x7efc6c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:22.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:22.950+0000 7efc717fa700 1 -- 172.21.15.104:0/2947852813 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7efc7404d520 con 0x7efc7c1574f0 2024-08-17T02:22:23.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.142+0000 7efc8272a700 1 -- 172.21.15.104:0/2947852813 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7efc7c064330 con 0x7efc7c1574f0 2024-08-17T02:22:23.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.818+0000 7efc717fa700 1 -- 172.21.15.104:0/2947852813 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7efc74050b40 con 0x7efc7c1574f0 2024-08-17T02:22:23.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.822+0000 7efc8272a700 1 -- 172.21.15.104:0/2947852813 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7efc680608e0 msgr2=0x7efc68062d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:23.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.822+0000 7efc8272a700 1 --2- 172.21.15.104:0/2947852813 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7efc680608e0 0x7efc68062d90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efc6c006f00 tx=0x7efc6c008040 comp rx=0 tx=0).stop 2024-08-17T02:22:23.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.822+0000 7efc8272a700 1 -- 172.21.15.104:0/2947852813 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc7c1574f0 msgr2=0x7efc7c0af530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:23.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.822+0000 7efc8272a700 1 --2- 172.21.15.104:0/2947852813 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc7c1574f0 0x7efc7c0af530 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efc7400cc90 tx=0x7efc74001a80 comp rx=0 tx=0).stop 2024-08-17T02:22:23.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.826+0000 7efc8272a700 1 -- 172.21.15.104:0/2947852813 shutdown_connections 2024-08-17T02:22:23.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.826+0000 7efc8272a700 1 --2- 172.21.15.104:0/2947852813 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7efc680608e0 0x7efc68062d90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:23.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.826+0000 7efc8272a700 1 --2- 172.21.15.104:0/2947852813 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc7c1574f0 0x7efc7c0af530 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:23.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.826+0000 7efc8272a700 1 --2- 172.21.15.104:0/2947852813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc7c1514d0 0x7efc7c0a85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:23.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.826+0000 7efc8272a700 1 --2- 172.21.15.104:0/2947852813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc7c0b0d90 0x7efc7c14e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:23.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.826+0000 7efc8272a700 1 -- 172.21.15.104:0/2947852813 >> 172.21.15.104:0/2947852813 conn(0x7efc7c0678a0 msgr2=0x7efc7c067c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:23.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.826+0000 7efc8272a700 1 -- 172.21.15.104:0/2947852813 shutdown_connections 2024-08-17T02:22:23.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.826+0000 7efc8272a700 1 -- 172.21.15.104:0/2947852813 wait complete. 2024-08-17T02:22:23.847 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-17T02:22:23.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.958+0000 7fd7e759e700 1 Processor -- start 2024-08-17T02:22:23.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.958+0000 7fd7e759e700 1 -- start start 2024-08-17T02:22:23.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.958+0000 7fd7e759e700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fd7e8067510 0x7fd7e80ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:23.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.958+0000 7fd7e759e700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd7e8159480 0x7fd7e80cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:23.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.958+0000 7fd7e759e700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e80ce210 con 0x7fd7e81590b0 2024-08-17T02:22:23.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.958+0000 7fd7e759e700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7e80cba00 con 0x7fd7e8067510 2024-08-17T02:22:23.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.958+0000 7fd7e759e700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7e80cdc90 con 0x7fd7e8159480 2024-08-17T02:22:23.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.962+0000 7fd7e5d9b700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fd7e8067510 0x7fd7e80ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:23.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.962+0000 7fd7e659c700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fd7e81590b0 0x7fd7e8066e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:42026/0 (socket says 172.21.15.104:42026) 2024-08-17T02:22:23.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.962+0000 7fd7e659c700 1 -- 172.21.15.104:0/4158448524 learned_addr learned my addr 172.21.15.104:0/4158448524 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:23.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.962+0000 7fd7e6d9d700 1 --2- 172.21.15.104:0/4158448524 >> v2:172.21.15.117:3300/0 conn(0x7fd7e8159480 0x7fd7e80cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:23.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.962+0000 7fd7e5d9b700 1 -- 172.21.15.104:0/4158448524 >> v2:172.21.15.117:3300/0 conn(0x7fd7e8159480 msgr2=0x7fd7e80cebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:23.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.962+0000 7fd7e5d9b700 1 --2- 172.21.15.104:0/4158448524 >> v2:172.21.15.117:3300/0 conn(0x7fd7e8159480 0x7fd7e80cebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:23.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.962+0000 7fd7e5d9b700 1 -- 172.21.15.104:0/4158448524 >> v1:172.21.15.104:6789/0 conn(0x7fd7e81590b0 legacy=0x7fd7e8066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:23.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.962+0000 7fd7e5d9b700 1 -- 172.21.15.104:0/4158448524 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e80cb440 con 0x7fd7e8067510 2024-08-17T02:22:23.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.962+0000 7fd7e5d9b700 1 --2- 172.21.15.104:0/4158448524 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7e8067510 0x7fd7e80ce6a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8071060 tx=0x7fd7d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6fc6d76d0fef669 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:23.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.962+0000 7fd7e559a700 1 -- 172.21.15.104:0/4158448524 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d8011630 con 0x7fd7e8067510 2024-08-17T02:22:23.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.962+0000 7fd7e559a700 1 -- 172.21.15.104:0/4158448524 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d8011790 con 0x7fd7e8067510 2024-08-17T02:22:23.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.962+0000 7fd7e559a700 1 -- 172.21.15.104:0/4158448524 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d8011b30 con 0x7fd7e8067510 2024-08-17T02:22:23.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.962+0000 7fd7e759e700 1 -- 172.21.15.104:0/4158448524 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7e8067510 msgr2=0x7fd7e80ce6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:23.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.962+0000 7fd7e759e700 1 --2- 172.21.15.104:0/4158448524 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7e8067510 0x7fd7e80ce6a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8071060 tx=0x7fd7d80091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:23.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.962+0000 7fd7e759e700 1 -- 172.21.15.104:0/4158448524 shutdown_connections 2024-08-17T02:22:23.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.962+0000 7fd7e759e700 1 --2- 172.21.15.104:0/4158448524 >> v2:172.21.15.117:3300/0 conn(0x7fd7e8159480 0x7fd7e80cebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:23.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.962+0000 7fd7e759e700 1 --2- 172.21.15.104:0/4158448524 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7e8067510 0x7fd7e80ce6a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:23.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.962+0000 7fd7e759e700 1 -- 172.21.15.104:0/4158448524 >> 172.21.15.104:0/4158448524 conn(0x7fd7e80d0b90 msgr2=0x7fd7e80ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:23.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.962+0000 7fd7e759e700 1 -- 172.21.15.104:0/4158448524 shutdown_connections 2024-08-17T02:22:23.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.962+0000 7fd7e759e700 1 -- 172.21.15.104:0/4158448524 wait complete. 2024-08-17T02:22:23.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.962+0000 7fd7e759e700 1 Processor -- start 2024-08-17T02:22:23.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.962+0000 7fd7e759e700 1 -- start start 2024-08-17T02:22:23.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.966+0000 7fd7e759e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7e8067510 0x7fd7e8143b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:23.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.966+0000 7fd7e759e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7e81590b0 0x7fd7e815d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:23.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.966+0000 7fd7e759e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7e8159480 0x7fd7e815dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:23.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.966+0000 7fd7e759e700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e8154bd0 con 0x7fd7e8159480 2024-08-17T02:22:23.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.966+0000 7fd7e759e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e80b2e60 con 0x7fd7e8067510 2024-08-17T02:22:23.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.966+0000 7fd7e759e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e80b3140 con 0x7fd7e81590b0 2024-08-17T02:22:23.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.966+0000 7fd7e6d9d700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7e8159480 0x7fd7e815dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:23.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.966+0000 7fd7e6d9d700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7e8159480 0x7fd7e815dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45662/0 (socket says 172.21.15.104:45662) 2024-08-17T02:22:23.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.966+0000 7fd7e6d9d700 1 -- 172.21.15.104:0/4125581792 learned_addr learned my addr 172.21.15.104:0/4125581792 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:23.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.966+0000 7fd7e659c700 1 --2- 172.21.15.104:0/4125581792 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7e8067510 0x7fd7e8143b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:23.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.966+0000 7fd7e5d9b700 1 --2- 172.21.15.104:0/4125581792 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7e81590b0 0x7fd7e815d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:23.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.966+0000 7fd7e6d9d700 1 -- 172.21.15.104:0/4125581792 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7e81590b0 msgr2=0x7fd7e815d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:23.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.966+0000 7fd7e6d9d700 1 --2- 172.21.15.104:0/4125581792 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7e81590b0 0x7fd7e815d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:23.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.966+0000 7fd7e6d9d700 1 -- 172.21.15.104:0/4125581792 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7e8067510 msgr2=0x7fd7e8143b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:23.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.966+0000 7fd7e6d9d700 1 --2- 172.21.15.104:0/4125581792 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7e8067510 0x7fd7e8143b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:23.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.966+0000 7fd7e6d9d700 1 -- 172.21.15.104:0/4125581792 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d8009420 con 0x7fd7e8159480 2024-08-17T02:22:23.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.966+0000 7fd7e659c700 1 --2- 172.21.15.104:0/4125581792 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7e8067510 0x7fd7e8143b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:22:23.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.966+0000 7fd7e6d9d700 1 --2- 172.21.15.104:0/4125581792 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7e8159480 0x7fd7e815dab0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0009e20 tx=0x7fd7e000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:23.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.966+0000 7fd7d67fc700 1 -- 172.21.15.104:0/4125581792 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e000cb50 con 0x7fd7e8159480 2024-08-17T02:22:23.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.966+0000 7fd7d67fc700 1 -- 172.21.15.104:0/4125581792 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e000f040 con 0x7fd7e8159480 2024-08-17T02:22:23.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.966+0000 7fd7e759e700 1 -- 172.21.15.104:0/4125581792 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7e81440b0 con 0x7fd7e8159480 2024-08-17T02:22:23.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.966+0000 7fd7d67fc700 1 -- 172.21.15.104:0/4125581792 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e0014480 con 0x7fd7e8159480 2024-08-17T02:22:23.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.966+0000 7fd7e759e700 1 -- 172.21.15.104:0/4125581792 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7e8152ad0 con 0x7fd7e8159480 2024-08-17T02:22:23.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.970+0000 7fd7d67fc700 1 -- 172.21.15.104:0/4125581792 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd7e0014830 con 0x7fd7e8159480 2024-08-17T02:22:23.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.970+0000 7fd7e759e700 1 -- 172.21.15.104:0/4125581792 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7e8064330 con 0x7fd7e8159480 2024-08-17T02:22:23.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.970+0000 7fd7d67fc700 1 --2- 172.21.15.104:0/4125581792 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fd7c8060860 0x7fd7c8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:23.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.970+0000 7fd7d67fc700 1 -- 172.21.15.104:0/4125581792 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd7e007d450 con 0x7fd7e8159480 2024-08-17T02:22:23.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.970+0000 7fd7e659c700 1 --2- 172.21.15.104:0/4125581792 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fd7c8060860 0x7fd7c8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:23.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.970+0000 7fd7e659c700 1 --2- 172.21.15.104:0/4125581792 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fd7c8060860 0x7fd7c8062d10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc0018c0 tx=0x7fd7dc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:23.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:23.982+0000 7fd7d67fc700 1 -- 172.21.15.104:0/4125581792 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd7e004d8a0 con 0x7fd7e8159480 2024-08-17T02:22:24.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:24.182+0000 7fd7e759e700 1 -- 172.21.15.104:0/4125581792 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd7e8158900 con 0x7fd7e8159480 2024-08-17T02:22:25.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.194+0000 7fd7d67fc700 1 -- 172.21.15.104:0/4125581792 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd7e0050ec0 con 0x7fd7e8159480 2024-08-17T02:22:25.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.202+0000 7fd7e759e700 1 -- 172.21.15.104:0/4125581792 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fd7c8060860 msgr2=0x7fd7c8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:25.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.202+0000 7fd7e759e700 1 --2- 172.21.15.104:0/4125581792 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fd7c8060860 0x7fd7c8062d10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc0018c0 tx=0x7fd7dc009040 comp rx=0 tx=0).stop 2024-08-17T02:22:25.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.202+0000 7fd7e759e700 1 -- 172.21.15.104:0/4125581792 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7e8159480 msgr2=0x7fd7e815dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:25.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.202+0000 7fd7e759e700 1 --2- 172.21.15.104:0/4125581792 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7e8159480 0x7fd7e815dab0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0009e20 tx=0x7fd7e000b040 comp rx=0 tx=0).stop 2024-08-17T02:22:25.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.202+0000 7fd7e759e700 1 -- 172.21.15.104:0/4125581792 shutdown_connections 2024-08-17T02:22:25.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.202+0000 7fd7e759e700 1 --2- 172.21.15.104:0/4125581792 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fd7c8060860 0x7fd7c8062d10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:25.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.202+0000 7fd7e759e700 1 --2- 172.21.15.104:0/4125581792 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7e8159480 0x7fd7e815dab0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:25.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.202+0000 7fd7e759e700 1 --2- 172.21.15.104:0/4125581792 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7e81590b0 0x7fd7e815d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:25.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.202+0000 7fd7e759e700 1 --2- 172.21.15.104:0/4125581792 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7e8067510 0x7fd7e8143b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:25.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.202+0000 7fd7e759e700 1 -- 172.21.15.104:0/4125581792 >> 172.21.15.104:0/4125581792 conn(0x7fd7e80d0b90 msgr2=0x7fd7e8066e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:25.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.202+0000 7fd7e759e700 1 -- 172.21.15.104:0/4125581792 shutdown_connections 2024-08-17T02:22:25.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.202+0000 7fd7e759e700 1 -- 172.21.15.104:0/4125581792 wait complete. 2024-08-17T02:22:25.220 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:22:25.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.322+0000 7f4631dd3700 1 Processor -- start 2024-08-17T02:22:25.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.322+0000 7f4631dd3700 1 -- start start 2024-08-17T02:22:25.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.322+0000 7f4631dd3700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f462c0af030 0x7f462c0a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:25.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.322+0000 7f4631dd3700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f462c0a9260 0x7f462c0b0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:25.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.322+0000 7f4631dd3700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f462c0b0270 con 0x7f462c15d540 2024-08-17T02:22:25.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.322+0000 7f4631dd3700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f462c0af480 con 0x7f462c0a9260 2024-08-17T02:22:25.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.322+0000 7f4631dd3700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f462c0af660 con 0x7f462c0af030 2024-08-17T02:22:25.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.322+0000 7f462b7fe700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f462c15d540 0x7f462c06e830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:42034/0 (socket says 172.21.15.104:42034) 2024-08-17T02:22:25.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.322+0000 7f462b7fe700 1 -- 172.21.15.104:0/4287055761 learned_addr learned my addr 172.21.15.104:0/4287055761 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:25.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.322+0000 7f462bfff700 1 --2- 172.21.15.104:0/4287055761 >> v2:172.21.15.104:3300/0 conn(0x7f462c0a9260 0x7f462c0b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:25.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.322+0000 7f4622ffd700 1 --2- 172.21.15.104:0/4287055761 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f462c0af030 0x7f462c0a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:25.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.322+0000 7f462affd700 1 -- 172.21.15.104:0/4287055761 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2779835805 0 0) 0x7f462c0b0270 con 0x7f462c15d540 2024-08-17T02:22:25.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.322+0000 7f462affd700 1 -- 172.21.15.104:0/4287055761 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4618003570 con 0x7f462c15d540 2024-08-17T02:22:25.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.322+0000 7f4622ffd700 1 -- 172.21.15.104:0/4287055761 >> v2:172.21.15.104:3300/0 conn(0x7f462c0a9260 msgr2=0x7f462c0b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:25.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.322+0000 7f462affd700 1 -- 172.21.15.104:0/4287055761 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1087525889 0 0) 0x7f4618003570 con 0x7f462c15d540 2024-08-17T02:22:25.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.322+0000 7f4622ffd700 1 --2- 172.21.15.104:0/4287055761 >> v2:172.21.15.104:3300/0 conn(0x7f462c0a9260 0x7f462c0b0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:25.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.322+0000 7f4622ffd700 1 -- 172.21.15.104:0/4287055761 >> v1:172.21.15.104:6789/0 conn(0x7f462c15d540 legacy=0x7f462c06e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:25.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.322+0000 7f4622ffd700 1 -- 172.21.15.104:0/4287055761 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f462c0af940 con 0x7f462c0af030 2024-08-17T02:22:25.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.322+0000 7f462bfff700 1 --2- 172.21.15.104:0/4287055761 >> v2:172.21.15.104:3300/0 conn(0x7f462c0a9260 0x7f462c0b0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:22:25.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.322+0000 7f4622ffd700 1 --2- 172.21.15.104:0/4287055761 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f462c0af030 0x7f462c0a8d20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f46140098e0 tx=0x7f46140091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f38c91f1555a349 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:25.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.322+0000 7f462affd700 1 -- 172.21.15.104:0/4287055761 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461c001470 con 0x7f462c0af030 2024-08-17T02:22:25.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.322+0000 7f462affd700 1 -- 172.21.15.104:0/4287055761 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4614011420 con 0x7f462c0af030 2024-08-17T02:22:25.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.322+0000 7f462affd700 1 -- 172.21.15.104:0/4287055761 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46140117a0 con 0x7f462c0af030 2024-08-17T02:22:25.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.322+0000 7f4631dd3700 1 -- 172.21.15.104:0/4287055761 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f462c0af030 msgr2=0x7f462c0a8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:25.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.322+0000 7f4631dd3700 1 --2- 172.21.15.104:0/4287055761 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f462c0af030 0x7f462c0a8d20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f46140098e0 tx=0x7f46140091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:25.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.322+0000 7f4631dd3700 1 -- 172.21.15.104:0/4287055761 shutdown_connections 2024-08-17T02:22:25.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.322+0000 7f4631dd3700 1 --2- 172.21.15.104:0/4287055761 >> v2:172.21.15.104:3300/0 conn(0x7f462c0a9260 0x7f462c0b0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:25.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.322+0000 7f4631dd3700 1 --2- 172.21.15.104:0/4287055761 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f462c0af030 0x7f462c0a8d20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:25.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.322+0000 7f4631dd3700 1 -- 172.21.15.104:0/4287055761 >> 172.21.15.104:0/4287055761 conn(0x7f462c066e00 msgr2=0x7f462c067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:25.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.326+0000 7f4631dd3700 1 -- 172.21.15.104:0/4287055761 shutdown_connections 2024-08-17T02:22:25.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.326+0000 7f4631dd3700 1 -- 172.21.15.104:0/4287055761 wait complete. 2024-08-17T02:22:25.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.326+0000 7f4631dd3700 1 Processor -- start 2024-08-17T02:22:25.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.326+0000 7f4631dd3700 1 -- start start 2024-08-17T02:22:25.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.326+0000 7f4631dd3700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f462c0a9260 0x7f462c0c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:25.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.326+0000 7f4631dd3700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f462c0af030 0x7f462c098590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:25.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.326+0000 7f4631dd3700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f462c15d540 0x7f462c170cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:25.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.326+0000 7f4631dd3700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462c15aef0 con 0x7f462c0af030 2024-08-17T02:22:25.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.326+0000 7f4631dd3700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462c098fc0 con 0x7f462c15d540 2024-08-17T02:22:25.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.326+0000 7f4631dd3700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f462c15a5c0 con 0x7f462c0a9260 2024-08-17T02:22:25.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.326+0000 7f4622ffd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f462c0af030 0x7f462c098590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:25.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.326+0000 7f462b7fe700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f462c0a9260 0x7f462c0c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:25.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.326+0000 7f4622ffd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f462c0af030 0x7f462c098590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45676/0 (socket says 172.21.15.104:45676) 2024-08-17T02:22:25.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.330+0000 7f462b7fe700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f462c0a9260 0x7f462c0c7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.104:34986/0 (socket says 172.21.15.104:34986) 2024-08-17T02:22:25.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.330+0000 7f4622ffd700 1 -- 172.21.15.104:0/626340234 learned_addr learned my addr 172.21.15.104:0/626340234 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:25.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.330+0000 7f462bfff700 1 --2- 172.21.15.104:0/626340234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f462c15d540 0x7f462c170cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:25.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.330+0000 7f4622ffd700 1 -- 172.21.15.104:0/626340234 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f462c0a9260 msgr2=0x7f462c0c7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:25.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.330+0000 7f4622ffd700 1 --2- 172.21.15.104:0/626340234 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f462c0a9260 0x7f462c0c7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:25.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.330+0000 7f4622ffd700 1 -- 172.21.15.104:0/626340234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f462c15d540 msgr2=0x7f462c170cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:25.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.330+0000 7f4622ffd700 1 --2- 172.21.15.104:0/626340234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f462c15d540 0x7f462c170cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:25.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.330+0000 7f4622ffd700 1 -- 172.21.15.104:0/626340234 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4624009a20 con 0x7f462c0af030 2024-08-17T02:22:25.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.330+0000 7f4622ffd700 1 --2- 172.21.15.104:0/626340234 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f462c0af030 0x7f462c098590 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f462c06f870 tx=0x7f4614016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:25.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.330+0000 7f4623fff700 1 -- 172.21.15.104:0/626340234 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461401caf0 con 0x7f462c0af030 2024-08-17T02:22:25.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.330+0000 7f4623fff700 1 -- 172.21.15.104:0/626340234 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f461401cc70 con 0x7f462c0af030 2024-08-17T02:22:25.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.330+0000 7f4631dd3700 1 -- 172.21.15.104:0/626340234 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4614009420 con 0x7f462c0af030 2024-08-17T02:22:25.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.330+0000 7f4623fff700 1 -- 172.21.15.104:0/626340234 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461401a450 con 0x7f462c0af030 2024-08-17T02:22:25.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.330+0000 7f4631dd3700 1 -- 172.21.15.104:0/626340234 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f462c15ab80 con 0x7f462c0af030 2024-08-17T02:22:25.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.330+0000 7f4631dd3700 1 -- 172.21.15.104:0/626340234 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f462c15b060 con 0x7f462c0af030 2024-08-17T02:22:25.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.330+0000 7f4623fff700 1 -- 172.21.15.104:0/626340234 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f461401a7e0 con 0x7f462c0af030 2024-08-17T02:22:25.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.334+0000 7f4623fff700 1 --2- 172.21.15.104:0/626340234 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f460c060860 0x7f460c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:25.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.334+0000 7f4623fff700 1 -- 172.21.15.104:0/626340234 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f461407e2c0 con 0x7f462c0af030 2024-08-17T02:22:25.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.334+0000 7f462b7fe700 1 --2- 172.21.15.104:0/626340234 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f460c060860 0x7f460c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:25.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.334+0000 7f462b7fe700 1 --2- 172.21.15.104:0/626340234 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f460c060860 0x7f460c062d10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f461c000c00 tx=0x7f461c001930 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:25.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.338+0000 7f4623fff700 1 -- 172.21.15.104:0/626340234 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f461404e880 con 0x7f462c0af030 2024-08-17T02:22:25.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.538+0000 7f4631dd3700 1 -- 172.21.15.104:0/626340234 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f462c0645c0 con 0x7f462c0af030 2024-08-17T02:22:25.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.538+0000 7f4623fff700 1 -- 172.21.15.104:0/626340234 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4603 (secure 0 0 0) 0x7f4614051ea0 con 0x7f462c0af030 2024-08-17T02:22:25.545 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:22:25.545 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/1242386459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":1242386459},{"type":"v1","addr":"172.21.15.104:6835","nonce":1242386459}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/2581980475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2581980475},{"type":"v1","addr":"172.21.15.104:6833","nonce":2581980475}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1039240942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1039240942},{"type":"v1","addr":"172.21.15.117:6835","nonce":1039240942}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:22:21.527207+0000","modified":"2024-08-17T02:22:25.187188+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/4197149840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":4197149840},{"type":"v1","addr":"172.21.15.117:6837","nonce":4197149840}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:22:25.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.542+0000 7f4631dd3700 1 -- 172.21.15.104:0/626340234 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f460c060860 msgr2=0x7f460c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:25.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.542+0000 7f4631dd3700 1 --2- 172.21.15.104:0/626340234 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f460c060860 0x7f460c062d10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f461c000c00 tx=0x7f461c001930 comp rx=0 tx=0).stop 2024-08-17T02:22:25.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.542+0000 7f4631dd3700 1 -- 172.21.15.104:0/626340234 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f462c0af030 msgr2=0x7f462c098590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:25.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.542+0000 7f4631dd3700 1 --2- 172.21.15.104:0/626340234 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f462c0af030 0x7f462c098590 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f462c06f870 tx=0x7f4614016000 comp rx=0 tx=0).stop 2024-08-17T02:22:25.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.542+0000 7f4631dd3700 1 -- 172.21.15.104:0/626340234 shutdown_connections 2024-08-17T02:22:25.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.542+0000 7f4631dd3700 1 --2- 172.21.15.104:0/626340234 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f460c060860 0x7f460c062d10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:25.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.542+0000 7f4631dd3700 1 --2- 172.21.15.104:0/626340234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f462c15d540 0x7f462c170cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:25.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.542+0000 7f4631dd3700 1 --2- 172.21.15.104:0/626340234 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f462c0af030 0x7f462c098590 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:25.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.542+0000 7f4631dd3700 1 --2- 172.21.15.104:0/626340234 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f462c0a9260 0x7f462c0c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:25.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.542+0000 7f4631dd3700 1 -- 172.21.15.104:0/626340234 >> 172.21.15.104:0/626340234 conn(0x7f462c066e00 msgr2=0x7f462c06a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:25.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.542+0000 7f4631dd3700 1 -- 172.21.15.104:0/626340234 shutdown_connections 2024-08-17T02:22:25.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.542+0000 7f4631dd3700 1 -- 172.21.15.104:0/626340234 wait complete. 2024-08-17T02:22:25.549 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 7 2024-08-17T02:22:25.559 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:22:25.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.658+0000 7f355e86f700 1 Processor -- start 2024-08-17T02:22:25.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.658+0000 7f355e86f700 1 -- start start 2024-08-17T02:22:25.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.658+0000 7f355e86f700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f355815a200 0x7f35580b2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:25.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.658+0000 7f355e86f700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f355815a5d0 0x7f35580cb450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:25.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.658+0000 7f355e86f700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35580ca3b0 con 0x7f35580c8720 2024-08-17T02:22:25.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.658+0000 7f355e86f700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35580ca690 con 0x7f355815a5d0 2024-08-17T02:22:25.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.658+0000 7f355e86f700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35580ca970 con 0x7f355815a200 2024-08-17T02:22:25.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.658+0000 7f355d86d700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f355815a200 0x7f35580b2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:25.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.658+0000 7f355e06e700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f355815a5d0 0x7f35580cb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:25.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.658+0000 7f355d86d700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f355815a200 0x7f35580b2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.104:34988/0 (socket says 172.21.15.104:34988) 2024-08-17T02:22:25.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.658+0000 7f355d86d700 1 -- 172.21.15.104:0/3167243900 learned_addr learned my addr 172.21.15.104:0/3167243900 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:25.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.658+0000 7f355d86d700 1 -- 172.21.15.104:0/3167243900 >> v2:172.21.15.117:3300/0 conn(0x7f355815a5d0 msgr2=0x7f35580cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:25.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.658+0000 7f355d86d700 1 --2- 172.21.15.104:0/3167243900 >> v2:172.21.15.117:3300/0 conn(0x7f355815a5d0 0x7f35580cb450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:25.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.658+0000 7f355d86d700 1 -- 172.21.15.104:0/3167243900 >> v1:172.21.15.117:6789/0 conn(0x7f35580c8720 legacy=0x7f35580abe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:25.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.658+0000 7f355d86d700 1 -- 172.21.15.104:0/3167243900 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35580cac50 con 0x7f355815a200 2024-08-17T02:22:25.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.658+0000 7f355e06e700 1 --2- 172.21.15.104:0/3167243900 >> v2:172.21.15.117:3300/0 conn(0x7f355815a5d0 0x7f35580cb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:22:25.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.662+0000 7f355d86d700 1 --2- 172.21.15.104:0/3167243900 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f355815a200 0x7f35580b2110 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f354c0099b0 tx=0x7f354c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df286125ab65fc61 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:25.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.662+0000 7f355c86b700 1 -- 172.21.15.104:0/3167243900 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354c009ea0 con 0x7f355815a200 2024-08-17T02:22:25.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.662+0000 7f355c86b700 1 -- 172.21.15.104:0/3167243900 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354c00b860 con 0x7f355815a200 2024-08-17T02:22:25.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.662+0000 7f355c86b700 1 -- 172.21.15.104:0/3167243900 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354c00bc00 con 0x7f355815a200 2024-08-17T02:22:25.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.662+0000 7f355e86f700 1 -- 172.21.15.104:0/3167243900 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f355815a200 msgr2=0x7f35580b2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:25.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.662+0000 7f355e86f700 1 --2- 172.21.15.104:0/3167243900 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f355815a200 0x7f35580b2110 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f354c0099b0 tx=0x7f354c009250 comp rx=0 tx=0).stop 2024-08-17T02:22:25.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.662+0000 7f355e86f700 1 -- 172.21.15.104:0/3167243900 shutdown_connections 2024-08-17T02:22:25.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.662+0000 7f355e86f700 1 --2- 172.21.15.104:0/3167243900 >> v2:172.21.15.117:3300/0 conn(0x7f355815a5d0 0x7f35580cb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:25.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.662+0000 7f355e86f700 1 --2- 172.21.15.104:0/3167243900 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f355815a200 0x7f35580b2110 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:25.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.662+0000 7f355e86f700 1 -- 172.21.15.104:0/3167243900 >> 172.21.15.104:0/3167243900 conn(0x7f355806d800 msgr2=0x7f355806dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:25.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.662+0000 7f355e86f700 1 -- 172.21.15.104:0/3167243900 shutdown_connections 2024-08-17T02:22:25.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.662+0000 7f355e86f700 1 -- 172.21.15.104:0/3167243900 wait complete. 2024-08-17T02:22:25.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.662+0000 7f355e86f700 1 Processor -- start 2024-08-17T02:22:25.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.662+0000 7f355e86f700 1 -- start start 2024-08-17T02:22:25.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.666+0000 7f355e86f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35580c8720 0x7f3558153000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:25.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.666+0000 7f355e86f700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f355815a200 0x7f3558154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:25.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.666+0000 7f355e86f700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f355815a5d0 0x7f355813eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:25.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.666+0000 7f355e86f700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3558153540 con 0x7f355815a5d0 2024-08-17T02:22:25.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.666+0000 7f355e86f700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3558155cf0 con 0x7f35580c8720 2024-08-17T02:22:25.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.666+0000 7f355e86f700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3558154e90 con 0x7f355815a200 2024-08-17T02:22:25.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.666+0000 7f355e06e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f355815a5d0 0x7f355813eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:25.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.666+0000 7f355e06e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f355815a5d0 0x7f355813eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45680/0 (socket says 172.21.15.104:45680) 2024-08-17T02:22:25.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.666+0000 7f355e06e700 1 -- 172.21.15.104:0/516504929 learned_addr learned my addr 172.21.15.104:0/516504929 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:25.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.666+0000 7f355d06c700 1 --2- 172.21.15.104:0/516504929 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f355815a200 0x7f3558154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:25.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.666+0000 7f355d86d700 1 --2- 172.21.15.104:0/516504929 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35580c8720 0x7f3558153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:25.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.666+0000 7f355e06e700 1 -- 172.21.15.104:0/516504929 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f355815a200 msgr2=0x7f3558154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:25.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.666+0000 7f355e06e700 1 --2- 172.21.15.104:0/516504929 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f355815a200 0x7f3558154950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:25.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.666+0000 7f355e06e700 1 -- 172.21.15.104:0/516504929 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35580c8720 msgr2=0x7f3558153000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:25.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.666+0000 7f355e06e700 1 --2- 172.21.15.104:0/516504929 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35580c8720 0x7f3558153000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:25.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.666+0000 7f355e06e700 1 -- 172.21.15.104:0/516504929 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3550009420 con 0x7f355815a5d0 2024-08-17T02:22:25.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.666+0000 7f355e06e700 1 --2- 172.21.15.104:0/516504929 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f355815a5d0 0x7f355813eec0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f355000ec80 tx=0x7f35500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:25.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.666+0000 7f3549ffb700 1 -- 172.21.15.104:0/516504929 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3550009720 con 0x7f355815a5d0 2024-08-17T02:22:25.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.666+0000 7f3549ffb700 1 -- 172.21.15.104:0/516504929 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355000c850 con 0x7f355815a5d0 2024-08-17T02:22:25.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.666+0000 7f355e86f700 1 -- 172.21.15.104:0/516504929 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f354c0094f0 con 0x7f355815a5d0 2024-08-17T02:22:25.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.666+0000 7f3549ffb700 1 -- 172.21.15.104:0/516504929 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355000cc10 con 0x7f355815a5d0 2024-08-17T02:22:25.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.666+0000 7f355e86f700 1 -- 172.21.15.104:0/516504929 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35581553c0 con 0x7f355815a5d0 2024-08-17T02:22:25.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.666+0000 7f355e86f700 1 -- 172.21.15.104:0/516504929 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3558155e60 con 0x7f355815a5d0 2024-08-17T02:22:25.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.666+0000 7f3549ffb700 1 -- 172.21.15.104:0/516504929 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f3550013470 con 0x7f355815a5d0 2024-08-17T02:22:25.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.670+0000 7f3549ffb700 1 --2- 172.21.15.104:0/516504929 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f353c060890 0x7f353c062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:25.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.670+0000 7f3549ffb700 1 -- 172.21.15.104:0/516504929 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f355007caa0 con 0x7f355815a5d0 2024-08-17T02:22:25.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.670+0000 7f355d86d700 1 --2- 172.21.15.104:0/516504929 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f353c060890 0x7f353c062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:25.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.670+0000 7f355d86d700 1 --2- 172.21.15.104:0/516504929 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f353c060890 0x7f353c062d40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f354c0099b0 tx=0x7f354c017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:25.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.674+0000 7f3549ffb700 1 -- 172.21.15.104:0/516504929 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f355004cef0 con 0x7f355815a5d0 2024-08-17T02:22:25.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.834+0000 7f355e86f700 1 -- 172.21.15.104:0/516504929 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35580638f0 con 0x7f355815a5d0 2024-08-17T02:22:25.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.834+0000 7f3549ffb700 1 -- 172.21.15.104:0/516504929 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f3550050510 con 0x7f355815a5d0 2024-08-17T02:22:25.843 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:22:25.843 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":23,"fsid":"fd5f7fb8-d34b-49bb-89a8-62b7dad1bc25","created":"2024-08-17T02:21:57.891389+0000","modified":"2024-08-17T02:22:23.175831+0000","last_up_change":"2024-08-17T02:22:08.924546+0000","last_in_change":"2024-08-17T02:21:59.938028+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:22:10.143970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:22:20.082708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:22:20.521582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"606b9088-590e-4709-aa3a-b0f6e22972ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":24257},{"type":"v1","addr":"172.21.15.104:6809","nonce":24257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":24257},{"type":"v1","addr":"172.21.15.104:6811","nonce":24257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":24257},{"type":"v1","addr":"172.21.15.104:6815","nonce":24257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":24257},{"type":"v1","addr":"172.21.15.104:6813","nonce":24257}]},"public_addr":"172.21.15.104:6809/24257","cluster_addr":"172.21.15.104:6811/24257","heartbeat_back_addr":"172.21.15.104:6815/24257","heartbeat_front_addr":"172.21.15.104:6813/24257","state":["exists","up"]},{"osd":1,"uuid":"9bc6a909-0c2f-4889-afe7-4a47f89b0f64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":24256},{"type":"v1","addr":"172.21.15.104:6825","nonce":24256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":24256},{"type":"v1","addr":"172.21.15.104:6827","nonce":24256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":24256},{"type":"v1","addr":"172.21.15.104:6831","nonce":24256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":24256},{"type":"v1","addr":"172.21.15.104:6829","nonce":24256}]},"public_addr":"172.21.15.104:6825/24256","cluster_addr":"172.21.15.104:6827/24256","heartbeat_back_addr":"172.21.15.104:6831/24256","heartbeat_front_addr":"172.21.15.104:6829/24256","state":["exists","up"]},{"osd":2,"uuid":"23da31d5-aefb-4edb-b79d-fa05e1becef7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":24255},{"type":"v1","addr":"172.21.15.104:6817","nonce":24255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":24255},{"type":"v1","addr":"172.21.15.104:6819","nonce":24255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":24255},{"type":"v1","addr":"172.21.15.104:6823","nonce":24255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":24255},{"type":"v1","addr":"172.21.15.104:6821","nonce":24255}]},"public_addr":"172.21.15.104:6817/24255","cluster_addr":"172.21.15.104:6819/24255","heartbeat_back_addr":"172.21.15.104:6823/24255","heartbeat_front_addr":"172.21.15.104:6821/24255","state":["exists","up"]},{"osd":3,"uuid":"6e4a5ec2-b415-45ef-8381-61a59eb65224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":24254},{"type":"v1","addr":"172.21.15.104:6801","nonce":24254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":24254},{"type":"v1","addr":"172.21.15.104:6803","nonce":24254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":24254},{"type":"v1","addr":"172.21.15.104:6807","nonce":24254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":24254},{"type":"v1","addr":"172.21.15.104:6805","nonce":24254}]},"public_addr":"172.21.15.104:6801/24254","cluster_addr":"172.21.15.104:6803/24254","heartbeat_back_addr":"172.21.15.104:6807/24254","heartbeat_front_addr":"172.21.15.104:6805/24254","state":["exists","up"]},{"osd":4,"uuid":"8d5bea2d-9039-4013-8c99-2c046c5b8a17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":24421},{"type":"v1","addr":"172.21.15.117:6804","nonce":24421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":24421},{"type":"v1","addr":"172.21.15.117:6809","nonce":24421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":24421},{"type":"v1","addr":"172.21.15.117:6815","nonce":24421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":24421},{"type":"v1","addr":"172.21.15.117:6813","nonce":24421}]},"public_addr":"172.21.15.117:6804/24421","cluster_addr":"172.21.15.117:6809/24421","heartbeat_back_addr":"172.21.15.117:6815/24421","heartbeat_front_addr":"172.21.15.117:6813/24421","state":["exists","up"]},{"osd":5,"uuid":"de8b36fc-121c-4f05-8f5b-28f513d9f21f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":24422},{"type":"v1","addr":"172.21.15.117:6817","nonce":24422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":24422},{"type":"v1","addr":"172.21.15.117:6819","nonce":24422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":24422},{"type":"v1","addr":"172.21.15.117:6823","nonce":24422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":24422},{"type":"v1","addr":"172.21.15.117:6821","nonce":24422}]},"public_addr":"172.21.15.117:6817/24422","cluster_addr":"172.21.15.117:6819/24422","heartbeat_back_addr":"172.21.15.117:6823/24422","heartbeat_front_addr":"172.21.15.117:6821/24422","state":["exists","up"]},{"osd":6,"uuid":"6a87f09f-7bf7-4f7a-be87-530ac1ff8ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":24420},{"type":"v1","addr":"172.21.15.117:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6803","nonce":24420},{"type":"v1","addr":"172.21.15.117:6805","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":24420},{"type":"v1","addr":"172.21.15.117:6811","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":24420},{"type":"v1","addr":"172.21.15.117:6808","nonce":24420}]},"public_addr":"172.21.15.117:6801/24420","cluster_addr":"172.21.15.117:6805/24420","heartbeat_back_addr":"172.21.15.117:6811/24420","heartbeat_front_addr":"172.21.15.117:6808/24420","state":["exists","up"]},{"osd":7,"uuid":"e31d8041-1aa1-4b5d-83b3-0a373426dd9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":24423},{"type":"v1","addr":"172.21.15.117:6825","nonce":24423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":24423},{"type":"v1","addr":"172.21.15.117:6827","nonce":24423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":24423},{"type":"v1","addr":"172.21.15.117:6831","nonce":24423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":24423},{"type":"v1","addr":"172.21.15.117:6829","nonce":24423}]},"public_addr":"172.21.15.117:6825/24423","cluster_addr":"172.21.15.117:6827/24423","heartbeat_back_addr":"172.21.15.117:6831/24423","heartbeat_front_addr":"172.21.15.117:6829/24423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.220874+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.210039+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.434762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.247206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.184316+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.306325+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.035719+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.400303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:22:25.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.838+0000 7f355e86f700 1 -- 172.21.15.104:0/516504929 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f353c060890 msgr2=0x7f353c062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:25.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.838+0000 7f355e86f700 1 --2- 172.21.15.104:0/516504929 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f353c060890 0x7f353c062d40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f354c0099b0 tx=0x7f354c017000 comp rx=0 tx=0).stop 2024-08-17T02:22:25.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.838+0000 7f355e86f700 1 -- 172.21.15.104:0/516504929 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f355815a5d0 msgr2=0x7f355813eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:25.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.838+0000 7f355e86f700 1 --2- 172.21.15.104:0/516504929 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f355815a5d0 0x7f355813eec0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f355000ec80 tx=0x7f35500091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:25.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.838+0000 7f355e86f700 1 -- 172.21.15.104:0/516504929 shutdown_connections 2024-08-17T02:22:25.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.838+0000 7f355e86f700 1 --2- 172.21.15.104:0/516504929 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f353c060890 0x7f353c062d40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:25.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.838+0000 7f355e86f700 1 --2- 172.21.15.104:0/516504929 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f355815a5d0 0x7f355813eec0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:25.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.838+0000 7f355e86f700 1 --2- 172.21.15.104:0/516504929 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f355815a200 0x7f3558154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:25.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.838+0000 7f355e86f700 1 --2- 172.21.15.104:0/516504929 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35580c8720 0x7f3558153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:25.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.838+0000 7f355e86f700 1 -- 172.21.15.104:0/516504929 >> 172.21.15.104:0/516504929 conn(0x7f355806d800 msgr2=0x7f35580cb820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:25.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.838+0000 7f355e86f700 1 -- 172.21.15.104:0/516504929 shutdown_connections 2024-08-17T02:22:25.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.838+0000 7f355e86f700 1 -- 172.21.15.104:0/516504929 wait complete. 2024-08-17T02:22:25.857 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-08-17T02:22:25.857 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:22:25.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.950+0000 7f8cdcd5a700 1 Processor -- start 2024-08-17T02:22:25.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.950+0000 7f8cdcd5a700 1 -- start start 2024-08-17T02:22:25.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.954+0000 7f8cdcd5a700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cd8155fb0 0x7f8cd8156380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:25.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.954+0000 7f8cdcd5a700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8cd80c96c0 0x7f8cd80c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:25.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.954+0000 7f8cdcd5a700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd806a3e0 con 0x7f8cd80b0050 2024-08-17T02:22:25.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.954+0000 7f8cdcd5a700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cd80ca0a0 con 0x7f8cd80c96c0 2024-08-17T02:22:25.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.954+0000 7f8cdcd5a700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd80697d0 con 0x7f8cd8155fb0 2024-08-17T02:22:25.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.954+0000 7f8cd77fe700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cd8155fb0 0x7f8cd8156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:25.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.954+0000 7f8cd77fe700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cd8155fb0 0x7f8cd8156380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.104:35018/0 (socket says 172.21.15.104:35018) 2024-08-17T02:22:25.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.954+0000 7f8cd7fff700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8cd80c96c0 0x7f8cd80c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:25.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.954+0000 7f8cd77fe700 1 -- 172.21.15.104:0/477091594 learned_addr learned my addr 172.21.15.104:0/477091594 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:25.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.954+0000 7f8cd7fff700 1 -- 172.21.15.104:0/477091594 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cd8155fb0 msgr2=0x7f8cd8156380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:25.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.954+0000 7f8cd7fff700 1 --2- 172.21.15.104:0/477091594 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cd8155fb0 0x7f8cd8156380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:25.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.954+0000 7f8cd7fff700 1 -- 172.21.15.104:0/477091594 >> v1:172.21.15.117:6789/0 conn(0x7f8cd80b0050 legacy=0x7f8cd80687a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:25.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.954+0000 7f8cd7fff700 1 -- 172.21.15.104:0/477091594 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd8069ab0 con 0x7f8cd80c96c0 2024-08-17T02:22:25.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.954+0000 7f8cd77fe700 1 --2- 172.21.15.104:0/477091594 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cd8155fb0 0x7f8cd8156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:22:25.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.954+0000 7f8cd7fff700 1 --2- 172.21.15.104:0/477091594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cd80c96c0 0x7f8cd80c9b60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0009e60 tx=0x7f8cd0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2410e38d9153d7b2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:25.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.954+0000 7f8cd6ffd700 1 -- 172.21.15.104:0/477091594 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd000e070 con 0x7f8cd80c96c0 2024-08-17T02:22:25.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.954+0000 7f8cd6ffd700 1 -- 172.21.15.104:0/477091594 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd000bb60 con 0x7f8cd80c96c0 2024-08-17T02:22:25.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.954+0000 7f8cd6ffd700 1 -- 172.21.15.104:0/477091594 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd0012430 con 0x7f8cd80c96c0 2024-08-17T02:22:25.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.958+0000 7f8cdcd5a700 1 -- 172.21.15.104:0/477091594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cd80c96c0 msgr2=0x7f8cd80c9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:25.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.958+0000 7f8cdcd5a700 1 --2- 172.21.15.104:0/477091594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cd80c96c0 0x7f8cd80c9b60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0009e60 tx=0x7f8cd0009780 comp rx=0 tx=0).stop 2024-08-17T02:22:25.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.958+0000 7f8cdcd5a700 1 -- 172.21.15.104:0/477091594 shutdown_connections 2024-08-17T02:22:25.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.958+0000 7f8cdcd5a700 1 --2- 172.21.15.104:0/477091594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cd80c96c0 0x7f8cd80c9b60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:25.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.958+0000 7f8cdcd5a700 1 --2- 172.21.15.104:0/477091594 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cd8155fb0 0x7f8cd8156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:25.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.958+0000 7f8cdcd5a700 1 -- 172.21.15.104:0/477091594 >> 172.21.15.104:0/477091594 conn(0x7f8cd80ccfc0 msgr2=0x7f8cd80c8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:25.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.958+0000 7f8cdcd5a700 1 -- 172.21.15.104:0/477091594 shutdown_connections 2024-08-17T02:22:25.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.958+0000 7f8cdcd5a700 1 -- 172.21.15.104:0/477091594 wait complete. 2024-08-17T02:22:25.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.958+0000 7f8cdcd5a700 1 Processor -- start 2024-08-17T02:22:25.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.958+0000 7f8cdcd5a700 1 -- start start 2024-08-17T02:22:25.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.962+0000 7f8cdcd5a700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cd80b0050 0x7f8cd814ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:25.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.962+0000 7f8cdcd5a700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cd80c96c0 0x7f8cd815a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:25.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.962+0000 7f8cdcd5a700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8cd8155fb0 0x7f8cd8152130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:25.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.962+0000 7f8cdcd5a700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd8159160 con 0x7f8cd8155fb0 2024-08-17T02:22:25.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.962+0000 7f8cdcd5a700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd8158550 con 0x7f8cd80b0050 2024-08-17T02:22:25.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.962+0000 7f8cdcd5a700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd8158830 con 0x7f8cd80c96c0 2024-08-17T02:22:25.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.962+0000 7f8cd7fff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8cd8155fb0 0x7f8cd8152130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:25.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.962+0000 7f8cd77fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cd80b0050 0x7f8cd814ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:25.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.962+0000 7f8cd7fff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8cd8155fb0 0x7f8cd8152130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45684/0 (socket says 172.21.15.104:45684) 2024-08-17T02:22:25.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.962+0000 7f8ccffff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cd80c96c0 0x7f8cd815a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:25.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.962+0000 7f8cd7fff700 1 -- 172.21.15.104:0/3866467186 learned_addr learned my addr 172.21.15.104:0/3866467186 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:25.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.962+0000 7f8cd7fff700 1 -- 172.21.15.104:0/3866467186 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cd80c96c0 msgr2=0x7f8cd815a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:25.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.962+0000 7f8cd7fff700 1 --2- 172.21.15.104:0/3866467186 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cd80c96c0 0x7f8cd815a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:25.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.962+0000 7f8cd7fff700 1 -- 172.21.15.104:0/3866467186 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cd80b0050 msgr2=0x7f8cd814ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:25.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.962+0000 7f8cd7fff700 1 --2- 172.21.15.104:0/3866467186 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cd80b0050 0x7f8cd814ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:25.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.962+0000 7f8cd7fff700 1 -- 172.21.15.104:0/3866467186 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc80094f0 con 0x7f8cd8155fb0 2024-08-17T02:22:25.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.962+0000 7f8ccffff700 1 --2- 172.21.15.104:0/3866467186 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cd80c96c0 0x7f8cd815a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:22:25.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.962+0000 7f8cd7fff700 1 --2- 172.21.15.104:0/3866467186 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8cd8155fb0 0x7f8cd8152130 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8069330 tx=0x7f8cd0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:25.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.962+0000 7f8ccf7fe700 1 -- 172.21.15.104:0/3866467186 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd0012ea0 con 0x7f8cd8155fb0 2024-08-17T02:22:25.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.962+0000 7f8ccf7fe700 1 -- 172.21.15.104:0/3866467186 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd0027470 con 0x7f8cd8155fb0 2024-08-17T02:22:25.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.962+0000 7f8cdcd5a700 1 -- 172.21.15.104:0/3866467186 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd0009a20 con 0x7f8cd8155fb0 2024-08-17T02:22:25.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.962+0000 7f8ccf7fe700 1 -- 172.21.15.104:0/3866467186 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd0027850 con 0x7f8cd8155fb0 2024-08-17T02:22:25.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.962+0000 7f8cdcd5a700 1 -- 172.21.15.104:0/3866467186 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd8158df0 con 0x7f8cd8155fb0 2024-08-17T02:22:25.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.966+0000 7f8cdcd5a700 1 -- 172.21.15.104:0/3866467186 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd81592d0 con 0x7f8cd8155fb0 2024-08-17T02:22:25.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.966+0000 7f8ccf7fe700 1 -- 172.21.15.104:0/3866467186 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8cd0024070 con 0x7f8cd8155fb0 2024-08-17T02:22:25.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.966+0000 7f8ccf7fe700 1 --2- 172.21.15.104:0/3866467186 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8cb8060860 0x7f8cb8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:25.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.966+0000 7f8ccf7fe700 1 -- 172.21.15.104:0/3866467186 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8cd007f640 con 0x7f8cd8155fb0 2024-08-17T02:22:25.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.966+0000 7f8cd77fe700 1 --2- 172.21.15.104:0/3866467186 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8cb8060860 0x7f8cb8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:25.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.966+0000 7f8cd77fe700 1 --2- 172.21.15.104:0/3866467186 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8cb8060860 0x7f8cb8062d10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8006d20 tx=0x7f8cc8009250 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:25.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:25.974+0000 7f8ccf7fe700 1 -- 172.21.15.104:0/3866467186 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f8cd004fa90 con 0x7f8cd8155fb0 2024-08-17T02:22:26.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.134+0000 7f8cdcd5a700 1 -- 172.21.15.104:0/3866467186 --> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8cd80c8760 con 0x7f8cb8060860 2024-08-17T02:22:26.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.154+0000 7f8ccf7fe700 1 -- 172.21.15.104:0/3866467186 <== mgr.4111 v2:172.21.15.117:6832/24084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264441 (secure 0 0 0) 0x7f8cd80c8760 con 0x7f8cb8060860 2024-08-17T02:22:26.160 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:22:26.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.154+0000 7f8cdcd5a700 1 -- 172.21.15.104:0/3866467186 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8cb8060860 msgr2=0x7f8cb8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:26.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.154+0000 7f8cdcd5a700 1 --2- 172.21.15.104:0/3866467186 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8cb8060860 0x7f8cb8062d10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8006d20 tx=0x7f8cc8009250 comp rx=0 tx=0).stop 2024-08-17T02:22:26.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.154+0000 7f8cdcd5a700 1 -- 172.21.15.104:0/3866467186 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8cd8155fb0 msgr2=0x7f8cd8152130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:26.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.154+0000 7f8cdcd5a700 1 --2- 172.21.15.104:0/3866467186 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8cd8155fb0 0x7f8cd8152130 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8069330 tx=0x7f8cd0019000 comp rx=0 tx=0).stop 2024-08-17T02:22:26.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.154+0000 7f8cdcd5a700 1 -- 172.21.15.104:0/3866467186 shutdown_connections 2024-08-17T02:22:26.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.154+0000 7f8cdcd5a700 1 --2- 172.21.15.104:0/3866467186 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8cb8060860 0x7f8cb8062d10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:26.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.154+0000 7f8cdcd5a700 1 --2- 172.21.15.104:0/3866467186 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8cd8155fb0 0x7f8cd8152130 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:26.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.154+0000 7f8cdcd5a700 1 --2- 172.21.15.104:0/3866467186 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cd80c96c0 0x7f8cd815a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:26.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.154+0000 7f8cdcd5a700 1 --2- 172.21.15.104:0/3866467186 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cd80b0050 0x7f8cd814ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:26.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.154+0000 7f8cdcd5a700 1 -- 172.21.15.104:0/3866467186 >> 172.21.15.104:0/3866467186 conn(0x7f8cd80ccfc0 msgr2=0x7f8cd80cb570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:26.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.154+0000 7f8cdcd5a700 1 -- 172.21.15.104:0/3866467186 shutdown_connections 2024-08-17T02:22:26.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.154+0000 7f8cdcd5a700 1 -- 172.21.15.104:0/3866467186 wait complete. 2024-08-17T02:22:26.164 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-08-17T02:22:26.176 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-08-17T02:22:26.086932+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":127,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2386004,"kb_used_data":2964,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752588716,"statfs":{"total":773094113280,"available":770650845184,"internally_reserved":0,"allocated":3035136,"data_stored":1785969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.937740"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.207394+0000","last_change":"2024-08-17T02:22:22.207394+0000","last_active":"2024-08-17T02:22:22.207394+0000","last_peered":"2024-08-17T02:22:22.207394+0000","last_clean":"2024-08-17T02:22:22.207394+0000","last_became_active":"2024-08-17T02:22:22.207136+0000","last_became_peered":"2024-08-17T02:22:22.207136+0000","last_unstale":"2024-08-17T02:22:22.207394+0000","last_undegraded":"2024-08-17T02:22:22.207394+0000","last_fullsized":"2024-08-17T02:22:22.207394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:18:56.483735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.201158+0000","last_change":"2024-08-17T02:22:22.193365+0000","last_active":"2024-08-17T02:22:22.201158+0000","last_peered":"2024-08-17T02:22:22.201158+0000","last_clean":"2024-08-17T02:22:22.201158+0000","last_became_active":"2024-08-17T02:22:22.192975+0000","last_became_peered":"2024-08-17T02:22:22.192975+0000","last_unstale":"2024-08-17T02:22:22.201158+0000","last_undegraded":"2024-08-17T02:22:22.201158+0000","last_fullsized":"2024-08-17T02:22:22.201158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:21:01.768875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.201378+0000","last_change":"2024-08-17T02:22:22.195675+0000","last_active":"2024-08-17T02:22:22.201378+0000","last_peered":"2024-08-17T02:22:22.201378+0000","last_clean":"2024-08-17T02:22:22.201378+0000","last_became_active":"2024-08-17T02:22:22.195378+0000","last_became_peered":"2024-08-17T02:22:22.195378+0000","last_unstale":"2024-08-17T02:22:22.201378+0000","last_undegraded":"2024-08-17T02:22:22.201378+0000","last_fullsized":"2024-08-17T02:22:22.201378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:42:06.496970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.213303+0000","last_change":"2024-08-17T02:22:22.206371+0000","last_active":"2024-08-17T02:22:22.213303+0000","last_peered":"2024-08-17T02:22:22.213303+0000","last_clean":"2024-08-17T02:22:22.213303+0000","last_became_active":"2024-08-17T02:22:22.206060+0000","last_became_peered":"2024-08-17T02:22:22.206060+0000","last_unstale":"2024-08-17T02:22:22.213303+0000","last_undegraded":"2024-08-17T02:22:22.213303+0000","last_fullsized":"2024-08-17T02:22:22.213303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:14:09.179717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.205544+0000","last_change":"2024-08-17T02:22:22.205544+0000","last_active":"2024-08-17T02:22:22.205544+0000","last_peered":"2024-08-17T02:22:22.205544+0000","last_clean":"2024-08-17T02:22:22.205544+0000","last_became_active":"2024-08-17T02:22:22.204373+0000","last_became_peered":"2024-08-17T02:22:22.204373+0000","last_unstale":"2024-08-17T02:22:22.205544+0000","last_undegraded":"2024-08-17T02:22:22.205544+0000","last_fullsized":"2024-08-17T02:22:22.205544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:12:21.015335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.210109+0000","last_change":"2024-08-17T02:22:22.203860+0000","last_active":"2024-08-17T02:22:22.210109+0000","last_peered":"2024-08-17T02:22:22.210109+0000","last_clean":"2024-08-17T02:22:22.210109+0000","last_became_active":"2024-08-17T02:22:22.203585+0000","last_became_peered":"2024-08-17T02:22:22.203585+0000","last_unstale":"2024-08-17T02:22:22.210109+0000","last_undegraded":"2024-08-17T02:22:22.210109+0000","last_fullsized":"2024-08-17T02:22:22.210109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:31:18.328390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.202691+0000","last_change":"2024-08-17T02:22:22.202691+0000","last_active":"2024-08-17T02:22:22.202691+0000","last_peered":"2024-08-17T02:22:22.202691+0000","last_clean":"2024-08-17T02:22:22.202691+0000","last_became_active":"2024-08-17T02:22:22.202339+0000","last_became_peered":"2024-08-17T02:22:22.202339+0000","last_unstale":"2024-08-17T02:22:22.202691+0000","last_undegraded":"2024-08-17T02:22:22.202691+0000","last_fullsized":"2024-08-17T02:22:22.202691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:42:06.496970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.204363+0000","last_change":"2024-08-17T02:22:22.198103+0000","last_active":"2024-08-17T02:22:22.204363+0000","last_peered":"2024-08-17T02:22:22.204363+0000","last_clean":"2024-08-17T02:22:22.204363+0000","last_became_active":"2024-08-17T02:22:22.197796+0000","last_became_peered":"2024-08-17T02:22:22.197796+0000","last_unstale":"2024-08-17T02:22:22.204363+0000","last_undegraded":"2024-08-17T02:22:22.204363+0000","last_fullsized":"2024-08-17T02:22:22.204363+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:52:23.293649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.207212+0000","last_change":"2024-08-17T02:22:22.202799+0000","last_active":"2024-08-17T02:22:22.207212+0000","last_peered":"2024-08-17T02:22:22.207212+0000","last_clean":"2024-08-17T02:22:22.207212+0000","last_became_active":"2024-08-17T02:22:22.202553+0000","last_became_peered":"2024-08-17T02:22:22.202553+0000","last_unstale":"2024-08-17T02:22:22.207212+0000","last_undegraded":"2024-08-17T02:22:22.207212+0000","last_fullsized":"2024-08-17T02:22:22.207212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:25:58.131547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.200665+0000","last_change":"2024-08-17T02:22:22.200665+0000","last_active":"2024-08-17T02:22:22.200665+0000","last_peered":"2024-08-17T02:22:22.200665+0000","last_clean":"2024-08-17T02:22:22.200665+0000","last_became_active":"2024-08-17T02:22:22.200068+0000","last_became_peered":"2024-08-17T02:22:22.200068+0000","last_unstale":"2024-08-17T02:22:22.200665+0000","last_undegraded":"2024-08-17T02:22:22.200665+0000","last_fullsized":"2024-08-17T02:22:22.200665+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:45:56.296454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.205418+0000","last_change":"2024-08-17T02:22:22.205418+0000","last_active":"2024-08-17T02:22:22.205418+0000","last_peered":"2024-08-17T02:22:22.205418+0000","last_clean":"2024-08-17T02:22:22.205418+0000","last_became_active":"2024-08-17T02:22:22.205155+0000","last_became_peered":"2024-08-17T02:22:22.205155+0000","last_unstale":"2024-08-17T02:22:22.205418+0000","last_undegraded":"2024-08-17T02:22:22.205418+0000","last_fullsized":"2024-08-17T02:22:22.205418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:09:52.735534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.208616+0000","last_change":"2024-08-17T02:22:22.208616+0000","last_active":"2024-08-17T02:22:22.208616+0000","last_peered":"2024-08-17T02:22:22.208616+0000","last_clean":"2024-08-17T02:22:22.208616+0000","last_became_active":"2024-08-17T02:22:22.208243+0000","last_became_peered":"2024-08-17T02:22:22.208243+0000","last_unstale":"2024-08-17T02:22:22.208616+0000","last_undegraded":"2024-08-17T02:22:22.208616+0000","last_fullsized":"2024-08-17T02:22:22.208616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:06:36.575795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.201596+0000","last_change":"2024-08-17T02:22:22.201596+0000","last_active":"2024-08-17T02:22:22.201596+0000","last_peered":"2024-08-17T02:22:22.201596+0000","last_clean":"2024-08-17T02:22:22.201596+0000","last_became_active":"2024-08-17T02:22:22.201280+0000","last_became_peered":"2024-08-17T02:22:22.201280+0000","last_unstale":"2024-08-17T02:22:22.201596+0000","last_undegraded":"2024-08-17T02:22:22.201596+0000","last_fullsized":"2024-08-17T02:22:22.201596+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:32:08.356996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.196235+0000","last_change":"2024-08-17T02:22:22.196235+0000","last_active":"2024-08-17T02:22:22.196235+0000","last_peered":"2024-08-17T02:22:22.196235+0000","last_clean":"2024-08-17T02:22:22.196235+0000","last_became_active":"2024-08-17T02:22:22.195933+0000","last_became_peered":"2024-08-17T02:22:22.195933+0000","last_unstale":"2024-08-17T02:22:22.196235+0000","last_undegraded":"2024-08-17T02:22:22.196235+0000","last_fullsized":"2024-08-17T02:22:22.196235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:24:36.708380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.205916+0000","last_change":"2024-08-17T02:22:22.203673+0000","last_active":"2024-08-17T02:22:22.205916+0000","last_peered":"2024-08-17T02:22:22.205916+0000","last_clean":"2024-08-17T02:22:22.205916+0000","last_became_active":"2024-08-17T02:22:22.203378+0000","last_became_peered":"2024-08-17T02:22:22.203378+0000","last_unstale":"2024-08-17T02:22:22.205916+0000","last_undegraded":"2024-08-17T02:22:22.205916+0000","last_fullsized":"2024-08-17T02:22:22.205916+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:14:55.331054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.204557+0000","last_change":"2024-08-17T02:22:22.204557+0000","last_active":"2024-08-17T02:22:22.204557+0000","last_peered":"2024-08-17T02:22:22.204557+0000","last_clean":"2024-08-17T02:22:22.204557+0000","last_became_active":"2024-08-17T02:22:22.203145+0000","last_became_peered":"2024-08-17T02:22:22.203145+0000","last_unstale":"2024-08-17T02:22:22.204557+0000","last_undegraded":"2024-08-17T02:22:22.204557+0000","last_fullsized":"2024-08-17T02:22:22.204557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:54:53.542063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.205880+0000","last_change":"2024-08-17T02:22:22.205880+0000","last_active":"2024-08-17T02:22:22.205880+0000","last_peered":"2024-08-17T02:22:22.205880+0000","last_clean":"2024-08-17T02:22:22.205880+0000","last_became_active":"2024-08-17T02:22:22.205133+0000","last_became_peered":"2024-08-17T02:22:22.205133+0000","last_unstale":"2024-08-17T02:22:22.205880+0000","last_undegraded":"2024-08-17T02:22:22.205880+0000","last_fullsized":"2024-08-17T02:22:22.205880+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:42:34.031508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.199981+0000","last_change":"2024-08-17T02:22:22.199981+0000","last_active":"2024-08-17T02:22:22.199981+0000","last_peered":"2024-08-17T02:22:22.199981+0000","last_clean":"2024-08-17T02:22:22.199981+0000","last_became_active":"2024-08-17T02:22:22.199695+0000","last_became_peered":"2024-08-17T02:22:22.199695+0000","last_unstale":"2024-08-17T02:22:22.199981+0000","last_undegraded":"2024-08-17T02:22:22.199981+0000","last_fullsized":"2024-08-17T02:22:22.199981+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:10:01.636342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.195819+0000","last_change":"2024-08-17T02:22:22.195819+0000","last_active":"2024-08-17T02:22:22.195819+0000","last_peered":"2024-08-17T02:22:22.195819+0000","last_clean":"2024-08-17T02:22:22.195819+0000","last_became_active":"2024-08-17T02:22:22.195534+0000","last_became_peered":"2024-08-17T02:22:22.195534+0000","last_unstale":"2024-08-17T02:22:22.195819+0000","last_undegraded":"2024-08-17T02:22:22.195819+0000","last_fullsized":"2024-08-17T02:22:22.195819+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:14:13.686376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.208982+0000","last_change":"2024-08-17T02:22:22.208982+0000","last_active":"2024-08-17T02:22:22.208982+0000","last_peered":"2024-08-17T02:22:22.208982+0000","last_clean":"2024-08-17T02:22:22.208982+0000","last_became_active":"2024-08-17T02:22:22.208519+0000","last_became_peered":"2024-08-17T02:22:22.208519+0000","last_unstale":"2024-08-17T02:22:22.208982+0000","last_undegraded":"2024-08-17T02:22:22.208982+0000","last_fullsized":"2024-08-17T02:22:22.208982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:14:55.331054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.216569+0000","last_change":"2024-08-17T02:22:22.208260+0000","last_active":"2024-08-17T02:22:22.216569+0000","last_peered":"2024-08-17T02:22:22.216569+0000","last_clean":"2024-08-17T02:22:22.216569+0000","last_became_active":"2024-08-17T02:22:22.207547+0000","last_became_peered":"2024-08-17T02:22:22.207547+0000","last_unstale":"2024-08-17T02:22:22.216569+0000","last_undegraded":"2024-08-17T02:22:22.216569+0000","last_fullsized":"2024-08-17T02:22:22.216569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:50:20.438197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.207287+0000","last_change":"2024-08-17T02:22:22.199523+0000","last_active":"2024-08-17T02:22:22.207287+0000","last_peered":"2024-08-17T02:22:22.207287+0000","last_clean":"2024-08-17T02:22:22.207287+0000","last_became_active":"2024-08-17T02:22:22.198679+0000","last_became_peered":"2024-08-17T02:22:22.198679+0000","last_unstale":"2024-08-17T02:22:22.207287+0000","last_undegraded":"2024-08-17T02:22:22.207287+0000","last_fullsized":"2024-08-17T02:22:22.207287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:52:03.967168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.205677+0000","last_change":"2024-08-17T02:22:22.200108+0000","last_active":"2024-08-17T02:22:22.205677+0000","last_peered":"2024-08-17T02:22:22.205677+0000","last_clean":"2024-08-17T02:22:22.205677+0000","last_became_active":"2024-08-17T02:22:22.199791+0000","last_became_peered":"2024-08-17T02:22:22.199791+0000","last_unstale":"2024-08-17T02:22:22.205677+0000","last_undegraded":"2024-08-17T02:22:22.205677+0000","last_fullsized":"2024-08-17T02:22:22.205677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:50:20.438197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.197872+0000","last_change":"2024-08-17T02:22:22.197872+0000","last_active":"2024-08-17T02:22:22.197872+0000","last_peered":"2024-08-17T02:22:22.197872+0000","last_clean":"2024-08-17T02:22:22.197872+0000","last_became_active":"2024-08-17T02:22:22.197575+0000","last_became_peered":"2024-08-17T02:22:22.197575+0000","last_unstale":"2024-08-17T02:22:22.197872+0000","last_undegraded":"2024-08-17T02:22:22.197872+0000","last_fullsized":"2024-08-17T02:22:22.197872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:19:48.379073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.201276+0000","last_change":"2024-08-17T02:22:22.192977+0000","last_active":"2024-08-17T02:22:22.201276+0000","last_peered":"2024-08-17T02:22:22.201276+0000","last_clean":"2024-08-17T02:22:22.201276+0000","last_became_active":"2024-08-17T02:22:22.192692+0000","last_became_peered":"2024-08-17T02:22:22.192692+0000","last_unstale":"2024-08-17T02:22:22.201276+0000","last_undegraded":"2024-08-17T02:22:22.201276+0000","last_fullsized":"2024-08-17T02:22:22.201276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:45:56.296454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.213112+0000","last_change":"2024-08-17T02:22:22.206334+0000","last_active":"2024-08-17T02:22:22.213112+0000","last_peered":"2024-08-17T02:22:22.213112+0000","last_clean":"2024-08-17T02:22:22.213112+0000","last_became_active":"2024-08-17T02:22:22.203810+0000","last_became_peered":"2024-08-17T02:22:22.203810+0000","last_unstale":"2024-08-17T02:22:22.213112+0000","last_undegraded":"2024-08-17T02:22:22.213112+0000","last_fullsized":"2024-08-17T02:22:22.213112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:44:23.689354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.196495+0000","last_change":"2024-08-17T02:22:22.196495+0000","last_active":"2024-08-17T02:22:22.196495+0000","last_peered":"2024-08-17T02:22:22.196495+0000","last_clean":"2024-08-17T02:22:22.196495+0000","last_became_active":"2024-08-17T02:22:22.196141+0000","last_became_peered":"2024-08-17T02:22:22.196141+0000","last_unstale":"2024-08-17T02:22:22.196495+0000","last_undegraded":"2024-08-17T02:22:22.196495+0000","last_fullsized":"2024-08-17T02:22:22.196495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:50:27.904463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.206082+0000","last_change":"2024-08-17T02:22:22.206082+0000","last_active":"2024-08-17T02:22:22.206082+0000","last_peered":"2024-08-17T02:22:22.206082+0000","last_clean":"2024-08-17T02:22:22.206082+0000","last_became_active":"2024-08-17T02:22:22.205748+0000","last_became_peered":"2024-08-17T02:22:22.205748+0000","last_unstale":"2024-08-17T02:22:22.206082+0000","last_undegraded":"2024-08-17T02:22:22.206082+0000","last_fullsized":"2024-08-17T02:22:22.206082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:37:31.095543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.198292+0000","last_change":"2024-08-17T02:22:22.188239+0000","last_active":"2024-08-17T02:22:22.198292+0000","last_peered":"2024-08-17T02:22:22.198292+0000","last_clean":"2024-08-17T02:22:22.198292+0000","last_became_active":"2024-08-17T02:22:22.187975+0000","last_became_peered":"2024-08-17T02:22:22.187975+0000","last_unstale":"2024-08-17T02:22:22.198292+0000","last_undegraded":"2024-08-17T02:22:22.198292+0000","last_fullsized":"2024-08-17T02:22:22.198292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:01:06.448601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.200334+0000","last_change":"2024-08-17T02:22:22.200334+0000","last_active":"2024-08-17T02:22:22.200334+0000","last_peered":"2024-08-17T02:22:22.200334+0000","last_clean":"2024-08-17T02:22:22.200334+0000","last_became_active":"2024-08-17T02:22:22.200074+0000","last_became_peered":"2024-08-17T02:22:22.200074+0000","last_unstale":"2024-08-17T02:22:22.200334+0000","last_undegraded":"2024-08-17T02:22:22.200334+0000","last_fullsized":"2024-08-17T02:22:22.200334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:40:31.008079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.189468+0000","last_change":"2024-08-17T02:22:22.189468+0000","last_active":"2024-08-17T02:22:22.189468+0000","last_peered":"2024-08-17T02:22:22.189468+0000","last_clean":"2024-08-17T02:22:22.189468+0000","last_became_active":"2024-08-17T02:22:22.189055+0000","last_became_peered":"2024-08-17T02:22:22.189055+0000","last_unstale":"2024-08-17T02:22:22.189468+0000","last_undegraded":"2024-08-17T02:22:22.189468+0000","last_fullsized":"2024-08-17T02:22:22.189468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:14:09.179717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.211815+0000","last_change":"2024-08-17T02:22:22.204911+0000","last_active":"2024-08-17T02:22:22.211815+0000","last_peered":"2024-08-17T02:22:22.211815+0000","last_clean":"2024-08-17T02:22:22.211815+0000","last_became_active":"2024-08-17T02:22:22.204551+0000","last_became_peered":"2024-08-17T02:22:22.204551+0000","last_unstale":"2024-08-17T02:22:22.211815+0000","last_undegraded":"2024-08-17T02:22:22.211815+0000","last_fullsized":"2024-08-17T02:22:22.211815+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:47:31.414680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.207076+0000","last_change":"2024-08-17T02:22:22.193415+0000","last_active":"2024-08-17T02:22:22.207076+0000","last_peered":"2024-08-17T02:22:22.207076+0000","last_clean":"2024-08-17T02:22:22.207076+0000","last_became_active":"2024-08-17T02:22:22.193075+0000","last_became_peered":"2024-08-17T02:22:22.193075+0000","last_unstale":"2024-08-17T02:22:22.207076+0000","last_undegraded":"2024-08-17T02:22:22.207076+0000","last_fullsized":"2024-08-17T02:22:22.207076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:10:01.636342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.216386+0000","last_change":"2024-08-17T02:22:21.175481+0000","last_active":"2024-08-17T02:22:22.216386+0000","last_peered":"2024-08-17T02:22:22.216386+0000","last_clean":"2024-08-17T02:22:22.216386+0000","last_became_active":"2024-08-17T02:22:21.175155+0000","last_became_peered":"2024-08-17T02:22:21.175155+0000","last_unstale":"2024-08-17T02:22:22.216386+0000","last_undegraded":"2024-08-17T02:22:22.216386+0000","last_fullsized":"2024-08-17T02:22:22.216386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:35:31.942397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.205780+0000","last_change":"2024-08-17T02:22:22.204166+0000","last_active":"2024-08-17T02:22:22.205780+0000","last_peered":"2024-08-17T02:22:22.205780+0000","last_clean":"2024-08-17T02:22:22.205780+0000","last_became_active":"2024-08-17T02:22:22.203874+0000","last_became_peered":"2024-08-17T02:22:22.203874+0000","last_unstale":"2024-08-17T02:22:22.205780+0000","last_undegraded":"2024-08-17T02:22:22.205780+0000","last_fullsized":"2024-08-17T02:22:22.205780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:12:21.015335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.193625+0000","last_change":"2024-08-17T02:22:21.187087+0000","last_active":"2024-08-17T02:22:22.193625+0000","last_peered":"2024-08-17T02:22:22.193625+0000","last_clean":"2024-08-17T02:22:22.193625+0000","last_became_active":"2024-08-17T02:22:21.186780+0000","last_became_peered":"2024-08-17T02:22:21.186780+0000","last_unstale":"2024-08-17T02:22:22.193625+0000","last_undegraded":"2024-08-17T02:22:22.193625+0000","last_fullsized":"2024-08-17T02:22:22.193625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:53:21.168875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:22:21.185949+0000","last_change":"2024-08-17T02:22:21.184095+0000","last_active":"2024-08-17T02:22:21.185949+0000","last_peered":"2024-08-17T02:22:21.185949+0000","last_clean":"2024-08-17T02:22:21.185949+0000","last_became_active":"2024-08-17T02:22:21.183707+0000","last_became_peered":"2024-08-17T02:22:21.183707+0000","last_unstale":"2024-08-17T02:22:21.185949+0000","last_undegraded":"2024-08-17T02:22:21.185949+0000","last_fullsized":"2024-08-17T02:22:21.185949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:33:34.653965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.201739+0000","last_change":"2024-08-17T02:22:22.193669+0000","last_active":"2024-08-17T02:22:22.201739+0000","last_peered":"2024-08-17T02:22:22.201739+0000","last_clean":"2024-08-17T02:22:22.201739+0000","last_became_active":"2024-08-17T02:22:22.193231+0000","last_became_peered":"2024-08-17T02:22:22.193231+0000","last_unstale":"2024-08-17T02:22:22.201739+0000","last_undegraded":"2024-08-17T02:22:22.201739+0000","last_fullsized":"2024-08-17T02:22:22.201739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:34:22.570830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:22:21.182936+0000","last_change":"2024-08-17T02:22:21.178190+0000","last_active":"2024-08-17T02:22:21.182936+0000","last_peered":"2024-08-17T02:22:21.182936+0000","last_clean":"2024-08-17T02:22:21.182936+0000","last_became_active":"2024-08-17T02:22:21.177828+0000","last_became_peered":"2024-08-17T02:22:21.177828+0000","last_unstale":"2024-08-17T02:22:21.182936+0000","last_undegraded":"2024-08-17T02:22:21.182936+0000","last_fullsized":"2024-08-17T02:22:21.182936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:10:00.628584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.216728+0000","last_change":"2024-08-17T02:22:22.209400+0000","last_active":"2024-08-17T02:22:22.216728+0000","last_peered":"2024-08-17T02:22:22.216728+0000","last_clean":"2024-08-17T02:22:22.216728+0000","last_became_active":"2024-08-17T02:22:22.208986+0000","last_became_peered":"2024-08-17T02:22:22.208986+0000","last_unstale":"2024-08-17T02:22:22.216728+0000","last_undegraded":"2024-08-17T02:22:22.216728+0000","last_fullsized":"2024-08-17T02:22:22.216728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:01:06.448601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.182530+0000","last_change":"2024-08-17T02:22:21.171298+0000","last_active":"2024-08-17T02:22:22.182530+0000","last_peered":"2024-08-17T02:22:22.182530+0000","last_clean":"2024-08-17T02:22:22.182530+0000","last_became_active":"2024-08-17T02:22:21.170688+0000","last_became_peered":"2024-08-17T02:22:21.170688+0000","last_unstale":"2024-08-17T02:22:22.182530+0000","last_undegraded":"2024-08-17T02:22:22.182530+0000","last_fullsized":"2024-08-17T02:22:22.182530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:14:01.383880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.213088+0000","last_change":"2024-08-17T02:22:22.205723+0000","last_active":"2024-08-17T02:22:22.213088+0000","last_peered":"2024-08-17T02:22:22.213088+0000","last_clean":"2024-08-17T02:22:22.213088+0000","last_became_active":"2024-08-17T02:22:22.204195+0000","last_became_peered":"2024-08-17T02:22:22.204195+0000","last_unstale":"2024-08-17T02:22:22.213088+0000","last_undegraded":"2024-08-17T02:22:22.213088+0000","last_fullsized":"2024-08-17T02:22:22.213088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:53:22.176633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:22:21.183622+0000","last_change":"2024-08-17T02:22:21.176993+0000","last_active":"2024-08-17T02:22:21.183622+0000","last_peered":"2024-08-17T02:22:21.183622+0000","last_clean":"2024-08-17T02:22:21.183622+0000","last_became_active":"2024-08-17T02:22:21.175101+0000","last_became_peered":"2024-08-17T02:22:21.175101+0000","last_unstale":"2024-08-17T02:22:21.183622+0000","last_undegraded":"2024-08-17T02:22:21.183622+0000","last_fullsized":"2024-08-17T02:22:21.183622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:35:31.942397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.207541+0000","last_change":"2024-08-17T02:22:22.204502+0000","last_active":"2024-08-17T02:22:22.207541+0000","last_peered":"2024-08-17T02:22:22.207541+0000","last_clean":"2024-08-17T02:22:22.207541+0000","last_became_active":"2024-08-17T02:22:22.204194+0000","last_became_peered":"2024-08-17T02:22:22.204194+0000","last_unstale":"2024-08-17T02:22:22.207541+0000","last_undegraded":"2024-08-17T02:22:22.207541+0000","last_fullsized":"2024-08-17T02:22:22.207541+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:18:56.483735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.219210+0000","last_change":"2024-08-17T02:22:21.175948+0000","last_active":"2024-08-17T02:22:22.219210+0000","last_peered":"2024-08-17T02:22:22.219210+0000","last_clean":"2024-08-17T02:22:22.219210+0000","last_became_active":"2024-08-17T02:22:21.175638+0000","last_became_peered":"2024-08-17T02:22:21.175638+0000","last_unstale":"2024-08-17T02:22:22.219210+0000","last_undegraded":"2024-08-17T02:22:22.219210+0000","last_fullsized":"2024-08-17T02:22:22.219210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:14:01.383880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.203497+0000","last_change":"2024-08-17T02:22:22.203497+0000","last_active":"2024-08-17T02:22:22.203497+0000","last_peered":"2024-08-17T02:22:22.203497+0000","last_clean":"2024-08-17T02:22:22.203497+0000","last_became_active":"2024-08-17T02:22:22.203129+0000","last_became_peered":"2024-08-17T02:22:22.203129+0000","last_unstale":"2024-08-17T02:22:22.203497+0000","last_undegraded":"2024-08-17T02:22:22.203497+0000","last_fullsized":"2024-08-17T02:22:22.203497+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:08:06.080463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.221812+0000","last_change":"2024-08-17T02:22:21.172088+0000","last_active":"2024-08-17T02:22:22.221812+0000","last_peered":"2024-08-17T02:22:22.221812+0000","last_clean":"2024-08-17T02:22:22.221812+0000","last_became_active":"2024-08-17T02:22:21.171674+0000","last_became_peered":"2024-08-17T02:22:21.171674+0000","last_unstale":"2024-08-17T02:22:22.221812+0000","last_undegraded":"2024-08-17T02:22:22.221812+0000","last_fullsized":"2024-08-17T02:22:22.221812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:20:14.853980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.200767+0000","last_change":"2024-08-17T02:22:22.200767+0000","last_active":"2024-08-17T02:22:22.200767+0000","last_peered":"2024-08-17T02:22:22.200767+0000","last_clean":"2024-08-17T02:22:22.200767+0000","last_became_active":"2024-08-17T02:22:22.200355+0000","last_became_peered":"2024-08-17T02:22:22.200355+0000","last_unstale":"2024-08-17T02:22:22.200767+0000","last_undegraded":"2024-08-17T02:22:22.200767+0000","last_fullsized":"2024-08-17T02:22:22.200767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:46:07.630925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.215662+0000","last_change":"2024-08-17T02:22:21.183259+0000","last_active":"2024-08-17T02:22:22.215662+0000","last_peered":"2024-08-17T02:22:22.215662+0000","last_clean":"2024-08-17T02:22:22.215662+0000","last_became_active":"2024-08-17T02:22:21.182967+0000","last_became_peered":"2024-08-17T02:22:21.182967+0000","last_unstale":"2024-08-17T02:22:22.215662+0000","last_undegraded":"2024-08-17T02:22:22.215662+0000","last_fullsized":"2024-08-17T02:22:22.215662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:43:54.663464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.203414+0000","last_change":"2024-08-17T02:22:22.203414+0000","last_active":"2024-08-17T02:22:22.203414+0000","last_peered":"2024-08-17T02:22:22.203414+0000","last_clean":"2024-08-17T02:22:22.203414+0000","last_became_active":"2024-08-17T02:22:22.203022+0000","last_became_peered":"2024-08-17T02:22:22.203022+0000","last_unstale":"2024-08-17T02:22:22.203414+0000","last_undegraded":"2024-08-17T02:22:22.203414+0000","last_fullsized":"2024-08-17T02:22:22.203414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:00:35.929768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:22:21.185236+0000","last_change":"2024-08-17T02:22:21.181277+0000","last_active":"2024-08-17T02:22:21.185236+0000","last_peered":"2024-08-17T02:22:21.185236+0000","last_clean":"2024-08-17T02:22:21.185236+0000","last_became_active":"2024-08-17T02:22:21.178480+0000","last_became_peered":"2024-08-17T02:22:21.178480+0000","last_unstale":"2024-08-17T02:22:21.185236+0000","last_undegraded":"2024-08-17T02:22:21.185236+0000","last_fullsized":"2024-08-17T02:22:21.185236+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:31:17.320632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.203294+0000","last_change":"2024-08-17T02:22:22.203294+0000","last_active":"2024-08-17T02:22:22.203294+0000","last_peered":"2024-08-17T02:22:22.203294+0000","last_clean":"2024-08-17T02:22:22.203294+0000","last_became_active":"2024-08-17T02:22:22.202695+0000","last_became_peered":"2024-08-17T02:22:22.202695+0000","last_unstale":"2024-08-17T02:22:22.203294+0000","last_undegraded":"2024-08-17T02:22:22.203294+0000","last_fullsized":"2024-08-17T02:22:22.203294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:11:36.411933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:22:21.190909+0000","last_change":"2024-08-17T02:22:21.186990+0000","last_active":"2024-08-17T02:22:21.190909+0000","last_peered":"2024-08-17T02:22:21.190909+0000","last_clean":"2024-08-17T02:22:21.190909+0000","last_became_active":"2024-08-17T02:22:21.186627+0000","last_became_peered":"2024-08-17T02:22:21.186627+0000","last_unstale":"2024-08-17T02:22:21.190909+0000","last_undegraded":"2024-08-17T02:22:21.190909+0000","last_fullsized":"2024-08-17T02:22:21.190909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:10:00.628584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.201334+0000","last_change":"2024-08-17T02:22:22.191715+0000","last_active":"2024-08-17T02:22:22.201334+0000","last_peered":"2024-08-17T02:22:22.201334+0000","last_clean":"2024-08-17T02:22:22.201334+0000","last_became_active":"2024-08-17T02:22:22.191284+0000","last_became_peered":"2024-08-17T02:22:22.191284+0000","last_unstale":"2024-08-17T02:22:22.201334+0000","last_undegraded":"2024-08-17T02:22:22.201334+0000","last_fullsized":"2024-08-17T02:22:22.201334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:31:18.328390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.219572+0000","last_change":"2024-08-17T02:22:21.173553+0000","last_active":"2024-08-17T02:22:22.219572+0000","last_peered":"2024-08-17T02:22:22.219572+0000","last_clean":"2024-08-17T02:22:22.219572+0000","last_became_active":"2024-08-17T02:22:21.173159+0000","last_became_peered":"2024-08-17T02:22:21.173159+0000","last_unstale":"2024-08-17T02:22:22.219572+0000","last_undegraded":"2024-08-17T02:22:22.219572+0000","last_fullsized":"2024-08-17T02:22:22.219572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:35:31.942397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.206143+0000","last_change":"2024-08-17T02:22:22.206143+0000","last_active":"2024-08-17T02:22:22.206143+0000","last_peered":"2024-08-17T02:22:22.206143+0000","last_clean":"2024-08-17T02:22:22.206143+0000","last_became_active":"2024-08-17T02:22:22.203641+0000","last_became_peered":"2024-08-17T02:22:22.203641+0000","last_unstale":"2024-08-17T02:22:22.206143+0000","last_undegraded":"2024-08-17T02:22:22.206143+0000","last_fullsized":"2024-08-17T02:22:22.206143+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:49:03.418573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.200988+0000","last_change":"2024-08-17T02:22:21.174493+0000","last_active":"2024-08-17T02:22:22.200988+0000","last_peered":"2024-08-17T02:22:22.200988+0000","last_clean":"2024-08-17T02:22:22.200988+0000","last_became_active":"2024-08-17T02:22:21.174142+0000","last_became_peered":"2024-08-17T02:22:21.174142+0000","last_unstale":"2024-08-17T02:22:22.200988+0000","last_undegraded":"2024-08-17T02:22:22.200988+0000","last_fullsized":"2024-08-17T02:22:22.200988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:14:08.171959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.206463+0000","last_change":"2024-08-17T02:22:22.201098+0000","last_active":"2024-08-17T02:22:22.206463+0000","last_peered":"2024-08-17T02:22:22.206463+0000","last_clean":"2024-08-17T02:22:22.206463+0000","last_became_active":"2024-08-17T02:22:22.200673+0000","last_became_peered":"2024-08-17T02:22:22.200673+0000","last_unstale":"2024-08-17T02:22:22.206463+0000","last_undegraded":"2024-08-17T02:22:22.206463+0000","last_fullsized":"2024-08-17T02:22:22.206463+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:25:58.131547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.218662+0000","last_change":"2024-08-17T02:22:21.175560+0000","last_active":"2024-08-17T02:22:22.218662+0000","last_peered":"2024-08-17T02:22:22.218662+0000","last_clean":"2024-08-17T02:22:22.218662+0000","last_became_active":"2024-08-17T02:22:21.175262+0000","last_became_peered":"2024-08-17T02:22:21.175262+0000","last_unstale":"2024-08-17T02:22:22.218662+0000","last_undegraded":"2024-08-17T02:22:22.218662+0000","last_fullsized":"2024-08-17T02:22:22.218662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:01:30.822179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.207471+0000","last_change":"2024-08-17T02:22:22.207471+0000","last_active":"2024-08-17T02:22:22.207471+0000","last_peered":"2024-08-17T02:22:22.207471+0000","last_clean":"2024-08-17T02:22:22.207471+0000","last_became_active":"2024-08-17T02:22:22.207237+0000","last_became_peered":"2024-08-17T02:22:22.207237+0000","last_unstale":"2024-08-17T02:22:22.207471+0000","last_undegraded":"2024-08-17T02:22:22.207471+0000","last_fullsized":"2024-08-17T02:22:22.207471+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:52:23.293649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.216725+0000","last_change":"2024-08-17T02:22:21.173738+0000","last_active":"2024-08-17T02:22:22.216725+0000","last_peered":"2024-08-17T02:22:22.216725+0000","last_clean":"2024-08-17T02:22:22.216725+0000","last_became_active":"2024-08-17T02:22:21.173409+0000","last_became_peered":"2024-08-17T02:22:21.173409+0000","last_unstale":"2024-08-17T02:22:22.216725+0000","last_undegraded":"2024-08-17T02:22:22.216725+0000","last_fullsized":"2024-08-17T02:22:22.216725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:43:54.663464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.200396+0000","last_change":"2024-08-17T02:22:22.200396+0000","last_active":"2024-08-17T02:22:22.200396+0000","last_peered":"2024-08-17T02:22:22.200396+0000","last_clean":"2024-08-17T02:22:22.200396+0000","last_became_active":"2024-08-17T02:22:22.199830+0000","last_became_peered":"2024-08-17T02:22:22.199830+0000","last_unstale":"2024-08-17T02:22:22.200396+0000","last_undegraded":"2024-08-17T02:22:22.200396+0000","last_fullsized":"2024-08-17T02:22:22.200396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:08:06.080463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:22:21.183159+0000","last_change":"2024-08-17T02:22:21.179346+0000","last_active":"2024-08-17T02:22:21.183159+0000","last_peered":"2024-08-17T02:22:21.183159+0000","last_clean":"2024-08-17T02:22:21.183159+0000","last_became_active":"2024-08-17T02:22:21.179089+0000","last_became_peered":"2024-08-17T02:22:21.179089+0000","last_unstale":"2024-08-17T02:22:21.183159+0000","last_undegraded":"2024-08-17T02:22:21.183159+0000","last_fullsized":"2024-08-17T02:22:21.183159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:05:31.566094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.210702+0000","last_change":"2024-08-17T02:22:22.210702+0000","last_active":"2024-08-17T02:22:22.210702+0000","last_peered":"2024-08-17T02:22:22.210702+0000","last_clean":"2024-08-17T02:22:22.210702+0000","last_became_active":"2024-08-17T02:22:22.210369+0000","last_became_peered":"2024-08-17T02:22:22.210369+0000","last_unstale":"2024-08-17T02:22:22.210702+0000","last_undegraded":"2024-08-17T02:22:22.210702+0000","last_fullsized":"2024-08-17T02:22:22.210702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:18:56.483735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":163,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.181820+0000","last_change":"2024-08-17T02:22:11.967052+0000","last_active":"2024-08-17T02:22:22.181820+0000","last_peered":"2024-08-17T02:22:22.181820+0000","last_clean":"2024-08-17T02:22:22.181820+0000","last_became_active":"2024-08-17T02:22:11.965269+0000","last_became_peered":"2024-08-17T02:22:11.965269+0000","last_unstale":"2024-08-17T02:22:22.181820+0000","last_undegraded":"2024-08-17T02:22:22.181820+0000","last_fullsized":"2024-08-17T02:22:22.181820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:10.930862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:10.930862+0000","last_clean_scrub_stamp":"2024-08-17T02:22:10.930862+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:59:34.931003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:22:21.182702+0000","last_change":"2024-08-17T02:22:21.177962+0000","last_active":"2024-08-17T02:22:21.182702+0000","last_peered":"2024-08-17T02:22:21.182702+0000","last_clean":"2024-08-17T02:22:21.182702+0000","last_became_active":"2024-08-17T02:22:21.174574+0000","last_became_peered":"2024-08-17T02:22:21.174574+0000","last_unstale":"2024-08-17T02:22:21.182702+0000","last_undegraded":"2024-08-17T02:22:21.182702+0000","last_fullsized":"2024-08-17T02:22:21.182702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:44:22.681596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.216579+0000","last_change":"2024-08-17T02:22:22.207889+0000","last_active":"2024-08-17T02:22:22.216579+0000","last_peered":"2024-08-17T02:22:22.216579+0000","last_clean":"2024-08-17T02:22:22.216579+0000","last_became_active":"2024-08-17T02:22:22.207591+0000","last_became_peered":"2024-08-17T02:22:22.207591+0000","last_unstale":"2024-08-17T02:22:22.216579+0000","last_undegraded":"2024-08-17T02:22:22.216579+0000","last_fullsized":"2024-08-17T02:22:22.216579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:49:22.101879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:22:21.185711+0000","last_change":"2024-08-17T02:22:21.182666+0000","last_active":"2024-08-17T02:22:21.185711+0000","last_peered":"2024-08-17T02:22:21.185711+0000","last_clean":"2024-08-17T02:22:21.185711+0000","last_became_active":"2024-08-17T02:22:21.182346+0000","last_became_peered":"2024-08-17T02:22:21.182346+0000","last_unstale":"2024-08-17T02:22:21.185711+0000","last_undegraded":"2024-08-17T02:22:21.185711+0000","last_fullsized":"2024-08-17T02:22:21.185711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:14:08.171959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.204365+0000","last_change":"2024-08-17T02:22:22.204365+0000","last_active":"2024-08-17T02:22:22.204365+0000","last_peered":"2024-08-17T02:22:22.204365+0000","last_clean":"2024-08-17T02:22:22.204365+0000","last_became_active":"2024-08-17T02:22:22.204108+0000","last_became_peered":"2024-08-17T02:22:22.204108+0000","last_unstale":"2024-08-17T02:22:22.204365+0000","last_undegraded":"2024-08-17T02:22:22.204365+0000","last_fullsized":"2024-08-17T02:22:22.204365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:41:01.256282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:22:21.180268+0000","last_change":"2024-08-17T02:22:21.176738+0000","last_active":"2024-08-17T02:22:21.180268+0000","last_peered":"2024-08-17T02:22:21.180268+0000","last_clean":"2024-08-17T02:22:21.180268+0000","last_became_active":"2024-08-17T02:22:21.176368+0000","last_became_peered":"2024-08-17T02:22:21.176368+0000","last_unstale":"2024-08-17T02:22:21.180268+0000","last_undegraded":"2024-08-17T02:22:21.180268+0000","last_fullsized":"2024-08-17T02:22:21.180268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:39:49.581004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.198194+0000","last_change":"2024-08-17T02:22:22.188353+0000","last_active":"2024-08-17T02:22:22.198194+0000","last_peered":"2024-08-17T02:22:22.198194+0000","last_clean":"2024-08-17T02:22:22.198194+0000","last_became_active":"2024-08-17T02:22:22.187993+0000","last_became_peered":"2024-08-17T02:22:22.187993+0000","last_unstale":"2024-08-17T02:22:22.198194+0000","last_undegraded":"2024-08-17T02:22:22.198194+0000","last_fullsized":"2024-08-17T02:22:22.198194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:12:21.015335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:22:21.185264+0000","last_change":"2024-08-17T02:22:21.181422+0000","last_active":"2024-08-17T02:22:21.185264+0000","last_peered":"2024-08-17T02:22:21.185264+0000","last_clean":"2024-08-17T02:22:21.185264+0000","last_became_active":"2024-08-17T02:22:21.178824+0000","last_became_peered":"2024-08-17T02:22:21.178824+0000","last_unstale":"2024-08-17T02:22:21.185264+0000","last_undegraded":"2024-08-17T02:22:21.185264+0000","last_fullsized":"2024-08-17T02:22:21.185264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:57:25.435387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.201524+0000","last_change":"2024-08-17T02:22:22.201524+0000","last_active":"2024-08-17T02:22:22.201524+0000","last_peered":"2024-08-17T02:22:22.201524+0000","last_clean":"2024-08-17T02:22:22.201524+0000","last_became_active":"2024-08-17T02:22:22.200008+0000","last_became_peered":"2024-08-17T02:22:22.200008+0000","last_unstale":"2024-08-17T02:22:22.201524+0000","last_undegraded":"2024-08-17T02:22:22.201524+0000","last_fullsized":"2024-08-17T02:22:22.201524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:21:01.768875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.184222+0000","last_change":"2024-08-17T02:22:21.176312+0000","last_active":"2024-08-17T02:22:22.184222+0000","last_peered":"2024-08-17T02:22:22.184222+0000","last_clean":"2024-08-17T02:22:22.184222+0000","last_became_active":"2024-08-17T02:22:21.175977+0000","last_became_peered":"2024-08-17T02:22:21.175977+0000","last_unstale":"2024-08-17T02:22:22.184222+0000","last_undegraded":"2024-08-17T02:22:22.184222+0000","last_fullsized":"2024-08-17T02:22:22.184222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:36:42.673124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.212680+0000","last_change":"2024-08-17T02:22:22.205225+0000","last_active":"2024-08-17T02:22:22.212680+0000","last_peered":"2024-08-17T02:22:22.212680+0000","last_clean":"2024-08-17T02:22:22.212680+0000","last_became_active":"2024-08-17T02:22:22.204500+0000","last_became_peered":"2024-08-17T02:22:22.204500+0000","last_unstale":"2024-08-17T02:22:22.212680+0000","last_undegraded":"2024-08-17T02:22:22.212680+0000","last_fullsized":"2024-08-17T02:22:22.212680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:57:26.443145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:22:21.182659+0000","last_change":"2024-08-17T02:22:21.179488+0000","last_active":"2024-08-17T02:22:21.182659+0000","last_peered":"2024-08-17T02:22:21.182659+0000","last_clean":"2024-08-17T02:22:21.182659+0000","last_became_active":"2024-08-17T02:22:21.179206+0000","last_became_peered":"2024-08-17T02:22:21.179206+0000","last_unstale":"2024-08-17T02:22:21.182659+0000","last_undegraded":"2024-08-17T02:22:21.182659+0000","last_fullsized":"2024-08-17T02:22:21.182659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:25:57.123789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.198568+0000","last_change":"2024-08-17T02:22:22.198568+0000","last_active":"2024-08-17T02:22:22.198568+0000","last_peered":"2024-08-17T02:22:22.198568+0000","last_clean":"2024-08-17T02:22:22.198568+0000","last_became_active":"2024-08-17T02:22:22.198281+0000","last_became_peered":"2024-08-17T02:22:22.198281+0000","last_unstale":"2024-08-17T02:22:22.198568+0000","last_undegraded":"2024-08-17T02:22:22.198568+0000","last_fullsized":"2024-08-17T02:22:22.198568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:37:52.949081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.194742+0000","last_change":"2024-08-17T02:22:21.174183+0000","last_active":"2024-08-17T02:22:22.194742+0000","last_peered":"2024-08-17T02:22:22.194742+0000","last_clean":"2024-08-17T02:22:22.194742+0000","last_became_active":"2024-08-17T02:22:21.173494+0000","last_became_peered":"2024-08-17T02:22:21.173494+0000","last_unstale":"2024-08-17T02:22:22.194742+0000","last_undegraded":"2024-08-17T02:22:22.194742+0000","last_fullsized":"2024-08-17T02:22:22.194742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:36:42.673124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.205718+0000","last_change":"2024-08-17T02:22:22.199900+0000","last_active":"2024-08-17T02:22:22.205718+0000","last_peered":"2024-08-17T02:22:22.205718+0000","last_clean":"2024-08-17T02:22:22.205718+0000","last_became_active":"2024-08-17T02:22:22.198791+0000","last_became_peered":"2024-08-17T02:22:22.198791+0000","last_unstale":"2024-08-17T02:22:22.205718+0000","last_undegraded":"2024-08-17T02:22:22.205718+0000","last_fullsized":"2024-08-17T02:22:22.205718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:47.721413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.216262+0000","last_change":"2024-08-17T02:22:21.187272+0000","last_active":"2024-08-17T02:22:22.216262+0000","last_peered":"2024-08-17T02:22:22.216262+0000","last_clean":"2024-08-17T02:22:22.216262+0000","last_became_active":"2024-08-17T02:22:21.186794+0000","last_became_peered":"2024-08-17T02:22:21.186794+0000","last_unstale":"2024-08-17T02:22:22.216262+0000","last_undegraded":"2024-08-17T02:22:22.216262+0000","last_fullsized":"2024-08-17T02:22:22.216262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:52:02.959411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.206287+0000","last_change":"2024-08-17T02:22:22.199762+0000","last_active":"2024-08-17T02:22:22.206287+0000","last_peered":"2024-08-17T02:22:22.206287+0000","last_clean":"2024-08-17T02:22:22.206287+0000","last_became_active":"2024-08-17T02:22:22.199436+0000","last_became_peered":"2024-08-17T02:22:22.199436+0000","last_unstale":"2024-08-17T02:22:22.206287+0000","last_undegraded":"2024-08-17T02:22:22.206287+0000","last_fullsized":"2024-08-17T02:22:22.206287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:34:22.570830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:22:21.182404+0000","last_change":"2024-08-17T02:22:21.176575+0000","last_active":"2024-08-17T02:22:21.182404+0000","last_peered":"2024-08-17T02:22:21.182404+0000","last_clean":"2024-08-17T02:22:21.182404+0000","last_became_active":"2024-08-17T02:22:21.175688+0000","last_became_peered":"2024-08-17T02:22:21.175688+0000","last_unstale":"2024-08-17T02:22:21.182404+0000","last_undegraded":"2024-08-17T02:22:21.182404+0000","last_fullsized":"2024-08-17T02:22:21.182404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:31:17.320632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.204419+0000","last_change":"2024-08-17T02:22:22.204419+0000","last_active":"2024-08-17T02:22:22.204419+0000","last_peered":"2024-08-17T02:22:22.204419+0000","last_clean":"2024-08-17T02:22:22.204419+0000","last_became_active":"2024-08-17T02:22:22.203728+0000","last_became_peered":"2024-08-17T02:22:22.203728+0000","last_unstale":"2024-08-17T02:22:22.204419+0000","last_undegraded":"2024-08-17T02:22:22.204419+0000","last_fullsized":"2024-08-17T02:22:22.204419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:09:52.735534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.194675+0000","last_change":"2024-08-17T02:22:21.175288+0000","last_active":"2024-08-17T02:22:22.194675+0000","last_peered":"2024-08-17T02:22:22.194675+0000","last_clean":"2024-08-17T02:22:22.194675+0000","last_became_active":"2024-08-17T02:22:21.175003+0000","last_became_peered":"2024-08-17T02:22:21.175003+0000","last_unstale":"2024-08-17T02:22:22.194675+0000","last_undegraded":"2024-08-17T02:22:22.194675+0000","last_fullsized":"2024-08-17T02:22:22.194675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:14:08.171959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.205630+0000","last_change":"2024-08-17T02:22:22.199455+0000","last_active":"2024-08-17T02:22:22.205630+0000","last_peered":"2024-08-17T02:22:22.205630+0000","last_clean":"2024-08-17T02:22:22.205630+0000","last_became_active":"2024-08-17T02:22:22.198936+0000","last_became_peered":"2024-08-17T02:22:22.198936+0000","last_unstale":"2024-08-17T02:22:22.205630+0000","last_undegraded":"2024-08-17T02:22:22.205630+0000","last_fullsized":"2024-08-17T02:22:22.205630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:23.581757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:22:21.183201+0000","last_change":"2024-08-17T02:22:21.176180+0000","last_active":"2024-08-17T02:22:21.183201+0000","last_peered":"2024-08-17T02:22:21.183201+0000","last_clean":"2024-08-17T02:22:21.183201+0000","last_became_active":"2024-08-17T02:22:21.175771+0000","last_became_peered":"2024-08-17T02:22:21.175771+0000","last_unstale":"2024-08-17T02:22:21.183201+0000","last_undegraded":"2024-08-17T02:22:21.183201+0000","last_fullsized":"2024-08-17T02:22:21.183201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:14:32.873264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.194158+0000","last_change":"2024-08-17T02:22:22.194158+0000","last_active":"2024-08-17T02:22:22.194158+0000","last_peered":"2024-08-17T02:22:22.194158+0000","last_clean":"2024-08-17T02:22:22.194158+0000","last_became_active":"2024-08-17T02:22:22.193862+0000","last_became_peered":"2024-08-17T02:22:22.193862+0000","last_unstale":"2024-08-17T02:22:22.194158+0000","last_undegraded":"2024-08-17T02:22:22.194158+0000","last_fullsized":"2024-08-17T02:22:22.194158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:31:18.328390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.216222+0000","last_change":"2024-08-17T02:22:21.179787+0000","last_active":"2024-08-17T02:22:22.216222+0000","last_peered":"2024-08-17T02:22:22.216222+0000","last_clean":"2024-08-17T02:22:22.216222+0000","last_became_active":"2024-08-17T02:22:21.178882+0000","last_became_peered":"2024-08-17T02:22:21.178882+0000","last_unstale":"2024-08-17T02:22:22.216222+0000","last_undegraded":"2024-08-17T02:22:22.216222+0000","last_fullsized":"2024-08-17T02:22:22.216222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:11:57.093981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.209292+0000","last_change":"2024-08-17T02:22:22.209292+0000","last_active":"2024-08-17T02:22:22.209292+0000","last_peered":"2024-08-17T02:22:22.209292+0000","last_clean":"2024-08-17T02:22:22.209292+0000","last_became_active":"2024-08-17T02:22:22.208985+0000","last_became_peered":"2024-08-17T02:22:22.208985+0000","last_unstale":"2024-08-17T02:22:22.209292+0000","last_undegraded":"2024-08-17T02:22:22.209292+0000","last_fullsized":"2024-08-17T02:22:22.209292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:06:36.575795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.202975+0000","last_change":"2024-08-17T02:22:22.202975+0000","last_active":"2024-08-17T02:22:22.202975+0000","last_peered":"2024-08-17T02:22:22.202975+0000","last_clean":"2024-08-17T02:22:22.202975+0000","last_became_active":"2024-08-17T02:22:22.202642+0000","last_became_peered":"2024-08-17T02:22:22.202642+0000","last_unstale":"2024-08-17T02:22:22.202975+0000","last_undegraded":"2024-08-17T02:22:22.202975+0000","last_fullsized":"2024-08-17T02:22:22.202975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:23:10.867889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.215260+0000","last_change":"2024-08-17T02:22:21.181265+0000","last_active":"2024-08-17T02:22:22.215260+0000","last_peered":"2024-08-17T02:22:22.215260+0000","last_clean":"2024-08-17T02:22:22.215260+0000","last_became_active":"2024-08-17T02:22:21.179868+0000","last_became_peered":"2024-08-17T02:22:21.179868+0000","last_unstale":"2024-08-17T02:22:22.215260+0000","last_undegraded":"2024-08-17T02:22:22.215260+0000","last_fullsized":"2024-08-17T02:22:22.215260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:01:30.822179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.209539+0000","last_change":"2024-08-17T02:22:22.204765+0000","last_active":"2024-08-17T02:22:22.209539+0000","last_peered":"2024-08-17T02:22:22.209539+0000","last_clean":"2024-08-17T02:22:22.209539+0000","last_became_active":"2024-08-17T02:22:22.204508+0000","last_became_peered":"2024-08-17T02:22:22.204508+0000","last_unstale":"2024-08-17T02:22:22.209539+0000","last_undegraded":"2024-08-17T02:22:22.209539+0000","last_fullsized":"2024-08-17T02:22:22.209539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:57:26.443145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.215173+0000","last_change":"2024-08-17T02:22:21.175884+0000","last_active":"2024-08-17T02:22:22.215173+0000","last_peered":"2024-08-17T02:22:22.215173+0000","last_clean":"2024-08-17T02:22:22.215173+0000","last_became_active":"2024-08-17T02:22:21.175130+0000","last_became_peered":"2024-08-17T02:22:21.175130+0000","last_unstale":"2024-08-17T02:22:22.215173+0000","last_undegraded":"2024-08-17T02:22:22.215173+0000","last_fullsized":"2024-08-17T02:22:22.215173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:47:30.406922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.201295+0000","last_change":"2024-08-17T02:22:22.193359+0000","last_active":"2024-08-17T02:22:22.201295+0000","last_peered":"2024-08-17T02:22:22.201295+0000","last_clean":"2024-08-17T02:22:22.201295+0000","last_became_active":"2024-08-17T02:22:22.192492+0000","last_became_peered":"2024-08-17T02:22:22.192492+0000","last_unstale":"2024-08-17T02:22:22.201295+0000","last_undegraded":"2024-08-17T02:22:22.201295+0000","last_fullsized":"2024-08-17T02:22:22.201295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:08:06.080463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.216505+0000","last_change":"2024-08-17T02:22:21.172581+0000","last_active":"2024-08-17T02:22:22.216505+0000","last_peered":"2024-08-17T02:22:22.216505+0000","last_clean":"2024-08-17T02:22:22.216505+0000","last_became_active":"2024-08-17T02:22:21.172139+0000","last_became_peered":"2024-08-17T02:22:21.172139+0000","last_unstale":"2024-08-17T02:22:22.216505+0000","last_undegraded":"2024-08-17T02:22:22.216505+0000","last_fullsized":"2024-08-17T02:22:22.216505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:01:30.822179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.201398+0000","last_change":"2024-08-17T02:22:22.196174+0000","last_active":"2024-08-17T02:22:22.201398+0000","last_peered":"2024-08-17T02:22:22.201398+0000","last_clean":"2024-08-17T02:22:22.201398+0000","last_became_active":"2024-08-17T02:22:22.195901+0000","last_became_peered":"2024-08-17T02:22:22.195901+0000","last_unstale":"2024-08-17T02:22:22.201398+0000","last_undegraded":"2024-08-17T02:22:22.201398+0000","last_fullsized":"2024-08-17T02:22:22.201398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:46:07.630925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.218844+0000","last_change":"2024-08-17T02:22:21.181273+0000","last_active":"2024-08-17T02:22:22.218844+0000","last_peered":"2024-08-17T02:22:22.218844+0000","last_clean":"2024-08-17T02:22:22.218844+0000","last_became_active":"2024-08-17T02:22:21.181022+0000","last_became_peered":"2024-08-17T02:22:21.181022+0000","last_unstale":"2024-08-17T02:22:22.218844+0000","last_undegraded":"2024-08-17T02:22:22.218844+0000","last_fullsized":"2024-08-17T02:22:22.218844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:47:30.406922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297588,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":229376,"data_stored":74467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]}]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298164,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073676,"statfs":{"total":96636764160,"available":96331444224,"internally_reserved":0,"allocated":823296,"data_stored":664803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]}]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":253952,"data_stored":82843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]}]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":225280,"data_stored":74913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]}]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297596,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074244,"statfs":{"total":96636764160,"available":96332025856,"internally_reserved":0,"allocated":245760,"data_stored":82183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.052}]}]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298160,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073680,"statfs":{"total":96636764160,"available":96331448320,"internally_reserved":0,"allocated":819200,"data_stored":664781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3580000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.224}]}]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297588,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":229376,"data_stored":74399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301720,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070120,"statfs":{"total":96636764160,"available":96327802880,"internally_reserved":0,"allocated":208896,"data_stored":67580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.149}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.258}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.296}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:22:26.181 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:22:26.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.278+0000 7f50e7fff700 1 Processor -- start 2024-08-17T02:22:26.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.278+0000 7f50e7fff700 1 -- start start 2024-08-17T02:22:26.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.278+0000 7f50e7fff700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f50e8153320 0x7f50e81536f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:26.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.278+0000 7f50e7fff700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f50e815a190 0x7f50e815cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:26.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.278+0000 7f50e7fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50e80ccaa0 0x7f50e80ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:26.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.278+0000 7f50e7fff700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50e80ce430 con 0x7f50e815a190 2024-08-17T02:22:26.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.278+0000 7f50e7fff700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50e80cd440 con 0x7f50e8153320 2024-08-17T02:22:26.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.278+0000 7f50e7fff700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e815dbd0 con 0x7f50e80ccaa0 2024-08-17T02:22:26.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.278+0000 7f50dffff700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f50e815a190 0x7f50e815cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:26.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.278+0000 7f50dffff700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f50e815a190 0x7f50e815cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45694/0 (socket says 172.21.15.104:45694) 2024-08-17T02:22:26.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.278+0000 7f50dffff700 1 -- 172.21.15.104:0/952802117 learned_addr learned my addr 172.21.15.104:0/952802117 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:26.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.278+0000 7f50e6ffd700 1 --2- 172.21.15.104:0/952802117 >> v2:172.21.15.117:3300/0 conn(0x7f50e8153320 0x7f50e81536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:26.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.278+0000 7f50e77fe700 1 --2- 172.21.15.104:0/952802117 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50e80ccaa0 0x7f50e80ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:26.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.278+0000 7f50dffff700 1 -- 172.21.15.104:0/952802117 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50e80ccaa0 msgr2=0x7f50e80ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:26.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.278+0000 7f50dffff700 1 --2- 172.21.15.104:0/952802117 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50e80ccaa0 0x7f50e80ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:26.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.278+0000 7f50dffff700 1 -- 172.21.15.104:0/952802117 >> v2:172.21.15.117:3300/0 conn(0x7f50e8153320 msgr2=0x7f50e81536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:26.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.278+0000 7f50dffff700 1 --2- 172.21.15.104:0/952802117 >> v2:172.21.15.117:3300/0 conn(0x7f50e8153320 0x7f50e81536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:26.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.278+0000 7f50dffff700 1 -- 172.21.15.104:0/952802117 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e815d370 con 0x7f50e815a190 2024-08-17T02:22:26.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.278+0000 7f50e6ffd700 1 --2- 172.21.15.104:0/952802117 >> v2:172.21.15.117:3300/0 conn(0x7f50e8153320 0x7f50e81536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:22:26.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.282+0000 7f50dffff700 1 --2- 172.21.15.104:0/952802117 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f50e815a190 0x7f50e815cc60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f50e80d0cd0 tx=0x7f50d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecade011e3efc01d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:26.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.282+0000 7f50e67fc700 1 -- 172.21.15.104:0/952802117 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d000b640 con 0x7f50e815a190 2024-08-17T02:22:26.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.282+0000 7f50e67fc700 1 -- 172.21.15.104:0/952802117 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d000b7a0 con 0x7f50e815a190 2024-08-17T02:22:26.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.282+0000 7f50e67fc700 1 -- 172.21.15.104:0/952802117 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d000bb60 con 0x7f50e815a190 2024-08-17T02:22:26.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.282+0000 7f50e7fff700 1 -- 172.21.15.104:0/952802117 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f50e815a190 msgr2=0x7f50e815cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:26.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.282+0000 7f50e7fff700 1 --2- 172.21.15.104:0/952802117 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f50e815a190 0x7f50e815cc60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f50e80d0cd0 tx=0x7f50d0009250 comp rx=0 tx=0).stop 2024-08-17T02:22:26.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.282+0000 7f50e7fff700 1 -- 172.21.15.104:0/952802117 shutdown_connections 2024-08-17T02:22:26.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.282+0000 7f50e7fff700 1 --2- 172.21.15.104:0/952802117 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50e80ccaa0 0x7f50e80ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:26.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.282+0000 7f50e7fff700 1 --2- 172.21.15.104:0/952802117 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f50e815a190 0x7f50e815cc60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:26.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.282+0000 7f50e7fff700 1 --2- 172.21.15.104:0/952802117 >> v2:172.21.15.117:3300/0 conn(0x7f50e8153320 0x7f50e81536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:26.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.282+0000 7f50e7fff700 1 -- 172.21.15.104:0/952802117 >> 172.21.15.104:0/952802117 conn(0x7f50e80d00a0 msgr2=0x7f50e80d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:26.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.282+0000 7f50e7fff700 1 -- 172.21.15.104:0/952802117 shutdown_connections 2024-08-17T02:22:26.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.282+0000 7f50e7fff700 1 -- 172.21.15.104:0/952802117 wait complete. 2024-08-17T02:22:26.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.282+0000 7f50e7fff700 1 Processor -- start 2024-08-17T02:22:26.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.282+0000 7f50e7fff700 1 -- start start 2024-08-17T02:22:26.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.286+0000 7f50e7fff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f50e80ccaa0 0x7f50e8150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:26.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.286+0000 7f50e7fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50e8153320 0x7f50e8157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:26.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.286+0000 7f50e7fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50e815a190 0x7f50e80b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:26.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.286+0000 7f50e7fff700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e8157dd0 con 0x7f50e80ccaa0 2024-08-17T02:22:26.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.286+0000 7f50e7fff700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e81580b0 con 0x7f50e8153320 2024-08-17T02:22:26.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.286+0000 7f50e7fff700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e8158390 con 0x7f50e815a190 2024-08-17T02:22:26.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.286+0000 7f50e6ffd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f50e80ccaa0 0x7f50e8150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:26.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.286+0000 7f50e6ffd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f50e80ccaa0 0x7f50e8150ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45706/0 (socket says 172.21.15.104:45706) 2024-08-17T02:22:26.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.286+0000 7f50e6ffd700 1 -- 172.21.15.104:0/723871181 learned_addr learned my addr 172.21.15.104:0/723871181 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:26.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.286+0000 7f50e77fe700 1 --2- 172.21.15.104:0/723871181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50e815a190 0x7f50e80b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:26.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.286+0000 7f50dffff700 1 --2- 172.21.15.104:0/723871181 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50e8153320 0x7f50e8157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:26.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.286+0000 7f50e6ffd700 1 -- 172.21.15.104:0/723871181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50e815a190 msgr2=0x7f50e80b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:26.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.286+0000 7f50e6ffd700 1 --2- 172.21.15.104:0/723871181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50e815a190 0x7f50e80b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:26.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.286+0000 7f50e6ffd700 1 -- 172.21.15.104:0/723871181 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50e8153320 msgr2=0x7f50e8157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:26.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.286+0000 7f50e6ffd700 1 --2- 172.21.15.104:0/723871181 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50e8153320 0x7f50e8157380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:26.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.286+0000 7f50e6ffd700 1 -- 172.21.15.104:0/723871181 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d8009420 con 0x7f50e80ccaa0 2024-08-17T02:22:26.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.286+0000 7f50e6ffd700 1 --2- 172.21.15.104:0/723871181 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f50e80ccaa0 0x7f50e8150ad0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f50d800ec80 tx=0x7f50d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:26.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.286+0000 7f50deffd700 1 -- 172.21.15.104:0/723871181 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d800c9b0 con 0x7f50e80ccaa0 2024-08-17T02:22:26.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.286+0000 7f50deffd700 1 -- 172.21.15.104:0/723871181 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d800cb10 con 0x7f50e80ccaa0 2024-08-17T02:22:26.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.286+0000 7f50e7fff700 1 -- 172.21.15.104:0/723871181 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50d00094f0 con 0x7f50e80ccaa0 2024-08-17T02:22:26.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.286+0000 7f50deffd700 1 -- 172.21.15.104:0/723871181 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d800ce90 con 0x7f50e80ccaa0 2024-08-17T02:22:26.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.286+0000 7f50e7fff700 1 -- 172.21.15.104:0/723871181 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50e8158950 con 0x7f50e80ccaa0 2024-08-17T02:22:26.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.290+0000 7f50e7fff700 1 -- 172.21.15.104:0/723871181 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50e80638f0 con 0x7f50e80ccaa0 2024-08-17T02:22:26.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.290+0000 7f50deffd700 1 -- 172.21.15.104:0/723871181 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f50d8013680 con 0x7f50e80ccaa0 2024-08-17T02:22:26.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.290+0000 7f50deffd700 1 --2- 172.21.15.104:0/723871181 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f50c8060890 0x7f50c8062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:26.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.290+0000 7f50deffd700 1 -- 172.21.15.104:0/723871181 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f50d807d2c0 con 0x7f50e80ccaa0 2024-08-17T02:22:26.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.290+0000 7f50dffff700 1 --2- 172.21.15.104:0/723871181 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f50c8060890 0x7f50c8062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:26.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.290+0000 7f50dffff700 1 --2- 172.21.15.104:0/723871181 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f50c8060890 0x7f50c8062d40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f50e80d0cd0 tx=0x7f50d0017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:26.303 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.298+0000 7f50deffd700 1 -- 172.21.15.104:0/723871181 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f50d80511a0 con 0x7f50e80ccaa0 2024-08-17T02:22:26.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.454+0000 7f50e7fff700 1 -- 172.21.15.104:0/723871181 --> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f50e80cde20 con 0x7f50c8060890 2024-08-17T02:22:26.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.474+0000 7f50deffd700 1 -- 172.21.15.104:0/723871181 <== mgr.4111 v2:172.21.15.117:6832/24084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264441 (secure 0 0 0) 0x7f50e80cde20 con 0x7f50c8060890 2024-08-17T02:22:26.480 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:22:26.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.474+0000 7f50e7fff700 1 -- 172.21.15.104:0/723871181 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f50c8060890 msgr2=0x7f50c8062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:26.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.474+0000 7f50e7fff700 1 --2- 172.21.15.104:0/723871181 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f50c8060890 0x7f50c8062d40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f50e80d0cd0 tx=0x7f50d0017000 comp rx=0 tx=0).stop 2024-08-17T02:22:26.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.474+0000 7f50e7fff700 1 -- 172.21.15.104:0/723871181 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f50e80ccaa0 msgr2=0x7f50e8150ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:26.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.474+0000 7f50e7fff700 1 --2- 172.21.15.104:0/723871181 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f50e80ccaa0 0x7f50e8150ad0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f50d800ec80 tx=0x7f50d80091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:26.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.474+0000 7f50e7fff700 1 -- 172.21.15.104:0/723871181 shutdown_connections 2024-08-17T02:22:26.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.474+0000 7f50e7fff700 1 --2- 172.21.15.104:0/723871181 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f50c8060890 0x7f50c8062d40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:26.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.474+0000 7f50e7fff700 1 --2- 172.21.15.104:0/723871181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50e815a190 0x7f50e80b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:26.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.474+0000 7f50e7fff700 1 --2- 172.21.15.104:0/723871181 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50e8153320 0x7f50e8157380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:26.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.474+0000 7f50e7fff700 1 --2- 172.21.15.104:0/723871181 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f50e80ccaa0 0x7f50e8150ad0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:26.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.474+0000 7f50e7fff700 1 -- 172.21.15.104:0/723871181 >> 172.21.15.104:0/723871181 conn(0x7f50e80d00a0 msgr2=0x7f50e815aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:26.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.474+0000 7f50e7fff700 1 -- 172.21.15.104:0/723871181 shutdown_connections 2024-08-17T02:22:26.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.474+0000 7f50e7fff700 1 -- 172.21.15.104:0/723871181 wait complete. 2024-08-17T02:22:26.484 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-08-17T02:22:26.496 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-08-17T02:22:26.086932+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":127,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2386004,"kb_used_data":2964,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752588716,"statfs":{"total":773094113280,"available":770650845184,"internally_reserved":0,"allocated":3035136,"data_stored":1785969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.937740"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.207394+0000","last_change":"2024-08-17T02:22:22.207394+0000","last_active":"2024-08-17T02:22:22.207394+0000","last_peered":"2024-08-17T02:22:22.207394+0000","last_clean":"2024-08-17T02:22:22.207394+0000","last_became_active":"2024-08-17T02:22:22.207136+0000","last_became_peered":"2024-08-17T02:22:22.207136+0000","last_unstale":"2024-08-17T02:22:22.207394+0000","last_undegraded":"2024-08-17T02:22:22.207394+0000","last_fullsized":"2024-08-17T02:22:22.207394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:18:56.483735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.201158+0000","last_change":"2024-08-17T02:22:22.193365+0000","last_active":"2024-08-17T02:22:22.201158+0000","last_peered":"2024-08-17T02:22:22.201158+0000","last_clean":"2024-08-17T02:22:22.201158+0000","last_became_active":"2024-08-17T02:22:22.192975+0000","last_became_peered":"2024-08-17T02:22:22.192975+0000","last_unstale":"2024-08-17T02:22:22.201158+0000","last_undegraded":"2024-08-17T02:22:22.201158+0000","last_fullsized":"2024-08-17T02:22:22.201158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:21:01.768875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.201378+0000","last_change":"2024-08-17T02:22:22.195675+0000","last_active":"2024-08-17T02:22:22.201378+0000","last_peered":"2024-08-17T02:22:22.201378+0000","last_clean":"2024-08-17T02:22:22.201378+0000","last_became_active":"2024-08-17T02:22:22.195378+0000","last_became_peered":"2024-08-17T02:22:22.195378+0000","last_unstale":"2024-08-17T02:22:22.201378+0000","last_undegraded":"2024-08-17T02:22:22.201378+0000","last_fullsized":"2024-08-17T02:22:22.201378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:42:06.496970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.213303+0000","last_change":"2024-08-17T02:22:22.206371+0000","last_active":"2024-08-17T02:22:22.213303+0000","last_peered":"2024-08-17T02:22:22.213303+0000","last_clean":"2024-08-17T02:22:22.213303+0000","last_became_active":"2024-08-17T02:22:22.206060+0000","last_became_peered":"2024-08-17T02:22:22.206060+0000","last_unstale":"2024-08-17T02:22:22.213303+0000","last_undegraded":"2024-08-17T02:22:22.213303+0000","last_fullsized":"2024-08-17T02:22:22.213303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:14:09.179717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.205544+0000","last_change":"2024-08-17T02:22:22.205544+0000","last_active":"2024-08-17T02:22:22.205544+0000","last_peered":"2024-08-17T02:22:22.205544+0000","last_clean":"2024-08-17T02:22:22.205544+0000","last_became_active":"2024-08-17T02:22:22.204373+0000","last_became_peered":"2024-08-17T02:22:22.204373+0000","last_unstale":"2024-08-17T02:22:22.205544+0000","last_undegraded":"2024-08-17T02:22:22.205544+0000","last_fullsized":"2024-08-17T02:22:22.205544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:12:21.015335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.210109+0000","last_change":"2024-08-17T02:22:22.203860+0000","last_active":"2024-08-17T02:22:22.210109+0000","last_peered":"2024-08-17T02:22:22.210109+0000","last_clean":"2024-08-17T02:22:22.210109+0000","last_became_active":"2024-08-17T02:22:22.203585+0000","last_became_peered":"2024-08-17T02:22:22.203585+0000","last_unstale":"2024-08-17T02:22:22.210109+0000","last_undegraded":"2024-08-17T02:22:22.210109+0000","last_fullsized":"2024-08-17T02:22:22.210109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:31:18.328390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.202691+0000","last_change":"2024-08-17T02:22:22.202691+0000","last_active":"2024-08-17T02:22:22.202691+0000","last_peered":"2024-08-17T02:22:22.202691+0000","last_clean":"2024-08-17T02:22:22.202691+0000","last_became_active":"2024-08-17T02:22:22.202339+0000","last_became_peered":"2024-08-17T02:22:22.202339+0000","last_unstale":"2024-08-17T02:22:22.202691+0000","last_undegraded":"2024-08-17T02:22:22.202691+0000","last_fullsized":"2024-08-17T02:22:22.202691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:42:06.496970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.204363+0000","last_change":"2024-08-17T02:22:22.198103+0000","last_active":"2024-08-17T02:22:22.204363+0000","last_peered":"2024-08-17T02:22:22.204363+0000","last_clean":"2024-08-17T02:22:22.204363+0000","last_became_active":"2024-08-17T02:22:22.197796+0000","last_became_peered":"2024-08-17T02:22:22.197796+0000","last_unstale":"2024-08-17T02:22:22.204363+0000","last_undegraded":"2024-08-17T02:22:22.204363+0000","last_fullsized":"2024-08-17T02:22:22.204363+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:52:23.293649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.207212+0000","last_change":"2024-08-17T02:22:22.202799+0000","last_active":"2024-08-17T02:22:22.207212+0000","last_peered":"2024-08-17T02:22:22.207212+0000","last_clean":"2024-08-17T02:22:22.207212+0000","last_became_active":"2024-08-17T02:22:22.202553+0000","last_became_peered":"2024-08-17T02:22:22.202553+0000","last_unstale":"2024-08-17T02:22:22.207212+0000","last_undegraded":"2024-08-17T02:22:22.207212+0000","last_fullsized":"2024-08-17T02:22:22.207212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:25:58.131547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.200665+0000","last_change":"2024-08-17T02:22:22.200665+0000","last_active":"2024-08-17T02:22:22.200665+0000","last_peered":"2024-08-17T02:22:22.200665+0000","last_clean":"2024-08-17T02:22:22.200665+0000","last_became_active":"2024-08-17T02:22:22.200068+0000","last_became_peered":"2024-08-17T02:22:22.200068+0000","last_unstale":"2024-08-17T02:22:22.200665+0000","last_undegraded":"2024-08-17T02:22:22.200665+0000","last_fullsized":"2024-08-17T02:22:22.200665+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:45:56.296454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.205418+0000","last_change":"2024-08-17T02:22:22.205418+0000","last_active":"2024-08-17T02:22:22.205418+0000","last_peered":"2024-08-17T02:22:22.205418+0000","last_clean":"2024-08-17T02:22:22.205418+0000","last_became_active":"2024-08-17T02:22:22.205155+0000","last_became_peered":"2024-08-17T02:22:22.205155+0000","last_unstale":"2024-08-17T02:22:22.205418+0000","last_undegraded":"2024-08-17T02:22:22.205418+0000","last_fullsized":"2024-08-17T02:22:22.205418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:09:52.735534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.208616+0000","last_change":"2024-08-17T02:22:22.208616+0000","last_active":"2024-08-17T02:22:22.208616+0000","last_peered":"2024-08-17T02:22:22.208616+0000","last_clean":"2024-08-17T02:22:22.208616+0000","last_became_active":"2024-08-17T02:22:22.208243+0000","last_became_peered":"2024-08-17T02:22:22.208243+0000","last_unstale":"2024-08-17T02:22:22.208616+0000","last_undegraded":"2024-08-17T02:22:22.208616+0000","last_fullsized":"2024-08-17T02:22:22.208616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:06:36.575795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.201596+0000","last_change":"2024-08-17T02:22:22.201596+0000","last_active":"2024-08-17T02:22:22.201596+0000","last_peered":"2024-08-17T02:22:22.201596+0000","last_clean":"2024-08-17T02:22:22.201596+0000","last_became_active":"2024-08-17T02:22:22.201280+0000","last_became_peered":"2024-08-17T02:22:22.201280+0000","last_unstale":"2024-08-17T02:22:22.201596+0000","last_undegraded":"2024-08-17T02:22:22.201596+0000","last_fullsized":"2024-08-17T02:22:22.201596+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:32:08.356996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.196235+0000","last_change":"2024-08-17T02:22:22.196235+0000","last_active":"2024-08-17T02:22:22.196235+0000","last_peered":"2024-08-17T02:22:22.196235+0000","last_clean":"2024-08-17T02:22:22.196235+0000","last_became_active":"2024-08-17T02:22:22.195933+0000","last_became_peered":"2024-08-17T02:22:22.195933+0000","last_unstale":"2024-08-17T02:22:22.196235+0000","last_undegraded":"2024-08-17T02:22:22.196235+0000","last_fullsized":"2024-08-17T02:22:22.196235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:24:36.708380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.205916+0000","last_change":"2024-08-17T02:22:22.203673+0000","last_active":"2024-08-17T02:22:22.205916+0000","last_peered":"2024-08-17T02:22:22.205916+0000","last_clean":"2024-08-17T02:22:22.205916+0000","last_became_active":"2024-08-17T02:22:22.203378+0000","last_became_peered":"2024-08-17T02:22:22.203378+0000","last_unstale":"2024-08-17T02:22:22.205916+0000","last_undegraded":"2024-08-17T02:22:22.205916+0000","last_fullsized":"2024-08-17T02:22:22.205916+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:14:55.331054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.204557+0000","last_change":"2024-08-17T02:22:22.204557+0000","last_active":"2024-08-17T02:22:22.204557+0000","last_peered":"2024-08-17T02:22:22.204557+0000","last_clean":"2024-08-17T02:22:22.204557+0000","last_became_active":"2024-08-17T02:22:22.203145+0000","last_became_peered":"2024-08-17T02:22:22.203145+0000","last_unstale":"2024-08-17T02:22:22.204557+0000","last_undegraded":"2024-08-17T02:22:22.204557+0000","last_fullsized":"2024-08-17T02:22:22.204557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:54:53.542063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.205880+0000","last_change":"2024-08-17T02:22:22.205880+0000","last_active":"2024-08-17T02:22:22.205880+0000","last_peered":"2024-08-17T02:22:22.205880+0000","last_clean":"2024-08-17T02:22:22.205880+0000","last_became_active":"2024-08-17T02:22:22.205133+0000","last_became_peered":"2024-08-17T02:22:22.205133+0000","last_unstale":"2024-08-17T02:22:22.205880+0000","last_undegraded":"2024-08-17T02:22:22.205880+0000","last_fullsized":"2024-08-17T02:22:22.205880+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:42:34.031508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.199981+0000","last_change":"2024-08-17T02:22:22.199981+0000","last_active":"2024-08-17T02:22:22.199981+0000","last_peered":"2024-08-17T02:22:22.199981+0000","last_clean":"2024-08-17T02:22:22.199981+0000","last_became_active":"2024-08-17T02:22:22.199695+0000","last_became_peered":"2024-08-17T02:22:22.199695+0000","last_unstale":"2024-08-17T02:22:22.199981+0000","last_undegraded":"2024-08-17T02:22:22.199981+0000","last_fullsized":"2024-08-17T02:22:22.199981+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:10:01.636342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.195819+0000","last_change":"2024-08-17T02:22:22.195819+0000","last_active":"2024-08-17T02:22:22.195819+0000","last_peered":"2024-08-17T02:22:22.195819+0000","last_clean":"2024-08-17T02:22:22.195819+0000","last_became_active":"2024-08-17T02:22:22.195534+0000","last_became_peered":"2024-08-17T02:22:22.195534+0000","last_unstale":"2024-08-17T02:22:22.195819+0000","last_undegraded":"2024-08-17T02:22:22.195819+0000","last_fullsized":"2024-08-17T02:22:22.195819+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:14:13.686376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.208982+0000","last_change":"2024-08-17T02:22:22.208982+0000","last_active":"2024-08-17T02:22:22.208982+0000","last_peered":"2024-08-17T02:22:22.208982+0000","last_clean":"2024-08-17T02:22:22.208982+0000","last_became_active":"2024-08-17T02:22:22.208519+0000","last_became_peered":"2024-08-17T02:22:22.208519+0000","last_unstale":"2024-08-17T02:22:22.208982+0000","last_undegraded":"2024-08-17T02:22:22.208982+0000","last_fullsized":"2024-08-17T02:22:22.208982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:14:55.331054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.216569+0000","last_change":"2024-08-17T02:22:22.208260+0000","last_active":"2024-08-17T02:22:22.216569+0000","last_peered":"2024-08-17T02:22:22.216569+0000","last_clean":"2024-08-17T02:22:22.216569+0000","last_became_active":"2024-08-17T02:22:22.207547+0000","last_became_peered":"2024-08-17T02:22:22.207547+0000","last_unstale":"2024-08-17T02:22:22.216569+0000","last_undegraded":"2024-08-17T02:22:22.216569+0000","last_fullsized":"2024-08-17T02:22:22.216569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:50:20.438197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.207287+0000","last_change":"2024-08-17T02:22:22.199523+0000","last_active":"2024-08-17T02:22:22.207287+0000","last_peered":"2024-08-17T02:22:22.207287+0000","last_clean":"2024-08-17T02:22:22.207287+0000","last_became_active":"2024-08-17T02:22:22.198679+0000","last_became_peered":"2024-08-17T02:22:22.198679+0000","last_unstale":"2024-08-17T02:22:22.207287+0000","last_undegraded":"2024-08-17T02:22:22.207287+0000","last_fullsized":"2024-08-17T02:22:22.207287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:52:03.967168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.205677+0000","last_change":"2024-08-17T02:22:22.200108+0000","last_active":"2024-08-17T02:22:22.205677+0000","last_peered":"2024-08-17T02:22:22.205677+0000","last_clean":"2024-08-17T02:22:22.205677+0000","last_became_active":"2024-08-17T02:22:22.199791+0000","last_became_peered":"2024-08-17T02:22:22.199791+0000","last_unstale":"2024-08-17T02:22:22.205677+0000","last_undegraded":"2024-08-17T02:22:22.205677+0000","last_fullsized":"2024-08-17T02:22:22.205677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:50:20.438197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.197872+0000","last_change":"2024-08-17T02:22:22.197872+0000","last_active":"2024-08-17T02:22:22.197872+0000","last_peered":"2024-08-17T02:22:22.197872+0000","last_clean":"2024-08-17T02:22:22.197872+0000","last_became_active":"2024-08-17T02:22:22.197575+0000","last_became_peered":"2024-08-17T02:22:22.197575+0000","last_unstale":"2024-08-17T02:22:22.197872+0000","last_undegraded":"2024-08-17T02:22:22.197872+0000","last_fullsized":"2024-08-17T02:22:22.197872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:19:48.379073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.201276+0000","last_change":"2024-08-17T02:22:22.192977+0000","last_active":"2024-08-17T02:22:22.201276+0000","last_peered":"2024-08-17T02:22:22.201276+0000","last_clean":"2024-08-17T02:22:22.201276+0000","last_became_active":"2024-08-17T02:22:22.192692+0000","last_became_peered":"2024-08-17T02:22:22.192692+0000","last_unstale":"2024-08-17T02:22:22.201276+0000","last_undegraded":"2024-08-17T02:22:22.201276+0000","last_fullsized":"2024-08-17T02:22:22.201276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:45:56.296454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.213112+0000","last_change":"2024-08-17T02:22:22.206334+0000","last_active":"2024-08-17T02:22:22.213112+0000","last_peered":"2024-08-17T02:22:22.213112+0000","last_clean":"2024-08-17T02:22:22.213112+0000","last_became_active":"2024-08-17T02:22:22.203810+0000","last_became_peered":"2024-08-17T02:22:22.203810+0000","last_unstale":"2024-08-17T02:22:22.213112+0000","last_undegraded":"2024-08-17T02:22:22.213112+0000","last_fullsized":"2024-08-17T02:22:22.213112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:44:23.689354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.196495+0000","last_change":"2024-08-17T02:22:22.196495+0000","last_active":"2024-08-17T02:22:22.196495+0000","last_peered":"2024-08-17T02:22:22.196495+0000","last_clean":"2024-08-17T02:22:22.196495+0000","last_became_active":"2024-08-17T02:22:22.196141+0000","last_became_peered":"2024-08-17T02:22:22.196141+0000","last_unstale":"2024-08-17T02:22:22.196495+0000","last_undegraded":"2024-08-17T02:22:22.196495+0000","last_fullsized":"2024-08-17T02:22:22.196495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:50:27.904463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.206082+0000","last_change":"2024-08-17T02:22:22.206082+0000","last_active":"2024-08-17T02:22:22.206082+0000","last_peered":"2024-08-17T02:22:22.206082+0000","last_clean":"2024-08-17T02:22:22.206082+0000","last_became_active":"2024-08-17T02:22:22.205748+0000","last_became_peered":"2024-08-17T02:22:22.205748+0000","last_unstale":"2024-08-17T02:22:22.206082+0000","last_undegraded":"2024-08-17T02:22:22.206082+0000","last_fullsized":"2024-08-17T02:22:22.206082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:37:31.095543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.198292+0000","last_change":"2024-08-17T02:22:22.188239+0000","last_active":"2024-08-17T02:22:22.198292+0000","last_peered":"2024-08-17T02:22:22.198292+0000","last_clean":"2024-08-17T02:22:22.198292+0000","last_became_active":"2024-08-17T02:22:22.187975+0000","last_became_peered":"2024-08-17T02:22:22.187975+0000","last_unstale":"2024-08-17T02:22:22.198292+0000","last_undegraded":"2024-08-17T02:22:22.198292+0000","last_fullsized":"2024-08-17T02:22:22.198292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:01:06.448601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.200334+0000","last_change":"2024-08-17T02:22:22.200334+0000","last_active":"2024-08-17T02:22:22.200334+0000","last_peered":"2024-08-17T02:22:22.200334+0000","last_clean":"2024-08-17T02:22:22.200334+0000","last_became_active":"2024-08-17T02:22:22.200074+0000","last_became_peered":"2024-08-17T02:22:22.200074+0000","last_unstale":"2024-08-17T02:22:22.200334+0000","last_undegraded":"2024-08-17T02:22:22.200334+0000","last_fullsized":"2024-08-17T02:22:22.200334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:40:31.008079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.189468+0000","last_change":"2024-08-17T02:22:22.189468+0000","last_active":"2024-08-17T02:22:22.189468+0000","last_peered":"2024-08-17T02:22:22.189468+0000","last_clean":"2024-08-17T02:22:22.189468+0000","last_became_active":"2024-08-17T02:22:22.189055+0000","last_became_peered":"2024-08-17T02:22:22.189055+0000","last_unstale":"2024-08-17T02:22:22.189468+0000","last_undegraded":"2024-08-17T02:22:22.189468+0000","last_fullsized":"2024-08-17T02:22:22.189468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:14:09.179717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.211815+0000","last_change":"2024-08-17T02:22:22.204911+0000","last_active":"2024-08-17T02:22:22.211815+0000","last_peered":"2024-08-17T02:22:22.211815+0000","last_clean":"2024-08-17T02:22:22.211815+0000","last_became_active":"2024-08-17T02:22:22.204551+0000","last_became_peered":"2024-08-17T02:22:22.204551+0000","last_unstale":"2024-08-17T02:22:22.211815+0000","last_undegraded":"2024-08-17T02:22:22.211815+0000","last_fullsized":"2024-08-17T02:22:22.211815+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:47:31.414680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.207076+0000","last_change":"2024-08-17T02:22:22.193415+0000","last_active":"2024-08-17T02:22:22.207076+0000","last_peered":"2024-08-17T02:22:22.207076+0000","last_clean":"2024-08-17T02:22:22.207076+0000","last_became_active":"2024-08-17T02:22:22.193075+0000","last_became_peered":"2024-08-17T02:22:22.193075+0000","last_unstale":"2024-08-17T02:22:22.207076+0000","last_undegraded":"2024-08-17T02:22:22.207076+0000","last_fullsized":"2024-08-17T02:22:22.207076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:10:01.636342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.216386+0000","last_change":"2024-08-17T02:22:21.175481+0000","last_active":"2024-08-17T02:22:22.216386+0000","last_peered":"2024-08-17T02:22:22.216386+0000","last_clean":"2024-08-17T02:22:22.216386+0000","last_became_active":"2024-08-17T02:22:21.175155+0000","last_became_peered":"2024-08-17T02:22:21.175155+0000","last_unstale":"2024-08-17T02:22:22.216386+0000","last_undegraded":"2024-08-17T02:22:22.216386+0000","last_fullsized":"2024-08-17T02:22:22.216386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:35:31.942397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.205780+0000","last_change":"2024-08-17T02:22:22.204166+0000","last_active":"2024-08-17T02:22:22.205780+0000","last_peered":"2024-08-17T02:22:22.205780+0000","last_clean":"2024-08-17T02:22:22.205780+0000","last_became_active":"2024-08-17T02:22:22.203874+0000","last_became_peered":"2024-08-17T02:22:22.203874+0000","last_unstale":"2024-08-17T02:22:22.205780+0000","last_undegraded":"2024-08-17T02:22:22.205780+0000","last_fullsized":"2024-08-17T02:22:22.205780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:12:21.015335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.193625+0000","last_change":"2024-08-17T02:22:21.187087+0000","last_active":"2024-08-17T02:22:22.193625+0000","last_peered":"2024-08-17T02:22:22.193625+0000","last_clean":"2024-08-17T02:22:22.193625+0000","last_became_active":"2024-08-17T02:22:21.186780+0000","last_became_peered":"2024-08-17T02:22:21.186780+0000","last_unstale":"2024-08-17T02:22:22.193625+0000","last_undegraded":"2024-08-17T02:22:22.193625+0000","last_fullsized":"2024-08-17T02:22:22.193625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:53:21.168875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:22:21.185949+0000","last_change":"2024-08-17T02:22:21.184095+0000","last_active":"2024-08-17T02:22:21.185949+0000","last_peered":"2024-08-17T02:22:21.185949+0000","last_clean":"2024-08-17T02:22:21.185949+0000","last_became_active":"2024-08-17T02:22:21.183707+0000","last_became_peered":"2024-08-17T02:22:21.183707+0000","last_unstale":"2024-08-17T02:22:21.185949+0000","last_undegraded":"2024-08-17T02:22:21.185949+0000","last_fullsized":"2024-08-17T02:22:21.185949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:33:34.653965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.201739+0000","last_change":"2024-08-17T02:22:22.193669+0000","last_active":"2024-08-17T02:22:22.201739+0000","last_peered":"2024-08-17T02:22:22.201739+0000","last_clean":"2024-08-17T02:22:22.201739+0000","last_became_active":"2024-08-17T02:22:22.193231+0000","last_became_peered":"2024-08-17T02:22:22.193231+0000","last_unstale":"2024-08-17T02:22:22.201739+0000","last_undegraded":"2024-08-17T02:22:22.201739+0000","last_fullsized":"2024-08-17T02:22:22.201739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:34:22.570830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:22:21.182936+0000","last_change":"2024-08-17T02:22:21.178190+0000","last_active":"2024-08-17T02:22:21.182936+0000","last_peered":"2024-08-17T02:22:21.182936+0000","last_clean":"2024-08-17T02:22:21.182936+0000","last_became_active":"2024-08-17T02:22:21.177828+0000","last_became_peered":"2024-08-17T02:22:21.177828+0000","last_unstale":"2024-08-17T02:22:21.182936+0000","last_undegraded":"2024-08-17T02:22:21.182936+0000","last_fullsized":"2024-08-17T02:22:21.182936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:10:00.628584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.216728+0000","last_change":"2024-08-17T02:22:22.209400+0000","last_active":"2024-08-17T02:22:22.216728+0000","last_peered":"2024-08-17T02:22:22.216728+0000","last_clean":"2024-08-17T02:22:22.216728+0000","last_became_active":"2024-08-17T02:22:22.208986+0000","last_became_peered":"2024-08-17T02:22:22.208986+0000","last_unstale":"2024-08-17T02:22:22.216728+0000","last_undegraded":"2024-08-17T02:22:22.216728+0000","last_fullsized":"2024-08-17T02:22:22.216728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:01:06.448601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.182530+0000","last_change":"2024-08-17T02:22:21.171298+0000","last_active":"2024-08-17T02:22:22.182530+0000","last_peered":"2024-08-17T02:22:22.182530+0000","last_clean":"2024-08-17T02:22:22.182530+0000","last_became_active":"2024-08-17T02:22:21.170688+0000","last_became_peered":"2024-08-17T02:22:21.170688+0000","last_unstale":"2024-08-17T02:22:22.182530+0000","last_undegraded":"2024-08-17T02:22:22.182530+0000","last_fullsized":"2024-08-17T02:22:22.182530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:14:01.383880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.213088+0000","last_change":"2024-08-17T02:22:22.205723+0000","last_active":"2024-08-17T02:22:22.213088+0000","last_peered":"2024-08-17T02:22:22.213088+0000","last_clean":"2024-08-17T02:22:22.213088+0000","last_became_active":"2024-08-17T02:22:22.204195+0000","last_became_peered":"2024-08-17T02:22:22.204195+0000","last_unstale":"2024-08-17T02:22:22.213088+0000","last_undegraded":"2024-08-17T02:22:22.213088+0000","last_fullsized":"2024-08-17T02:22:22.213088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:53:22.176633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:22:21.183622+0000","last_change":"2024-08-17T02:22:21.176993+0000","last_active":"2024-08-17T02:22:21.183622+0000","last_peered":"2024-08-17T02:22:21.183622+0000","last_clean":"2024-08-17T02:22:21.183622+0000","last_became_active":"2024-08-17T02:22:21.175101+0000","last_became_peered":"2024-08-17T02:22:21.175101+0000","last_unstale":"2024-08-17T02:22:21.183622+0000","last_undegraded":"2024-08-17T02:22:21.183622+0000","last_fullsized":"2024-08-17T02:22:21.183622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:35:31.942397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.207541+0000","last_change":"2024-08-17T02:22:22.204502+0000","last_active":"2024-08-17T02:22:22.207541+0000","last_peered":"2024-08-17T02:22:22.207541+0000","last_clean":"2024-08-17T02:22:22.207541+0000","last_became_active":"2024-08-17T02:22:22.204194+0000","last_became_peered":"2024-08-17T02:22:22.204194+0000","last_unstale":"2024-08-17T02:22:22.207541+0000","last_undegraded":"2024-08-17T02:22:22.207541+0000","last_fullsized":"2024-08-17T02:22:22.207541+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:18:56.483735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.219210+0000","last_change":"2024-08-17T02:22:21.175948+0000","last_active":"2024-08-17T02:22:22.219210+0000","last_peered":"2024-08-17T02:22:22.219210+0000","last_clean":"2024-08-17T02:22:22.219210+0000","last_became_active":"2024-08-17T02:22:21.175638+0000","last_became_peered":"2024-08-17T02:22:21.175638+0000","last_unstale":"2024-08-17T02:22:22.219210+0000","last_undegraded":"2024-08-17T02:22:22.219210+0000","last_fullsized":"2024-08-17T02:22:22.219210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:14:01.383880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.203497+0000","last_change":"2024-08-17T02:22:22.203497+0000","last_active":"2024-08-17T02:22:22.203497+0000","last_peered":"2024-08-17T02:22:22.203497+0000","last_clean":"2024-08-17T02:22:22.203497+0000","last_became_active":"2024-08-17T02:22:22.203129+0000","last_became_peered":"2024-08-17T02:22:22.203129+0000","last_unstale":"2024-08-17T02:22:22.203497+0000","last_undegraded":"2024-08-17T02:22:22.203497+0000","last_fullsized":"2024-08-17T02:22:22.203497+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:08:06.080463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.221812+0000","last_change":"2024-08-17T02:22:21.172088+0000","last_active":"2024-08-17T02:22:22.221812+0000","last_peered":"2024-08-17T02:22:22.221812+0000","last_clean":"2024-08-17T02:22:22.221812+0000","last_became_active":"2024-08-17T02:22:21.171674+0000","last_became_peered":"2024-08-17T02:22:21.171674+0000","last_unstale":"2024-08-17T02:22:22.221812+0000","last_undegraded":"2024-08-17T02:22:22.221812+0000","last_fullsized":"2024-08-17T02:22:22.221812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:20:14.853980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.200767+0000","last_change":"2024-08-17T02:22:22.200767+0000","last_active":"2024-08-17T02:22:22.200767+0000","last_peered":"2024-08-17T02:22:22.200767+0000","last_clean":"2024-08-17T02:22:22.200767+0000","last_became_active":"2024-08-17T02:22:22.200355+0000","last_became_peered":"2024-08-17T02:22:22.200355+0000","last_unstale":"2024-08-17T02:22:22.200767+0000","last_undegraded":"2024-08-17T02:22:22.200767+0000","last_fullsized":"2024-08-17T02:22:22.200767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:46:07.630925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.215662+0000","last_change":"2024-08-17T02:22:21.183259+0000","last_active":"2024-08-17T02:22:22.215662+0000","last_peered":"2024-08-17T02:22:22.215662+0000","last_clean":"2024-08-17T02:22:22.215662+0000","last_became_active":"2024-08-17T02:22:21.182967+0000","last_became_peered":"2024-08-17T02:22:21.182967+0000","last_unstale":"2024-08-17T02:22:22.215662+0000","last_undegraded":"2024-08-17T02:22:22.215662+0000","last_fullsized":"2024-08-17T02:22:22.215662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:43:54.663464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.203414+0000","last_change":"2024-08-17T02:22:22.203414+0000","last_active":"2024-08-17T02:22:22.203414+0000","last_peered":"2024-08-17T02:22:22.203414+0000","last_clean":"2024-08-17T02:22:22.203414+0000","last_became_active":"2024-08-17T02:22:22.203022+0000","last_became_peered":"2024-08-17T02:22:22.203022+0000","last_unstale":"2024-08-17T02:22:22.203414+0000","last_undegraded":"2024-08-17T02:22:22.203414+0000","last_fullsized":"2024-08-17T02:22:22.203414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:00:35.929768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:22:21.185236+0000","last_change":"2024-08-17T02:22:21.181277+0000","last_active":"2024-08-17T02:22:21.185236+0000","last_peered":"2024-08-17T02:22:21.185236+0000","last_clean":"2024-08-17T02:22:21.185236+0000","last_became_active":"2024-08-17T02:22:21.178480+0000","last_became_peered":"2024-08-17T02:22:21.178480+0000","last_unstale":"2024-08-17T02:22:21.185236+0000","last_undegraded":"2024-08-17T02:22:21.185236+0000","last_fullsized":"2024-08-17T02:22:21.185236+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:31:17.320632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.203294+0000","last_change":"2024-08-17T02:22:22.203294+0000","last_active":"2024-08-17T02:22:22.203294+0000","last_peered":"2024-08-17T02:22:22.203294+0000","last_clean":"2024-08-17T02:22:22.203294+0000","last_became_active":"2024-08-17T02:22:22.202695+0000","last_became_peered":"2024-08-17T02:22:22.202695+0000","last_unstale":"2024-08-17T02:22:22.203294+0000","last_undegraded":"2024-08-17T02:22:22.203294+0000","last_fullsized":"2024-08-17T02:22:22.203294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:11:36.411933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:22:21.190909+0000","last_change":"2024-08-17T02:22:21.186990+0000","last_active":"2024-08-17T02:22:21.190909+0000","last_peered":"2024-08-17T02:22:21.190909+0000","last_clean":"2024-08-17T02:22:21.190909+0000","last_became_active":"2024-08-17T02:22:21.186627+0000","last_became_peered":"2024-08-17T02:22:21.186627+0000","last_unstale":"2024-08-17T02:22:21.190909+0000","last_undegraded":"2024-08-17T02:22:21.190909+0000","last_fullsized":"2024-08-17T02:22:21.190909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:10:00.628584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.201334+0000","last_change":"2024-08-17T02:22:22.191715+0000","last_active":"2024-08-17T02:22:22.201334+0000","last_peered":"2024-08-17T02:22:22.201334+0000","last_clean":"2024-08-17T02:22:22.201334+0000","last_became_active":"2024-08-17T02:22:22.191284+0000","last_became_peered":"2024-08-17T02:22:22.191284+0000","last_unstale":"2024-08-17T02:22:22.201334+0000","last_undegraded":"2024-08-17T02:22:22.201334+0000","last_fullsized":"2024-08-17T02:22:22.201334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:31:18.328390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.219572+0000","last_change":"2024-08-17T02:22:21.173553+0000","last_active":"2024-08-17T02:22:22.219572+0000","last_peered":"2024-08-17T02:22:22.219572+0000","last_clean":"2024-08-17T02:22:22.219572+0000","last_became_active":"2024-08-17T02:22:21.173159+0000","last_became_peered":"2024-08-17T02:22:21.173159+0000","last_unstale":"2024-08-17T02:22:22.219572+0000","last_undegraded":"2024-08-17T02:22:22.219572+0000","last_fullsized":"2024-08-17T02:22:22.219572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:35:31.942397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.206143+0000","last_change":"2024-08-17T02:22:22.206143+0000","last_active":"2024-08-17T02:22:22.206143+0000","last_peered":"2024-08-17T02:22:22.206143+0000","last_clean":"2024-08-17T02:22:22.206143+0000","last_became_active":"2024-08-17T02:22:22.203641+0000","last_became_peered":"2024-08-17T02:22:22.203641+0000","last_unstale":"2024-08-17T02:22:22.206143+0000","last_undegraded":"2024-08-17T02:22:22.206143+0000","last_fullsized":"2024-08-17T02:22:22.206143+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:49:03.418573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.200988+0000","last_change":"2024-08-17T02:22:21.174493+0000","last_active":"2024-08-17T02:22:22.200988+0000","last_peered":"2024-08-17T02:22:22.200988+0000","last_clean":"2024-08-17T02:22:22.200988+0000","last_became_active":"2024-08-17T02:22:21.174142+0000","last_became_peered":"2024-08-17T02:22:21.174142+0000","last_unstale":"2024-08-17T02:22:22.200988+0000","last_undegraded":"2024-08-17T02:22:22.200988+0000","last_fullsized":"2024-08-17T02:22:22.200988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:14:08.171959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.206463+0000","last_change":"2024-08-17T02:22:22.201098+0000","last_active":"2024-08-17T02:22:22.206463+0000","last_peered":"2024-08-17T02:22:22.206463+0000","last_clean":"2024-08-17T02:22:22.206463+0000","last_became_active":"2024-08-17T02:22:22.200673+0000","last_became_peered":"2024-08-17T02:22:22.200673+0000","last_unstale":"2024-08-17T02:22:22.206463+0000","last_undegraded":"2024-08-17T02:22:22.206463+0000","last_fullsized":"2024-08-17T02:22:22.206463+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:25:58.131547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.218662+0000","last_change":"2024-08-17T02:22:21.175560+0000","last_active":"2024-08-17T02:22:22.218662+0000","last_peered":"2024-08-17T02:22:22.218662+0000","last_clean":"2024-08-17T02:22:22.218662+0000","last_became_active":"2024-08-17T02:22:21.175262+0000","last_became_peered":"2024-08-17T02:22:21.175262+0000","last_unstale":"2024-08-17T02:22:22.218662+0000","last_undegraded":"2024-08-17T02:22:22.218662+0000","last_fullsized":"2024-08-17T02:22:22.218662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:01:30.822179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.207471+0000","last_change":"2024-08-17T02:22:22.207471+0000","last_active":"2024-08-17T02:22:22.207471+0000","last_peered":"2024-08-17T02:22:22.207471+0000","last_clean":"2024-08-17T02:22:22.207471+0000","last_became_active":"2024-08-17T02:22:22.207237+0000","last_became_peered":"2024-08-17T02:22:22.207237+0000","last_unstale":"2024-08-17T02:22:22.207471+0000","last_undegraded":"2024-08-17T02:22:22.207471+0000","last_fullsized":"2024-08-17T02:22:22.207471+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:52:23.293649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.216725+0000","last_change":"2024-08-17T02:22:21.173738+0000","last_active":"2024-08-17T02:22:22.216725+0000","last_peered":"2024-08-17T02:22:22.216725+0000","last_clean":"2024-08-17T02:22:22.216725+0000","last_became_active":"2024-08-17T02:22:21.173409+0000","last_became_peered":"2024-08-17T02:22:21.173409+0000","last_unstale":"2024-08-17T02:22:22.216725+0000","last_undegraded":"2024-08-17T02:22:22.216725+0000","last_fullsized":"2024-08-17T02:22:22.216725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:43:54.663464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.200396+0000","last_change":"2024-08-17T02:22:22.200396+0000","last_active":"2024-08-17T02:22:22.200396+0000","last_peered":"2024-08-17T02:22:22.200396+0000","last_clean":"2024-08-17T02:22:22.200396+0000","last_became_active":"2024-08-17T02:22:22.199830+0000","last_became_peered":"2024-08-17T02:22:22.199830+0000","last_unstale":"2024-08-17T02:22:22.200396+0000","last_undegraded":"2024-08-17T02:22:22.200396+0000","last_fullsized":"2024-08-17T02:22:22.200396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:08:06.080463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:22:21.183159+0000","last_change":"2024-08-17T02:22:21.179346+0000","last_active":"2024-08-17T02:22:21.183159+0000","last_peered":"2024-08-17T02:22:21.183159+0000","last_clean":"2024-08-17T02:22:21.183159+0000","last_became_active":"2024-08-17T02:22:21.179089+0000","last_became_peered":"2024-08-17T02:22:21.179089+0000","last_unstale":"2024-08-17T02:22:21.183159+0000","last_undegraded":"2024-08-17T02:22:21.183159+0000","last_fullsized":"2024-08-17T02:22:21.183159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:05:31.566094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.210702+0000","last_change":"2024-08-17T02:22:22.210702+0000","last_active":"2024-08-17T02:22:22.210702+0000","last_peered":"2024-08-17T02:22:22.210702+0000","last_clean":"2024-08-17T02:22:22.210702+0000","last_became_active":"2024-08-17T02:22:22.210369+0000","last_became_peered":"2024-08-17T02:22:22.210369+0000","last_unstale":"2024-08-17T02:22:22.210702+0000","last_undegraded":"2024-08-17T02:22:22.210702+0000","last_fullsized":"2024-08-17T02:22:22.210702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:18:56.483735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":163,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.181820+0000","last_change":"2024-08-17T02:22:11.967052+0000","last_active":"2024-08-17T02:22:22.181820+0000","last_peered":"2024-08-17T02:22:22.181820+0000","last_clean":"2024-08-17T02:22:22.181820+0000","last_became_active":"2024-08-17T02:22:11.965269+0000","last_became_peered":"2024-08-17T02:22:11.965269+0000","last_unstale":"2024-08-17T02:22:22.181820+0000","last_undegraded":"2024-08-17T02:22:22.181820+0000","last_fullsized":"2024-08-17T02:22:22.181820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:10.930862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:10.930862+0000","last_clean_scrub_stamp":"2024-08-17T02:22:10.930862+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:59:34.931003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:22:21.182702+0000","last_change":"2024-08-17T02:22:21.177962+0000","last_active":"2024-08-17T02:22:21.182702+0000","last_peered":"2024-08-17T02:22:21.182702+0000","last_clean":"2024-08-17T02:22:21.182702+0000","last_became_active":"2024-08-17T02:22:21.174574+0000","last_became_peered":"2024-08-17T02:22:21.174574+0000","last_unstale":"2024-08-17T02:22:21.182702+0000","last_undegraded":"2024-08-17T02:22:21.182702+0000","last_fullsized":"2024-08-17T02:22:21.182702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:44:22.681596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.216579+0000","last_change":"2024-08-17T02:22:22.207889+0000","last_active":"2024-08-17T02:22:22.216579+0000","last_peered":"2024-08-17T02:22:22.216579+0000","last_clean":"2024-08-17T02:22:22.216579+0000","last_became_active":"2024-08-17T02:22:22.207591+0000","last_became_peered":"2024-08-17T02:22:22.207591+0000","last_unstale":"2024-08-17T02:22:22.216579+0000","last_undegraded":"2024-08-17T02:22:22.216579+0000","last_fullsized":"2024-08-17T02:22:22.216579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:49:22.101879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:22:21.185711+0000","last_change":"2024-08-17T02:22:21.182666+0000","last_active":"2024-08-17T02:22:21.185711+0000","last_peered":"2024-08-17T02:22:21.185711+0000","last_clean":"2024-08-17T02:22:21.185711+0000","last_became_active":"2024-08-17T02:22:21.182346+0000","last_became_peered":"2024-08-17T02:22:21.182346+0000","last_unstale":"2024-08-17T02:22:21.185711+0000","last_undegraded":"2024-08-17T02:22:21.185711+0000","last_fullsized":"2024-08-17T02:22:21.185711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:14:08.171959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.204365+0000","last_change":"2024-08-17T02:22:22.204365+0000","last_active":"2024-08-17T02:22:22.204365+0000","last_peered":"2024-08-17T02:22:22.204365+0000","last_clean":"2024-08-17T02:22:22.204365+0000","last_became_active":"2024-08-17T02:22:22.204108+0000","last_became_peered":"2024-08-17T02:22:22.204108+0000","last_unstale":"2024-08-17T02:22:22.204365+0000","last_undegraded":"2024-08-17T02:22:22.204365+0000","last_fullsized":"2024-08-17T02:22:22.204365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:41:01.256282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:22:21.180268+0000","last_change":"2024-08-17T02:22:21.176738+0000","last_active":"2024-08-17T02:22:21.180268+0000","last_peered":"2024-08-17T02:22:21.180268+0000","last_clean":"2024-08-17T02:22:21.180268+0000","last_became_active":"2024-08-17T02:22:21.176368+0000","last_became_peered":"2024-08-17T02:22:21.176368+0000","last_unstale":"2024-08-17T02:22:21.180268+0000","last_undegraded":"2024-08-17T02:22:21.180268+0000","last_fullsized":"2024-08-17T02:22:21.180268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:39:49.581004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.198194+0000","last_change":"2024-08-17T02:22:22.188353+0000","last_active":"2024-08-17T02:22:22.198194+0000","last_peered":"2024-08-17T02:22:22.198194+0000","last_clean":"2024-08-17T02:22:22.198194+0000","last_became_active":"2024-08-17T02:22:22.187993+0000","last_became_peered":"2024-08-17T02:22:22.187993+0000","last_unstale":"2024-08-17T02:22:22.198194+0000","last_undegraded":"2024-08-17T02:22:22.198194+0000","last_fullsized":"2024-08-17T02:22:22.198194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:12:21.015335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:22:21.185264+0000","last_change":"2024-08-17T02:22:21.181422+0000","last_active":"2024-08-17T02:22:21.185264+0000","last_peered":"2024-08-17T02:22:21.185264+0000","last_clean":"2024-08-17T02:22:21.185264+0000","last_became_active":"2024-08-17T02:22:21.178824+0000","last_became_peered":"2024-08-17T02:22:21.178824+0000","last_unstale":"2024-08-17T02:22:21.185264+0000","last_undegraded":"2024-08-17T02:22:21.185264+0000","last_fullsized":"2024-08-17T02:22:21.185264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:57:25.435387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.201524+0000","last_change":"2024-08-17T02:22:22.201524+0000","last_active":"2024-08-17T02:22:22.201524+0000","last_peered":"2024-08-17T02:22:22.201524+0000","last_clean":"2024-08-17T02:22:22.201524+0000","last_became_active":"2024-08-17T02:22:22.200008+0000","last_became_peered":"2024-08-17T02:22:22.200008+0000","last_unstale":"2024-08-17T02:22:22.201524+0000","last_undegraded":"2024-08-17T02:22:22.201524+0000","last_fullsized":"2024-08-17T02:22:22.201524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:21:01.768875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.184222+0000","last_change":"2024-08-17T02:22:21.176312+0000","last_active":"2024-08-17T02:22:22.184222+0000","last_peered":"2024-08-17T02:22:22.184222+0000","last_clean":"2024-08-17T02:22:22.184222+0000","last_became_active":"2024-08-17T02:22:21.175977+0000","last_became_peered":"2024-08-17T02:22:21.175977+0000","last_unstale":"2024-08-17T02:22:22.184222+0000","last_undegraded":"2024-08-17T02:22:22.184222+0000","last_fullsized":"2024-08-17T02:22:22.184222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:36:42.673124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.212680+0000","last_change":"2024-08-17T02:22:22.205225+0000","last_active":"2024-08-17T02:22:22.212680+0000","last_peered":"2024-08-17T02:22:22.212680+0000","last_clean":"2024-08-17T02:22:22.212680+0000","last_became_active":"2024-08-17T02:22:22.204500+0000","last_became_peered":"2024-08-17T02:22:22.204500+0000","last_unstale":"2024-08-17T02:22:22.212680+0000","last_undegraded":"2024-08-17T02:22:22.212680+0000","last_fullsized":"2024-08-17T02:22:22.212680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:57:26.443145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:22:21.182659+0000","last_change":"2024-08-17T02:22:21.179488+0000","last_active":"2024-08-17T02:22:21.182659+0000","last_peered":"2024-08-17T02:22:21.182659+0000","last_clean":"2024-08-17T02:22:21.182659+0000","last_became_active":"2024-08-17T02:22:21.179206+0000","last_became_peered":"2024-08-17T02:22:21.179206+0000","last_unstale":"2024-08-17T02:22:21.182659+0000","last_undegraded":"2024-08-17T02:22:21.182659+0000","last_fullsized":"2024-08-17T02:22:21.182659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:25:57.123789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.198568+0000","last_change":"2024-08-17T02:22:22.198568+0000","last_active":"2024-08-17T02:22:22.198568+0000","last_peered":"2024-08-17T02:22:22.198568+0000","last_clean":"2024-08-17T02:22:22.198568+0000","last_became_active":"2024-08-17T02:22:22.198281+0000","last_became_peered":"2024-08-17T02:22:22.198281+0000","last_unstale":"2024-08-17T02:22:22.198568+0000","last_undegraded":"2024-08-17T02:22:22.198568+0000","last_fullsized":"2024-08-17T02:22:22.198568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:37:52.949081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.194742+0000","last_change":"2024-08-17T02:22:21.174183+0000","last_active":"2024-08-17T02:22:22.194742+0000","last_peered":"2024-08-17T02:22:22.194742+0000","last_clean":"2024-08-17T02:22:22.194742+0000","last_became_active":"2024-08-17T02:22:21.173494+0000","last_became_peered":"2024-08-17T02:22:21.173494+0000","last_unstale":"2024-08-17T02:22:22.194742+0000","last_undegraded":"2024-08-17T02:22:22.194742+0000","last_fullsized":"2024-08-17T02:22:22.194742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:36:42.673124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.205718+0000","last_change":"2024-08-17T02:22:22.199900+0000","last_active":"2024-08-17T02:22:22.205718+0000","last_peered":"2024-08-17T02:22:22.205718+0000","last_clean":"2024-08-17T02:22:22.205718+0000","last_became_active":"2024-08-17T02:22:22.198791+0000","last_became_peered":"2024-08-17T02:22:22.198791+0000","last_unstale":"2024-08-17T02:22:22.205718+0000","last_undegraded":"2024-08-17T02:22:22.205718+0000","last_fullsized":"2024-08-17T02:22:22.205718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:47.721413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.216262+0000","last_change":"2024-08-17T02:22:21.187272+0000","last_active":"2024-08-17T02:22:22.216262+0000","last_peered":"2024-08-17T02:22:22.216262+0000","last_clean":"2024-08-17T02:22:22.216262+0000","last_became_active":"2024-08-17T02:22:21.186794+0000","last_became_peered":"2024-08-17T02:22:21.186794+0000","last_unstale":"2024-08-17T02:22:22.216262+0000","last_undegraded":"2024-08-17T02:22:22.216262+0000","last_fullsized":"2024-08-17T02:22:22.216262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:52:02.959411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.206287+0000","last_change":"2024-08-17T02:22:22.199762+0000","last_active":"2024-08-17T02:22:22.206287+0000","last_peered":"2024-08-17T02:22:22.206287+0000","last_clean":"2024-08-17T02:22:22.206287+0000","last_became_active":"2024-08-17T02:22:22.199436+0000","last_became_peered":"2024-08-17T02:22:22.199436+0000","last_unstale":"2024-08-17T02:22:22.206287+0000","last_undegraded":"2024-08-17T02:22:22.206287+0000","last_fullsized":"2024-08-17T02:22:22.206287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:34:22.570830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:22:21.182404+0000","last_change":"2024-08-17T02:22:21.176575+0000","last_active":"2024-08-17T02:22:21.182404+0000","last_peered":"2024-08-17T02:22:21.182404+0000","last_clean":"2024-08-17T02:22:21.182404+0000","last_became_active":"2024-08-17T02:22:21.175688+0000","last_became_peered":"2024-08-17T02:22:21.175688+0000","last_unstale":"2024-08-17T02:22:21.182404+0000","last_undegraded":"2024-08-17T02:22:21.182404+0000","last_fullsized":"2024-08-17T02:22:21.182404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:31:17.320632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.204419+0000","last_change":"2024-08-17T02:22:22.204419+0000","last_active":"2024-08-17T02:22:22.204419+0000","last_peered":"2024-08-17T02:22:22.204419+0000","last_clean":"2024-08-17T02:22:22.204419+0000","last_became_active":"2024-08-17T02:22:22.203728+0000","last_became_peered":"2024-08-17T02:22:22.203728+0000","last_unstale":"2024-08-17T02:22:22.204419+0000","last_undegraded":"2024-08-17T02:22:22.204419+0000","last_fullsized":"2024-08-17T02:22:22.204419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:09:52.735534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.194675+0000","last_change":"2024-08-17T02:22:21.175288+0000","last_active":"2024-08-17T02:22:22.194675+0000","last_peered":"2024-08-17T02:22:22.194675+0000","last_clean":"2024-08-17T02:22:22.194675+0000","last_became_active":"2024-08-17T02:22:21.175003+0000","last_became_peered":"2024-08-17T02:22:21.175003+0000","last_unstale":"2024-08-17T02:22:22.194675+0000","last_undegraded":"2024-08-17T02:22:22.194675+0000","last_fullsized":"2024-08-17T02:22:22.194675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:14:08.171959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.205630+0000","last_change":"2024-08-17T02:22:22.199455+0000","last_active":"2024-08-17T02:22:22.205630+0000","last_peered":"2024-08-17T02:22:22.205630+0000","last_clean":"2024-08-17T02:22:22.205630+0000","last_became_active":"2024-08-17T02:22:22.198936+0000","last_became_peered":"2024-08-17T02:22:22.198936+0000","last_unstale":"2024-08-17T02:22:22.205630+0000","last_undegraded":"2024-08-17T02:22:22.205630+0000","last_fullsized":"2024-08-17T02:22:22.205630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:23.581757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:22:21.183201+0000","last_change":"2024-08-17T02:22:21.176180+0000","last_active":"2024-08-17T02:22:21.183201+0000","last_peered":"2024-08-17T02:22:21.183201+0000","last_clean":"2024-08-17T02:22:21.183201+0000","last_became_active":"2024-08-17T02:22:21.175771+0000","last_became_peered":"2024-08-17T02:22:21.175771+0000","last_unstale":"2024-08-17T02:22:21.183201+0000","last_undegraded":"2024-08-17T02:22:21.183201+0000","last_fullsized":"2024-08-17T02:22:21.183201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:14:32.873264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.194158+0000","last_change":"2024-08-17T02:22:22.194158+0000","last_active":"2024-08-17T02:22:22.194158+0000","last_peered":"2024-08-17T02:22:22.194158+0000","last_clean":"2024-08-17T02:22:22.194158+0000","last_became_active":"2024-08-17T02:22:22.193862+0000","last_became_peered":"2024-08-17T02:22:22.193862+0000","last_unstale":"2024-08-17T02:22:22.194158+0000","last_undegraded":"2024-08-17T02:22:22.194158+0000","last_fullsized":"2024-08-17T02:22:22.194158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:31:18.328390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.216222+0000","last_change":"2024-08-17T02:22:21.179787+0000","last_active":"2024-08-17T02:22:22.216222+0000","last_peered":"2024-08-17T02:22:22.216222+0000","last_clean":"2024-08-17T02:22:22.216222+0000","last_became_active":"2024-08-17T02:22:21.178882+0000","last_became_peered":"2024-08-17T02:22:21.178882+0000","last_unstale":"2024-08-17T02:22:22.216222+0000","last_undegraded":"2024-08-17T02:22:22.216222+0000","last_fullsized":"2024-08-17T02:22:22.216222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:11:57.093981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.209292+0000","last_change":"2024-08-17T02:22:22.209292+0000","last_active":"2024-08-17T02:22:22.209292+0000","last_peered":"2024-08-17T02:22:22.209292+0000","last_clean":"2024-08-17T02:22:22.209292+0000","last_became_active":"2024-08-17T02:22:22.208985+0000","last_became_peered":"2024-08-17T02:22:22.208985+0000","last_unstale":"2024-08-17T02:22:22.209292+0000","last_undegraded":"2024-08-17T02:22:22.209292+0000","last_fullsized":"2024-08-17T02:22:22.209292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:06:36.575795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.202975+0000","last_change":"2024-08-17T02:22:22.202975+0000","last_active":"2024-08-17T02:22:22.202975+0000","last_peered":"2024-08-17T02:22:22.202975+0000","last_clean":"2024-08-17T02:22:22.202975+0000","last_became_active":"2024-08-17T02:22:22.202642+0000","last_became_peered":"2024-08-17T02:22:22.202642+0000","last_unstale":"2024-08-17T02:22:22.202975+0000","last_undegraded":"2024-08-17T02:22:22.202975+0000","last_fullsized":"2024-08-17T02:22:22.202975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:23:10.867889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.215260+0000","last_change":"2024-08-17T02:22:21.181265+0000","last_active":"2024-08-17T02:22:22.215260+0000","last_peered":"2024-08-17T02:22:22.215260+0000","last_clean":"2024-08-17T02:22:22.215260+0000","last_became_active":"2024-08-17T02:22:21.179868+0000","last_became_peered":"2024-08-17T02:22:21.179868+0000","last_unstale":"2024-08-17T02:22:22.215260+0000","last_undegraded":"2024-08-17T02:22:22.215260+0000","last_fullsized":"2024-08-17T02:22:22.215260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:01:30.822179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.209539+0000","last_change":"2024-08-17T02:22:22.204765+0000","last_active":"2024-08-17T02:22:22.209539+0000","last_peered":"2024-08-17T02:22:22.209539+0000","last_clean":"2024-08-17T02:22:22.209539+0000","last_became_active":"2024-08-17T02:22:22.204508+0000","last_became_peered":"2024-08-17T02:22:22.204508+0000","last_unstale":"2024-08-17T02:22:22.209539+0000","last_undegraded":"2024-08-17T02:22:22.209539+0000","last_fullsized":"2024-08-17T02:22:22.209539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:57:26.443145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.215173+0000","last_change":"2024-08-17T02:22:21.175884+0000","last_active":"2024-08-17T02:22:22.215173+0000","last_peered":"2024-08-17T02:22:22.215173+0000","last_clean":"2024-08-17T02:22:22.215173+0000","last_became_active":"2024-08-17T02:22:21.175130+0000","last_became_peered":"2024-08-17T02:22:21.175130+0000","last_unstale":"2024-08-17T02:22:22.215173+0000","last_undegraded":"2024-08-17T02:22:22.215173+0000","last_fullsized":"2024-08-17T02:22:22.215173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:47:30.406922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.201295+0000","last_change":"2024-08-17T02:22:22.193359+0000","last_active":"2024-08-17T02:22:22.201295+0000","last_peered":"2024-08-17T02:22:22.201295+0000","last_clean":"2024-08-17T02:22:22.201295+0000","last_became_active":"2024-08-17T02:22:22.192492+0000","last_became_peered":"2024-08-17T02:22:22.192492+0000","last_unstale":"2024-08-17T02:22:22.201295+0000","last_undegraded":"2024-08-17T02:22:22.201295+0000","last_fullsized":"2024-08-17T02:22:22.201295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:08:06.080463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.216505+0000","last_change":"2024-08-17T02:22:21.172581+0000","last_active":"2024-08-17T02:22:22.216505+0000","last_peered":"2024-08-17T02:22:22.216505+0000","last_clean":"2024-08-17T02:22:22.216505+0000","last_became_active":"2024-08-17T02:22:21.172139+0000","last_became_peered":"2024-08-17T02:22:21.172139+0000","last_unstale":"2024-08-17T02:22:22.216505+0000","last_undegraded":"2024-08-17T02:22:22.216505+0000","last_fullsized":"2024-08-17T02:22:22.216505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:01:30.822179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.201398+0000","last_change":"2024-08-17T02:22:22.196174+0000","last_active":"2024-08-17T02:22:22.201398+0000","last_peered":"2024-08-17T02:22:22.201398+0000","last_clean":"2024-08-17T02:22:22.201398+0000","last_became_active":"2024-08-17T02:22:22.195901+0000","last_became_peered":"2024-08-17T02:22:22.195901+0000","last_unstale":"2024-08-17T02:22:22.201398+0000","last_undegraded":"2024-08-17T02:22:22.201398+0000","last_fullsized":"2024-08-17T02:22:22.201398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:46:07.630925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.218844+0000","last_change":"2024-08-17T02:22:21.181273+0000","last_active":"2024-08-17T02:22:22.218844+0000","last_peered":"2024-08-17T02:22:22.218844+0000","last_clean":"2024-08-17T02:22:22.218844+0000","last_became_active":"2024-08-17T02:22:21.181022+0000","last_became_peered":"2024-08-17T02:22:21.181022+0000","last_unstale":"2024-08-17T02:22:22.218844+0000","last_undegraded":"2024-08-17T02:22:22.218844+0000","last_fullsized":"2024-08-17T02:22:22.218844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:47:30.406922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297588,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":229376,"data_stored":74467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]}]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298164,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073676,"statfs":{"total":96636764160,"available":96331444224,"internally_reserved":0,"allocated":823296,"data_stored":664803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]}]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":253952,"data_stored":82843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]}]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":225280,"data_stored":74913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]}]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297596,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074244,"statfs":{"total":96636764160,"available":96332025856,"internally_reserved":0,"allocated":245760,"data_stored":82183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.052}]}]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298160,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073680,"statfs":{"total":96636764160,"available":96331448320,"internally_reserved":0,"allocated":819200,"data_stored":664781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3580000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.224}]}]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297588,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":229376,"data_stored":74399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301720,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070120,"statfs":{"total":96636764160,"available":96327802880,"internally_reserved":0,"allocated":208896,"data_stored":67580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.149}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.258}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.296}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:22:26.500 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-08-17T02:22:26.500 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-17T02:22:26.500 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-08-17T02:22:26.500 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-08-17T02:22:26.501 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-08-17T02:22:26.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.602+0000 7fdb66b70700 1 Processor -- start 2024-08-17T02:22:26.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.602+0000 7fdb66b70700 1 -- start start 2024-08-17T02:22:26.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.602+0000 7fdb66b70700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdb60159080 0x7fdb600ae9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:26.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.602+0000 7fdb66b70700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb6015a8a0 0x7fdb600af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:26.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.602+0000 7fdb66b70700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb6015ba00 con 0x7fdb600686a0 2024-08-17T02:22:26.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.602+0000 7fdb66b70700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb600afa10 con 0x7fdb60159080 2024-08-17T02:22:26.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.602+0000 7fdb66b70700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6015adf0 con 0x7fdb6015a8a0 2024-08-17T02:22:26.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.602+0000 7fdb6636f700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fdb600686a0 0x7fdb6015be90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:42046/0 (socket says 172.21.15.104:42046) 2024-08-17T02:22:26.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.602+0000 7fdb6636f700 1 -- 172.21.15.104:0/2605082745 learned_addr learned my addr 172.21.15.104:0/2605082745 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:26.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.602+0000 7fdb6536d700 1 --2- 172.21.15.104:0/2605082745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb6015a8a0 0x7fdb600af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:26.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.602+0000 7fdb65b6e700 1 --2- 172.21.15.104:0/2605082745 >> v2:172.21.15.117:3300/0 conn(0x7fdb60159080 0x7fdb600ae9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:26.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.602+0000 7fdb64b6c700 1 -- 172.21.15.104:0/2605082745 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1802803133 0 0) 0x7fdb6015ba00 con 0x7fdb600686a0 2024-08-17T02:22:26.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.602+0000 7fdb64b6c700 1 -- 172.21.15.104:0/2605082745 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb4c003570 con 0x7fdb600686a0 2024-08-17T02:22:26.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.602+0000 7fdb6536d700 1 -- 172.21.15.104:0/2605082745 >> v2:172.21.15.117:3300/0 conn(0x7fdb60159080 msgr2=0x7fdb600ae9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:26.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.602+0000 7fdb6536d700 1 --2- 172.21.15.104:0/2605082745 >> v2:172.21.15.117:3300/0 conn(0x7fdb60159080 0x7fdb600ae9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:26.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.602+0000 7fdb6536d700 1 -- 172.21.15.104:0/2605082745 >> v1:172.21.15.104:6789/0 conn(0x7fdb600686a0 legacy=0x7fdb6015be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:26.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.602+0000 7fdb6536d700 1 -- 172.21.15.104:0/2605082745 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb6015b0d0 con 0x7fdb6015a8a0 2024-08-17T02:22:26.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.602+0000 7fdb6536d700 1 --2- 172.21.15.104:0/2605082745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb6015a8a0 0x7fdb600af4d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdb58009e60 tx=0x7fdb58009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8dc5b4eca6bdaed4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:26.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.606+0000 7fdb64b6c700 1 -- 172.21.15.104:0/2605082745 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5800e070 con 0x7fdb6015a8a0 2024-08-17T02:22:26.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.606+0000 7fdb64b6c700 1 -- 172.21.15.104:0/2605082745 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5800bab0 con 0x7fdb6015a8a0 2024-08-17T02:22:26.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.606+0000 7fdb64b6c700 1 -- 172.21.15.104:0/2605082745 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5800be30 con 0x7fdb6015a8a0 2024-08-17T02:22:26.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.606+0000 7fdb66b70700 1 -- 172.21.15.104:0/2605082745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb6015a8a0 msgr2=0x7fdb600af4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:26.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.606+0000 7fdb66b70700 1 --2- 172.21.15.104:0/2605082745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb6015a8a0 0x7fdb600af4d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdb58009e60 tx=0x7fdb58009780 comp rx=0 tx=0).stop 2024-08-17T02:22:26.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.606+0000 7fdb66b70700 1 -- 172.21.15.104:0/2605082745 shutdown_connections 2024-08-17T02:22:26.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.606+0000 7fdb66b70700 1 --2- 172.21.15.104:0/2605082745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb6015a8a0 0x7fdb600af4d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:26.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.606+0000 7fdb66b70700 1 --2- 172.21.15.104:0/2605082745 >> v2:172.21.15.117:3300/0 conn(0x7fdb60159080 0x7fdb600ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:26.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.606+0000 7fdb66b70700 1 -- 172.21.15.104:0/2605082745 >> 172.21.15.104:0/2605082745 conn(0x7fdb6006d870 msgr2=0x7fdb6006dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:26.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.606+0000 7fdb66b70700 1 -- 172.21.15.104:0/2605082745 shutdown_connections 2024-08-17T02:22:26.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.606+0000 7fdb66b70700 1 -- 172.21.15.104:0/2605082745 wait complete. 2024-08-17T02:22:26.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.606+0000 7fdb66b70700 1 Processor -- start 2024-08-17T02:22:26.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.606+0000 7fdb66b70700 1 -- start start 2024-08-17T02:22:26.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.606+0000 7fdb66b70700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdb600686a0 0x7fdb6014a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:26.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.606+0000 7fdb66b70700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb60159080 0x7fdb600caf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:26.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.606+0000 7fdb66b70700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb6015a8a0 0x7fdb600b1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:26.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.606+0000 7fdb66b70700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb600aa850 con 0x7fdb600686a0 2024-08-17T02:22:26.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.606+0000 7fdb66b70700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6014a560 con 0x7fdb6015a8a0 2024-08-17T02:22:26.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.606+0000 7fdb66b70700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb600a9c40 con 0x7fdb60159080 2024-08-17T02:22:26.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.606+0000 7fdb65b6e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdb600686a0 0x7fdb6014a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:26.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.606+0000 7fdb65b6e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdb600686a0 0x7fdb6014a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45708/0 (socket says 172.21.15.104:45708) 2024-08-17T02:22:26.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.606+0000 7fdb65b6e700 1 -- 172.21.15.104:0/1221463027 learned_addr learned my addr 172.21.15.104:0/1221463027 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:26.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.610+0000 7fdb6536d700 1 --2- 172.21.15.104:0/1221463027 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb60159080 0x7fdb600caf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:26.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.610+0000 7fdb6636f700 1 --2- 172.21.15.104:0/1221463027 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb6015a8a0 0x7fdb600b1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:26.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.610+0000 7fdb65b6e700 1 -- 172.21.15.104:0/1221463027 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb60159080 msgr2=0x7fdb600caf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:26.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.610+0000 7fdb65b6e700 1 --2- 172.21.15.104:0/1221463027 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb60159080 0x7fdb600caf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:26.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.610+0000 7fdb65b6e700 1 -- 172.21.15.104:0/1221463027 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb6015a8a0 msgr2=0x7fdb600b1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:26.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.610+0000 7fdb65b6e700 1 --2- 172.21.15.104:0/1221463027 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb6015a8a0 0x7fdb600b1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:26.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.610+0000 7fdb65b6e700 1 -- 172.21.15.104:0/1221463027 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb58009a20 con 0x7fdb600686a0 2024-08-17T02:22:26.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.610+0000 7fdb6636f700 1 --2- 172.21.15.104:0/1221463027 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb6015a8a0 0x7fdb600b1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:22:26.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.610+0000 7fdb65b6e700 1 --2- 172.21.15.104:0/1221463027 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdb600686a0 0x7fdb6014a020 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdb4800ec80 tx=0x7fdb480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:26.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.610+0000 7fdb5dffb700 1 -- 172.21.15.104:0/1221463027 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4800c850 con 0x7fdb600686a0 2024-08-17T02:22:26.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.610+0000 7fdb5dffb700 1 -- 172.21.15.104:0/1221463027 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb4800c9b0 con 0x7fdb600686a0 2024-08-17T02:22:26.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.610+0000 7fdb66b70700 1 -- 172.21.15.104:0/1221463027 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb600a9f20 con 0x7fdb600686a0 2024-08-17T02:22:26.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.610+0000 7fdb5dffb700 1 -- 172.21.15.104:0/1221463027 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4800cd50 con 0x7fdb600686a0 2024-08-17T02:22:26.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.610+0000 7fdb66b70700 1 -- 172.21.15.104:0/1221463027 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb600aa4e0 con 0x7fdb600686a0 2024-08-17T02:22:26.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.610+0000 7fdb66b70700 1 -- 172.21.15.104:0/1221463027 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb600638f0 con 0x7fdb600686a0 2024-08-17T02:22:26.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.610+0000 7fdb5dffb700 1 -- 172.21.15.104:0/1221463027 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fdb48013680 con 0x7fdb600686a0 2024-08-17T02:22:26.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.610+0000 7fdb5dffb700 1 --2- 172.21.15.104:0/1221463027 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fdb40060890 0x7fdb40062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:26.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.614+0000 7fdb5dffb700 1 -- 172.21.15.104:0/1221463027 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdb4807ce30 con 0x7fdb600686a0 2024-08-17T02:22:26.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.614+0000 7fdb6536d700 1 --2- 172.21.15.104:0/1221463027 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fdb40060890 0x7fdb40062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:26.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.614+0000 7fdb6536d700 1 --2- 172.21.15.104:0/1221463027 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fdb40060890 0x7fdb40062d40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdb580097c0 tx=0x7fdb58019000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:26.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.622+0000 7fdb5dffb700 1 -- 172.21.15.104:0/1221463027 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fdb4804d280 con 0x7fdb600686a0 2024-08-17T02:22:26.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.822+0000 7fdb66b70700 1 -- 172.21.15.104:0/1221463027 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fdb600aecd0 con 0x7fdb600686a0 2024-08-17T02:22:26.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.830+0000 7fdb5dffb700 1 -- 172.21.15.104:0/1221463027 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+154542 (secure 0 0 0) 0x7fdb480508a0 con 0x7fdb600686a0 2024-08-17T02:22:26.839 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:22:26.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.834+0000 7fdb66b70700 1 -- 172.21.15.104:0/1221463027 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fdb40060890 msgr2=0x7fdb40062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:26.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.834+0000 7fdb66b70700 1 --2- 172.21.15.104:0/1221463027 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fdb40060890 0x7fdb40062d40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdb580097c0 tx=0x7fdb58019000 comp rx=0 tx=0).stop 2024-08-17T02:22:26.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.834+0000 7fdb66b70700 1 -- 172.21.15.104:0/1221463027 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdb600686a0 msgr2=0x7fdb6014a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:26.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.834+0000 7fdb66b70700 1 --2- 172.21.15.104:0/1221463027 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdb600686a0 0x7fdb6014a020 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdb4800ec80 tx=0x7fdb480091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:26.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.834+0000 7fdb66b70700 1 -- 172.21.15.104:0/1221463027 shutdown_connections 2024-08-17T02:22:26.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.834+0000 7fdb66b70700 1 --2- 172.21.15.104:0/1221463027 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fdb40060890 0x7fdb40062d40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:26.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.834+0000 7fdb66b70700 1 --2- 172.21.15.104:0/1221463027 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb6015a8a0 0x7fdb600b1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:26.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.834+0000 7fdb66b70700 1 --2- 172.21.15.104:0/1221463027 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb60159080 0x7fdb600caf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:26.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.834+0000 7fdb66b70700 1 --2- 172.21.15.104:0/1221463027 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdb600686a0 0x7fdb6014a020 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:26.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.834+0000 7fdb66b70700 1 -- 172.21.15.104:0/1221463027 >> 172.21.15.104:0/1221463027 conn(0x7fdb6006d870 msgr2=0x7fdb6015bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:26.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.834+0000 7fdb66b70700 1 -- 172.21.15.104:0/1221463027 shutdown_connections 2024-08-17T02:22:26.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.834+0000 7fdb66b70700 1 -- 172.21.15.104:0/1221463027 wait complete. 2024-08-17T02:22:26.855 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":5,"flags":0,"active_gid":4111,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":24084},{"type":"v1","addr":"172.21.15.117:6833","nonce":24084}]},"active_addr":"172.21.15.117:6833/24084","active_change":"2024-08-17T02:22:02.066500+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4101,"name":"y","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":1349324693}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":1901355089}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":3864746351}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":1348067340}]}]} 2024-08-17T02:22:26.858 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-08-17T02:22:26.858 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-08-17T02:22:26.858 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:22:26.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.958+0000 7f831f141700 1 Processor -- start 2024-08-17T02:22:26.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.958+0000 7f831f141700 1 -- start start 2024-08-17T02:22:26.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.958+0000 7f831f141700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83180aac50 0x7f831815aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:26.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.958+0000 7f831f141700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f831815a2e0 0x7f83181574a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:26.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.958+0000 7f831f141700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f83180b3b30 0x7f83180b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:26.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.958+0000 7f831f141700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f831815bc90 con 0x7f83180b3b30 2024-08-17T02:22:26.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.958+0000 7f831f141700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83180b4490 con 0x7f831815a2e0 2024-08-17T02:22:26.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.958+0000 7f831f141700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f831815b010 con 0x7f83180aac50 2024-08-17T02:22:26.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.958+0000 7f831d6de700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f83180b3b30 0x7f83180b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:26.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.958+0000 7f831d6de700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f83180b3b30 0x7f83180b3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42122/0 (socket says 172.21.15.104:42122) 2024-08-17T02:22:26.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.958+0000 7f831d6de700 1 -- 172.21.15.104:0/148016272 learned_addr learned my addr 172.21.15.104:0/148016272 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:26.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.958+0000 7f8317fff700 1 --2- 172.21.15.104:0/148016272 >> v2:172.21.15.117:3300/0 conn(0x7f831815a2e0 0x7f83181574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:26.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.958+0000 7f831cedd700 1 --2- 172.21.15.104:0/148016272 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83180aac50 0x7f831815aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:26.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.958+0000 7f831d6de700 1 -- 172.21.15.104:0/148016272 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83180aac50 msgr2=0x7f831815aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:26.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.958+0000 7f831d6de700 1 --2- 172.21.15.104:0/148016272 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83180aac50 0x7f831815aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:26.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.958+0000 7f831d6de700 1 -- 172.21.15.104:0/148016272 >> v2:172.21.15.117:3300/0 conn(0x7f831815a2e0 msgr2=0x7f83181574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:26.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.958+0000 7f831d6de700 1 --2- 172.21.15.104:0/148016272 >> v2:172.21.15.117:3300/0 conn(0x7f831815a2e0 0x7f83181574a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:26.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.958+0000 7f831d6de700 1 -- 172.21.15.104:0/148016272 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f831815b2f0 con 0x7f83180b3b30 2024-08-17T02:22:26.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.958+0000 7f831d6de700 1 --2- 172.21.15.104:0/148016272 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f83180b3b30 0x7f83180b3f50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f83180892f0 tx=0x7f8310009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b8b4d253ebedb3f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:26.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.958+0000 7f83177fe700 1 -- 172.21.15.104:0/148016272 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831000b640 con 0x7f83180b3b30 2024-08-17T02:22:26.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.958+0000 7f83177fe700 1 -- 172.21.15.104:0/148016272 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831000b7a0 con 0x7f83180b3b30 2024-08-17T02:22:26.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.958+0000 7f83177fe700 1 -- 172.21.15.104:0/148016272 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831000bb60 con 0x7f83180b3b30 2024-08-17T02:22:26.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.962+0000 7f831f141700 1 -- 172.21.15.104:0/148016272 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f83180b3b30 msgr2=0x7f83180b3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:26.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.962+0000 7f831f141700 1 --2- 172.21.15.104:0/148016272 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f83180b3b30 0x7f83180b3f50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f83180892f0 tx=0x7f8310009250 comp rx=0 tx=0).stop 2024-08-17T02:22:26.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.962+0000 7f831f141700 1 -- 172.21.15.104:0/148016272 shutdown_connections 2024-08-17T02:22:26.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.962+0000 7f831f141700 1 --2- 172.21.15.104:0/148016272 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f83180b3b30 0x7f83180b3f50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:26.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.962+0000 7f831f141700 1 --2- 172.21.15.104:0/148016272 >> v2:172.21.15.117:3300/0 conn(0x7f831815a2e0 0x7f83181574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:26.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.962+0000 7f831f141700 1 --2- 172.21.15.104:0/148016272 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83180aac50 0x7f831815aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:26.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.962+0000 7f831f141700 1 -- 172.21.15.104:0/148016272 >> 172.21.15.104:0/148016272 conn(0x7f83180994d0 msgr2=0x7f83180675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:26.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.962+0000 7f831f141700 1 -- 172.21.15.104:0/148016272 shutdown_connections 2024-08-17T02:22:26.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.962+0000 7f831f141700 1 -- 172.21.15.104:0/148016272 wait complete. 2024-08-17T02:22:26.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.962+0000 7f831f141700 1 Processor -- start 2024-08-17T02:22:26.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.962+0000 7f831f141700 1 -- start start 2024-08-17T02:22:26.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.966+0000 7f831f141700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83180aac50 0x7f8318153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:26.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.966+0000 7f831f141700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83180b3b30 0x7f831809d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:26.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.966+0000 7f831f141700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f831815a2e0 0x7f83180adb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:26.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.966+0000 7f831f141700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831809a8f0 con 0x7f831815a2e0 2024-08-17T02:22:26.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.966+0000 7f831f141700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8318153550 con 0x7f83180b3b30 2024-08-17T02:22:26.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.966+0000 7f831f141700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8318099fc0 con 0x7f83180aac50 2024-08-17T02:22:26.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.966+0000 7f831cedd700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83180aac50 0x7f8318153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:26.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.966+0000 7f8317fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83180b3b30 0x7f831809d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:26.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.966+0000 7f831d6de700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f831815a2e0 0x7f83180adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:26.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.966+0000 7f8317fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83180b3b30 0x7f831809d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.104:40894/0 (socket says 172.21.15.104:40894) 2024-08-17T02:22:26.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.966+0000 7f8317fff700 1 -- 172.21.15.104:0/298634142 learned_addr learned my addr 172.21.15.104:0/298634142 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:26.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.966+0000 7f8317fff700 1 -- 172.21.15.104:0/298634142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83180aac50 msgr2=0x7f8318153010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:26.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.966+0000 7f8317fff700 1 --2- 172.21.15.104:0/298634142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83180aac50 0x7f8318153010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:26.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.966+0000 7f8317fff700 1 -- 172.21.15.104:0/298634142 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f831815a2e0 msgr2=0x7f83180adb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:26.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.966+0000 7f8317fff700 1 --2- 172.21.15.104:0/298634142 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f831815a2e0 0x7f83180adb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:26.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.966+0000 7f8317fff700 1 -- 172.21.15.104:0/298634142 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83100094f0 con 0x7f83180b3b30 2024-08-17T02:22:26.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.966+0000 7f831cedd700 1 --2- 172.21.15.104:0/298634142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83180aac50 0x7f8318153010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:22:26.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.966+0000 7f831d6de700 1 --2- 172.21.15.104:0/298634142 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f831815a2e0 0x7f83180adb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:22:26.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.966+0000 7f8317fff700 1 --2- 172.21.15.104:0/298634142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83180b3b30 0x7f831809d4e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8308009ef0 tx=0x7f830800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:26.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.966+0000 7f8314ff9700 1 -- 172.21.15.104:0/298634142 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830800cb70 con 0x7f83180b3b30 2024-08-17T02:22:26.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.966+0000 7f8314ff9700 1 -- 172.21.15.104:0/298634142 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f830800f040 con 0x7f83180b3b30 2024-08-17T02:22:26.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.966+0000 7f831f141700 1 -- 172.21.15.104:0/298634142 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f831809a2a0 con 0x7f83180b3b30 2024-08-17T02:22:26.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.966+0000 7f8314ff9700 1 -- 172.21.15.104:0/298634142 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8308014480 con 0x7f83180b3b30 2024-08-17T02:22:26.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.966+0000 7f831f141700 1 -- 172.21.15.104:0/298634142 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f831809c310 con 0x7f83180b3b30 2024-08-17T02:22:26.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.970+0000 7f831f141700 1 -- 172.21.15.104:0/298634142 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f831809aa60 con 0x7f83180b3b30 2024-08-17T02:22:26.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.970+0000 7f8314ff9700 1 -- 172.21.15.104:0/298634142 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f83080147f0 con 0x7f83180b3b30 2024-08-17T02:22:26.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.970+0000 7f8314ff9700 1 --2- 172.21.15.104:0/298634142 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f82fc060890 0x7f82fc062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:26.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.970+0000 7f8314ff9700 1 -- 172.21.15.104:0/298634142 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f830807d4d0 con 0x7f83180b3b30 2024-08-17T02:22:26.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.970+0000 7f831cedd700 1 --2- 172.21.15.104:0/298634142 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f82fc060890 0x7f82fc062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:26.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.970+0000 7f831cedd700 1 --2- 172.21.15.104:0/298634142 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f82fc060890 0x7f82fc062d40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f83000113e0 tx=0x7f8300009120 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:26.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:26.986+0000 7f8314ff9700 1 -- 172.21.15.104:0/298634142 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f830804d880 con 0x7f83180b3b30 2024-08-17T02:22:27.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.150+0000 7f831f141700 1 -- 172.21.15.104:0/298634142 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83180645c0 con 0x7f83180b3b30 2024-08-17T02:22:27.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.150+0000 7f8314ff9700 1 -- 172.21.15.104:0/298634142 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f8308050ea0 con 0x7f83180b3b30 2024-08-17T02:22:27.158 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:22:27.158 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":23,"fsid":"fd5f7fb8-d34b-49bb-89a8-62b7dad1bc25","created":"2024-08-17T02:21:57.891389+0000","modified":"2024-08-17T02:22:23.175831+0000","last_up_change":"2024-08-17T02:22:08.924546+0000","last_in_change":"2024-08-17T02:21:59.938028+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:22:10.143970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:22:20.082708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:22:20.521582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"606b9088-590e-4709-aa3a-b0f6e22972ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":24257},{"type":"v1","addr":"172.21.15.104:6809","nonce":24257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":24257},{"type":"v1","addr":"172.21.15.104:6811","nonce":24257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":24257},{"type":"v1","addr":"172.21.15.104:6815","nonce":24257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":24257},{"type":"v1","addr":"172.21.15.104:6813","nonce":24257}]},"public_addr":"172.21.15.104:6809/24257","cluster_addr":"172.21.15.104:6811/24257","heartbeat_back_addr":"172.21.15.104:6815/24257","heartbeat_front_addr":"172.21.15.104:6813/24257","state":["exists","up"]},{"osd":1,"uuid":"9bc6a909-0c2f-4889-afe7-4a47f89b0f64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":24256},{"type":"v1","addr":"172.21.15.104:6825","nonce":24256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":24256},{"type":"v1","addr":"172.21.15.104:6827","nonce":24256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":24256},{"type":"v1","addr":"172.21.15.104:6831","nonce":24256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":24256},{"type":"v1","addr":"172.21.15.104:6829","nonce":24256}]},"public_addr":"172.21.15.104:6825/24256","cluster_addr":"172.21.15.104:6827/24256","heartbeat_back_addr":"172.21.15.104:6831/24256","heartbeat_front_addr":"172.21.15.104:6829/24256","state":["exists","up"]},{"osd":2,"uuid":"23da31d5-aefb-4edb-b79d-fa05e1becef7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":24255},{"type":"v1","addr":"172.21.15.104:6817","nonce":24255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":24255},{"type":"v1","addr":"172.21.15.104:6819","nonce":24255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":24255},{"type":"v1","addr":"172.21.15.104:6823","nonce":24255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":24255},{"type":"v1","addr":"172.21.15.104:6821","nonce":24255}]},"public_addr":"172.21.15.104:6817/24255","cluster_addr":"172.21.15.104:6819/24255","heartbeat_back_addr":"172.21.15.104:6823/24255","heartbeat_front_addr":"172.21.15.104:6821/24255","state":["exists","up"]},{"osd":3,"uuid":"6e4a5ec2-b415-45ef-8381-61a59eb65224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":24254},{"type":"v1","addr":"172.21.15.104:6801","nonce":24254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":24254},{"type":"v1","addr":"172.21.15.104:6803","nonce":24254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":24254},{"type":"v1","addr":"172.21.15.104:6807","nonce":24254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":24254},{"type":"v1","addr":"172.21.15.104:6805","nonce":24254}]},"public_addr":"172.21.15.104:6801/24254","cluster_addr":"172.21.15.104:6803/24254","heartbeat_back_addr":"172.21.15.104:6807/24254","heartbeat_front_addr":"172.21.15.104:6805/24254","state":["exists","up"]},{"osd":4,"uuid":"8d5bea2d-9039-4013-8c99-2c046c5b8a17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":24421},{"type":"v1","addr":"172.21.15.117:6804","nonce":24421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":24421},{"type":"v1","addr":"172.21.15.117:6809","nonce":24421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":24421},{"type":"v1","addr":"172.21.15.117:6815","nonce":24421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":24421},{"type":"v1","addr":"172.21.15.117:6813","nonce":24421}]},"public_addr":"172.21.15.117:6804/24421","cluster_addr":"172.21.15.117:6809/24421","heartbeat_back_addr":"172.21.15.117:6815/24421","heartbeat_front_addr":"172.21.15.117:6813/24421","state":["exists","up"]},{"osd":5,"uuid":"de8b36fc-121c-4f05-8f5b-28f513d9f21f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":24422},{"type":"v1","addr":"172.21.15.117:6817","nonce":24422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":24422},{"type":"v1","addr":"172.21.15.117:6819","nonce":24422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":24422},{"type":"v1","addr":"172.21.15.117:6823","nonce":24422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":24422},{"type":"v1","addr":"172.21.15.117:6821","nonce":24422}]},"public_addr":"172.21.15.117:6817/24422","cluster_addr":"172.21.15.117:6819/24422","heartbeat_back_addr":"172.21.15.117:6823/24422","heartbeat_front_addr":"172.21.15.117:6821/24422","state":["exists","up"]},{"osd":6,"uuid":"6a87f09f-7bf7-4f7a-be87-530ac1ff8ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":24420},{"type":"v1","addr":"172.21.15.117:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6803","nonce":24420},{"type":"v1","addr":"172.21.15.117:6805","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":24420},{"type":"v1","addr":"172.21.15.117:6811","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":24420},{"type":"v1","addr":"172.21.15.117:6808","nonce":24420}]},"public_addr":"172.21.15.117:6801/24420","cluster_addr":"172.21.15.117:6805/24420","heartbeat_back_addr":"172.21.15.117:6811/24420","heartbeat_front_addr":"172.21.15.117:6808/24420","state":["exists","up"]},{"osd":7,"uuid":"e31d8041-1aa1-4b5d-83b3-0a373426dd9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":24423},{"type":"v1","addr":"172.21.15.117:6825","nonce":24423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":24423},{"type":"v1","addr":"172.21.15.117:6827","nonce":24423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":24423},{"type":"v1","addr":"172.21.15.117:6831","nonce":24423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":24423},{"type":"v1","addr":"172.21.15.117:6829","nonce":24423}]},"public_addr":"172.21.15.117:6825/24423","cluster_addr":"172.21.15.117:6827/24423","heartbeat_back_addr":"172.21.15.117:6831/24423","heartbeat_front_addr":"172.21.15.117:6829/24423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.220874+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.210039+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.434762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.247206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.184316+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.306325+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.035719+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.400303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:22:27.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.154+0000 7f831f141700 1 -- 172.21.15.104:0/298634142 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f82fc060890 msgr2=0x7f82fc062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.154+0000 7f831f141700 1 --2- 172.21.15.104:0/298634142 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f82fc060890 0x7f82fc062d40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f83000113e0 tx=0x7f8300009120 comp rx=0 tx=0).stop 2024-08-17T02:22:27.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.154+0000 7f831f141700 1 -- 172.21.15.104:0/298634142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83180b3b30 msgr2=0x7f831809d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.154+0000 7f831f141700 1 --2- 172.21.15.104:0/298634142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83180b3b30 0x7f831809d4e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8308009ef0 tx=0x7f830800b040 comp rx=0 tx=0).stop 2024-08-17T02:22:27.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.154+0000 7f831f141700 1 -- 172.21.15.104:0/298634142 shutdown_connections 2024-08-17T02:22:27.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.154+0000 7f831f141700 1 --2- 172.21.15.104:0/298634142 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f82fc060890 0x7f82fc062d40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.154+0000 7f831f141700 1 --2- 172.21.15.104:0/298634142 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f831815a2e0 0x7f83180adb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.154+0000 7f831f141700 1 --2- 172.21.15.104:0/298634142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83180b3b30 0x7f831809d4e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.154+0000 7f831f141700 1 --2- 172.21.15.104:0/298634142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83180aac50 0x7f8318153010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.154+0000 7f831f141700 1 -- 172.21.15.104:0/298634142 >> 172.21.15.104:0/298634142 conn(0x7f83180994d0 msgr2=0x7f83180affc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:27.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.154+0000 7f831f141700 1 -- 172.21.15.104:0/298634142 shutdown_connections 2024-08-17T02:22:27.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.154+0000 7f831f141700 1 -- 172.21.15.104:0/298634142 wait complete. 2024-08-17T02:22:27.175 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-08-17T02:22:27.175 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:22:27.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.270+0000 7f38cef54700 1 Processor -- start 2024-08-17T02:22:27.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.270+0000 7f38cef54700 1 -- start start 2024-08-17T02:22:27.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.270+0000 7f38cef54700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f38c8068ca0 0x7f38c80cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.270+0000 7f38cef54700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f38c806a470 0x7f38c806a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.270+0000 7f38cef54700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38c80c7750 con 0x7f38c80688d0 2024-08-17T02:22:27.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.270+0000 7f38cef54700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38c80cb220 con 0x7f38c806a470 2024-08-17T02:22:27.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.274+0000 7f38cccf0700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f38c80688d0 0x7f38c80caa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:56692/0 (socket says 172.21.15.104:56692) 2024-08-17T02:22:27.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.274+0000 7f38cef54700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38c80c6e20 con 0x7f38c8068ca0 2024-08-17T02:22:27.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.274+0000 7f38cccf0700 1 -- 172.21.15.104:0/1472449022 learned_addr learned my addr 172.21.15.104:0/1472449022 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:27.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.274+0000 7f38cd4f1700 1 --2- 172.21.15.104:0/1472449022 >> v2:172.21.15.104:3300/0 conn(0x7f38c806a470 0x7f38c806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.274+0000 7f38c7fff700 1 --2- 172.21.15.104:0/1472449022 >> v2:172.21.15.117:3300/0 conn(0x7f38c8068ca0 0x7f38c80cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.274+0000 7f38c77fe700 1 -- 172.21.15.104:0/1472449022 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1462702315 0 0) 0x7f38c80c7750 con 0x7f38c80688d0 2024-08-17T02:22:27.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.274+0000 7f38c77fe700 1 -- 172.21.15.104:0/1472449022 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38b0003570 con 0x7f38c80688d0 2024-08-17T02:22:27.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.274+0000 7f38cd4f1700 1 -- 172.21.15.104:0/1472449022 >> v2:172.21.15.117:3300/0 conn(0x7f38c8068ca0 msgr2=0x7f38c80cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:27.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.274+0000 7f38cd4f1700 1 --2- 172.21.15.104:0/1472449022 >> v2:172.21.15.117:3300/0 conn(0x7f38c8068ca0 0x7f38c80cc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.274+0000 7f38cd4f1700 1 -- 172.21.15.104:0/1472449022 >> v1:172.21.15.104:6789/0 conn(0x7f38c80688d0 legacy=0x7f38c80caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.274+0000 7f38cd4f1700 1 -- 172.21.15.104:0/1472449022 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c80c7100 con 0x7f38c806a470 2024-08-17T02:22:27.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.274+0000 7f38cd4f1700 1 --2- 172.21.15.104:0/1472449022 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f38c806a470 0x7f38c806a870 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f38c8159380 tx=0x7f38b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c366874df306c30 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.274+0000 7f38c77fe700 1 -- 172.21.15.104:0/1472449022 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b8011630 con 0x7f38c806a470 2024-08-17T02:22:27.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.274+0000 7f38c77fe700 1 -- 172.21.15.104:0/1472449022 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b80117b0 con 0x7f38c806a470 2024-08-17T02:22:27.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.274+0000 7f38c77fe700 1 -- 172.21.15.104:0/1472449022 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b8011b70 con 0x7f38c806a470 2024-08-17T02:22:27.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.274+0000 7f38cef54700 1 -- 172.21.15.104:0/1472449022 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f38c806a470 msgr2=0x7f38c806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.274+0000 7f38cef54700 1 --2- 172.21.15.104:0/1472449022 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f38c806a470 0x7f38c806a870 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f38c8159380 tx=0x7f38b80091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.274+0000 7f38cef54700 1 -- 172.21.15.104:0/1472449022 shutdown_connections 2024-08-17T02:22:27.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.274+0000 7f38cef54700 1 --2- 172.21.15.104:0/1472449022 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f38c806a470 0x7f38c806a870 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.274+0000 7f38cef54700 1 --2- 172.21.15.104:0/1472449022 >> v2:172.21.15.117:3300/0 conn(0x7f38c8068ca0 0x7f38c80cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.274+0000 7f38cef54700 1 -- 172.21.15.104:0/1472449022 >> 172.21.15.104:0/1472449022 conn(0x7f38c80c9c20 msgr2=0x7f38c806d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:27.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.274+0000 7f38cef54700 1 -- 172.21.15.104:0/1472449022 shutdown_connections 2024-08-17T02:22:27.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.274+0000 7f38cef54700 1 -- 172.21.15.104:0/1472449022 wait complete. 2024-08-17T02:22:27.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.278+0000 7f38cef54700 1 Processor -- start 2024-08-17T02:22:27.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.278+0000 7f38cef54700 1 -- start start 2024-08-17T02:22:27.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.278+0000 7f38cef54700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f38c80688d0 0x7f38c80abc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.278+0000 7f38cef54700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38c8068ca0 0x7f38c80ae990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.278+0000 7f38cef54700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38c806a470 0x7f38c80c2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.278+0000 7f38cef54700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c80b0b00 con 0x7f38c80688d0 2024-08-17T02:22:27.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.278+0000 7f38cef54700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c80aeed0 con 0x7f38c8068ca0 2024-08-17T02:22:27.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.278+0000 7f38cef54700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c8153660 con 0x7f38c806a470 2024-08-17T02:22:27.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.278+0000 7f38cccf0700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f38c80688d0 0x7f38c80abc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.278+0000 7f38cccf0700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f38c80688d0 0x7f38c80abc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42160/0 (socket says 172.21.15.104:42160) 2024-08-17T02:22:27.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.278+0000 7f38cccf0700 1 -- 172.21.15.104:0/2518699665 learned_addr learned my addr 172.21.15.104:0/2518699665 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:27.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.278+0000 7f38c7fff700 1 --2- 172.21.15.104:0/2518699665 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38c8068ca0 0x7f38c80ae990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.278+0000 7f38cd4f1700 1 --2- 172.21.15.104:0/2518699665 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38c806a470 0x7f38c80c2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.278+0000 7f38cccf0700 1 -- 172.21.15.104:0/2518699665 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38c806a470 msgr2=0x7f38c80c2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.278+0000 7f38cccf0700 1 --2- 172.21.15.104:0/2518699665 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38c806a470 0x7f38c80c2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.278+0000 7f38cccf0700 1 -- 172.21.15.104:0/2518699665 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38c8068ca0 msgr2=0x7f38c80ae990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.278+0000 7f38cccf0700 1 --2- 172.21.15.104:0/2518699665 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38c8068ca0 0x7f38c80ae990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.278+0000 7f38cccf0700 1 -- 172.21.15.104:0/2518699665 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b8009420 con 0x7f38c80688d0 2024-08-17T02:22:27.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.278+0000 7f38cccf0700 1 --2- 172.21.15.104:0/2518699665 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f38c80688d0 0x7f38c80abc80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f38c000cd30 tx=0x7f38c0001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.278+0000 7f38c4ff9700 1 -- 172.21.15.104:0/2518699665 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c000ce90 con 0x7f38c80688d0 2024-08-17T02:22:27.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.278+0000 7f38c4ff9700 1 -- 172.21.15.104:0/2518699665 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c000aad0 con 0x7f38c80688d0 2024-08-17T02:22:27.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.278+0000 7f38cef54700 1 -- 172.21.15.104:0/2518699665 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38c8167000 con 0x7f38c80688d0 2024-08-17T02:22:27.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.278+0000 7f38c4ff9700 1 -- 172.21.15.104:0/2518699665 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c000ae70 con 0x7f38c80688d0 2024-08-17T02:22:27.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.278+0000 7f38cef54700 1 -- 172.21.15.104:0/2518699665 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38c81675c0 con 0x7f38c80688d0 2024-08-17T02:22:27.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.282+0000 7f38cef54700 1 -- 172.21.15.104:0/2518699665 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38c81677e0 con 0x7f38c80688d0 2024-08-17T02:22:27.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.282+0000 7f38c4ff9700 1 -- 172.21.15.104:0/2518699665 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f38c0007300 con 0x7f38c80688d0 2024-08-17T02:22:27.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.282+0000 7f38c4ff9700 1 --2- 172.21.15.104:0/2518699665 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f38b4060860 0x7f38b4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.282+0000 7f38c4ff9700 1 -- 172.21.15.104:0/2518699665 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f38c007cfd0 con 0x7f38c80688d0 2024-08-17T02:22:27.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.282+0000 7f38c7fff700 1 --2- 172.21.15.104:0/2518699665 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f38b4060860 0x7f38b4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.282+0000 7f38c7fff700 1 --2- 172.21.15.104:0/2518699665 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f38b4060860 0x7f38b4062d10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f38c80ca480 tx=0x7f38bc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.290+0000 7f38c4ff9700 1 -- 172.21.15.104:0/2518699665 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f38c0050f30 con 0x7f38c80688d0 2024-08-17T02:22:27.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.458+0000 7f38cef54700 1 -- 172.21.15.104:0/2518699665 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38c80645c0 con 0x7f38c80688d0 2024-08-17T02:22:27.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.458+0000 7f38c4ff9700 1 -- 172.21.15.104:0/2518699665 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f38c0050ac0 con 0x7f38c80688d0 2024-08-17T02:22:27.466 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:22:27.466 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":23,"fsid":"fd5f7fb8-d34b-49bb-89a8-62b7dad1bc25","created":"2024-08-17T02:21:57.891389+0000","modified":"2024-08-17T02:22:23.175831+0000","last_up_change":"2024-08-17T02:22:08.924546+0000","last_in_change":"2024-08-17T02:21:59.938028+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:22:10.143970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:22:20.082708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:22:20.521582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"606b9088-590e-4709-aa3a-b0f6e22972ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":24257},{"type":"v1","addr":"172.21.15.104:6809","nonce":24257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":24257},{"type":"v1","addr":"172.21.15.104:6811","nonce":24257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":24257},{"type":"v1","addr":"172.21.15.104:6815","nonce":24257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":24257},{"type":"v1","addr":"172.21.15.104:6813","nonce":24257}]},"public_addr":"172.21.15.104:6809/24257","cluster_addr":"172.21.15.104:6811/24257","heartbeat_back_addr":"172.21.15.104:6815/24257","heartbeat_front_addr":"172.21.15.104:6813/24257","state":["exists","up"]},{"osd":1,"uuid":"9bc6a909-0c2f-4889-afe7-4a47f89b0f64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":24256},{"type":"v1","addr":"172.21.15.104:6825","nonce":24256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":24256},{"type":"v1","addr":"172.21.15.104:6827","nonce":24256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":24256},{"type":"v1","addr":"172.21.15.104:6831","nonce":24256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":24256},{"type":"v1","addr":"172.21.15.104:6829","nonce":24256}]},"public_addr":"172.21.15.104:6825/24256","cluster_addr":"172.21.15.104:6827/24256","heartbeat_back_addr":"172.21.15.104:6831/24256","heartbeat_front_addr":"172.21.15.104:6829/24256","state":["exists","up"]},{"osd":2,"uuid":"23da31d5-aefb-4edb-b79d-fa05e1becef7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":24255},{"type":"v1","addr":"172.21.15.104:6817","nonce":24255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":24255},{"type":"v1","addr":"172.21.15.104:6819","nonce":24255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":24255},{"type":"v1","addr":"172.21.15.104:6823","nonce":24255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":24255},{"type":"v1","addr":"172.21.15.104:6821","nonce":24255}]},"public_addr":"172.21.15.104:6817/24255","cluster_addr":"172.21.15.104:6819/24255","heartbeat_back_addr":"172.21.15.104:6823/24255","heartbeat_front_addr":"172.21.15.104:6821/24255","state":["exists","up"]},{"osd":3,"uuid":"6e4a5ec2-b415-45ef-8381-61a59eb65224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":24254},{"type":"v1","addr":"172.21.15.104:6801","nonce":24254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":24254},{"type":"v1","addr":"172.21.15.104:6803","nonce":24254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":24254},{"type":"v1","addr":"172.21.15.104:6807","nonce":24254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":24254},{"type":"v1","addr":"172.21.15.104:6805","nonce":24254}]},"public_addr":"172.21.15.104:6801/24254","cluster_addr":"172.21.15.104:6803/24254","heartbeat_back_addr":"172.21.15.104:6807/24254","heartbeat_front_addr":"172.21.15.104:6805/24254","state":["exists","up"]},{"osd":4,"uuid":"8d5bea2d-9039-4013-8c99-2c046c5b8a17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":24421},{"type":"v1","addr":"172.21.15.117:6804","nonce":24421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":24421},{"type":"v1","addr":"172.21.15.117:6809","nonce":24421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":24421},{"type":"v1","addr":"172.21.15.117:6815","nonce":24421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":24421},{"type":"v1","addr":"172.21.15.117:6813","nonce":24421}]},"public_addr":"172.21.15.117:6804/24421","cluster_addr":"172.21.15.117:6809/24421","heartbeat_back_addr":"172.21.15.117:6815/24421","heartbeat_front_addr":"172.21.15.117:6813/24421","state":["exists","up"]},{"osd":5,"uuid":"de8b36fc-121c-4f05-8f5b-28f513d9f21f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":24422},{"type":"v1","addr":"172.21.15.117:6817","nonce":24422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":24422},{"type":"v1","addr":"172.21.15.117:6819","nonce":24422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":24422},{"type":"v1","addr":"172.21.15.117:6823","nonce":24422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":24422},{"type":"v1","addr":"172.21.15.117:6821","nonce":24422}]},"public_addr":"172.21.15.117:6817/24422","cluster_addr":"172.21.15.117:6819/24422","heartbeat_back_addr":"172.21.15.117:6823/24422","heartbeat_front_addr":"172.21.15.117:6821/24422","state":["exists","up"]},{"osd":6,"uuid":"6a87f09f-7bf7-4f7a-be87-530ac1ff8ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":24420},{"type":"v1","addr":"172.21.15.117:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6803","nonce":24420},{"type":"v1","addr":"172.21.15.117:6805","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":24420},{"type":"v1","addr":"172.21.15.117:6811","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":24420},{"type":"v1","addr":"172.21.15.117:6808","nonce":24420}]},"public_addr":"172.21.15.117:6801/24420","cluster_addr":"172.21.15.117:6805/24420","heartbeat_back_addr":"172.21.15.117:6811/24420","heartbeat_front_addr":"172.21.15.117:6808/24420","state":["exists","up"]},{"osd":7,"uuid":"e31d8041-1aa1-4b5d-83b3-0a373426dd9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":24423},{"type":"v1","addr":"172.21.15.117:6825","nonce":24423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":24423},{"type":"v1","addr":"172.21.15.117:6827","nonce":24423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":24423},{"type":"v1","addr":"172.21.15.117:6831","nonce":24423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":24423},{"type":"v1","addr":"172.21.15.117:6829","nonce":24423}]},"public_addr":"172.21.15.117:6825/24423","cluster_addr":"172.21.15.117:6827/24423","heartbeat_back_addr":"172.21.15.117:6831/24423","heartbeat_front_addr":"172.21.15.117:6829/24423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.220874+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.210039+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.434762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.247206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.184316+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.306325+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.035719+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.400303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:22:27.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.462+0000 7f38cef54700 1 -- 172.21.15.104:0/2518699665 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f38b4060860 msgr2=0x7f38b4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.462+0000 7f38cef54700 1 --2- 172.21.15.104:0/2518699665 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f38b4060860 0x7f38b4062d10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f38c80ca480 tx=0x7f38bc008040 comp rx=0 tx=0).stop 2024-08-17T02:22:27.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.462+0000 7f38cef54700 1 -- 172.21.15.104:0/2518699665 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f38c80688d0 msgr2=0x7f38c80abc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.462+0000 7f38cef54700 1 --2- 172.21.15.104:0/2518699665 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f38c80688d0 0x7f38c80abc80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f38c000cd30 tx=0x7f38c0001b00 comp rx=0 tx=0).stop 2024-08-17T02:22:27.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.462+0000 7f38cef54700 1 -- 172.21.15.104:0/2518699665 shutdown_connections 2024-08-17T02:22:27.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.462+0000 7f38cef54700 1 --2- 172.21.15.104:0/2518699665 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f38b4060860 0x7f38b4062d10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.462+0000 7f38cef54700 1 --2- 172.21.15.104:0/2518699665 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38c806a470 0x7f38c80c2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.462+0000 7f38cef54700 1 --2- 172.21.15.104:0/2518699665 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38c8068ca0 0x7f38c80ae990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.462+0000 7f38cef54700 1 --2- 172.21.15.104:0/2518699665 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f38c80688d0 0x7f38c80abc80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.462+0000 7f38cef54700 1 -- 172.21.15.104:0/2518699665 >> 172.21.15.104:0/2518699665 conn(0x7f38c80c9c20 msgr2=0x7f38c806bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:27.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.462+0000 7f38cef54700 1 -- 172.21.15.104:0/2518699665 shutdown_connections 2024-08-17T02:22:27.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.462+0000 7f38cef54700 1 -- 172.21.15.104:0/2518699665 wait complete. 2024-08-17T02:22:27.480 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-08-17T02:22:27.481 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-08-17T02:22:27.481 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-08-17T02:22:27.482 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-08-17T02:22:27.482 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-08-17T02:22:27.482 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-08-17T02:22:27.483 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-08-17T02:22:27.483 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-08-17T02:22:27.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.614+0000 7f8dc446b700 1 Processor -- start 2024-08-17T02:22:27.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.614+0000 7f1d26804700 1 Processor -- start 2024-08-17T02:22:27.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.614+0000 7f8dc446b700 1 -- start start 2024-08-17T02:22:27.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.614+0000 7f1d26804700 1 -- start start 2024-08-17T02:22:27.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.614+0000 7fbafe1d6700 1 Processor -- start 2024-08-17T02:22:27.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.614+0000 7f8dc446b700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f8dbc0b14a0 0x7f8dbc0ca660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.614+0000 7f8dc446b700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dbc0abb70 con 0x7f8dbc156ef0 2024-08-17T02:22:27.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.614+0000 7f8dc446b700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dbc0ac130 con 0x7f8dbc0caeb0 2024-08-17T02:22:27.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.614+0000 7f8dc446b700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dbc0cb620 con 0x7f8dbc0b14a0 2024-08-17T02:22:27.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.614+0000 7fbafe1d6700 1 -- start start 2024-08-17T02:22:27.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7f1d26804700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d20158f20 0x7f1d200a9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7f1d26804700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1d2006e620 0x7f1d200ab2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7f1d26804700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d200aed60 con 0x7f1d200a9da0 2024-08-17T02:22:27.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7f1d26804700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d200aa240 con 0x7f1d2006e620 2024-08-17T02:22:27.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7f1d26804700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d200aa520 con 0x7f1d20158f20 2024-08-17T02:22:27.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7f8dc2207700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f8dbc156ef0 0x7f8dbc0b0d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:56696/0 (socket says 172.21.15.104:56696) 2024-08-17T02:22:27.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7f8dc2207700 1 -- 172.21.15.104:0/2255163497 learned_addr learned my addr 172.21.15.104:0/2255163497 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:27.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7f8dc2a08700 1 --1- 172.21.15.104:0/2255163497 >> v1:172.21.15.117:6789/0 conn(0x7f8dbc0caeb0 0x7f8dbc0ac5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.104:60630/0 (socket says 172.21.15.104:60630) 2024-08-17T02:22:27.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7f1d1ffff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d20158f20 0x7f1d200a9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7f1d24da1700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1d2006e620 0x7f1d200ab2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7f1d24da1700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1d2006e620 0x7f1d200ab2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.104:40912/0 (socket says 172.21.15.104:40912) 2024-08-17T02:22:27.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7f1d24da1700 1 -- 172.21.15.104:0/3181932165 learned_addr learned my addr 172.21.15.104:0/3181932165 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:27.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7f8dc1a06700 1 --2- 172.21.15.104:0/2255163497 >> v2:172.21.15.104:3300/0 conn(0x7f8dbc0b14a0 0x7f8dbc0ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7f1d1effd700 1 -- 172.21.15.104:0/3181932165 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2324273804 0 0) 0x7f1d200aed60 con 0x7f1d200a9da0 2024-08-17T02:22:27.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7f1d1ffff700 1 -- 172.21.15.104:0/3181932165 >> v2:172.21.15.117:3300/0 conn(0x7f1d2006e620 msgr2=0x7f1d200ab2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:27.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7f1d1ffff700 1 --2- 172.21.15.104:0/3181932165 >> v2:172.21.15.117:3300/0 conn(0x7f1d2006e620 0x7f1d200ab2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7f1d1ffff700 1 -- 172.21.15.104:0/3181932165 >> v1:172.21.15.104:6789/0 conn(0x7f1d200a9da0 legacy=0x7f1d2006df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7f1d1ffff700 1 -- 172.21.15.104:0/3181932165 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d200aa800 con 0x7f1d20158f20 2024-08-17T02:22:27.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7f8dc1a06700 1 -- 172.21.15.104:0/2255163497 >> v1:172.21.15.117:6789/0 conn(0x7f8dbc0caeb0 legacy=0x7f8dbc0ac5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7f8dc1a06700 1 -- 172.21.15.104:0/2255163497 >> v1:172.21.15.104:6789/0 conn(0x7f8dbc156ef0 legacy=0x7f8dbc0b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7f8dc1a06700 1 -- 172.21.15.104:0/2255163497 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dbc0cb900 con 0x7f8dbc0b14a0 2024-08-17T02:22:27.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7ff5a1868700 1 Processor -- start 2024-08-17T02:22:27.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7ff5a1868700 1 -- start start 2024-08-17T02:22:27.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7f1d1ffff700 1 --2- 172.21.15.104:0/3181932165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d20158f20 0x7f1d200a9860 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1d140098e0 tx=0x7f1d140091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51b1f5c02e33a3e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7f8dc1a06700 1 --2- 172.21.15.104:0/2255163497 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8dbc0b14a0 0x7f8dbc0ca660 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8dac0098e0 tx=0x7f8dac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a397db3eff195235 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7fbafe1d6700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fbaf8155f90 0x7fbaf8159a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7f1d1effd700 1 -- 172.21.15.104:0/3181932165 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1400b640 con 0x7f1d20158f20 2024-08-17T02:22:27.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7f1d1effd700 1 -- 172.21.15.104:0/3181932165 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d1400b7a0 con 0x7f1d20158f20 2024-08-17T02:22:27.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7fbaf6ffd700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fbaf8155f90 0x7fbaf8159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7fbaf6ffd700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fbaf8155f90 0x7fbaf8159a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42178/0 (socket says 172.21.15.104:42178) 2024-08-17T02:22:27.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7f1d1effd700 1 -- 172.21.15.104:0/3181932165 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1400bb40 con 0x7f1d20158f20 2024-08-17T02:22:27.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7ff5a1868700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff59c1562c0 0x7ff59c069f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7ff5a1868700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff59c0b1020 0x7ff59c0affe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7ff5a1868700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff59c0ac260 con 0x7ff59c155ef0 2024-08-17T02:22:27.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7ff5a1868700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff59c068640 con 0x7ff59c0b1020 2024-08-17T02:22:27.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7ff5a1868700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff59c0b14a0 con 0x7ff59c1562c0 2024-08-17T02:22:27.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7fbaf6ffd700 1 -- 172.21.15.104:0/2836366335 learned_addr learned my addr 172.21.15.104:0/2836366335 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:27.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7fbafe1d6700 1 --2- 172.21.15.104:0/2836366335 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaf81563e0 0x7fbaf8159f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7fbafe1d6700 1 -- 172.21.15.104:0/2836366335 --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaf80c97d0 con 0x7fbaf8155bc0 2024-08-17T02:22:27.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7fbafe1d6700 1 -- 172.21.15.104:0/2836366335 --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaf80ca630 con 0x7fbaf8155f90 2024-08-17T02:22:27.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7fbafe1d6700 1 -- 172.21.15.104:0/2836366335 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf80c9a20 con 0x7fbaf81563e0 2024-08-17T02:22:27.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7fbaf6ffd700 1 -- 172.21.15.104:0/2836366335 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaf81563e0 msgr2=0x7fbaf8159f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:27.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7fbaf6ffd700 1 --2- 172.21.15.104:0/2836366335 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaf81563e0 0x7fbaf8159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7fbaf6ffd700 1 -- 172.21.15.104:0/2836366335 >> v1:172.21.15.117:6789/0 conn(0x7fbaf8155bc0 legacy=0x7fbaf80af1d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-17T02:22:27.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7fbaf6ffd700 1 -- 172.21.15.104:0/2836366335 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf80c9d00 con 0x7fbaf8155f90 2024-08-17T02:22:27.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7f8dc1205700 1 -- 172.21.15.104:0/2255163497 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dac009e80 con 0x7f8dbc0b14a0 2024-08-17T02:22:27.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7f8dc1205700 1 -- 172.21.15.104:0/2255163497 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dac00b760 con 0x7f8dbc0b14a0 2024-08-17T02:22:27.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7f8dc1205700 1 -- 172.21.15.104:0/2255163497 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dac00bb00 con 0x7f8dbc0b14a0 2024-08-17T02:22:27.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7ff59a7fc700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff59c1562c0 0x7ff59c069f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7ff59b7fe700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff59c0b1020 0x7ff59c0affe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7ff59b7fe700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff59c0b1020 0x7ff59c0affe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.104:40918/0 (socket says 172.21.15.104:40918) 2024-08-17T02:22:27.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7ff59b7fe700 1 -- 172.21.15.104:0/172594669 learned_addr learned my addr 172.21.15.104:0/172594669 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:27.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7f1d26804700 1 -- 172.21.15.104:0/3181932165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d20158f20 msgr2=0x7f1d200a9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7f1d26804700 1 --2- 172.21.15.104:0/3181932165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d20158f20 0x7f1d200a9860 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1d140098e0 tx=0x7f1d140091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7f1d26804700 1 -- 172.21.15.104:0/3181932165 shutdown_connections 2024-08-17T02:22:27.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7f1d26804700 1 --2- 172.21.15.104:0/3181932165 >> v2:172.21.15.117:3300/0 conn(0x7f1d2006e620 0x7f1d200ab2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7f1d26804700 1 --2- 172.21.15.104:0/3181932165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d20158f20 0x7f1d200a9860 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7f1d26804700 1 -- 172.21.15.104:0/3181932165 >> 172.21.15.104:0/3181932165 conn(0x7f1d200678d0 msgr2=0x7f1d20067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:27.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7f8dc446b700 1 -- 172.21.15.104:0/2255163497 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8dbc0b14a0 msgr2=0x7f8dbc0ca660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7f8dc446b700 1 --2- 172.21.15.104:0/2255163497 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8dbc0b14a0 0x7f8dbc0ca660 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8dac0098e0 tx=0x7f8dac0091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7fbaf6ffd700 1 --2- 172.21.15.104:0/2836366335 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbaf8155f90 0x7fbaf8159a10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbaf0009f20 tx=0x7fbaf0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d608058b792b68db server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7f1d26804700 1 -- 172.21.15.104:0/3181932165 shutdown_connections 2024-08-17T02:22:27.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7f8dc446b700 1 -- 172.21.15.104:0/2255163497 shutdown_connections 2024-08-17T02:22:27.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.618+0000 7f8dc446b700 1 --2- 172.21.15.104:0/2255163497 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8dbc0b14a0 0x7f8dbc0ca660 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7f8dc446b700 1 -- 172.21.15.104:0/2255163497 >> 172.21.15.104:0/2255163497 conn(0x7f8dbc0678d0 msgr2=0x7f8dbc067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:27.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7f1d26804700 1 -- 172.21.15.104:0/3181932165 wait complete. 2024-08-17T02:22:27.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7fcd9bfff700 1 Processor -- start 2024-08-17T02:22:27.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7ff59b7fe700 1 -- 172.21.15.104:0/172594669 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff59c1562c0 msgr2=0x7ff59c069f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:27.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7ff59b7fe700 1 --2- 172.21.15.104:0/172594669 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff59c1562c0 0x7ff59c069f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7fcd9bfff700 1 -- start start 2024-08-17T02:22:27.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7ff59b7fe700 1 -- 172.21.15.104:0/172594669 >> v1:172.21.15.104:6789/0 conn(0x7ff59c155ef0 legacy=0x7ff59c0ac6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:27.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7ff59b7fe700 1 -- 172.21.15.104:0/172594669 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff59c06a650 con 0x7ff59c0b1020 2024-08-17T02:22:27.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7ff59a7fc700 1 --2- 172.21.15.104:0/172594669 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff59c1562c0 0x7ff59c069f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:22:27.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7ff59b7fe700 1 --2- 172.21.15.104:0/172594669 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff59c0b1020 0x7ff59c0affe0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff5900099b0 tx=0x7ff590009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e29d6d6990825795 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7fbaf67fc700 1 -- 172.21.15.104:0/2836366335 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf000e070 con 0x7fbaf8155f90 2024-08-17T02:22:27.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7fbaf67fc700 1 -- 172.21.15.104:0/2836366335 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf000ba40 con 0x7fbaf8155f90 2024-08-17T02:22:27.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7fbaf67fc700 1 -- 172.21.15.104:0/2836366335 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf00092e0 con 0x7fbaf8155f90 2024-08-17T02:22:27.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7ff599ffb700 1 -- 172.21.15.104:0/172594669 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff590009ea0 con 0x7ff59c0b1020 2024-08-17T02:22:27.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7ff599ffb700 1 -- 172.21.15.104:0/172594669 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59000b820 con 0x7ff59c0b1020 2024-08-17T02:22:27.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7ff599ffb700 1 -- 172.21.15.104:0/172594669 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59000bbc0 con 0x7ff59c0b1020 2024-08-17T02:22:27.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7fbafe1d6700 1 -- 172.21.15.104:0/2836366335 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbaf8155f90 msgr2=0x7fbaf8159a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7fbafe1d6700 1 --2- 172.21.15.104:0/2836366335 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbaf8155f90 0x7fbaf8159a10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbaf0009f20 tx=0x7fbaf0009840 comp rx=0 tx=0).stop 2024-08-17T02:22:27.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7fbafe1d6700 1 -- 172.21.15.104:0/2836366335 shutdown_connections 2024-08-17T02:22:27.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7fbafe1d6700 1 --2- 172.21.15.104:0/2836366335 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaf81563e0 0x7fbaf8159f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7fbafe1d6700 1 --2- 172.21.15.104:0/2836366335 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbaf8155f90 0x7fbaf8159a10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7fbafe1d6700 1 -- 172.21.15.104:0/2836366335 >> 172.21.15.104:0/2836366335 conn(0x7fbaf806e070 msgr2=0x7fbaf80b1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:27.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7fcd9bfff700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fcd9c0a9430 0x7fcd9c0ab200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7fcd9bfff700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd9c0af160 con 0x7fcd9c1428f0 2024-08-17T02:22:27.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7fcd9bfff700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd9c06e330 con 0x7fcd9c06dbe0 2024-08-17T02:22:27.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7fcd9bfff700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd9c0ab740 con 0x7fcd9c0a9430 2024-08-17T02:22:27.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7f8dc446b700 1 -- 172.21.15.104:0/2255163497 shutdown_connections 2024-08-17T02:22:27.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7f47fcf11700 1 Processor -- start 2024-08-17T02:22:27.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7f47fcf11700 1 -- start start 2024-08-17T02:22:27.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7f8dc446b700 1 -- 172.21.15.104:0/2255163497 wait complete. 2024-08-17T02:22:27.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7f1d26804700 1 Processor -- start 2024-08-17T02:22:27.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7f1d26804700 1 -- start start 2024-08-17T02:22:27.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7ff5a1868700 1 -- 172.21.15.104:0/172594669 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff59c0b1020 msgr2=0x7ff59c0affe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7ff5a1868700 1 --2- 172.21.15.104:0/172594669 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff59c0b1020 0x7ff59c0affe0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff5900099b0 tx=0x7ff590009250 comp rx=0 tx=0).stop 2024-08-17T02:22:27.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7ff5a1868700 1 -- 172.21.15.104:0/172594669 shutdown_connections 2024-08-17T02:22:27.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7ff5a1868700 1 --2- 172.21.15.104:0/172594669 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff59c0b1020 0x7ff59c0affe0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7ff5a1868700 1 --2- 172.21.15.104:0/172594669 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff59c1562c0 0x7ff59c069f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7ff5a1868700 1 -- 172.21.15.104:0/172594669 >> 172.21.15.104:0/172594669 conn(0x7ff59c0ccb80 msgr2=0x7ff59c0a8f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:27.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7fbafe1d6700 1 -- 172.21.15.104:0/2836366335 shutdown_connections 2024-08-17T02:22:27.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7fba4086c700 1 Processor -- start 2024-08-17T02:22:27.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7fba4086c700 1 -- start start 2024-08-17T02:22:27.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7ff5a1868700 1 -- 172.21.15.104:0/172594669 shutdown_connections 2024-08-17T02:22:27.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7ff5a1868700 1 -- 172.21.15.104:0/172594669 wait complete. 2024-08-17T02:22:27.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7f133f362700 1 Processor -- start 2024-08-17T02:22:27.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7f47fcf11700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47f806e510 0x7f47f81556f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7f47fcf11700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47f8156940 con 0x7f47f813e250 2024-08-17T02:22:27.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7f47fcf11700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47f8155d30 con 0x7f47f806e140 2024-08-17T02:22:27.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7f47fcf11700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f8156010 con 0x7f47f806e510 2024-08-17T02:22:27.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7f47f7fff700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f47f813e250 0x7f47f813e6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:56732/0 (socket says 172.21.15.104:56732) 2024-08-17T02:22:27.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7f47f7fff700 1 -- 172.21.15.104:0/358155690 learned_addr learned my addr 172.21.15.104:0/358155690 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:27.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7f47f6ffd700 1 --2- 172.21.15.104:0/358155690 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47f806e510 0x7f47f81556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7f8dc446b700 1 Processor -- start 2024-08-17T02:22:27.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7f8dc446b700 1 -- start start 2024-08-17T02:22:27.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7f1d26804700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1d2006e620 0x7f1d20169810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7f1d26804700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d200a9da0 0x7f1d2014e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7f1d26804700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d20158f20 0x7f1d20155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7f1d26804700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d200ca480 con 0x7f1d2006e620 2024-08-17T02:22:27.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7f1d26804700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d200c9870 con 0x7f1d200a9da0 2024-08-17T02:22:27.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7f1d26804700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d200c9b50 con 0x7f1d20158f20 2024-08-17T02:22:27.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7f1d24da1700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d20158f20 0x7f1d20155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7f1d24da1700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d20158f20 0x7f1d20155d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.104:44548/0 (socket says 172.21.15.104:44548) 2024-08-17T02:22:27.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7f1d24da1700 1 -- 172.21.15.104:0/3158408705 learned_addr learned my addr 172.21.15.104:0/3158408705 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:27.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7ff5a1868700 1 Processor -- start 2024-08-17T02:22:27.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7fbafe1d6700 1 -- 172.21.15.104:0/2836366335 wait complete. 2024-08-17T02:22:27.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7fba4086c700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fba3c0aecc0 0x7fba3c06df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7fba4086c700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba3c0ac000 con 0x7fba3c158eb0 2024-08-17T02:22:27.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7fba4086c700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba3c0ab190 con 0x7fba3c159280 2024-08-17T02:22:27.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7fba4086c700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba3c0ab3f0 con 0x7fba3c0aecc0 2024-08-17T02:22:27.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7ff5a1868700 1 -- start start 2024-08-17T02:22:27.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7f1d1ffff700 1 --2- 172.21.15.104:0/3158408705 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1d2006e620 0x7f1d20169810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7fba3b7fe700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fba3c158eb0 0x7fba3c0aaa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:56746/0 (socket says 172.21.15.104:56746) 2024-08-17T02:22:27.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f1d1ffff700 1 -- 172.21.15.104:0/3158408705 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d20158f20 msgr2=0x7f1d20155d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f1d1ffff700 1 --2- 172.21.15.104:0/3158408705 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d20158f20 0x7f1d20155d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f1d1ffff700 1 -- 172.21.15.104:0/3158408705 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d200a9da0 msgr2=0x7f1d2014e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f1d1f7fe700 1 --2- 172.21.15.104:0/3158408705 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d200a9da0 0x7f1d2014e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7fba3b7fe700 1 -- 172.21.15.104:0/2785411216 learned_addr learned my addr 172.21.15.104:0/2785411216 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:27.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7fbafe1d6700 1 Processor -- start 2024-08-17T02:22:27.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7fcd9a7fc700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fcd9c0a9430 0x7fcd9c0ab200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7fcd9a7fc700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fcd9c0a9430 0x7fcd9c0ab200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42182/0 (socket says 172.21.15.104:42182) 2024-08-17T02:22:27.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7fcd9a7fc700 1 -- 172.21.15.104:0/2486256132 learned_addr learned my addr 172.21.15.104:0/2486256132 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:27.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7fcd9a7fc700 1 -- 172.21.15.104:0/2486256132 >> v1:172.21.15.117:6789/0 conn(0x7fcd9c06dbe0 legacy=0x7fcd9c0af5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:27.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7fcd9a7fc700 1 -- 172.21.15.104:0/2486256132 >> v1:172.21.15.104:6789/0 conn(0x7fcd9c1428f0 legacy=0x7fcd9c0a8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7fcd9a7fc700 1 -- 172.21.15.104:0/2486256132 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd9c06e610 con 0x7fcd9c0a9430 2024-08-17T02:22:27.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7fcd99ffb700 1 -- 172.21.15.104:0/2486256132 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 535920569 0 0) 0x7fcd9c0af160 con 0x7fcd9c1428f0 2024-08-17T02:22:27.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.622+0000 7fcd9a7fc700 1 --2- 172.21.15.104:0/2486256132 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd9c0a9430 0x7fcd9c0ab200 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcd900099b0 tx=0x7fcd90009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea2c86a779ca6542 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f1d1ffff700 1 --2- 172.21.15.104:0/3158408705 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d200a9da0 0x7f1d2014e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f1d1ffff700 1 -- 172.21.15.104:0/3158408705 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d14009420 con 0x7f1d2006e620 2024-08-17T02:22:27.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f1d1f7fe700 1 --2- 172.21.15.104:0/3158408705 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d200a9da0 0x7f1d2014e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:22:27.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7fbafe1d6700 1 -- start start 2024-08-17T02:22:27.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7fba3affd700 1 --2- 172.21.15.104:0/2785411216 >> v2:172.21.15.117:3300/0 conn(0x7fba3c0aecc0 0x7fba3c06df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f8dc446b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dbc0b14a0 0x7f8dbc15d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f8dc446b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8dbc0caeb0 0x7f8dbc14a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f8dc446b700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8dbc156ef0 0x7f8dbc14e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f8dc446b700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc15f030 con 0x7f8dbc0caeb0 2024-08-17T02:22:27.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f8dc446b700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc15b9b0 con 0x7f8dbc0b14a0 2024-08-17T02:22:27.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f8dc446b700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc15c530 con 0x7f8dbc156ef0 2024-08-17T02:22:27.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f1d1ffff700 1 --2- 172.21.15.104:0/3158408705 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1d2006e620 0x7f1d20169810 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1d14016000 tx=0x7f1d14017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7fba3a7fc700 1 -- 172.21.15.104:0/2785411216 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2523280657 0 0) 0x7fba3c0ac000 con 0x7fba3c158eb0 2024-08-17T02:22:27.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7fba3a7fc700 1 -- 172.21.15.104:0/2785411216 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba24003570 con 0x7fba3c158eb0 2024-08-17T02:22:27.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f8dc2a08700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8dbc156ef0 0x7f8dbc14e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f8dc1a06700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8dbc0caeb0 0x7f8dbc14a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f8dc2207700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dbc0b14a0 0x7f8dbc15d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f8dc2a08700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8dbc156ef0 0x7f8dbc14e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.104:44558/0 (socket says 172.21.15.104:44558) 2024-08-17T02:22:27.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f8dc2a08700 1 -- 172.21.15.104:0/2667072056 learned_addr learned my addr 172.21.15.104:0/2667072056 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:27.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f47f67fc700 1 -- 172.21.15.104:0/358155690 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3323661745 0 0) 0x7f47f8156940 con 0x7f47f813e250 2024-08-17T02:22:27.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f47f67fc700 1 -- 172.21.15.104:0/358155690 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47e0005780 con 0x7f47f813e250 2024-08-17T02:22:27.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f47f67fc700 1 -- 172.21.15.104:0/358155690 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2083664699 0 0) 0x7f47f8155d30 con 0x7f47f806e140 2024-08-17T02:22:27.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f47f67fc700 1 -- 172.21.15.104:0/358155690 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47f8156940 con 0x7f47f806e140 2024-08-17T02:22:27.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f47f6ffd700 1 -- 172.21.15.104:0/358155690 >> v1:172.21.15.117:6789/0 conn(0x7f47f806e140 legacy=0x7f47f80b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f47f6ffd700 1 -- 172.21.15.104:0/358155690 >> v1:172.21.15.104:6789/0 conn(0x7f47f813e250 legacy=0x7f47f813e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f47f6ffd700 1 -- 172.21.15.104:0/358155690 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f81562f0 con 0x7f47f806e510 2024-08-17T02:22:27.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7fba3affd700 1 -- 172.21.15.104:0/2785411216 >> v1:172.21.15.117:6789/0 conn(0x7fba3c159280 legacy=0x7fba3c0ac490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:22:27.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7fba3affd700 1 -- 172.21.15.104:0/2785411216 >> v1:172.21.15.104:6789/0 conn(0x7fba3c158eb0 legacy=0x7fba3c0aaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7fba3affd700 1 -- 172.21.15.104:0/2785411216 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba3c0ab6d0 con 0x7fba3c0aecc0 2024-08-17T02:22:27.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f1d07fff700 1 -- 172.21.15.104:0/3158408705 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1400bb20 con 0x7f1d2006e620 2024-08-17T02:22:27.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7ff5a1868700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff59c0b1020 0x7ff59c0989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f1d07fff700 1 -- 172.21.15.104:0/3158408705 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d14024430 con 0x7f1d2006e620 2024-08-17T02:22:27.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f1d26804700 1 -- 172.21.15.104:0/3158408705 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d200c9e30 con 0x7f1d2006e620 2024-08-17T02:22:27.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f1d26804700 1 -- 172.21.15.104:0/3158408705 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d20169d50 con 0x7f1d2006e620 2024-08-17T02:22:27.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7fba3affd700 1 --2- 172.21.15.104:0/2785411216 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba3c0aecc0 0x7fba3c06df10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fba300098e0 tx=0x7fba300091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6edb9b8bec15546d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f8dc1a06700 1 -- 172.21.15.104:0/2667072056 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8dbc156ef0 msgr2=0x7f8dbc14e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f8dc1a06700 1 --2- 172.21.15.104:0/2667072056 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8dbc156ef0 0x7f8dbc14e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f8dc1a06700 1 -- 172.21.15.104:0/2667072056 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dbc0b14a0 msgr2=0x7f8dbc15d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f8dc1a06700 1 --2- 172.21.15.104:0/2667072056 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dbc0b14a0 0x7f8dbc15d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f8dc1a06700 1 -- 172.21.15.104:0/2667072056 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dac009420 con 0x7f8dbc0caeb0 2024-08-17T02:22:27.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7fbafe1d6700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbaf8155bc0 0x7fbaf815e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7ff5a1868700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff59c155ef0 0x7ff59c097080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7ff5a1868700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff59c1562c0 0x7ff59c14b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7ff5a1868700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59c0975c0 con 0x7ff59c0b1020 2024-08-17T02:22:27.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7ff5a1868700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59c099840 con 0x7ff59c1562c0 2024-08-17T02:22:27.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7ff5a1868700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff59c0ac8b0 con 0x7ff59c155ef0 2024-08-17T02:22:27.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7ff59affd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff59c0b1020 0x7ff59c0989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7ff59affd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff59c0b1020 0x7ff59c0989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42208/0 (socket says 172.21.15.104:42208) 2024-08-17T02:22:27.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7ff59affd700 1 -- 172.21.15.104:0/2078075841 learned_addr learned my addr 172.21.15.104:0/2078075841 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:27.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7fbafe1d6700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbaf8155f90 0x7fbaf814cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7fbafe1d6700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaf81563e0 0x7fbaf806b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7fbafe1d6700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf815dfb0 con 0x7fbaf8155bc0 2024-08-17T02:22:27.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7fbafe1d6700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf815d3a0 con 0x7fbaf8155f90 2024-08-17T02:22:27.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7fbafe1d6700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf815d680 con 0x7fbaf81563e0 2024-08-17T02:22:27.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7ff59a7fc700 1 --2- 172.21.15.104:0/2078075841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff59c155ef0 0x7ff59c097080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f133f362700 1 -- start start 2024-08-17T02:22:27.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7fbaf77fe700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbaf8155bc0 0x7fbaf815e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7fbaf77fe700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbaf8155bc0 0x7fbaf815e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42216/0 (socket says 172.21.15.104:42216) 2024-08-17T02:22:27.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7fbaf77fe700 1 -- 172.21.15.104:0/807406560 learned_addr learned my addr 172.21.15.104:0/807406560 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:27.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f8dc1a06700 1 --2- 172.21.15.104:0/2667072056 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8dbc0caeb0 0x7f8dbc14a130 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8dac014000 tx=0x7f8dac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f47f6ffd700 1 --2- 172.21.15.104:0/358155690 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47f806e510 0x7f47f81556f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f47ec009910 tx=0x7f47ec0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f2825c64cf4e0b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7fba3a7fc700 1 -- 172.21.15.104:0/2785411216 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba30011630 con 0x7fba3c0aecc0 2024-08-17T02:22:27.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7ff59affd700 1 -- 172.21.15.104:0/2078075841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff59c155ef0 msgr2=0x7ff59c097080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7ff59affd700 1 --2- 172.21.15.104:0/2078075841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff59c155ef0 0x7ff59c097080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7ff59affd700 1 -- 172.21.15.104:0/2078075841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff59c1562c0 msgr2=0x7ff59c14b870 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-17T02:22:27.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7ff59affd700 1 --2- 172.21.15.104:0/2078075841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff59c1562c0 0x7ff59c14b870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7ff59affd700 1 -- 172.21.15.104:0/2078075841 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff58c009420 con 0x7ff59c0b1020 2024-08-17T02:22:27.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f47f67fc700 1 -- 172.21.15.104:0/358155690 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f00017f0 con 0x7f47f806e510 2024-08-17T02:22:27.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f1d07fff700 1 -- 172.21.15.104:0/3158408705 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d14024830 con 0x7f1d2006e620 2024-08-17T02:22:27.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7ff59affd700 1 --2- 172.21.15.104:0/2078075841 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff59c0b1020 0x7ff59c0989a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff59400c980 tx=0x7ff594002760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7fbaf77fe700 1 -- 172.21.15.104:0/807406560 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaf81563e0 msgr2=0x7fbaf806b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7fbaf77fe700 1 --2- 172.21.15.104:0/807406560 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaf81563e0 0x7fbaf806b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7fbaf77fe700 1 -- 172.21.15.104:0/807406560 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbaf8155f90 msgr2=0x7fbaf814cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7fbaf77fe700 1 --2- 172.21.15.104:0/807406560 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbaf8155f90 0x7fbaf814cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7fbaf77fe700 1 -- 172.21.15.104:0/807406560 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf0009ae0 con 0x7fbaf8155bc0 2024-08-17T02:22:27.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7fbaf77fe700 1 --2- 172.21.15.104:0/807406560 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbaf8155bc0 0x7fbaf815e440 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbaec00b600 tx=0x7fbaec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7ff582ffd700 1 -- 172.21.15.104:0/2078075841 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59400a7a0 con 0x7ff59c0b1020 2024-08-17T02:22:27.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f8db27fc700 1 -- 172.21.15.104:0/2667072056 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dac011b20 con 0x7f8dbc0caeb0 2024-08-17T02:22:27.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7fcd99ffb700 1 -- 172.21.15.104:0/2486256132 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9000b820 con 0x7fcd9c0a9430 2024-08-17T02:22:27.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7fba3a7fc700 1 -- 172.21.15.104:0/2785411216 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba30011790 con 0x7fba3c0aecc0 2024-08-17T02:22:27.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7fba3a7fc700 1 -- 172.21.15.104:0/2785411216 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba30011b10 con 0x7fba3c0aecc0 2024-08-17T02:22:27.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f8db27fc700 1 -- 172.21.15.104:0/2667072056 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dac011ca0 con 0x7f8dbc0caeb0 2024-08-17T02:22:27.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f8db27fc700 1 -- 172.21.15.104:0/2667072056 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dac0266c0 con 0x7f8dbc0caeb0 2024-08-17T02:22:27.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7ff582ffd700 1 -- 172.21.15.104:0/2078075841 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59400a920 con 0x7ff59c0b1020 2024-08-17T02:22:27.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7ff582ffd700 1 -- 172.21.15.104:0/2078075841 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59400ace0 con 0x7ff59c0b1020 2024-08-17T02:22:27.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7ff5a1868700 1 -- 172.21.15.104:0/2078075841 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5900094f0 con 0x7ff59c0b1020 2024-08-17T02:22:27.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7ff5a1868700 1 -- 172.21.15.104:0/2078075841 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff59c099280 con 0x7ff59c0b1020 2024-08-17T02:22:27.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7fba4086c700 1 -- 172.21.15.104:0/2785411216 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba3c0aecc0 msgr2=0x7fba3c06df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7fba4086c700 1 --2- 172.21.15.104:0/2785411216 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba3c0aecc0 0x7fba3c06df10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fba300098e0 tx=0x7fba300091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f8dc446b700 1 -- 172.21.15.104:0/2667072056 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dbc15c9c0 con 0x7f8dbc0caeb0 2024-08-17T02:22:27.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f8dc446b700 1 -- 172.21.15.104:0/2667072056 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dbc15bf60 con 0x7f8dbc0caeb0 2024-08-17T02:22:27.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7fbadf7fe700 1 -- 172.21.15.104:0/807406560 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaec00f510 con 0x7fbaf8155bc0 2024-08-17T02:22:27.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7fbafe1d6700 1 -- 172.21.15.104:0/807406560 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaf815d960 con 0x7fbaf8155bc0 2024-08-17T02:22:27.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7fbafe1d6700 1 -- 172.21.15.104:0/807406560 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaf814d0f0 con 0x7fbaf8155bc0 2024-08-17T02:22:27.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7f1d26804700 1 -- 172.21.15.104:0/3158408705 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1d00000fd0 con 0x7f1d2006e620 2024-08-17T02:22:27.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7f1d07fff700 1 -- 172.21.15.104:0/3158408705 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1d14011420 con 0x7f1d2006e620 2024-08-17T02:22:27.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f47f67fc700 1 -- 172.21.15.104:0/358155690 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47ec015b40 con 0x7f47f806e510 2024-08-17T02:22:27.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f47f67fc700 1 -- 172.21.15.104:0/358155690 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec01d420 con 0x7f47f806e510 2024-08-17T02:22:27.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f47fcf11700 1 -- 172.21.15.104:0/358155690 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47f806e510 msgr2=0x7f47f81556f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f47fcf11700 1 --2- 172.21.15.104:0/358155690 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47f806e510 0x7f47f81556f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f47ec009910 tx=0x7f47ec0091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7fcd99ffb700 1 -- 172.21.15.104:0/2486256132 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9000b980 con 0x7fcd9c0a9430 2024-08-17T02:22:27.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7fcd99ffb700 1 -- 172.21.15.104:0/2486256132 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9000bd20 con 0x7fcd9c0a9430 2024-08-17T02:22:27.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7fcd9bfff700 1 -- 172.21.15.104:0/2486256132 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd9c0a9430 msgr2=0x7fcd9c0ab200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7fcd9bfff700 1 --2- 172.21.15.104:0/2486256132 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd9c0a9430 0x7fcd9c0ab200 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcd900099b0 tx=0x7fcd90009250 comp rx=0 tx=0).stop 2024-08-17T02:22:27.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7f1d07fff700 1 --2- 172.21.15.104:0/3158408705 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f1d0c0608e0 0x7f1d0c062d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7ff5a1868700 1 -- 172.21.15.104:0/2078075841 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff57c000fd0 con 0x7ff59c0b1020 2024-08-17T02:22:27.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7fbadf7fe700 1 -- 172.21.15.104:0/807406560 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaec00f690 con 0x7fbaf8155bc0 2024-08-17T02:22:27.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7fcd9bfff700 1 -- 172.21.15.104:0/2486256132 shutdown_connections 2024-08-17T02:22:27.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7fcd9bfff700 1 --2- 172.21.15.104:0/2486256132 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd9c0a9430 0x7fcd9c0ab200 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7fcd9bfff700 1 -- 172.21.15.104:0/2486256132 >> 172.21.15.104:0/2486256132 conn(0x7fcd9c066e00 msgr2=0x7fcd9c067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:27.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7f47fcf11700 1 -- 172.21.15.104:0/358155690 shutdown_connections 2024-08-17T02:22:27.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7f47fcf11700 1 --2- 172.21.15.104:0/358155690 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47f806e510 0x7f47f81556f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7f47fcf11700 1 -- 172.21.15.104:0/358155690 >> 172.21.15.104:0/358155690 conn(0x7f47f80678d0 msgr2=0x7f47f8067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:27.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7fbadf7fe700 1 -- 172.21.15.104:0/807406560 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaec00fa50 con 0x7fbaf8155bc0 2024-08-17T02:22:27.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7fbafe1d6700 1 -- 172.21.15.104:0/807406560 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbad8000fd0 con 0x7fbaf8155bc0 2024-08-17T02:22:27.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f133f362700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f133806e620 0x7f13380b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f133f362700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13380b1630 0x7f1338141e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f133f362700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1338141a00 con 0x7f13380b0d20 2024-08-17T02:22:27.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f133f362700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1338140b10 con 0x7f133806e620 2024-08-17T02:22:27.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f133f362700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1338140df0 con 0x7f13380b1630 2024-08-17T02:22:27.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f133db5f700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f133806e620 0x7f13380b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f133db5f700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f133806e620 0x7f13380b10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.104:40972/0 (socket says 172.21.15.104:40972) 2024-08-17T02:22:27.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.626+0000 7f133db5f700 1 -- 172.21.15.104:0/1369851730 learned_addr learned my addr 172.21.15.104:0/1369851730 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:27.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7f133db5f700 1 -- 172.21.15.104:0/1369851730 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13380b1630 msgr2=0x7f1338141e90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-17T02:22:27.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7f133db5f700 1 --2- 172.21.15.104:0/1369851730 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13380b1630 0x7f1338141e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7f133db5f700 1 -- 172.21.15.104:0/1369851730 >> v1:172.21.15.104:6789/0 conn(0x7f13380b0d20 legacy=0x7f133806df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:27.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7f133db5f700 1 -- 172.21.15.104:0/1369851730 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13381410d0 con 0x7f133806e620 2024-08-17T02:22:27.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7f133db5f700 1 --2- 172.21.15.104:0/1369851730 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f133806e620 0x7f13380b10f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f13280099b0 tx=0x7f1328009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=724ad2585345d490 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7f133d35e700 1 -- 172.21.15.104:0/1369851730 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132800b820 con 0x7f133806e620 2024-08-17T02:22:27.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7f133d35e700 1 -- 172.21.15.104:0/1369851730 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f132800b980 con 0x7f133806e620 2024-08-17T02:22:27.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7f133f362700 1 -- 172.21.15.104:0/1369851730 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f133806e620 msgr2=0x7f13380b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7f133f362700 1 --2- 172.21.15.104:0/1369851730 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f133806e620 0x7f13380b10f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f13280099b0 tx=0x7f1328009250 comp rx=0 tx=0).stop 2024-08-17T02:22:27.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7f133f362700 1 -- 172.21.15.104:0/1369851730 shutdown_connections 2024-08-17T02:22:27.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7f133f362700 1 --2- 172.21.15.104:0/1369851730 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13380b1630 0x7f1338141e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7f133f362700 1 --2- 172.21.15.104:0/1369851730 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f133806e620 0x7f13380b10f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7f133f362700 1 -- 172.21.15.104:0/1369851730 >> 172.21.15.104:0/1369851730 conn(0x7f13380678d0 msgr2=0x7f1338067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:27.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7f133f362700 1 -- 172.21.15.104:0/1369851730 shutdown_connections 2024-08-17T02:22:27.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7f133f362700 1 -- 172.21.15.104:0/1369851730 wait complete. 2024-08-17T02:22:27.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7f8db27fc700 1 -- 172.21.15.104:0/2667072056 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8dac023070 con 0x7f8dbc0caeb0 2024-08-17T02:22:27.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7fba4086c700 1 -- 172.21.15.104:0/2785411216 shutdown_connections 2024-08-17T02:22:27.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7fba4086c700 1 --2- 172.21.15.104:0/2785411216 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba3c0aecc0 0x7fba3c06df10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7fba4086c700 1 -- 172.21.15.104:0/2785411216 >> 172.21.15.104:0/2785411216 conn(0x7fba3c0678d0 msgr2=0x7fba3c067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:27.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7fba4086c700 1 -- 172.21.15.104:0/2785411216 shutdown_connections 2024-08-17T02:22:27.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7fba4086c700 1 -- 172.21.15.104:0/2785411216 wait complete. 2024-08-17T02:22:27.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7ff582ffd700 1 -- 172.21.15.104:0/2078075841 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff594012630 con 0x7ff59c0b1020 2024-08-17T02:22:27.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7f8db27fc700 1 --2- 172.21.15.104:0/2667072056 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8da0060910 0x7f8da0062dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7f8db27fc700 1 -- 172.21.15.104:0/2667072056 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8dac07ec10 con 0x7f8dbc0caeb0 2024-08-17T02:22:27.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7f1d07fff700 1 -- 172.21.15.104:0/3158408705 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1d1407dbe0 con 0x7f1d2006e620 2024-08-17T02:22:27.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7f8dc2207700 1 --2- 172.21.15.104:0/2667072056 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8da0060910 0x7f8da0062dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7ff582ffd700 1 --2- 172.21.15.104:0/2078075841 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff588060930 0x7ff588062de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7f1d1f7fe700 1 --2- 172.21.15.104:0/3158408705 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f1d0c0608e0 0x7f1d0c062d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7f8dc446b700 1 --2- 172.21.15.104:0/2667072056 >> [v2:172.21.15.104:6800/24254,v1:172.21.15.104:6801/24254] conn(0x7f8dbc14aac0 0x7f8dbc16cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7ff582ffd700 1 -- 172.21.15.104:0/2078075841 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff59407cfd0 con 0x7ff59c0b1020 2024-08-17T02:22:27.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7f8dc446b700 1 -- 172.21.15.104:0/2667072056 --> [v2:172.21.15.104:6800/24254,v1:172.21.15.104:6801/24254] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8dbc0643a0 con 0x7f8dbc14aac0 2024-08-17T02:22:27.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7ff582ffd700 1 --2- 172.21.15.104:0/2078075841 >> [v2:172.21.15.104:6824/24256,v1:172.21.15.104:6825/24256] conn(0x7ff588068b40 0x7ff58806af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7ff582ffd700 1 -- 172.21.15.104:0/2078075841 --> [v2:172.21.15.104:6824/24256,v1:172.21.15.104:6825/24256] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff58806b600 con 0x7ff588068b40 2024-08-17T02:22:27.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7ff582ffd700 1 -- 172.21.15.104:0/2078075841 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff59407f610 con 0x7ff59c0b1020 2024-08-17T02:22:27.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7f8dc2a08700 1 --2- 172.21.15.104:0/2667072056 >> [v2:172.21.15.104:6800/24254,v1:172.21.15.104:6801/24254] conn(0x7f8dbc14aac0 0x7f8dbc16cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7fbadf7fe700 1 -- 172.21.15.104:0/807406560 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fbaec024430 con 0x7fbaf8155bc0 2024-08-17T02:22:27.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7f1d07fff700 1 --2- 172.21.15.104:0/3158408705 >> [v2:172.21.15.117:6824/24423,v1:172.21.15.117:6825/24423] conn(0x7f1d0c068980 0x7f1d0c06ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7f1d07fff700 1 -- 172.21.15.104:0/3158408705 --> [v2:172.21.15.117:6824/24423,v1:172.21.15.117:6825/24423] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1d0c06b440 con 0x7f1d0c068980 2024-08-17T02:22:27.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7f1d07fff700 1 -- 172.21.15.104:0/3158408705 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d14082240 con 0x7f1d2006e620 2024-08-17T02:22:27.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7f1d24da1700 1 --2- 172.21.15.104:0/3158408705 >> [v2:172.21.15.117:6824/24423,v1:172.21.15.117:6825/24423] conn(0x7f1d0c068980 0x7f1d0c06ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7f8dc2a08700 1 --2- 172.21.15.104:0/2667072056 >> [v2:172.21.15.104:6800/24254,v1:172.21.15.104:6801/24254] conn(0x7f8dbc14aac0 0x7f8dbc16cc00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7f133f362700 1 Processor -- start 2024-08-17T02:22:27.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.630+0000 7f133f362700 1 -- start start 2024-08-17T02:22:27.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7fbadf7fe700 1 --2- 172.21.15.104:0/807406560 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fbae4060930 0x7fbae4062de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7ff59a7fc700 1 --2- 172.21.15.104:0/2078075841 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff588060930 0x7ff588062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7f1d1f7fe700 1 --2- 172.21.15.104:0/3158408705 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f1d0c0608e0 0x7f1d0c062d90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1d18001560 tx=0x7f1d18009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7fba4086c700 1 Processor -- start 2024-08-17T02:22:27.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7f8dc2207700 1 --2- 172.21.15.104:0/2667072056 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8da0060910 0x7f8da0062dc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8db4001390 tx=0x7f8db4001a30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7fbadf7fe700 1 -- 172.21.15.104:0/807406560 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbaec07d070 con 0x7fbaf8155bc0 2024-08-17T02:22:27.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7fba4086c700 1 -- start start 2024-08-17T02:22:27.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7fbaf6ffd700 1 --2- 172.21.15.104:0/807406560 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fbae4060930 0x7fbae4062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7fbadf7fe700 1 --2- 172.21.15.104:0/807406560 >> [v2:172.21.15.117:6802/24421,v1:172.21.15.117:6804/24421] conn(0x7fbae40689d0 0x7fbae406ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7fbadf7fe700 1 -- 172.21.15.104:0/807406560 --> [v2:172.21.15.117:6802/24421,v1:172.21.15.117:6804/24421] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbae406b490 con 0x7fbae40689d0 2024-08-17T02:22:27.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7fbadf7fe700 1 -- 172.21.15.104:0/807406560 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbaec07d3a0 con 0x7fbaf8155bc0 2024-08-17T02:22:27.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7ff59b7fe700 1 --2- 172.21.15.104:0/2078075841 >> [v2:172.21.15.104:6824/24256,v1:172.21.15.104:6825/24256] conn(0x7ff588068b40 0x7ff58806af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7fcd9bfff700 1 -- 172.21.15.104:0/2486256132 shutdown_connections 2024-08-17T02:22:27.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7f47fcf11700 1 -- 172.21.15.104:0/358155690 shutdown_connections 2024-08-17T02:22:27.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7f1d24da1700 1 --2- 172.21.15.104:0/3158408705 >> [v2:172.21.15.117:6824/24423,v1:172.21.15.117:6825/24423] conn(0x7f1d0c068980 0x7f1d0c06ad90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7f47fcf11700 1 -- 172.21.15.104:0/358155690 wait complete. 2024-08-17T02:22:27.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7fbaf7fff700 1 --2- 172.21.15.104:0/807406560 >> [v2:172.21.15.117:6802/24421,v1:172.21.15.117:6804/24421] conn(0x7fbae40689d0 0x7fbae406ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7f133f362700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f133806e620 0x7f13381739d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7f133f362700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f13380b0d20 0x7f133815c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7f133f362700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13380b1630 0x7f13381764a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7ff59a7fc700 1 --2- 172.21.15.104:0/2078075841 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff588060930 0x7ff588062de0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff58c0093f0 tx=0x7ff58c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7f133f362700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133815b680 con 0x7f13380b0d20 2024-08-17T02:22:27.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7f133f362700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133815bc40 con 0x7f13380b1630 2024-08-17T02:22:27.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7f133f362700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1338173f10 con 0x7f133806e620 2024-08-17T02:22:27.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7fcd9bfff700 1 -- 172.21.15.104:0/2486256132 wait complete. 2024-08-17T02:22:27.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7ff59b7fe700 1 --2- 172.21.15.104:0/2078075841 >> [v2:172.21.15.104:6824/24256,v1:172.21.15.104:6825/24256] conn(0x7ff588068b40 0x7ff58806af50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7f133eb61700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13380b1630 0x7f13381764a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7fbaf6ffd700 1 --2- 172.21.15.104:0/807406560 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fbae4060930 0x7fbae4062de0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8158e90 tx=0x7fbaf0017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7f133eb61700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13380b1630 0x7f13381764a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.104:40974/0 (socket says 172.21.15.104:40974) 2024-08-17T02:22:27.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7f133eb61700 1 -- 172.21.15.104:0/2636249120 learned_addr learned my addr 172.21.15.104:0/2636249120 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:27.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7fbaf7fff700 1 --2- 172.21.15.104:0/807406560 >> [v2:172.21.15.117:6802/24421,v1:172.21.15.117:6804/24421] conn(0x7fbae40689d0 0x7fbae406ade0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7f8db27fc700 1 -- 172.21.15.104:0/2667072056 <== osd.3 v2:172.21.15.104:6800/24254 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f8dbc0643a0 con 0x7f8dbc14aac0 2024-08-17T02:22:27.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7fba4086c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba3c0aecc0 0x7fba3c1485a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7f133eb61700 1 -- 172.21.15.104:0/2636249120 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f133806e620 msgr2=0x7f13381739d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-17T02:22:27.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7f133eb61700 1 --2- 172.21.15.104:0/2636249120 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f133806e620 0x7f13381739d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7f133eb61700 1 -- 172.21.15.104:0/2636249120 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f13380b0d20 msgr2=0x7f133815c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7f133eb61700 1 --2- 172.21.15.104:0/2636249120 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f13380b0d20 0x7f133815c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7f133eb61700 1 -- 172.21.15.104:0/2636249120 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13280094f0 con 0x7f13380b1630 2024-08-17T02:22:27.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7f133eb61700 1 --2- 172.21.15.104:0/2636249120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13380b1630 0x7f13381764a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f133400b5e0 tx=0x7f1334009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7ff582ffd700 1 -- 172.21.15.104:0/2078075841 <== osd.1 v2:172.21.15.104:6824/24256 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7ff58806b600 con 0x7ff588068b40 2024-08-17T02:22:27.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7fbadf7fe700 1 -- 172.21.15.104:0/807406560 <== osd.4 v2:172.21.15.117:6802/24421 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fbae406b490 con 0x7fbae40689d0 2024-08-17T02:22:27.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7f47fcf11700 1 Processor -- start 2024-08-17T02:22:27.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7f47fcf11700 1 -- start start 2024-08-17T02:22:27.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7fcd9bfff700 1 Processor -- start 2024-08-17T02:22:27.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7fcd9bfff700 1 -- start start 2024-08-17T02:22:27.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7f47fcf11700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47f806e140 0x7f47f8138d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7f47fcf11700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f47f806e510 0x7f47f81361a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7fba4086c700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba3c158eb0 0x7fba3c152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7fba4086c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fba3c159280 0x7fba3c06cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7fba4086c700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3c1518b0 con 0x7fba3c159280 2024-08-17T02:22:27.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7fba4086c700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3c150ca0 con 0x7fba3c0aecc0 2024-08-17T02:22:27.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7fba4086c700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba3c150f80 con 0x7fba3c158eb0 2024-08-17T02:22:27.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7fba3bfff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fba3c159280 0x7fba3c06cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7fba3bfff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fba3c159280 0x7fba3c06cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42234/0 (socket says 172.21.15.104:42234) 2024-08-17T02:22:27.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7fba3bfff700 1 -- 172.21.15.104:0/1317872921 learned_addr learned my addr 172.21.15.104:0/1317872921 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:27.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7fba3bfff700 1 -- 172.21.15.104:0/1317872921 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba3c158eb0 msgr2=0x7fba3c152370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:22:27.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7fba3bfff700 1 --2- 172.21.15.104:0/1317872921 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba3c158eb0 0x7fba3c152370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7fba3bfff700 1 -- 172.21.15.104:0/1317872921 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba3c0aecc0 msgr2=0x7fba3c1485a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:22:27.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7fba3bfff700 1 --2- 172.21.15.104:0/1317872921 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba3c0aecc0 0x7fba3c1485a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7fba3bfff700 1 -- 172.21.15.104:0/1317872921 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba30009420 con 0x7fba3c159280 2024-08-17T02:22:27.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7fba3bfff700 1 --2- 172.21.15.104:0/1317872921 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fba3c159280 0x7fba3c06cf00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fba2c00b4f0 tx=0x7fba2c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7f47fcf11700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47f813e250 0x7f47f8165470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7f47fcf11700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f8136c60 con 0x7f47f806e510 2024-08-17T02:22:27.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7f47fcf11700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f8133f50 con 0x7f47f806e140 2024-08-17T02:22:27.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7f47fcf11700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f81366e0 con 0x7f47f813e250 2024-08-17T02:22:27.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7fcd9bfff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd9c06dbe0 0x7fcd9c0c5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7fcd9bfff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd9c0a9430 0x7fcd9c140680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7f132e7fc700 1 -- 172.21.15.104:0/2636249120 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133400f510 con 0x7f13380b1630 2024-08-17T02:22:27.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7f132e7fc700 1 -- 172.21.15.104:0/2636249120 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133400f690 con 0x7f13380b1630 2024-08-17T02:22:27.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7f133f362700 1 -- 172.21.15.104:0/2636249120 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1338176fd0 con 0x7f13380b1630 2024-08-17T02:22:27.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7f132e7fc700 1 -- 172.21.15.104:0/2636249120 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133400fa50 con 0x7f13380b1630 2024-08-17T02:22:27.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.634+0000 7f133f362700 1 -- 172.21.15.104:0/2636249120 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f133815b950 con 0x7f13380b1630 2024-08-17T02:22:27.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7f133f362700 1 -- 172.21.15.104:0/2636249120 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f13380643a0 con 0x7f13380b1630 2024-08-17T02:22:27.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7fcd9bfff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd9c1428f0 0x7fcd9c0c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7fcd9bfff700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c0ae150 con 0x7fcd9c0a9430 2024-08-17T02:22:27.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7fcd9bfff700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c0ad540 con 0x7fcd9c06dbe0 2024-08-17T02:22:27.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7fcd9bfff700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c0ad820 con 0x7fcd9c1428f0 2024-08-17T02:22:27.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7fcd9a7fc700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd9c0a9430 0x7fcd9c140680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7fcd9a7fc700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd9c0a9430 0x7fcd9c140680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42248/0 (socket says 172.21.15.104:42248) 2024-08-17T02:22:27.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7fcd9a7fc700 1 -- 172.21.15.104:0/264535294 learned_addr learned my addr 172.21.15.104:0/264535294 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:27.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7f47f6ffd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f47f806e510 0x7f47f81361a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7f47f77fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47f806e140 0x7f47f8138d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7f47f6ffd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f47f806e510 0x7f47f81361a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42244/0 (socket says 172.21.15.104:42244) 2024-08-17T02:22:27.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7f47f6ffd700 1 -- 172.21.15.104:0/1632963388 learned_addr learned my addr 172.21.15.104:0/1632963388 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:27.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7f47f7fff700 1 --2- 172.21.15.104:0/1632963388 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47f813e250 0x7f47f8165470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7f47f6ffd700 1 -- 172.21.15.104:0/1632963388 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47f813e250 msgr2=0x7f47f8165470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7fcd9b7fe700 1 --2- 172.21.15.104:0/264535294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd9c1428f0 0x7fcd9c0c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7f47f6ffd700 1 --2- 172.21.15.104:0/1632963388 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47f813e250 0x7f47f8165470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7f47f6ffd700 1 -- 172.21.15.104:0/1632963388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47f806e140 msgr2=0x7f47f8138d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7f47f6ffd700 1 --2- 172.21.15.104:0/1632963388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47f806e140 0x7f47f8138d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7f47f6ffd700 1 -- 172.21.15.104:0/1632963388 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47ec009420 con 0x7f47f806e510 2024-08-17T02:22:27.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7f47f7fff700 1 --2- 172.21.15.104:0/1632963388 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47f813e250 0x7f47f8165470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:22:27.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7fcd9a7fc700 1 -- 172.21.15.104:0/264535294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd9c1428f0 msgr2=0x7fcd9c0c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7fcd9a7fc700 1 --2- 172.21.15.104:0/264535294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd9c1428f0 0x7fcd9c0c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7fcd9a7fc700 1 -- 172.21.15.104:0/264535294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd9c06dbe0 msgr2=0x7fcd9c0c5a60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:22:27.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7fcd9a7fc700 1 --2- 172.21.15.104:0/264535294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd9c06dbe0 0x7fcd9c0c5a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7fcd9a7fc700 1 -- 172.21.15.104:0/264535294 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd900094f0 con 0x7fcd9c0a9430 2024-08-17T02:22:27.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7fcd9b7fe700 1 --2- 172.21.15.104:0/264535294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd9c1428f0 0x7fcd9c0c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:22:27.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7f47f6ffd700 1 --2- 172.21.15.104:0/1632963388 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f47f806e510 0x7f47f81361a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f47ec0091e0 tx=0x7f47ec01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7f47df7fe700 1 -- 172.21.15.104:0/1632963388 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec01c5e0 con 0x7f47f806e510 2024-08-17T02:22:27.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7f47df7fe700 1 -- 172.21.15.104:0/1632963388 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47ec021070 con 0x7f47f806e510 2024-08-17T02:22:27.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7f47fcf11700 1 -- 172.21.15.104:0/1632963388 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47f8136980 con 0x7f47f806e510 2024-08-17T02:22:27.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7f47fcf11700 1 -- 172.21.15.104:0/1632963388 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47f8133be0 con 0x7f47f806e510 2024-08-17T02:22:27.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7fcd9a7fc700 1 --2- 172.21.15.104:0/264535294 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd9c0a9430 0x7fcd9c140680 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcd90009290 tx=0x7fcd90016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7f47df7fe700 1 -- 172.21.15.104:0/1632963388 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec01c990 con 0x7f47f806e510 2024-08-17T02:22:27.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7f132e7fc700 1 -- 172.21.15.104:0/2636249120 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1334024430 con 0x7f13380b1630 2024-08-17T02:22:27.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7f132e7fc700 1 --2- 172.21.15.104:0/2636249120 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f131c060930 0x7f131c062de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7f132e7fc700 1 -- 172.21.15.104:0/2636249120 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f133407d080 con 0x7f13380b1630 2024-08-17T02:22:27.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7f132e7fc700 1 --2- 172.21.15.104:0/2636249120 >> [v2:172.21.15.117:6816/24422,v1:172.21.15.117:6817/24422] conn(0x7f131c068b40 0x7f131c06af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7f132e7fc700 1 -- 172.21.15.104:0/2636249120 --> [v2:172.21.15.117:6816/24422,v1:172.21.15.117:6817/24422] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f131c06b600 con 0x7f131c068b40 2024-08-17T02:22:27.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7f132e7fc700 1 -- 172.21.15.104:0/2636249120 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f133407d370 con 0x7f13380b1630 2024-08-17T02:22:27.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7fcd82ffd700 1 -- 172.21.15.104:0/264535294 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd90011d50 con 0x7fcd9c0a9430 2024-08-17T02:22:27.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7fcd82ffd700 1 -- 172.21.15.104:0/264535294 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd90020070 con 0x7fcd9c0a9430 2024-08-17T02:22:27.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7fcd9bfff700 1 -- 172.21.15.104:0/264535294 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd9c0adb00 con 0x7fcd9c0a9430 2024-08-17T02:22:27.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7fcd82ffd700 1 -- 172.21.15.104:0/264535294 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9001b6a0 con 0x7fcd9c0a9430 2024-08-17T02:22:27.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7fcd9bfff700 1 -- 172.21.15.104:0/264535294 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd9c0c52e0 con 0x7fcd9c0a9430 2024-08-17T02:22:27.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7f133db5f700 1 --2- 172.21.15.104:0/2636249120 >> [v2:172.21.15.117:6816/24422,v1:172.21.15.117:6817/24422] conn(0x7f131c068b40 0x7f131c06af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7f47df7fe700 1 -- 172.21.15.104:0/1632963388 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f47ec0313b0 con 0x7f47f806e510 2024-08-17T02:22:27.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.642+0000 7f47df7fe700 1 --2- 172.21.15.104:0/1632963388 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f47e4060860 0x7f47e4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7f133db5f700 1 --2- 172.21.15.104:0/2636249120 >> [v2:172.21.15.117:6816/24422,v1:172.21.15.117:6817/24422] conn(0x7f131c068b40 0x7f131c06af50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.642+0000 7f133e360700 1 --2- 172.21.15.104:0/2636249120 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f131c060930 0x7f131c062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.638+0000 7fcd9bfff700 1 -- 172.21.15.104:0/264535294 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcd9c0643a0 con 0x7fcd9c0a9430 2024-08-17T02:22:27.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.642+0000 7f1d07fff700 1 -- 172.21.15.104:0/3158408705 <== osd.7 v2:172.21.15.117:6824/24423 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f1d0c06b440 con 0x7f1d0c068980 2024-08-17T02:22:27.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.642+0000 7f47df7fe700 1 -- 172.21.15.104:0/1632963388 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f47ec019070 con 0x7f47f806e510 2024-08-17T02:22:27.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.642+0000 7f47f77fe700 1 --2- 172.21.15.104:0/1632963388 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f47e4060860 0x7f47e4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.642+0000 7f133e360700 1 --2- 172.21.15.104:0/2636249120 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f131c060930 0x7f131c062de0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f133000ad10 tx=0x7f1330009370 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.642+0000 7f132e7fc700 1 -- 172.21.15.104:0/2636249120 <== osd.5 v2:172.21.15.117:6816/24422 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f131c06b600 con 0x7f131c068b40 2024-08-17T02:22:27.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.642+0000 7f47f77fe700 1 --2- 172.21.15.104:0/1632963388 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f47e4060860 0x7f47e4062d10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f47f8132e80 tx=0x7f47e8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.642+0000 7fcd82ffd700 1 -- 172.21.15.104:0/264535294 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fcd90022030 con 0x7fcd9c0a9430 2024-08-17T02:22:27.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.642+0000 7fcd82ffd700 1 --2- 172.21.15.104:0/264535294 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fcd88060930 0x7fcd88062de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.642+0000 7fcd82ffd700 1 -- 172.21.15.104:0/264535294 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcd9007e9a0 con 0x7fcd9c0a9430 2024-08-17T02:22:27.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.642+0000 7fcd82ffd700 1 --2- 172.21.15.104:0/264535294 >> [v2:172.21.15.117:6800/24420,v1:172.21.15.117:6801/24420] conn(0x7fcd88068b40 0x7fcd8806af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.642+0000 7fcd9affd700 1 --2- 172.21.15.104:0/264535294 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fcd88060930 0x7fcd88062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.642+0000 7fcd82ffd700 1 -- 172.21.15.104:0/264535294 --> [v2:172.21.15.117:6800/24420,v1:172.21.15.117:6801/24420] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcd8806b600 con 0x7fcd88068b40 2024-08-17T02:22:27.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.642+0000 7fcd82ffd700 1 -- 172.21.15.104:0/264535294 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd90083240 con 0x7fcd9c0a9430 2024-08-17T02:22:27.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.642+0000 7fcd9b7fe700 1 --2- 172.21.15.104:0/264535294 >> [v2:172.21.15.117:6800/24420,v1:172.21.15.117:6801/24420] conn(0x7fcd88068b40 0x7fcd8806af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.642+0000 7fcd9affd700 1 --2- 172.21.15.104:0/264535294 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fcd88060930 0x7fcd88062de0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c0011e0 tx=0x7fcd8c007960 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.642+0000 7fcd9b7fe700 1 --2- 172.21.15.104:0/264535294 >> [v2:172.21.15.117:6800/24420,v1:172.21.15.117:6801/24420] conn(0x7fcd88068b40 0x7fcd8806af50 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.646+0000 7fba237fe700 1 -- 172.21.15.104:0/1317872921 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2c00f510 con 0x7fba3c159280 2024-08-17T02:22:27.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.646+0000 7fba4086c700 1 -- 172.21.15.104:0/1317872921 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba3c151260 con 0x7fba3c159280 2024-08-17T02:22:27.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.646+0000 7fba4086c700 1 -- 172.21.15.104:0/1317872921 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba3c148ae0 con 0x7fba3c159280 2024-08-17T02:22:27.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.646+0000 7fba237fe700 1 -- 172.21.15.104:0/1317872921 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba2c00f670 con 0x7fba3c159280 2024-08-17T02:22:27.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.646+0000 7fba237fe700 1 -- 172.21.15.104:0/1317872921 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2c00f9f0 con 0x7fba3c159280 2024-08-17T02:22:27.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.646+0000 7fcd82ffd700 1 -- 172.21.15.104:0/264535294 <== osd.6 v2:172.21.15.117:6800/24420 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fcd8806b600 con 0x7fcd88068b40 2024-08-17T02:22:27.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.650+0000 7f47fcf11700 1 --2- 172.21.15.104:0/1632963388 >> [v2:172.21.15.104:6816/24255,v1:172.21.15.104:6817/24255] conn(0x7f47d80015f0 0x7f47d8003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.650+0000 7f47fcf11700 1 -- 172.21.15.104:0/1632963388 --> [v2:172.21.15.104:6816/24255,v1:172.21.15.104:6817/24255] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f47d8006b90 con 0x7f47d80015f0 2024-08-17T02:22:27.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.650+0000 7f8dc446b700 1 -- 172.21.15.104:0/2667072056 --> [v2:172.21.15.104:6800/24254,v1:172.21.15.104:6801/24254] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8dbc06f5f0 con 0x7f8dbc14aac0 2024-08-17T02:22:27.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.650+0000 7f47f7fff700 1 --2- 172.21.15.104:0/1632963388 >> [v2:172.21.15.104:6816/24255,v1:172.21.15.104:6817/24255] conn(0x7f47d80015f0 0x7f47d8003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.650+0000 7f47f7fff700 1 --2- 172.21.15.104:0/1632963388 >> [v2:172.21.15.104:6816/24255,v1:172.21.15.104:6817/24255] conn(0x7f47d80015f0 0x7f47d8003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.650+0000 7f8db27fc700 1 -- 172.21.15.104:0/2667072056 <== osd.3 v2:172.21.15.104:6800/24254 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8dbc06f5f0 con 0x7f8dbc14aac0 2024-08-17T02:22:27.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.654+0000 7f47df7fe700 1 -- 172.21.15.104:0/1632963388 <== osd.2 v2:172.21.15.104:6816/24255 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f47d8006b90 con 0x7f47d80015f0 2024-08-17T02:22:27.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.654+0000 7f8d9ffff700 1 -- 172.21.15.104:0/2667072056 >> [v2:172.21.15.104:6800/24254,v1:172.21.15.104:6801/24254] conn(0x7f8dbc14aac0 msgr2=0x7f8dbc16cc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.654+0000 7f8d9ffff700 1 --2- 172.21.15.104:0/2667072056 >> [v2:172.21.15.104:6800/24254,v1:172.21.15.104:6801/24254] conn(0x7f8dbc14aac0 0x7f8dbc16cc00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.654+0000 7fba4086c700 1 -- 172.21.15.104:0/1317872921 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fba1c000fd0 con 0x7fba3c159280 2024-08-17T02:22:27.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.654+0000 7fba237fe700 1 -- 172.21.15.104:0/1317872921 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fba2c01a400 con 0x7fba3c159280 2024-08-17T02:22:27.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.654+0000 7f8d9ffff700 1 -- 172.21.15.104:0/2667072056 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8da0060910 msgr2=0x7f8da0062dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.654+0000 7f8d9ffff700 1 --2- 172.21.15.104:0/2667072056 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8da0060910 0x7f8da0062dc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8db4001390 tx=0x7f8db4001a30 comp rx=0 tx=0).stop 2024-08-17T02:22:27.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.654+0000 7f8d9ffff700 1 -- 172.21.15.104:0/2667072056 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8dbc0caeb0 msgr2=0x7f8dbc14a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.654+0000 7f8d9ffff700 1 --2- 172.21.15.104:0/2667072056 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8dbc0caeb0 0x7f8dbc14a130 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8dac014000 tx=0x7f8dac017000 comp rx=0 tx=0).stop 2024-08-17T02:22:27.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.654+0000 7f8dc2a08700 1 -- 172.21.15.104:0/2667072056 reap_dead start 2024-08-17T02:22:27.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.654+0000 7fba237fe700 1 --2- 172.21.15.104:0/1317872921 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fba28060930 0x7fba28062de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.654+0000 7fba237fe700 1 -- 172.21.15.104:0/1317872921 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fba2c07c4d0 con 0x7fba3c159280 2024-08-17T02:22:27.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.654+0000 7fba237fe700 1 --2- 172.21.15.104:0/1317872921 >> [v2:172.21.15.104:6808/24257,v1:172.21.15.104:6809/24257] conn(0x7fba28068ac0 0x7fba2806aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.654+0000 7fba237fe700 1 -- 172.21.15.104:0/1317872921 --> [v2:172.21.15.104:6808/24257,v1:172.21.15.104:6809/24257] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fba2806b580 con 0x7fba28068ac0 2024-08-17T02:22:27.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.654+0000 7fba3b7fe700 1 --2- 172.21.15.104:0/1317872921 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fba28060930 0x7fba28062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.654+0000 7fba3affd700 1 --2- 172.21.15.104:0/1317872921 >> [v2:172.21.15.104:6808/24257,v1:172.21.15.104:6809/24257] conn(0x7fba28068ac0 0x7fba2806aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.654+0000 7fba3affd700 1 --2- 172.21.15.104:0/1317872921 >> [v2:172.21.15.104:6808/24257,v1:172.21.15.104:6809/24257] conn(0x7fba28068ac0 0x7fba2806aed0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.654+0000 7fba3b7fe700 1 --2- 172.21.15.104:0/1317872921 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fba28060930 0x7fba28062de0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fba34005c50 tx=0x7fba34001420 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.654+0000 7fba237fe700 1 -- 172.21.15.104:0/1317872921 <== osd.0 v2:172.21.15.104:6808/24257 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fba2806b580 con 0x7fba28068ac0 2024-08-17T02:22:27.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.658+0000 7f8d9ffff700 1 -- 172.21.15.104:0/2667072056 shutdown_connections 2024-08-17T02:22:27.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.658+0000 7f8d9ffff700 1 -- 172.21.15.104:0/2667072056 >> 172.21.15.104:0/2667072056 conn(0x7f8dbc0678d0 msgr2=0x7f8dbc0ac5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:27.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.658+0000 7f8d9ffff700 1 -- 172.21.15.104:0/2667072056 shutdown_connections 2024-08-17T02:22:27.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.658+0000 7f8d9ffff700 1 -- 172.21.15.104:0/2667072056 wait complete. 2024-08-17T02:22:27.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.662+0000 7fbafe1d6700 1 -- 172.21.15.104:0/807406560 --> [v2:172.21.15.117:6802/24421,v1:172.21.15.117:6804/24421] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbad8002d30 con 0x7fbae40689d0 2024-08-17T02:22:27.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.662+0000 7ff5a1868700 1 -- 172.21.15.104:0/2078075841 --> [v2:172.21.15.104:6824/24256,v1:172.21.15.104:6825/24256] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff57c002d30 con 0x7ff588068b40 2024-08-17T02:22:27.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.662+0000 7f133f362700 1 -- 172.21.15.104:0/2636249120 --> [v2:172.21.15.117:6816/24422,v1:172.21.15.117:6817/24422] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f133806f5f0 con 0x7f131c068b40 2024-08-17T02:22:27.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.662+0000 7fba237fe700 1 -- 172.21.15.104:0/1317872921 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba2c04ca80 con 0x7fba3c159280 2024-08-17T02:22:27.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.662+0000 7ff582ffd700 1 -- 172.21.15.104:0/2078075841 <== osd.1 v2:172.21.15.104:6824/24256 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff57c002d30 con 0x7ff588068b40 2024-08-17T02:22:27.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.662+0000 7fbadf7fe700 1 -- 172.21.15.104:0/807406560 <== osd.4 v2:172.21.15.117:6802/24421 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbad8002d30 con 0x7fbae40689d0 2024-08-17T02:22:27.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.662+0000 7f132e7fc700 1 -- 172.21.15.104:0/2636249120 <== osd.5 v2:172.21.15.117:6816/24422 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f133806f5f0 con 0x7f131c068b40 2024-08-17T02:22:27.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.662+0000 7ff5a1868700 1 -- 172.21.15.104:0/2078075841 >> [v2:172.21.15.104:6824/24256,v1:172.21.15.104:6825/24256] conn(0x7ff588068b40 msgr2=0x7ff58806af50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.662+0000 7ff5a1868700 1 --2- 172.21.15.104:0/2078075841 >> [v2:172.21.15.104:6824/24256,v1:172.21.15.104:6825/24256] conn(0x7ff588068b40 0x7ff58806af50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.662+0000 7f133f362700 1 -- 172.21.15.104:0/2636249120 >> [v2:172.21.15.117:6816/24422,v1:172.21.15.117:6817/24422] conn(0x7f131c068b40 msgr2=0x7f131c06af50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.662+0000 7f133f362700 1 --2- 172.21.15.104:0/2636249120 >> [v2:172.21.15.117:6816/24422,v1:172.21.15.117:6817/24422] conn(0x7f131c068b40 0x7f131c06af50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.662+0000 7ff5a1868700 1 -- 172.21.15.104:0/2078075841 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff588060930 msgr2=0x7ff588062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.662+0000 7ff5a1868700 1 --2- 172.21.15.104:0/2078075841 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff588060930 0x7ff588062de0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff58c0093f0 tx=0x7ff58c008040 comp rx=0 tx=0).stop 2024-08-17T02:22:27.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.662+0000 7ff5a1868700 1 -- 172.21.15.104:0/2078075841 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff59c0b1020 msgr2=0x7ff59c0989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.662+0000 7ff5a1868700 1 --2- 172.21.15.104:0/2078075841 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff59c0b1020 0x7ff59c0989a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff59400c980 tx=0x7ff594002760 comp rx=0 tx=0).stop 2024-08-17T02:22:27.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.662+0000 7ff59b7fe700 1 -- 172.21.15.104:0/2078075841 reap_dead start 2024-08-17T02:22:27.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.662+0000 7ff5a1868700 1 -- 172.21.15.104:0/2078075841 shutdown_connections 2024-08-17T02:22:27.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.662+0000 7ff5a1868700 1 -- 172.21.15.104:0/2078075841 >> 172.21.15.104:0/2078075841 conn(0x7ff59c0ccb80 msgr2=0x7ff59c06e370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:27.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.662+0000 7ff5a1868700 1 -- 172.21.15.104:0/2078075841 shutdown_connections 2024-08-17T02:22:27.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.662+0000 7f133f362700 1 -- 172.21.15.104:0/2636249120 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f131c060930 msgr2=0x7f131c062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.662+0000 7ff5a1868700 1 -- 172.21.15.104:0/2078075841 wait complete. 2024-08-17T02:22:27.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.666+0000 7f133f362700 1 --2- 172.21.15.104:0/2636249120 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f131c060930 0x7f131c062de0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f133000ad10 tx=0x7f1330009370 comp rx=0 tx=0).stop 2024-08-17T02:22:27.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.666+0000 7f133f362700 1 -- 172.21.15.104:0/2636249120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13380b1630 msgr2=0x7f13381764a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.666+0000 7f133f362700 1 --2- 172.21.15.104:0/2636249120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13380b1630 0x7f13381764a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f133400b5e0 tx=0x7f1334009120 comp rx=0 tx=0).stop 2024-08-17T02:22:27.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.666+0000 7f133eb61700 1 -- 172.21.15.104:0/2636249120 reap_dead start 2024-08-17T02:22:27.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.666+0000 7f133f362700 1 -- 172.21.15.104:0/2636249120 shutdown_connections 2024-08-17T02:22:27.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.666+0000 7f133f362700 1 -- 172.21.15.104:0/2636249120 >> 172.21.15.104:0/2636249120 conn(0x7f13380678d0 msgr2=0x7f133806de90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:27.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.666+0000 7f133f362700 1 -- 172.21.15.104:0/2636249120 shutdown_connections 2024-08-17T02:22:27.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.666+0000 7f133f362700 1 -- 172.21.15.104:0/2636249120 wait complete. 2024-08-17T02:22:27.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.666+0000 7f1d26804700 1 -- 172.21.15.104:0/3158408705 --> [v2:172.21.15.117:6824/24423,v1:172.21.15.117:6825/24423] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1d00002d30 con 0x7f1d0c068980 2024-08-17T02:22:27.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.666+0000 7f1d07fff700 1 -- 172.21.15.104:0/3158408705 <== osd.7 v2:172.21.15.117:6824/24423 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1d00002d30 con 0x7f1d0c068980 2024-08-17T02:22:27.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.670+0000 7fbafe1d6700 1 -- 172.21.15.104:0/807406560 >> [v2:172.21.15.117:6802/24421,v1:172.21.15.117:6804/24421] conn(0x7fbae40689d0 msgr2=0x7fbae406ade0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.670+0000 7fbafe1d6700 1 --2- 172.21.15.104:0/807406560 >> [v2:172.21.15.117:6802/24421,v1:172.21.15.117:6804/24421] conn(0x7fbae40689d0 0x7fbae406ade0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.670+0000 7f1d26804700 1 -- 172.21.15.104:0/3158408705 >> [v2:172.21.15.117:6824/24423,v1:172.21.15.117:6825/24423] conn(0x7f1d0c068980 msgr2=0x7f1d0c06ad90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.670+0000 7f1d26804700 1 --2- 172.21.15.104:0/3158408705 >> [v2:172.21.15.117:6824/24423,v1:172.21.15.117:6825/24423] conn(0x7f1d0c068980 0x7f1d0c06ad90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.670+0000 7f1d26804700 1 -- 172.21.15.104:0/3158408705 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f1d0c0608e0 msgr2=0x7f1d0c062d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.670+0000 7f1d26804700 1 --2- 172.21.15.104:0/3158408705 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f1d0c0608e0 0x7f1d0c062d90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1d18001560 tx=0x7f1d18009040 comp rx=0 tx=0).stop 2024-08-17T02:22:27.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.670+0000 7f1d26804700 1 -- 172.21.15.104:0/3158408705 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1d2006e620 msgr2=0x7f1d20169810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.670+0000 7f1d26804700 1 --2- 172.21.15.104:0/3158408705 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1d2006e620 0x7f1d20169810 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1d14016000 tx=0x7f1d14017000 comp rx=0 tx=0).stop 2024-08-17T02:22:27.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.670+0000 7f1d24da1700 1 -- 172.21.15.104:0/3158408705 reap_dead start 2024-08-17T02:22:27.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.670+0000 7fbafe1d6700 1 -- 172.21.15.104:0/807406560 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fbae4060930 msgr2=0x7fbae4062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.670+0000 7fbafe1d6700 1 --2- 172.21.15.104:0/807406560 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fbae4060930 0x7fbae4062de0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8158e90 tx=0x7fbaf0017000 comp rx=0 tx=0).stop 2024-08-17T02:22:27.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.670+0000 7f1d26804700 1 -- 172.21.15.104:0/3158408705 shutdown_connections 2024-08-17T02:22:27.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.670+0000 7f1d26804700 1 -- 172.21.15.104:0/3158408705 >> 172.21.15.104:0/3158408705 conn(0x7f1d200678d0 msgr2=0x7f1d20151670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:27.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.670+0000 7fbafe1d6700 1 -- 172.21.15.104:0/807406560 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbaf8155bc0 msgr2=0x7fbaf815e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.670+0000 7f1d26804700 1 -- 172.21.15.104:0/3158408705 shutdown_connections 2024-08-17T02:22:27.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.670+0000 7f1d26804700 1 -- 172.21.15.104:0/3158408705 wait complete. 2024-08-17T02:22:27.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.670+0000 7fbafe1d6700 1 --2- 172.21.15.104:0/807406560 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbaf8155bc0 0x7fbaf815e440 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbaec00b600 tx=0x7fbaec0091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.670+0000 7fbaf7fff700 1 -- 172.21.15.104:0/807406560 reap_dead start 2024-08-17T02:22:27.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.670+0000 7fbafe1d6700 1 -- 172.21.15.104:0/807406560 shutdown_connections 2024-08-17T02:22:27.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.670+0000 7fbafe1d6700 1 -- 172.21.15.104:0/807406560 >> 172.21.15.104:0/807406560 conn(0x7fbaf806e070 msgr2=0x7fbaf8151f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:27.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.670+0000 7fbafe1d6700 1 -- 172.21.15.104:0/807406560 shutdown_connections 2024-08-17T02:22:27.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.670+0000 7fbafe1d6700 1 -- 172.21.15.104:0/807406560 wait complete. 2024-08-17T02:22:27.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.674+0000 7fcd9bfff700 1 -- 172.21.15.104:0/264535294 --> [v2:172.21.15.117:6800/24420,v1:172.21.15.117:6801/24420] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcd9c06f300 con 0x7fcd88068b40 2024-08-17T02:22:27.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.674+0000 7f47fcf11700 1 -- 172.21.15.104:0/1632963388 --> [v2:172.21.15.104:6816/24255,v1:172.21.15.104:6817/24255] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f47d8005c80 con 0x7f47d80015f0 2024-08-17T02:22:27.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.674+0000 7fcd82ffd700 1 -- 172.21.15.104:0/264535294 <== osd.6 v2:172.21.15.117:6800/24420 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcd9c06f300 con 0x7fcd88068b40 2024-08-17T02:22:27.724 INFO:teuthology.orchestra.run.smithi104.stdout:64424509447 2024-08-17T02:22:27.724 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-17T02:22:27.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.674+0000 7f47df7fe700 1 -- 172.21.15.104:0/1632963388 <== osd.2 v2:172.21.15.104:6816/24255 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f47d8005c80 con 0x7f47d80015f0 2024-08-17T02:22:27.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.674+0000 7fcd9bfff700 1 -- 172.21.15.104:0/264535294 >> [v2:172.21.15.117:6800/24420,v1:172.21.15.117:6801/24420] conn(0x7fcd88068b40 msgr2=0x7fcd8806af50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.674+0000 7fcd9bfff700 1 --2- 172.21.15.104:0/264535294 >> [v2:172.21.15.117:6800/24420,v1:172.21.15.117:6801/24420] conn(0x7fcd88068b40 0x7fcd8806af50 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.674+0000 7fcd9bfff700 1 -- 172.21.15.104:0/264535294 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fcd88060930 msgr2=0x7fcd88062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.674+0000 7fcd9bfff700 1 --2- 172.21.15.104:0/264535294 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fcd88060930 0x7fcd88062de0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c0011e0 tx=0x7fcd8c007960 comp rx=0 tx=0).stop 2024-08-17T02:22:27.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.674+0000 7fcd9bfff700 1 -- 172.21.15.104:0/264535294 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd9c0a9430 msgr2=0x7fcd9c140680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.674+0000 7fcd9bfff700 1 --2- 172.21.15.104:0/264535294 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd9c0a9430 0x7fcd9c140680 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcd90009290 tx=0x7fcd90016000 comp rx=0 tx=0).stop 2024-08-17T02:22:27.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.674+0000 7fcd9b7fe700 1 -- 172.21.15.104:0/264535294 reap_dead start 2024-08-17T02:22:27.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.674+0000 7fcd9bfff700 1 -- 172.21.15.104:0/264535294 shutdown_connections 2024-08-17T02:22:27.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.674+0000 7fcd9bfff700 1 -- 172.21.15.104:0/264535294 >> 172.21.15.104:0/264535294 conn(0x7fcd9c066e00 msgr2=0x7fcd9c06a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:27.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.674+0000 7f47fcf11700 1 -- 172.21.15.104:0/1632963388 >> [v2:172.21.15.104:6816/24255,v1:172.21.15.104:6817/24255] conn(0x7f47d80015f0 msgr2=0x7f47d8003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.674+0000 7f47fcf11700 1 --2- 172.21.15.104:0/1632963388 >> [v2:172.21.15.104:6816/24255,v1:172.21.15.104:6817/24255] conn(0x7f47d80015f0 0x7f47d8003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.674+0000 7f47fcf11700 1 -- 172.21.15.104:0/1632963388 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f47e4060860 msgr2=0x7f47e4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.674+0000 7f47fcf11700 1 --2- 172.21.15.104:0/1632963388 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f47e4060860 0x7f47e4062d10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f47f8132e80 tx=0x7f47e8009040 comp rx=0 tx=0).stop 2024-08-17T02:22:27.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.674+0000 7f47fcf11700 1 -- 172.21.15.104:0/1632963388 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f47f806e510 msgr2=0x7f47f81361a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.674+0000 7f47fcf11700 1 --2- 172.21.15.104:0/1632963388 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f47f806e510 0x7f47f81361a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f47ec0091e0 tx=0x7f47ec01e000 comp rx=0 tx=0).stop 2024-08-17T02:22:27.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.674+0000 7f47f7fff700 1 -- 172.21.15.104:0/1632963388 reap_dead start 2024-08-17T02:22:27.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.674+0000 7fcd9bfff700 1 -- 172.21.15.104:0/264535294 shutdown_connections 2024-08-17T02:22:27.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.674+0000 7fcd9bfff700 1 -- 172.21.15.104:0/264535294 wait complete. 2024-08-17T02:22:27.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.674+0000 7f47fcf11700 1 -- 172.21.15.104:0/1632963388 shutdown_connections 2024-08-17T02:22:27.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.674+0000 7f47fcf11700 1 -- 172.21.15.104:0/1632963388 >> 172.21.15.104:0/1632963388 conn(0x7f47f80678d0 msgr2=0x7f47f806a180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:27.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.674+0000 7f47fcf11700 1 -- 172.21.15.104:0/1632963388 shutdown_connections 2024-08-17T02:22:27.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.674+0000 7f47fcf11700 1 -- 172.21.15.104:0/1632963388 wait complete. 2024-08-17T02:22:27.729 INFO:teuthology.orchestra.run.smithi104.stdout:64424509448 2024-08-17T02:22:27.729 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-17T02:22:27.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.686+0000 7fba4086c700 1 -- 172.21.15.104:0/1317872921 --> [v2:172.21.15.104:6808/24257,v1:172.21.15.104:6809/24257] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fba1c002cf0 con 0x7fba28068ac0 2024-08-17T02:22:27.730 INFO:teuthology.orchestra.run.smithi104.stdout:64424509447 2024-08-17T02:22:27.731 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-17T02:22:27.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.686+0000 7fba237fe700 1 -- 172.21.15.104:0/1317872921 <== osd.0 v2:172.21.15.104:6808/24257 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fba1c002cf0 con 0x7fba28068ac0 2024-08-17T02:22:27.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.686+0000 7fba4086c700 1 -- 172.21.15.104:0/1317872921 >> [v2:172.21.15.104:6808/24257,v1:172.21.15.104:6809/24257] conn(0x7fba28068ac0 msgr2=0x7fba2806aed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.686+0000 7fba4086c700 1 --2- 172.21.15.104:0/1317872921 >> [v2:172.21.15.104:6808/24257,v1:172.21.15.104:6809/24257] conn(0x7fba28068ac0 0x7fba2806aed0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.686+0000 7fba4086c700 1 -- 172.21.15.104:0/1317872921 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fba28060930 msgr2=0x7fba28062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.686+0000 7fba4086c700 1 --2- 172.21.15.104:0/1317872921 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fba28060930 0x7fba28062de0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fba34005c50 tx=0x7fba34001420 comp rx=0 tx=0).stop 2024-08-17T02:22:27.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.686+0000 7fba4086c700 1 -- 172.21.15.104:0/1317872921 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fba3c159280 msgr2=0x7fba3c06cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.686+0000 7fba4086c700 1 --2- 172.21.15.104:0/1317872921 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fba3c159280 0x7fba3c06cf00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fba2c00b4f0 tx=0x7fba2c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.686+0000 7fba3bfff700 1 -- 172.21.15.104:0/1317872921 reap_dead start 2024-08-17T02:22:27.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.686+0000 7fba4086c700 1 -- 172.21.15.104:0/1317872921 shutdown_connections 2024-08-17T02:22:27.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.686+0000 7fba4086c700 1 -- 172.21.15.104:0/1317872921 >> 172.21.15.104:0/1317872921 conn(0x7fba3c0678d0 msgr2=0x7fba3c153050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:27.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.686+0000 7fba4086c700 1 -- 172.21.15.104:0/1317872921 shutdown_connections 2024-08-17T02:22:27.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.686+0000 7fba4086c700 1 -- 172.21.15.104:0/1317872921 wait complete. 2024-08-17T02:22:27.733 INFO:teuthology.orchestra.run.smithi104.stdout:64424509448 2024-08-17T02:22:27.734 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-17T02:22:27.734 INFO:teuthology.orchestra.run.smithi104.stdout:64424509447 2024-08-17T02:22:27.738 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-17T02:22:27.739 INFO:teuthology.orchestra.run.smithi104.stdout:64424509447 2024-08-17T02:22:27.739 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-17T02:22:27.740 INFO:teuthology.orchestra.run.smithi104.stdout:60129542152 2024-08-17T02:22:27.740 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-17T02:22:27.741 INFO:teuthology.orchestra.run.smithi104.stdout:64424509447 2024-08-17T02:22:27.742 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-17T02:22:27.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.906+0000 7f6a06376700 1 Processor -- start 2024-08-17T02:22:27.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.906+0000 7f6a06376700 1 -- start start 2024-08-17T02:22:27.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.906+0000 7ffa1431f700 1 Processor -- start 2024-08-17T02:22:27.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.906+0000 7fb177076700 1 Processor -- start 2024-08-17T02:22:27.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.906+0000 7fb177076700 1 -- start start 2024-08-17T02:22:27.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.906+0000 7ffa1431f700 1 -- start start 2024-08-17T02:22:27.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.906+0000 7f8d509b2700 1 Processor -- start 2024-08-17T02:22:27.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.906+0000 7f6edd126700 1 Processor -- start 2024-08-17T02:22:27.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.906+0000 7f6edd126700 1 -- start start 2024-08-17T02:22:27.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.906+0000 7fb177076700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb1701664a0 0x7fb170166870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.906+0000 7fb177076700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb1700ae5b0 0x7fb1700874b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.906+0000 7fb177076700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb170166e70 con 0x7fb1700879f0 2024-08-17T02:22:27.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.906+0000 7fb177076700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb170167150 con 0x7fb1701664a0 2024-08-17T02:22:27.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.906+0000 7fb177076700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb170167430 con 0x7fb1700ae5b0 2024-08-17T02:22:27.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.906+0000 7fb175613700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fb1700879f0 0x7fb1700abe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:56754/0 (socket says 172.21.15.104:56754) 2024-08-17T02:22:27.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.906+0000 7fb175613700 1 -- 172.21.15.104:0/1686279832 learned_addr learned my addr 172.21.15.104:0/1686279832 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:27.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.906+0000 7fb16ffff700 1 --2- 172.21.15.104:0/1686279832 >> v2:172.21.15.117:3300/0 conn(0x7fb1700ae5b0 0x7fb1700874b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.906+0000 7f8d509b2700 1 -- start start 2024-08-17T02:22:27.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7ffa1431f700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ffa0c0aa520 0x7ffa0c0adb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7ffa1431f700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa0c0b0f50 con 0x7ffa0c06a750 2024-08-17T02:22:27.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7ffa1431f700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa0c0b1230 con 0x7ffa0c156ee0 2024-08-17T02:22:27.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7ffa1431f700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa0c0b1510 con 0x7ffa0c0aa520 2024-08-17T02:22:27.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f6a06376700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6a000aa440 0x7f6a000aa870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7fb174e12700 1 --2- 172.21.15.104:0/1686279832 >> v2:172.21.15.104:3300/0 conn(0x7fb1701664a0 0x7fb170166870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7fb174e12700 1 -- 172.21.15.104:0/1686279832 >> v2:172.21.15.117:3300/0 conn(0x7fb1700ae5b0 msgr2=0x7fb1700874b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:27.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7fb174e12700 1 --2- 172.21.15.104:0/1686279832 >> v2:172.21.15.117:3300/0 conn(0x7fb1700ae5b0 0x7fb1700874b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7fb174e12700 1 -- 172.21.15.104:0/1686279832 >> v1:172.21.15.104:6789/0 conn(0x7fb1700879f0 legacy=0x7fb1700abe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7fb174e12700 1 -- 172.21.15.104:0/1686279832 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb170167710 con 0x7fb1701664a0 2024-08-17T02:22:27.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7fb16f7fe700 1 -- 172.21.15.104:0/1686279832 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1007099241 0 0) 0x7fb170166e70 con 0x7fb1700879f0 2024-08-17T02:22:27.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7ffa128bc700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7ffa0c06a750 0x7ffa0c160d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:56758/0 (socket says 172.21.15.104:56758) 2024-08-17T02:22:27.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7ffa128bc700 1 -- 172.21.15.104:0/249466095 learned_addr learned my addr 172.21.15.104:0/249466095 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:27.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f6a06376700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6a000b0d40 0x7f6a000b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f6a06376700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a000acae0 con 0x7f6a001593b0 2024-08-17T02:22:27.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f6a06376700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a000ac650 con 0x7f6a000b0d40 2024-08-17T02:22:27.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f6a06376700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a000aadb0 con 0x7f6a000aa440 2024-08-17T02:22:27.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f6a04913700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6a000b0d40 0x7f6a000b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f6a04913700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6a000b0d40 0x7f6a000b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42272/0 (socket says 172.21.15.104:42272) 2024-08-17T02:22:27.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f6a04913700 1 -- 172.21.15.104:0/1793976269 learned_addr learned my addr 172.21.15.104:0/1793976269 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:27.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f69ff7fe700 1 --2- 172.21.15.104:0/1793976269 >> v2:172.21.15.117:3300/0 conn(0x7f6a000aa440 0x7f6a000aa870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f6edd126700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ed806e140 0x7f6ed806e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f6edd126700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6ed81556f0 0x7f6ed80b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f6edd126700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ed8156940 con 0x7f6ed813e250 2024-08-17T02:22:27.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f6edd126700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ed8155b40 con 0x7f6ed81556f0 2024-08-17T02:22:27.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f6edd126700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed80b1ba0 con 0x7f6ed806e140 2024-08-17T02:22:27.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f6ed77fe700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6ed81556f0 0x7f6ed80b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f6ed77fe700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6ed81556f0 0x7f6ed80b1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42282/0 (socket says 172.21.15.104:42282) 2024-08-17T02:22:27.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f6ed77fe700 1 -- 172.21.15.104:0/1147550875 learned_addr learned my addr 172.21.15.104:0/1147550875 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:27.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f8d509b2700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8d4c0adf10 0x7f8d4c0ae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f8d509b2700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d4c06e470 0x7f8d4c06e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f8d509b2700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f8d4c0cad40 0x7f8d4c0cb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f8d509b2700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d4c158290 con 0x7f8d4c0cad40 2024-08-17T02:22:27.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f8d509b2700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d4c1610c0 con 0x7f8d4c0adf10 2024-08-17T02:22:27.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f8d509b2700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c0ae820 con 0x7f8d4c06e470 2024-08-17T02:22:27.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7ffa118ba700 1 --2- 172.21.15.104:0/249466095 >> v2:172.21.15.117:3300/0 conn(0x7ffa0c0aa520 0x7ffa0c0adb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f6a04913700 1 -- 172.21.15.104:0/1793976269 >> v2:172.21.15.117:3300/0 conn(0x7f6a000aa440 msgr2=0x7f6a000aa870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:27.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f6a04913700 1 --2- 172.21.15.104:0/1793976269 >> v2:172.21.15.117:3300/0 conn(0x7f6a000aa440 0x7f6a000aa870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f6a04913700 1 -- 172.21.15.104:0/1793976269 >> v1:172.21.15.104:6789/0 conn(0x7f6a001593b0 legacy=0x7f6a0015a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:27.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f6a04913700 1 -- 172.21.15.104:0/1793976269 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a00159780 con 0x7f6a000b0d40 2024-08-17T02:22:27.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f6ed7fff700 1 --2- 172.21.15.104:0/1147550875 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ed806e140 0x7f6ed806e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f8d4ad9d700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f8d4c0cad40 0x7f8d4c0cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f8d4a59c700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8d4c0adf10 0x7f8d4c0ae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f8d4ad9d700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f8d4c0cad40 0x7f8d4c0cb180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42290/0 (socket says 172.21.15.104:42290) 2024-08-17T02:22:27.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f8d4ad9d700 1 -- 172.21.15.104:0/2361522333 learned_addr learned my addr 172.21.15.104:0/2361522333 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:27.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7fb174e12700 1 --2- 172.21.15.104:0/1686279832 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1701664a0 0x7fb170166870 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb17006be50 tx=0x7fb1600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e7152c24a1bd49a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f6a04913700 1 --2- 172.21.15.104:0/1793976269 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6a000b0d40 0x7f6a000b1130 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6a0006cd50 tx=0x7f69f8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a97eda7568780184 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f8d49d9b700 1 --2- 172.21.15.104:0/2361522333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d4c06e470 0x7f8d4c06e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7fb16f7fe700 1 -- 172.21.15.104:0/1686279832 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16000b690 con 0x7fb1701664a0 2024-08-17T02:22:27.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7ffa118ba700 1 -- 172.21.15.104:0/249466095 >> v1:172.21.15.117:6789/0 conn(0x7ffa0c156ee0 legacy=0x7ffa0c0b04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:27.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f8d4ad9d700 1 -- 172.21.15.104:0/2361522333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d4c06e470 msgr2=0x7f8d4c06e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:27.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f8d4ad9d700 1 --2- 172.21.15.104:0/2361522333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d4c06e470 0x7f8d4c06e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7ffa118ba700 1 -- 172.21.15.104:0/249466095 >> v1:172.21.15.104:6789/0 conn(0x7ffa0c06a750 legacy=0x7ffa0c160d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7ffa118ba700 1 -- 172.21.15.104:0/249466095 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa0c0b17f0 con 0x7ffa0c0aa520 2024-08-17T02:22:27.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f6ed7fff700 1 -- 172.21.15.104:0/1147550875 >> v2:172.21.15.104:3300/0 conn(0x7f6ed81556f0 msgr2=0x7f6ed80b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:27.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f6ed7fff700 1 --2- 172.21.15.104:0/1147550875 >> v2:172.21.15.104:3300/0 conn(0x7f6ed81556f0 0x7f6ed80b1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f6ed7fff700 1 -- 172.21.15.104:0/1147550875 >> v1:172.21.15.117:6789/0 conn(0x7f6ed813e250 legacy=0x7f6ed813e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f6ed7fff700 1 -- 172.21.15.104:0/1147550875 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed8155d30 con 0x7f6ed806e140 2024-08-17T02:22:27.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f8d4ad9d700 1 -- 172.21.15.104:0/2361522333 >> v2:172.21.15.117:3300/0 conn(0x7f8d4c0adf10 msgr2=0x7f8d4c0ae2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:27.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f8d4ad9d700 1 --2- 172.21.15.104:0/2361522333 >> v2:172.21.15.117:3300/0 conn(0x7f8d4c0adf10 0x7f8d4c0ae2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f8d4ad9d700 1 -- 172.21.15.104:0/2361522333 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d4c15dff0 con 0x7f8d4c0cad40 2024-08-17T02:22:27.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f8d4a59c700 1 --2- 172.21.15.104:0/2361522333 >> v2:172.21.15.117:3300/0 conn(0x7f8d4c0adf10 0x7f8d4c0ae2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:22:27.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7fb16f7fe700 1 -- 172.21.15.104:0/1686279832 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb16000b7f0 con 0x7fb1701664a0 2024-08-17T02:22:27.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7fb16f7fe700 1 -- 172.21.15.104:0/1686279832 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16000bb90 con 0x7fb1701664a0 2024-08-17T02:22:27.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7ffa118ba700 1 --2- 172.21.15.104:0/249466095 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa0c0aa520 0x7ffa0c0adb90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ffa080098e0 tx=0x7ffa080091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b785db370be14c56 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f69feffd700 1 -- 172.21.15.104:0/1793976269 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f800e070 con 0x7f6a000b0d40 2024-08-17T02:22:27.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f69feffd700 1 -- 172.21.15.104:0/1793976269 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f800ba10 con 0x7f6a000b0d40 2024-08-17T02:22:27.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7fd496952700 1 Processor -- start 2024-08-17T02:22:27.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f6ed7fff700 1 --2- 172.21.15.104:0/1147550875 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ed806e140 0x7f6ed806e510 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6ec8009910 tx=0x7f6ec80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2bc4713c2cf306f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7fd496952700 1 -- start start 2024-08-17T02:22:27.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7ffa110b9700 1 -- 172.21.15.104:0/249466095 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa08009e80 con 0x7ffa0c0aa520 2024-08-17T02:22:27.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7ffa110b9700 1 -- 172.21.15.104:0/249466095 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa0800b760 con 0x7ffa0c0aa520 2024-08-17T02:22:27.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f6ed6ffd700 1 -- 172.21.15.104:0/1147550875 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec800b640 con 0x7f6ed806e140 2024-08-17T02:22:27.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7fb177076700 1 -- 172.21.15.104:0/1686279832 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1701664a0 msgr2=0x7fb170166870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7fb177076700 1 --2- 172.21.15.104:0/1686279832 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1701664a0 0x7fb170166870 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb17006be50 tx=0x7fb1600091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f69feffd700 1 -- 172.21.15.104:0/1793976269 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f80092e0 con 0x7f6a000b0d40 2024-08-17T02:22:27.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f6ed6ffd700 1 -- 172.21.15.104:0/1147550875 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec800b7a0 con 0x7f6ed806e140 2024-08-17T02:22:27.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f6ed6ffd700 1 -- 172.21.15.104:0/1147550875 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec800bb60 con 0x7f6ed806e140 2024-08-17T02:22:27.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f6a06376700 1 -- 172.21.15.104:0/1793976269 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6a000b0d40 msgr2=0x7f6a000b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f6a06376700 1 --2- 172.21.15.104:0/1793976269 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6a000b0d40 0x7f6a000b1130 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6a0006cd50 tx=0x7f69f8009840 comp rx=0 tx=0).stop 2024-08-17T02:22:27.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f8d4ad9d700 1 --2- 172.21.15.104:0/2361522333 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d4c0cad40 0x7f8d4c0cb180 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c06fbc0 tx=0x7f8d44009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e879e58593bc21c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7ffa110b9700 1 -- 172.21.15.104:0/249466095 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0800bb00 con 0x7ffa0c0aa520 2024-08-17T02:22:27.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f6a06376700 1 -- 172.21.15.104:0/1793976269 shutdown_connections 2024-08-17T02:22:27.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f6a06376700 1 --2- 172.21.15.104:0/1793976269 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6a000b0d40 0x7f6a000b1130 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f6a06376700 1 --2- 172.21.15.104:0/1793976269 >> v2:172.21.15.117:3300/0 conn(0x7f6a000aa440 0x7f6a000aa870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f6a06376700 1 -- 172.21.15.104:0/1793976269 >> 172.21.15.104:0/1793976269 conn(0x7f6a00068300 msgr2=0x7f6a000a8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:27.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7fb177076700 1 -- 172.21.15.104:0/1686279832 shutdown_connections 2024-08-17T02:22:27.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7fb177076700 1 --2- 172.21.15.104:0/1686279832 >> v2:172.21.15.117:3300/0 conn(0x7fb1700ae5b0 0x7fb1700874b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7fb177076700 1 --2- 172.21.15.104:0/1686279832 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1701664a0 0x7fb170166870 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7fb177076700 1 -- 172.21.15.104:0/1686279832 >> 172.21.15.104:0/1686279832 conn(0x7fb170068300 msgr2=0x7fb1700a8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:27.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f6704c3e700 1 Processor -- start 2024-08-17T02:22:27.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7ffa1431f700 1 -- 172.21.15.104:0/249466095 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa0c0aa520 msgr2=0x7ffa0c0adb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7ffa1431f700 1 --2- 172.21.15.104:0/249466095 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa0c0aa520 0x7ffa0c0adb90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ffa080098e0 tx=0x7ffa080091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f8d4959a700 1 -- 172.21.15.104:0/2361522333 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4400e070 con 0x7f8d4c0cad40 2024-08-17T02:22:27.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7ffa1431f700 1 -- 172.21.15.104:0/249466095 shutdown_connections 2024-08-17T02:22:27.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7ffa1431f700 1 --2- 172.21.15.104:0/249466095 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa0c0aa520 0x7ffa0c0adb90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7ffa1431f700 1 -- 172.21.15.104:0/249466095 >> 172.21.15.104:0/249466095 conn(0x7ffa0c068300 msgr2=0x7ffa0c0a8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:27.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f8d4959a700 1 -- 172.21.15.104:0/2361522333 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d4400ba50 con 0x7f8d4c0cad40 2024-08-17T02:22:27.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f8d4959a700 1 -- 172.21.15.104:0/2361522333 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d440092e0 con 0x7f8d4c0cad40 2024-08-17T02:22:27.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f6704c3e700 1 -- start start 2024-08-17T02:22:27.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f6edd126700 1 -- 172.21.15.104:0/1147550875 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ed806e140 msgr2=0x7f6ed806e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f6edd126700 1 --2- 172.21.15.104:0/1147550875 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ed806e140 0x7f6ed806e510 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6ec8009910 tx=0x7f6ec80091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7fb177076700 1 -- 172.21.15.104:0/1686279832 shutdown_connections 2024-08-17T02:22:27.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7fd496952700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd4901503b0 0x7fd490150780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7f6a06376700 1 -- 172.21.15.104:0/1793976269 shutdown_connections 2024-08-17T02:22:27.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.910+0000 7fd496952700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd49006eb70 0x7fd49006efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f6a06376700 1 -- 172.21.15.104:0/1793976269 wait complete. 2024-08-17T02:22:27.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f6edd126700 1 -- 172.21.15.104:0/1147550875 shutdown_connections 2024-08-17T02:22:27.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f6edd126700 1 --2- 172.21.15.104:0/1147550875 >> v2:172.21.15.104:3300/0 conn(0x7f6ed81556f0 0x7f6ed80b1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f6edd126700 1 --2- 172.21.15.104:0/1147550875 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ed806e140 0x7f6ed806e510 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f6edd126700 1 -- 172.21.15.104:0/1147550875 >> 172.21.15.104:0/1147550875 conn(0x7f6ed80678d0 msgr2=0x7f6ed8067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:27.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7fd496952700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd49006f510 con 0x7fd4900b0490 2024-08-17T02:22:27.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f6edd126700 1 -- 172.21.15.104:0/1147550875 shutdown_connections 2024-08-17T02:22:27.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f6edd126700 1 -- 172.21.15.104:0/1147550875 wait complete. 2024-08-17T02:22:27.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7fd496952700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4900b0fe0 con 0x7fd4901503b0 2024-08-17T02:22:27.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7fd496952700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4900b11c0 con 0x7fd49006eb70 2024-08-17T02:22:27.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7fd49514f700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd49006eb70 0x7fd49006efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7fd49514f700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd49006eb70 0x7fd49006efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.104:44616/0 (socket says 172.21.15.104:44616) 2024-08-17T02:22:27.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7fd49514f700 1 -- 172.21.15.104:0/2493210532 learned_addr learned my addr 172.21.15.104:0/2493210532 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:27.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7ffa1431f700 1 -- 172.21.15.104:0/249466095 shutdown_connections 2024-08-17T02:22:27.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f8d509b2700 1 -- 172.21.15.104:0/2361522333 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d4c0cad40 msgr2=0x7f8d4c0cb180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f8d509b2700 1 --2- 172.21.15.104:0/2361522333 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d4c0cad40 0x7f8d4c0cb180 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c06fbc0 tx=0x7f8d44009840 comp rx=0 tx=0).stop 2024-08-17T02:22:27.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7fb177076700 1 -- 172.21.15.104:0/1686279832 wait complete. 2024-08-17T02:22:27.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7fd495950700 1 --2- 172.21.15.104:0/2493210532 >> v2:172.21.15.117:3300/0 conn(0x7fd4901503b0 0x7fd490150780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f96ae41f700 1 Processor -- start 2024-08-17T02:22:27.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f6704c3e700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6700156fb0 0x7f67000caa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f6704c3e700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f670015d6b0 0x7f670015b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f6704c3e700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f670015ada0 con 0x7f67000cafa0 2024-08-17T02:22:27.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f6704c3e700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67000cbce0 con 0x7f6700156fb0 2024-08-17T02:22:27.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f6704c3e700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6700157380 con 0x7f670015d6b0 2024-08-17T02:22:27.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f96ae41f700 1 -- start start 2024-08-17T02:22:27.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f66fed9d700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f670015d6b0 0x7f670015b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f66fdd9b700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f67000cafa0 0x7f670015cfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.104:60700/0 (socket says 172.21.15.104:60700) 2024-08-17T02:22:27.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f66fdd9b700 1 -- 172.21.15.104:0/3036275649 learned_addr learned my addr 172.21.15.104:0/3036275649 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:27.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f66fe59c700 1 --2- 172.21.15.104:0/3036275649 >> v2:172.21.15.104:3300/0 conn(0x7f6700156fb0 0x7f67000caa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f66fe59c700 1 -- 172.21.15.104:0/3036275649 >> v2:172.21.15.117:3300/0 conn(0x7f670015d6b0 msgr2=0x7f670015b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:27.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f66fe59c700 1 --2- 172.21.15.104:0/3036275649 >> v2:172.21.15.117:3300/0 conn(0x7f670015d6b0 0x7f670015b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f66fe59c700 1 -- 172.21.15.104:0/3036275649 >> v1:172.21.15.117:6789/0 conn(0x7f67000cafa0 legacy=0x7f670015cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f66fe59c700 1 -- 172.21.15.104:0/3036275649 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67000cb440 con 0x7f6700156fb0 2024-08-17T02:22:27.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f6edd126700 1 Processor -- start 2024-08-17T02:22:27.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f66fe59c700 1 --2- 172.21.15.104:0/3036275649 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6700156fb0 0x7f67000caa60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f67000c3cc0 tx=0x7f66f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74dd77e09c5e4883 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7fb177076700 1 Processor -- start 2024-08-17T02:22:27.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f8d509b2700 1 -- 172.21.15.104:0/2361522333 shutdown_connections 2024-08-17T02:22:27.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f8d509b2700 1 --2- 172.21.15.104:0/2361522333 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d4c0cad40 0x7f8d4c0cb180 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f8d509b2700 1 --2- 172.21.15.104:0/2361522333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d4c06e470 0x7f8d4c06e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f8d509b2700 1 --2- 172.21.15.104:0/2361522333 >> v2:172.21.15.117:3300/0 conn(0x7f8d4c0adf10 0x7f8d4c0ae2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f8d509b2700 1 -- 172.21.15.104:0/2361522333 >> 172.21.15.104:0/2361522333 conn(0x7f8d4c067810 msgr2=0x7f8d4c067c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:27.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f8d509b2700 1 -- 172.21.15.104:0/2361522333 shutdown_connections 2024-08-17T02:22:27.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f8d509b2700 1 -- 172.21.15.104:0/2361522333 wait complete. 2024-08-17T02:22:27.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f96ae41f700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a8159250 0x7f96a80c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f66fd59a700 1 -- 172.21.15.104:0/3036275649 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f0011630 con 0x7f6700156fb0 2024-08-17T02:22:27.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f96ae41f700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f96a806efd0 0x7f96a80c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f96ae41f700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96a80c8a40 con 0x7f96a80cbb80 2024-08-17T02:22:27.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f96ae41f700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96a80c9410 con 0x7f96a806efd0 2024-08-17T02:22:27.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f96ae41f700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a80c7e30 con 0x7f96a8159250 2024-08-17T02:22:27.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f6a06376700 1 Processor -- start 2024-08-17T02:22:27.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f6a06376700 1 -- start start 2024-08-17T02:22:27.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7fd49514f700 1 -- 172.21.15.104:0/2493210532 >> v2:172.21.15.117:3300/0 conn(0x7fd4901503b0 msgr2=0x7fd490150780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:27.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7fd49514f700 1 --2- 172.21.15.104:0/2493210532 >> v2:172.21.15.117:3300/0 conn(0x7fd4901503b0 0x7fd490150780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7fd49514f700 1 -- 172.21.15.104:0/2493210532 >> v1:172.21.15.117:6789/0 conn(0x7fd4900b0490 legacy=0x7fd4900b08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:27.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7fd49514f700 1 -- 172.21.15.104:0/2493210532 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4900a9d30 con 0x7fd49006eb70 2024-08-17T02:22:27.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7fd495950700 1 --2- 172.21.15.104:0/2493210532 >> v2:172.21.15.117:3300/0 conn(0x7fd4901503b0 0x7fd490150780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:22:27.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f66fd59a700 1 -- 172.21.15.104:0/3036275649 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f0011790 con 0x7f6700156fb0 2024-08-17T02:22:27.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f66fd59a700 1 -- 172.21.15.104:0/3036275649 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f0011b30 con 0x7f6700156fb0 2024-08-17T02:22:27.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7fd49514f700 1 --2- 172.21.15.104:0/2493210532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd49006eb70 0x7fd49006efd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd48c00bc50 tx=0x7fd48c00b4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c6645702b1a19cf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f96a7fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a8159250 0x7f96a80c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7ffa1431f700 1 -- 172.21.15.104:0/249466095 wait complete. 2024-08-17T02:22:27.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f6a06376700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6a000aa440 0x7f6a00176a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f6a06376700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6a000b0d40 0x7f6a00156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f6a06376700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a001593b0 0x7f6a00179620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f6a06376700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a00176020 con 0x7f6a000b0d40 2024-08-17T02:22:27.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f6a06376700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0017a0a0 con 0x7f6a001593b0 2024-08-17T02:22:27.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f6a06376700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0017a380 con 0x7f6a000aa440 2024-08-17T02:22:27.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7fd49494e700 1 -- 172.21.15.104:0/2493210532 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c00be60 con 0x7fd49006eb70 2024-08-17T02:22:27.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7fd49494e700 1 -- 172.21.15.104:0/2493210532 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd48c00ddc0 con 0x7fd49006eb70 2024-08-17T02:22:27.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7fd49494e700 1 -- 172.21.15.104:0/2493210532 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c0106a0 con 0x7fd49006eb70 2024-08-17T02:22:27.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f96a77fe700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f96a806efd0 0x7f96a80c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f96a7fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a8159250 0x7f96a80c8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.104:44630/0 (socket says 172.21.15.104:44630) 2024-08-17T02:22:27.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f96a7fff700 1 -- 172.21.15.104:0/3167957547 learned_addr learned my addr 172.21.15.104:0/3167957547 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:27.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f6edd126700 1 -- start start 2024-08-17T02:22:27.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f69fffff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6a000aa440 0x7f6a00176a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f69fffff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6a000aa440 0x7f6a00176a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.104:44632/0 (socket says 172.21.15.104:44632) 2024-08-17T02:22:27.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f69fffff700 1 -- 172.21.15.104:0/3180794022 learned_addr learned my addr 172.21.15.104:0/3180794022 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:27.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7ffa1431f700 1 Processor -- start 2024-08-17T02:22:27.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f6a04913700 1 --2- 172.21.15.104:0/3180794022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a001593b0 0x7f6a00179620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7fb177076700 1 -- start start 2024-08-17T02:22:27.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f8d509b2700 1 Processor -- start 2024-08-17T02:22:27.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f8d509b2700 1 -- start start 2024-08-17T02:22:27.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f8d509b2700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d4c06e470 0x7f8d4c097620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f8d509b2700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d4c0adf10 0x7f8d4c0b0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f8d509b2700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d4c0cad40 0x7f8d4c0b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f8d509b2700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c1583e0 con 0x7f8d4c0adf10 2024-08-17T02:22:27.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f8d509b2700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c097c20 con 0x7f8d4c0cad40 2024-08-17T02:22:27.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f8d509b2700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c097f00 con 0x7f8d4c06e470 2024-08-17T02:22:27.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7fb177076700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1700879f0 0x7fb170175df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7fb177076700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1700ae5b0 0x7fb1700c1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7fb177076700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1701664a0 0x7fb1700c2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7fb177076700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1700c1fb0 con 0x7fb1701664a0 2024-08-17T02:22:27.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7fb177076700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb170096b20 con 0x7fb1700ae5b0 2024-08-17T02:22:27.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7fb177076700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb170096e00 con 0x7fb1700879f0 2024-08-17T02:22:27.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7fb175613700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1701664a0 0x7fb1700c2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7fb175613700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1701664a0 0x7fb1700c2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42298/0 (socket says 172.21.15.104:42298) 2024-08-17T02:22:27.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7fb175613700 1 -- 172.21.15.104:0/2653676836 learned_addr learned my addr 172.21.15.104:0/2653676836 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:27.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7fb16ffff700 1 --2- 172.21.15.104:0/2653676836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1700ae5b0 0x7fb1700c1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f8d49d9b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d4c0adf10 0x7f8d4c0b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f8d49d9b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d4c0adf10 0x7f8d4c0b0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42306/0 (socket says 172.21.15.104:42306) 2024-08-17T02:22:27.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f8d49d9b700 1 -- 172.21.15.104:0/65316973 learned_addr learned my addr 172.21.15.104:0/65316973 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:27.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f8d4a59c700 1 --2- 172.21.15.104:0/65316973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d4c06e470 0x7f8d4c097620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7fb174e12700 1 --2- 172.21.15.104:0/2653676836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1700879f0 0x7fb170175df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7ffa1431f700 1 -- start start 2024-08-17T02:22:27.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f69ff7fe700 1 --2- 172.21.15.104:0/3180794022 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6a000b0d40 0x7f6a00156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f8d49d9b700 1 -- 172.21.15.104:0/65316973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d4c06e470 msgr2=0x7f8d4c097620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f8d49d9b700 1 --2- 172.21.15.104:0/65316973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d4c06e470 0x7f8d4c097620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f8d49d9b700 1 -- 172.21.15.104:0/65316973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d4c0cad40 msgr2=0x7f8d4c0b14e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:22:27.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f8d49d9b700 1 --2- 172.21.15.104:0/65316973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d4c0cad40 0x7f8d4c0b14e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f8d49d9b700 1 -- 172.21.15.104:0/65316973 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d44009ae0 con 0x7f8d4c0adf10 2024-08-17T02:22:27.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f6704c3e700 1 -- 172.21.15.104:0/3036275649 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6700156fb0 msgr2=0x7f67000caa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f6704c3e700 1 --2- 172.21.15.104:0/3036275649 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6700156fb0 0x7f67000caa60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f67000c3cc0 tx=0x7f66f00091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f6704c3e700 1 -- 172.21.15.104:0/3036275649 shutdown_connections 2024-08-17T02:22:27.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f6704c3e700 1 --2- 172.21.15.104:0/3036275649 >> v2:172.21.15.117:3300/0 conn(0x7f670015d6b0 0x7f670015b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f6704c3e700 1 --2- 172.21.15.104:0/3036275649 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6700156fb0 0x7f67000caa60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f6704c3e700 1 -- 172.21.15.104:0/3036275649 >> 172.21.15.104:0/3036275649 conn(0x7f6700099500 msgr2=0x7f67000675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:27.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f6704c3e700 1 -- 172.21.15.104:0/3036275649 shutdown_connections 2024-08-17T02:22:27.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f69fffff700 1 -- 172.21.15.104:0/3180794022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a001593b0 msgr2=0x7f6a00179620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f69fffff700 1 --2- 172.21.15.104:0/3180794022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a001593b0 0x7f6a00179620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f69fffff700 1 -- 172.21.15.104:0/3180794022 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6a000b0d40 msgr2=0x7f6a00156f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f69fffff700 1 --2- 172.21.15.104:0/3180794022 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6a000b0d40 0x7f6a00156f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f69fffff700 1 -- 172.21.15.104:0/3180794022 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f8009ae0 con 0x7f6a000aa440 2024-08-17T02:22:27.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7fb175613700 1 -- 172.21.15.104:0/2653676836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1700879f0 msgr2=0x7fb170175df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7fb175613700 1 --2- 172.21.15.104:0/2653676836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1700879f0 0x7fb170175df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7fb175613700 1 -- 172.21.15.104:0/2653676836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1700ae5b0 msgr2=0x7fb1700c1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7fb175613700 1 --2- 172.21.15.104:0/2653676836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1700ae5b0 0x7fb1700c1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7fb175613700 1 -- 172.21.15.104:0/2653676836 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb160009420 con 0x7fb1701664a0 2024-08-17T02:22:27.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f6704c3e700 1 -- 172.21.15.104:0/3036275649 wait complete. 2024-08-17T02:22:27.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f96a77fe700 1 -- 172.21.15.104:0/3167957547 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a8159250 msgr2=0x7f96a80c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:27.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f96a77fe700 1 --2- 172.21.15.104:0/3167957547 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a8159250 0x7f96a80c8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f96a77fe700 1 -- 172.21.15.104:0/3167957547 >> v1:172.21.15.104:6789/0 conn(0x7f96a80cbb80 legacy=0x7f96a80c4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:27.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f96a77fe700 1 -- 172.21.15.104:0/3167957547 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a80c8110 con 0x7f96a806efd0 2024-08-17T02:22:27.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.914+0000 7f96a7fff700 1 --2- 172.21.15.104:0/3167957547 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a8159250 0x7f96a80c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:22:27.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f96a77fe700 1 --2- 172.21.15.104:0/3167957547 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96a806efd0 0x7f96a80c75e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f969c0098e0 tx=0x7f969c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=724dfa6571ae0f55 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f96a6ffd700 1 -- 172.21.15.104:0/3167957547 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969c011630 con 0x7f96a806efd0 2024-08-17T02:22:27.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7fb175613700 1 --2- 172.21.15.104:0/2653676836 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1701664a0 0x7fb1700c2b60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb16400c5d0 tx=0x7fb164006c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7fd496952700 1 -- 172.21.15.104:0/2493210532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd49006eb70 msgr2=0x7fd49006efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7fd496952700 1 --2- 172.21.15.104:0/2493210532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd49006eb70 0x7fd49006efd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd48c00bc50 tx=0x7fd48c00b4f0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f96a6ffd700 1 -- 172.21.15.104:0/3167957547 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969c011790 con 0x7f96a806efd0 2024-08-17T02:22:27.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f96a6ffd700 1 -- 172.21.15.104:0/3167957547 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969c011b30 con 0x7f96a806efd0 2024-08-17T02:22:27.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f8d49d9b700 1 --2- 172.21.15.104:0/65316973 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d4c0adf10 0x7f8d4c0b0190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8d4000d860 tx=0x7f8d40008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7fb16cff9700 1 -- 172.21.15.104:0/2653676836 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16400f040 con 0x7fb1701664a0 2024-08-17T02:22:27.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7fb16cff9700 1 -- 172.21.15.104:0/2653676836 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb164006320 con 0x7fb1701664a0 2024-08-17T02:22:27.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f6edd126700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ed806e140 0x7f6ed81540a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f6edd126700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ed813e250 0x7f6ed80aacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f6edd126700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ed81556f0 0x7f6ed80ab1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f6edd126700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed80adaa0 con 0x7f6ed81556f0 2024-08-17T02:22:27.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f6edd126700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed80add80 con 0x7f6ed813e250 2024-08-17T02:22:27.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f6edd126700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed80ae060 con 0x7f6ed806e140 2024-08-17T02:22:27.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f6edc925700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ed81556f0 0x7f6ed80ab1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f6edc925700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ed81556f0 0x7f6ed80ab1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42318/0 (socket says 172.21.15.104:42318) 2024-08-17T02:22:27.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f6edc925700 1 -- 172.21.15.104:0/2423127478 learned_addr learned my addr 172.21.15.104:0/2423127478 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:27.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f6ed77fe700 1 --2- 172.21.15.104:0/2423127478 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ed813e250 0x7f6ed80aacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f6ed7fff700 1 --2- 172.21.15.104:0/2423127478 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ed806e140 0x7f6ed81540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7fb16cff9700 1 -- 172.21.15.104:0/2653676836 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb164004810 con 0x7fb1701664a0 2024-08-17T02:22:27.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f8d3a7fc700 1 -- 172.21.15.104:0/65316973 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d400096a0 con 0x7f8d4c0adf10 2024-08-17T02:22:27.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f8d3a7fc700 1 -- 172.21.15.104:0/65316973 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d40009800 con 0x7f8d4c0adf10 2024-08-17T02:22:27.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f8d3a7fc700 1 -- 172.21.15.104:0/65316973 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d40009bc0 con 0x7f8d4c0adf10 2024-08-17T02:22:27.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f8d509b2700 1 -- 172.21.15.104:0/65316973 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d4c0981e0 con 0x7f8d4c0adf10 2024-08-17T02:22:27.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f8d509b2700 1 -- 172.21.15.104:0/65316973 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d4c0b06d0 con 0x7f8d4c0adf10 2024-08-17T02:22:27.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7ffa1431f700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffa0c06a750 0x7ffa0c06eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f69fffff700 1 --2- 172.21.15.104:0/3180794022 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6a000aa440 0x7f6a00176a30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f69f000b5e0 tx=0x7f69f00090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f69e7fff700 1 -- 172.21.15.104:0/3180794022 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f000f510 con 0x7f6a000aa440 2024-08-17T02:22:27.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f6a06376700 1 -- 172.21.15.104:0/3180794022 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a00176230 con 0x7f6a000aa440 2024-08-17T02:22:27.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f6a06376700 1 -- 172.21.15.104:0/3180794022 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a00176f70 con 0x7f6a000aa440 2024-08-17T02:22:27.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f69e7fff700 1 -- 172.21.15.104:0/3180794022 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f000f690 con 0x7f6a000aa440 2024-08-17T02:22:27.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f69e7fff700 1 -- 172.21.15.104:0/3180794022 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f000fa50 con 0x7f6a000aa440 2024-08-17T02:22:27.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f6704c3e700 1 Processor -- start 2024-08-17T02:22:27.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f6704c3e700 1 -- start start 2024-08-17T02:22:27.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7fd496952700 1 -- 172.21.15.104:0/2493210532 shutdown_connections 2024-08-17T02:22:27.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7fd496952700 1 --2- 172.21.15.104:0/2493210532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd49006eb70 0x7fd49006efd0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7fd496952700 1 --2- 172.21.15.104:0/2493210532 >> v2:172.21.15.117:3300/0 conn(0x7fd4901503b0 0x7fd490150780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7fd496952700 1 -- 172.21.15.104:0/2493210532 >> 172.21.15.104:0/2493210532 conn(0x7fd490066e00 msgr2=0x7fd490067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:27.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f6704c3e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67000cafa0 0x7f67000c76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f6704c3e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6700156fb0 0x7f67000c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f6704c3e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f670015d6b0 0x7f67000c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f6704c3e700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67000b1800 con 0x7f67000cafa0 2024-08-17T02:22:27.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f6704c3e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67000b1ae0 con 0x7f670015d6b0 2024-08-17T02:22:27.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f6704c3e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67000b1dc0 con 0x7f6700156fb0 2024-08-17T02:22:27.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f6edc925700 1 -- 172.21.15.104:0/2423127478 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ed806e140 msgr2=0x7f6ed81540a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f6edc925700 1 --2- 172.21.15.104:0/2423127478 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ed806e140 0x7f6ed81540a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f6edc925700 1 -- 172.21.15.104:0/2423127478 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ed813e250 msgr2=0x7f6ed80aacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f6edc925700 1 --2- 172.21.15.104:0/2423127478 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ed813e250 0x7f6ed80aacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f6edc925700 1 -- 172.21.15.104:0/2423127478 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec8009420 con 0x7f6ed81556f0 2024-08-17T02:22:27.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f6edc925700 1 --2- 172.21.15.104:0/2423127478 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ed81556f0 0x7f6ed80ab1f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6ed001d7d0 tx=0x7f6ed00015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7fd496952700 1 -- 172.21.15.104:0/2493210532 shutdown_connections 2024-08-17T02:22:27.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f66fe59c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67000cafa0 0x7f67000c76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f66fed9d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f670015d6b0 0x7f67000c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f66fed9d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f670015d6b0 0x7f67000c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.104:41092/0 (socket says 172.21.15.104:41092) 2024-08-17T02:22:27.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f66fed9d700 1 -- 172.21.15.104:0/1077922304 learned_addr learned my addr 172.21.15.104:0/1077922304 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:27.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7ffa1431f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa0c0aa520 0x7ffa0c0ac100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7ffa1431f700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa0c156ee0 0x7ffa0c099180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7ffa1431f700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c0abce0 con 0x7ffa0c06a750 2024-08-17T02:22:27.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7ffa1431f700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c0ad8c0 con 0x7ffa0c0aa520 2024-08-17T02:22:27.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7ffa1431f700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c0ad300 con 0x7ffa0c156ee0 2024-08-17T02:22:27.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7ffa120bb700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffa0c06a750 0x7ffa0c06eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7ffa120bb700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffa0c06a750 0x7ffa0c06eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42326/0 (socket says 172.21.15.104:42326) 2024-08-17T02:22:27.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7ffa120bb700 1 -- 172.21.15.104:0/2815748688 learned_addr learned my addr 172.21.15.104:0/2815748688 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:27.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f96ae41f700 1 -- 172.21.15.104:0/3167957547 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96a806efd0 msgr2=0x7f96a80c75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f96ae41f700 1 --2- 172.21.15.104:0/3167957547 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96a806efd0 0x7f96a80c75e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f969c0098e0 tx=0x7f969c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f96ae41f700 1 -- 172.21.15.104:0/3167957547 shutdown_connections 2024-08-17T02:22:27.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f96ae41f700 1 --2- 172.21.15.104:0/3167957547 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96a806efd0 0x7f96a80c75e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f96ae41f700 1 --2- 172.21.15.104:0/3167957547 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a8159250 0x7f96a80c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f96ae41f700 1 -- 172.21.15.104:0/3167957547 >> 172.21.15.104:0/3167957547 conn(0x7f96a806e210 msgr2=0x7f96a806e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:27.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f96ae41f700 1 -- 172.21.15.104:0/3167957547 shutdown_connections 2024-08-17T02:22:27.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7ffa120bb700 1 -- 172.21.15.104:0/2815748688 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa0c156ee0 msgr2=0x7ffa0c099180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7ffa120bb700 1 --2- 172.21.15.104:0/2815748688 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa0c156ee0 0x7ffa0c099180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7ffa120bb700 1 -- 172.21.15.104:0/2815748688 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa0c0aa520 msgr2=0x7ffa0c0ac100 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:22:27.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f96ae41f700 1 -- 172.21.15.104:0/3167957547 wait complete. 2024-08-17T02:22:27.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7ffa120bb700 1 --2- 172.21.15.104:0/2815748688 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa0c0aa520 0x7ffa0c0ac100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f66fdd9b700 1 --2- 172.21.15.104:0/1077922304 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6700156fb0 0x7f67000c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7fd496952700 1 -- 172.21.15.104:0/2493210532 wait complete. 2024-08-17T02:22:27.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f66fe59c700 1 -- 172.21.15.104:0/1077922304 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6700156fb0 msgr2=0x7f67000c7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f66fe59c700 1 --2- 172.21.15.104:0/1077922304 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6700156fb0 0x7f67000c7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f66fe59c700 1 -- 172.21.15.104:0/1077922304 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f670015d6b0 msgr2=0x7f67000c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f66fe59c700 1 --2- 172.21.15.104:0/1077922304 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f670015d6b0 0x7f67000c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f66fe59c700 1 -- 172.21.15.104:0/1077922304 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f0009420 con 0x7f67000cafa0 2024-08-17T02:22:27.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f66fed9d700 1 --2- 172.21.15.104:0/1077922304 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f670015d6b0 0x7f67000c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:22:27.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f66fe59c700 1 --2- 172.21.15.104:0/1077922304 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67000cafa0 0x7f67000c76a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f66f0016000 tx=0x7f66f0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f66ee7fc700 1 -- 172.21.15.104:0/1077922304 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f0011900 con 0x7f67000cafa0 2024-08-17T02:22:27.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f66ee7fc700 1 -- 172.21.15.104:0/1077922304 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f0011a80 con 0x7f67000cafa0 2024-08-17T02:22:27.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f6704c3e700 1 -- 172.21.15.104:0/1077922304 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67000b20a0 con 0x7f67000cafa0 2024-08-17T02:22:27.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f66ee7fc700 1 -- 172.21.15.104:0/1077922304 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f001a680 con 0x7f67000cafa0 2024-08-17T02:22:27.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f6704c3e700 1 -- 172.21.15.104:0/1077922304 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f670015d2b0 con 0x7f67000cafa0 2024-08-17T02:22:27.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7ffa120bb700 1 -- 172.21.15.104:0/2815748688 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa08009420 con 0x7ffa0c06a750 2024-08-17T02:22:27.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.918+0000 7f6a06376700 1 -- 172.21.15.104:0/3180794022 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69e00052b0 con 0x7f6a000aa440 2024-08-17T02:22:27.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f69e7fff700 1 -- 172.21.15.104:0/3180794022 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f69f001a400 con 0x7f6a000aa440 2024-08-17T02:22:27.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f69e7fff700 1 --2- 172.21.15.104:0/3180794022 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f69ec0608e0 0x7f69ec062d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f69e7fff700 1 -- 172.21.15.104:0/3180794022 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f69f007c5c0 con 0x7f6a000aa440 2024-08-17T02:22:27.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7fd496952700 1 Processor -- start 2024-08-17T02:22:27.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f8d509b2700 1 -- 172.21.15.104:0/65316973 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d300052b0 con 0x7f8d4c0adf10 2024-08-17T02:22:27.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f8d3a7fc700 1 -- 172.21.15.104:0/65316973 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8d4001e460 con 0x7f8d4c0adf10 2024-08-17T02:22:27.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f8d3a7fc700 1 --2- 172.21.15.104:0/65316973 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8d2c0608e0 0x7f8d2c062d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f8d3a7fc700 1 -- 172.21.15.104:0/65316973 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8d4007d2e0 con 0x7f8d4c0adf10 2024-08-17T02:22:27.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f8d4a59c700 1 --2- 172.21.15.104:0/65316973 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8d2c0608e0 0x7f8d2c062d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7fb177076700 1 -- 172.21.15.104:0/2653676836 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1700970e0 con 0x7fb1701664a0 2024-08-17T02:22:27.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f6ebffff700 1 -- 172.21.15.104:0/2423127478 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed0023640 con 0x7f6ed81556f0 2024-08-17T02:22:27.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7fb177076700 1 -- 172.21.15.104:0/2653676836 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb170176330 con 0x7fb1701664a0 2024-08-17T02:22:27.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f6ebffff700 1 -- 172.21.15.104:0/2423127478 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed00237a0 con 0x7f6ed81556f0 2024-08-17T02:22:27.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f69ff7fe700 1 --2- 172.21.15.104:0/3180794022 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f69ec0608e0 0x7f69ec062d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f6704c3e700 1 -- 172.21.15.104:0/1077922304 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66e40052b0 con 0x7f67000cafa0 2024-08-17T02:22:27.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7ffa120bb700 1 --2- 172.21.15.104:0/2815748688 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffa0c06a750 0x7ffa0c06eed0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ffa04013ab0 tx=0x7ffa040143c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f8d4a59c700 1 --2- 172.21.15.104:0/65316973 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8d2c0608e0 0x7f8d2c062d90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c00ac00 tx=0x7f8d3c006f90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f69ff7fe700 1 --2- 172.21.15.104:0/3180794022 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f69ec0608e0 0x7f69ec062d90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6a00097ab0 tx=0x7f69f4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f6ebffff700 1 -- 172.21.15.104:0/2423127478 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed0023b60 con 0x7f6ed81556f0 2024-08-17T02:22:27.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f6edd126700 1 -- 172.21.15.104:0/2423127478 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ed80ae340 con 0x7f6ed81556f0 2024-08-17T02:22:27.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f6edd126700 1 -- 172.21.15.104:0/2423127478 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ed81545e0 con 0x7f6ed81556f0 2024-08-17T02:22:27.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f66ee7fc700 1 -- 172.21.15.104:0/1077922304 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f66f001aab0 con 0x7f67000cafa0 2024-08-17T02:22:27.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7fb177076700 1 -- 172.21.15.104:0/2653676836 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1700975c0 con 0x7fb1701664a0 2024-08-17T02:22:27.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f96ae41f700 1 Processor -- start 2024-08-17T02:22:27.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f96ae41f700 1 -- start start 2024-08-17T02:22:27.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f96ae41f700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a806efd0 0x7f96a80b1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f96ae41f700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f96a80cbb80 0x7f96a814bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f96ae41f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96a8159250 0x7f96a814c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f96ae41f700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a80ad560 con 0x7f96a80cbb80 2024-08-17T02:22:27.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f96ae41f700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a80ac950 con 0x7f96a8159250 2024-08-17T02:22:27.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f96ae41f700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a80acc30 con 0x7f96a806efd0 2024-08-17T02:22:27.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f96a7fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a806efd0 0x7f96a80b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f96a7fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a806efd0 0x7f96a80b1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.104:44696/0 (socket says 172.21.15.104:44696) 2024-08-17T02:22:27.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f96a7fff700 1 -- 172.21.15.104:0/1480611757 learned_addr learned my addr 172.21.15.104:0/1480611757 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:27.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f66ee7fc700 1 --2- 172.21.15.104:0/1077922304 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f66e0060890 0x7f66e0062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f6ebdffb700 1 -- 172.21.15.104:0/2423127478 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eb00052b0 con 0x7f6ed81556f0 2024-08-17T02:22:27.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f96ac9bc700 1 --2- 172.21.15.104:0/1480611757 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96a8159250 0x7f96a814c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7fd496952700 1 -- start start 2024-08-17T02:22:27.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f66ee7fc700 1 -- 172.21.15.104:0/1077922304 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f66f007e670 con 0x7f67000cafa0 2024-08-17T02:22:27.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7fd496952700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd49006eb70 0x7fd490096cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7fd496952700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4900b0490 0x7fd49016d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7fd496952700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd4901503b0 0x7fd49016da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7fd496952700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd490097fa0 con 0x7fd4901503b0 2024-08-17T02:22:27.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7fd496952700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd490097390 con 0x7fd4900b0490 2024-08-17T02:22:27.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7fd496952700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd490097670 con 0x7fd49006eb70 2024-08-17T02:22:27.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7fd496151700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd4901503b0 0x7fd49016da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7fd495950700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd49006eb70 0x7fd490096cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f66fdd9b700 1 --2- 172.21.15.104:0/1077922304 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f66e0060890 0x7f66e0062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7fd496151700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd4901503b0 0x7fd49016da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42354/0 (socket says 172.21.15.104:42354) 2024-08-17T02:22:27.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7fd495950700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd49006eb70 0x7fd490096cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.104:44706/0 (socket says 172.21.15.104:44706) 2024-08-17T02:22:27.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7fd496151700 1 -- 172.21.15.104:0/3765474476 learned_addr learned my addr 172.21.15.104:0/3765474476 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:27.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f96a77fe700 1 --2- 172.21.15.104:0/1480611757 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f96a80cbb80 0x7f96a814bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f96a7fff700 1 -- 172.21.15.104:0/1480611757 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96a8159250 msgr2=0x7f96a814c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f96a7fff700 1 --2- 172.21.15.104:0/1480611757 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96a8159250 0x7f96a814c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f96a7fff700 1 -- 172.21.15.104:0/1480611757 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f96a80cbb80 msgr2=0x7f96a814bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f96a7fff700 1 --2- 172.21.15.104:0/1480611757 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f96a80cbb80 0x7f96a814bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.922+0000 7f96a7fff700 1 -- 172.21.15.104:0/1480611757 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96980094f0 con 0x7f96a806efd0 2024-08-17T02:22:27.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.926+0000 7fd496151700 1 -- 172.21.15.104:0/3765474476 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd49006eb70 msgr2=0x7fd490096cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.926+0000 7fd496151700 1 --2- 172.21.15.104:0/3765474476 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd49006eb70 0x7fd490096cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.926+0000 7fd496151700 1 -- 172.21.15.104:0/3765474476 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4900b0490 msgr2=0x7fd49016d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:27.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.926+0000 7fd496151700 1 --2- 172.21.15.104:0/3765474476 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4900b0490 0x7fd49016d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:27.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.926+0000 7fd496151700 1 -- 172.21.15.104:0/3765474476 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd48c00b790 con 0x7fd4901503b0 2024-08-17T02:22:27.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.926+0000 7f96a7fff700 1 --2- 172.21.15.104:0/1480611757 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a806efd0 0x7f96a80b1510 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f969800ec50 tx=0x7f9698009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.926+0000 7f66fdd9b700 1 --2- 172.21.15.104:0/1077922304 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f66e0060890 0x7f66e0062d40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f67000cfa80 tx=0x7f66f4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.926+0000 7fd496151700 1 --2- 172.21.15.104:0/3765474476 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd4901503b0 0x7fd49016da00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd48800bc30 tx=0x7fd488009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.926+0000 7f968ffff700 1 -- 172.21.15.104:0/1480611757 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969800c850 con 0x7f96a806efd0 2024-08-17T02:22:27.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.930+0000 7f968ffff700 1 -- 172.21.15.104:0/1480611757 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969800c9b0 con 0x7f96a806efd0 2024-08-17T02:22:27.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.930+0000 7f96ae41f700 1 -- 172.21.15.104:0/1480611757 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f969c009420 con 0x7f96a806efd0 2024-08-17T02:22:27.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.930+0000 7f968ffff700 1 -- 172.21.15.104:0/1480611757 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969800cd30 con 0x7f96a806efd0 2024-08-17T02:22:27.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.930+0000 7f96ae41f700 1 -- 172.21.15.104:0/1480611757 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96a80ad1f0 con 0x7f96a806efd0 2024-08-17T02:22:27.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.930+0000 7f69e7fff700 1 -- 172.21.15.104:0/3180794022 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f69f0050480 con 0x7f6a000aa440 2024-08-17T02:22:27.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.930+0000 7ffa027fc700 1 -- 172.21.15.104:0/2815748688 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa040112e0 con 0x7ffa0c06a750 2024-08-17T02:22:27.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.930+0000 7ffa1431f700 1 -- 172.21.15.104:0/2815748688 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa0c0ad5e0 con 0x7ffa0c06a750 2024-08-17T02:22:27.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.930+0000 7ffa1431f700 1 -- 172.21.15.104:0/2815748688 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa0c06f410 con 0x7ffa0c06a750 2024-08-17T02:22:27.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.930+0000 7f96ae41f700 1 -- 172.21.15.104:0/1480611757 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96a80645c0 con 0x7f96a806efd0 2024-08-17T02:22:27.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.930+0000 7ffa1431f700 1 -- 172.21.15.104:0/2815748688 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa0c0abe20 con 0x7ffa0c06a750 2024-08-17T02:22:27.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.930+0000 7f968ffff700 1 -- 172.21.15.104:0/1480611757 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9698013680 con 0x7f96a806efd0 2024-08-17T02:22:27.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.930+0000 7f968ffff700 1 --2- 172.21.15.104:0/1480611757 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f9694060860 0x7f9694062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.930+0000 7f968ffff700 1 -- 172.21.15.104:0/1480611757 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f969807cf30 con 0x7f96a806efd0 2024-08-17T02:22:27.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.930+0000 7f96a77fe700 1 --2- 172.21.15.104:0/1480611757 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f9694060860 0x7f9694062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.930+0000 7f96a77fe700 1 --2- 172.21.15.104:0/1480611757 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f9694060860 0x7f9694062d10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f969c0030c0 tx=0x7f969c016000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.934+0000 7f8d3a7fc700 1 -- 172.21.15.104:0/65316973 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f8d4004d690 con 0x7f8d4c0adf10 2024-08-17T02:22:27.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.934+0000 7f6ebffff700 1 -- 172.21.15.104:0/2423127478 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6ed0003030 con 0x7f6ed81556f0 2024-08-17T02:22:27.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.934+0000 7f6ebffff700 1 --2- 172.21.15.104:0/2423127478 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f6ec4060930 0x7f6ec4062de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.934+0000 7f6ed7fff700 1 --2- 172.21.15.104:0/2423127478 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f6ec4060930 0x7f6ec4062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.934+0000 7f6ed7fff700 1 --2- 172.21.15.104:0/2423127478 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f6ec4060930 0x7f6ec4062de0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6ec80093f0 tx=0x7f6ec8017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.934+0000 7f968ffff700 1 -- 172.21.15.104:0/1480611757 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f969804d380 con 0x7f96a806efd0 2024-08-17T02:22:27.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.938+0000 7fd485ffb700 1 -- 172.21.15.104:0/3765474476 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48800c900 con 0x7fd4901503b0 2024-08-17T02:22:27.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.938+0000 7fd496952700 1 -- 172.21.15.104:0/3765474476 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd490097950 con 0x7fd4901503b0 2024-08-17T02:22:27.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.938+0000 7fd496952700 1 -- 172.21.15.104:0/3765474476 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4900c80e0 con 0x7fd4901503b0 2024-08-17T02:22:27.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.938+0000 7f66ee7fc700 1 -- 172.21.15.104:0/1077922304 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f66f004eac0 con 0x7f67000cafa0 2024-08-17T02:22:27.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.938+0000 7f6ebffff700 1 -- 172.21.15.104:0/2423127478 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6ed0062b00 con 0x7f6ed81556f0 2024-08-17T02:22:27.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.938+0000 7ffa027fc700 1 -- 172.21.15.104:0/2815748688 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa04011650 con 0x7ffa0c06a750 2024-08-17T02:22:27.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.938+0000 7ffa027fc700 1 -- 172.21.15.104:0/2815748688 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa04011800 con 0x7ffa0c06a750 2024-08-17T02:22:27.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.938+0000 7fb16cff9700 1 -- 172.21.15.104:0/2653676836 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb164004c00 con 0x7fb1701664a0 2024-08-17T02:22:27.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.938+0000 7fd485ffb700 1 -- 172.21.15.104:0/3765474476 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd48800cc70 con 0x7fd4901503b0 2024-08-17T02:22:27.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.938+0000 7fb16cff9700 1 --2- 172.21.15.104:0/2653676836 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb15c060860 0x7fb15c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.938+0000 7fb16cff9700 1 -- 172.21.15.104:0/2653676836 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb16407cfc0 con 0x7fb1701664a0 2024-08-17T02:22:27.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.938+0000 7fb174e12700 1 --2- 172.21.15.104:0/2653676836 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb15c060860 0x7fb15c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.938+0000 7fd485ffb700 1 -- 172.21.15.104:0/3765474476 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48800ce20 con 0x7fd4901503b0 2024-08-17T02:22:27.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.942+0000 7fd496952700 1 -- 172.21.15.104:0/3765474476 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4700052b0 con 0x7fd4901503b0 2024-08-17T02:22:27.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.942+0000 7fb174e12700 1 --2- 172.21.15.104:0/2653676836 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb15c060860 0x7fb15c062d10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb1600093f0 tx=0x7fb160017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:27.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.946+0000 7f6ebffff700 1 -- 172.21.15.104:0/2423127478 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f6ed005e700 con 0x7f6ed81556f0 2024-08-17T02:22:27.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.950+0000 7fd485ffb700 1 -- 172.21.15.104:0/3765474476 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd488014620 con 0x7fd4901503b0 2024-08-17T02:22:27.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.950+0000 7fd485ffb700 1 --2- 172.21.15.104:0/3765474476 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fd474060860 0x7fd474062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.950+0000 7ffa027fc700 1 -- 172.21.15.104:0/2815748688 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ffa04011960 con 0x7ffa0c06a750 2024-08-17T02:22:27.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.950+0000 7ffa027fc700 1 --2- 172.21.15.104:0/2815748688 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff9f0060860 0x7ff9f0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:27.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.950+0000 7ffa118ba700 1 --2- 172.21.15.104:0/2815748688 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff9f0060860 0x7ff9f0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.950+0000 7fd495950700 1 --2- 172.21.15.104:0/3765474476 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fd474060860 0x7fd474062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:27.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.950+0000 7ffa118ba700 1 --2- 172.21.15.104:0/2815748688 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff9f0060860 0x7ff9f0062d10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c0aa8f0 tx=0x7ffa08016000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:28.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.950+0000 7fd495950700 1 --2- 172.21.15.104:0/3765474476 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fd474060860 0x7fd474062d10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd4900adfe0 tx=0x7fd480006f90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:28.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.958+0000 7fb16cff9700 1 -- 172.21.15.104:0/2653676836 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb16404d490 con 0x7fb1701664a0 2024-08-17T02:22:28.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.958+0000 7ffa027fc700 1 -- 172.21.15.104:0/2815748688 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffa0405ad70 con 0x7ffa0c06a750 2024-08-17T02:22:28.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.958+0000 7fd485ffb700 1 -- 172.21.15.104:0/3765474476 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd488051d30 con 0x7fd4901503b0 2024-08-17T02:22:28.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.966+0000 7ffa027fc700 1 -- 172.21.15.104:0/2815748688 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ffa0405a400 con 0x7ffa0c06a750 2024-08-17T02:22:28.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:27.974+0000 7fd485ffb700 1 -- 172.21.15.104:0/3765474476 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd48804d930 con 0x7fd4901503b0 2024-08-17T02:22:28.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.226+0000 7f8d509b2700 1 -- 172.21.15.104:0/65316973 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8d30005560 con 0x7f8d4c0adf10 2024-08-17T02:22:28.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.226+0000 7f8d3a7fc700 1 -- 172.21.15.104:0/65316973 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8d40050cb0 con 0x7f8d4c0adf10 2024-08-17T02:22:28.234 INFO:teuthology.orchestra.run.smithi104.stdout:64424509447 2024-08-17T02:22:28.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.234+0000 7f8d2bfff700 1 -- 172.21.15.104:0/65316973 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8d2c0608e0 msgr2=0x7f8d2c062d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:28.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.234+0000 7f8d2bfff700 1 --2- 172.21.15.104:0/65316973 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8d2c0608e0 0x7f8d2c062d90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c00ac00 tx=0x7f8d3c006f90 comp rx=0 tx=0).stop 2024-08-17T02:22:28.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.234+0000 7f8d2bfff700 1 -- 172.21.15.104:0/65316973 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d4c0adf10 msgr2=0x7f8d4c0b0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:28.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.234+0000 7f8d2bfff700 1 --2- 172.21.15.104:0/65316973 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d4c0adf10 0x7f8d4c0b0190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8d4000d860 tx=0x7f8d40008040 comp rx=0 tx=0).stop 2024-08-17T02:22:28.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.234+0000 7f8d2bfff700 1 -- 172.21.15.104:0/65316973 shutdown_connections 2024-08-17T02:22:28.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.234+0000 7f8d2bfff700 1 --2- 172.21.15.104:0/65316973 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8d2c0608e0 0x7f8d2c062d90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.234+0000 7f8d2bfff700 1 --2- 172.21.15.104:0/65316973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d4c0cad40 0x7f8d4c0b14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.234+0000 7f8d2bfff700 1 --2- 172.21.15.104:0/65316973 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d4c0adf10 0x7f8d4c0b0190 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.234+0000 7f8d2bfff700 1 --2- 172.21.15.104:0/65316973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d4c06e470 0x7f8d4c097620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.234+0000 7f8d2bfff700 1 -- 172.21.15.104:0/65316973 >> 172.21.15.104:0/65316973 conn(0x7f8d4c067810 msgr2=0x7f8d4c160770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:28.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.234+0000 7f8d2bfff700 1 -- 172.21.15.104:0/65316973 shutdown_connections 2024-08-17T02:22:28.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.234+0000 7f8d2bfff700 1 -- 172.21.15.104:0/65316973 wait complete. 2024-08-17T02:22:28.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.238+0000 7f6a06376700 1 -- 172.21.15.104:0/3180794022 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f69e0005560 con 0x7f6a000aa440 2024-08-17T02:22:28.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.238+0000 7f69e7fff700 1 -- 172.21.15.104:0/3180794022 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f69f007ae60 con 0x7f6a000aa440 2024-08-17T02:22:28.249 INFO:teuthology.orchestra.run.smithi104.stdout:64424509448 2024-08-17T02:22:28.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.246+0000 7f69e5ffb700 1 -- 172.21.15.104:0/3180794022 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f69ec0608e0 msgr2=0x7f69ec062d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:28.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.246+0000 7f69e5ffb700 1 --2- 172.21.15.104:0/3180794022 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f69ec0608e0 0x7f69ec062d90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6a00097ab0 tx=0x7f69f4008040 comp rx=0 tx=0).stop 2024-08-17T02:22:28.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.246+0000 7f69e5ffb700 1 -- 172.21.15.104:0/3180794022 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6a000aa440 msgr2=0x7f6a00176a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:28.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.246+0000 7f69e5ffb700 1 --2- 172.21.15.104:0/3180794022 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6a000aa440 0x7f6a00176a30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f69f000b5e0 tx=0x7f69f00090f0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.246+0000 7f69e5ffb700 1 -- 172.21.15.104:0/3180794022 shutdown_connections 2024-08-17T02:22:28.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.246+0000 7f69e5ffb700 1 --2- 172.21.15.104:0/3180794022 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f69ec0608e0 0x7f69ec062d90 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.246+0000 7f69e5ffb700 1 --2- 172.21.15.104:0/3180794022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a001593b0 0x7f6a00179620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.246+0000 7f69e5ffb700 1 --2- 172.21.15.104:0/3180794022 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6a000b0d40 0x7f6a00156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.246+0000 7f69e5ffb700 1 --2- 172.21.15.104:0/3180794022 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6a000aa440 0x7f6a00176a30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.246+0000 7f69e5ffb700 1 -- 172.21.15.104:0/3180794022 >> 172.21.15.104:0/3180794022 conn(0x7f6a00068300 msgr2=0x7f6a000c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:28.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.246+0000 7f69e5ffb700 1 -- 172.21.15.104:0/3180794022 shutdown_connections 2024-08-17T02:22:28.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.246+0000 7f69e5ffb700 1 -- 172.21.15.104:0/3180794022 wait complete. 2024-08-17T02:22:28.254 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.0 2024-08-17T02:22:28.255 DEBUG:teuthology.parallel:result is None 2024-08-17T02:22:28.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.250+0000 7f96ae41f700 1 -- 172.21.15.104:0/1480611757 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f96a80c9160 con 0x7f96a806efd0 2024-08-17T02:22:28.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.250+0000 7f968ffff700 1 -- 172.21.15.104:0/1480611757 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9698017090 con 0x7f96a806efd0 2024-08-17T02:22:28.258 INFO:teuthology.orchestra.run.smithi104.stdout:60129542152 2024-08-17T02:22:28.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.254+0000 7f96ae41f700 1 -- 172.21.15.104:0/1480611757 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f9694060860 msgr2=0x7f9694062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:28.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.254+0000 7f96ae41f700 1 --2- 172.21.15.104:0/1480611757 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f9694060860 0x7f9694062d10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f969c0030c0 tx=0x7f969c016000 comp rx=0 tx=0).stop 2024-08-17T02:22:28.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.254+0000 7f96ae41f700 1 -- 172.21.15.104:0/1480611757 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a806efd0 msgr2=0x7f96a80b1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:28.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.254+0000 7f96ae41f700 1 --2- 172.21.15.104:0/1480611757 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a806efd0 0x7f96a80b1510 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f969800ec50 tx=0x7f9698009250 comp rx=0 tx=0).stop 2024-08-17T02:22:28.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.254+0000 7f96ae41f700 1 -- 172.21.15.104:0/1480611757 shutdown_connections 2024-08-17T02:22:28.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.254+0000 7f96ae41f700 1 --2- 172.21.15.104:0/1480611757 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f9694060860 0x7f9694062d10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.254+0000 7f96ae41f700 1 --2- 172.21.15.104:0/1480611757 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96a8159250 0x7f96a814c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.254+0000 7f96ae41f700 1 --2- 172.21.15.104:0/1480611757 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f96a80cbb80 0x7f96a814bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.254+0000 7f96ae41f700 1 --2- 172.21.15.104:0/1480611757 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a806efd0 0x7f96a80b1510 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.254+0000 7f96ae41f700 1 -- 172.21.15.104:0/1480611757 >> 172.21.15.104:0/1480611757 conn(0x7f96a806e210 msgr2=0x7f96a80c4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:28.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.254+0000 7f96ae41f700 1 -- 172.21.15.104:0/1480611757 shutdown_connections 2024-08-17T02:22:28.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.254+0000 7f96ae41f700 1 -- 172.21.15.104:0/1480611757 wait complete. 2024-08-17T02:22:28.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.258+0000 7f6ebdffb700 1 -- 172.21.15.104:0/2423127478 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6eb0005830 con 0x7f6ed81556f0 2024-08-17T02:22:28.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.258+0000 7f6ebffff700 1 -- 172.21.15.104:0/2423127478 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6ed0061d20 con 0x7f6ed81556f0 2024-08-17T02:22:28.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.258+0000 7f6704c3e700 1 -- 172.21.15.104:0/1077922304 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f66e4005830 con 0x7f67000cafa0 2024-08-17T02:22:28.264 INFO:teuthology.orchestra.run.smithi104.stdout:64424509447 2024-08-17T02:22:28.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.258+0000 7f66ee7fc700 1 -- 172.21.15.104:0/1077922304 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f66f002eed0 con 0x7f67000cafa0 2024-08-17T02:22:28.265 INFO:teuthology.orchestra.run.smithi104.stdout:64424509447 2024-08-17T02:22:28.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.258+0000 7f6ebdffb700 1 -- 172.21.15.104:0/2423127478 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f6ec4060930 msgr2=0x7f6ec4062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:28.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.258+0000 7f6ebdffb700 1 --2- 172.21.15.104:0/2423127478 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f6ec4060930 0x7f6ec4062de0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6ec80093f0 tx=0x7f6ec8017000 comp rx=0 tx=0).stop 2024-08-17T02:22:28.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.258+0000 7f6ebdffb700 1 -- 172.21.15.104:0/2423127478 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ed81556f0 msgr2=0x7f6ed80ab1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:28.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.258+0000 7f6ebdffb700 1 --2- 172.21.15.104:0/2423127478 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ed81556f0 0x7f6ed80ab1f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6ed001d7d0 tx=0x7f6ed00015f0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.258+0000 7f6704c3e700 1 -- 172.21.15.104:0/1077922304 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f66e0060890 msgr2=0x7f66e0062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:28.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.258+0000 7f6704c3e700 1 --2- 172.21.15.104:0/1077922304 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f66e0060890 0x7f66e0062d40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f67000cfa80 tx=0x7f66f4009040 comp rx=0 tx=0).stop 2024-08-17T02:22:28.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.262+0000 7f6704c3e700 1 -- 172.21.15.104:0/1077922304 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67000cafa0 msgr2=0x7f67000c76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:28.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.262+0000 7f6704c3e700 1 --2- 172.21.15.104:0/1077922304 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67000cafa0 0x7f67000c76a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f66f0016000 tx=0x7f66f0017000 comp rx=0 tx=0).stop 2024-08-17T02:22:28.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.262+0000 7f6704c3e700 1 -- 172.21.15.104:0/1077922304 shutdown_connections 2024-08-17T02:22:28.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.262+0000 7f6704c3e700 1 --2- 172.21.15.104:0/1077922304 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f66e0060890 0x7f66e0062d40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.262+0000 7f6704c3e700 1 --2- 172.21.15.104:0/1077922304 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f670015d6b0 0x7f67000c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.262+0000 7f6704c3e700 1 --2- 172.21.15.104:0/1077922304 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6700156fb0 0x7f67000c7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.262+0000 7f6704c3e700 1 --2- 172.21.15.104:0/1077922304 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67000cafa0 0x7f67000c76a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.262+0000 7f6704c3e700 1 -- 172.21.15.104:0/1077922304 >> 172.21.15.104:0/1077922304 conn(0x7f6700099500 msgr2=0x7f67000ceee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:28.269 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.7 2024-08-17T02:22:28.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.262+0000 7f6ebdffb700 1 -- 172.21.15.104:0/2423127478 shutdown_connections 2024-08-17T02:22:28.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.262+0000 7f6ebdffb700 1 --2- 172.21.15.104:0/2423127478 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f6ec4060930 0x7f6ec4062de0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.262+0000 7f6704c3e700 1 -- 172.21.15.104:0/1077922304 shutdown_connections 2024-08-17T02:22:28.270 DEBUG:teuthology.parallel:result is None 2024-08-17T02:22:28.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.262+0000 7f6ebdffb700 1 --2- 172.21.15.104:0/2423127478 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ed81556f0 0x7f6ed80ab1f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.262+0000 7f6ebdffb700 1 --2- 172.21.15.104:0/2423127478 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ed813e250 0x7f6ed80aacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.262+0000 7f6ebdffb700 1 --2- 172.21.15.104:0/2423127478 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ed806e140 0x7f6ed81540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.262+0000 7f6ebdffb700 1 -- 172.21.15.104:0/2423127478 >> 172.21.15.104:0/2423127478 conn(0x7f6ed80678d0 msgr2=0x7f6ed80a6630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:28.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.262+0000 7f6704c3e700 1 -- 172.21.15.104:0/1077922304 wait complete. 2024-08-17T02:22:28.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.262+0000 7f6ebdffb700 1 -- 172.21.15.104:0/2423127478 shutdown_connections 2024-08-17T02:22:28.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.262+0000 7f6ebdffb700 1 -- 172.21.15.104:0/2423127478 wait complete. 2024-08-17T02:22:28.273 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.6 2024-08-17T02:22:28.273 DEBUG:teuthology.parallel:result is None 2024-08-17T02:22:28.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.270+0000 7fb177076700 1 -- 172.21.15.104:0/2653676836 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb170070360 con 0x7fb1701664a0 2024-08-17T02:22:28.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.270+0000 7fb16cff9700 1 -- 172.21.15.104:0/2653676836 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb164050ab0 con 0x7fb1701664a0 2024-08-17T02:22:28.278 INFO:teuthology.orchestra.run.smithi104.stdout:64424509448 2024-08-17T02:22:28.281 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.3 2024-08-17T02:22:28.281 DEBUG:teuthology.parallel:result is None 2024-08-17T02:22:28.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.274+0000 7fb177076700 1 -- 172.21.15.104:0/2653676836 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb15c060860 msgr2=0x7fb15c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:28.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.274+0000 7fb177076700 1 --2- 172.21.15.104:0/2653676836 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb15c060860 0x7fb15c062d10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb1600093f0 tx=0x7fb160017000 comp rx=0 tx=0).stop 2024-08-17T02:22:28.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.274+0000 7fb177076700 1 -- 172.21.15.104:0/2653676836 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1701664a0 msgr2=0x7fb1700c2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:28.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.274+0000 7fb177076700 1 --2- 172.21.15.104:0/2653676836 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1701664a0 0x7fb1700c2b60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb16400c5d0 tx=0x7fb164006c80 comp rx=0 tx=0).stop 2024-08-17T02:22:28.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.274+0000 7fb177076700 1 -- 172.21.15.104:0/2653676836 shutdown_connections 2024-08-17T02:22:28.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.274+0000 7fb177076700 1 --2- 172.21.15.104:0/2653676836 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb15c060860 0x7fb15c062d10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.274+0000 7fb177076700 1 --2- 172.21.15.104:0/2653676836 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1701664a0 0x7fb1700c2b60 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.274+0000 7fb177076700 1 --2- 172.21.15.104:0/2653676836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1700ae5b0 0x7fb1700c1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.274+0000 7fb177076700 1 --2- 172.21.15.104:0/2653676836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1700879f0 0x7fb170175df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.274+0000 7fb177076700 1 -- 172.21.15.104:0/2653676836 >> 172.21.15.104:0/2653676836 conn(0x7fb170068300 msgr2=0x7fb1700b0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:28.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.274+0000 7fb177076700 1 -- 172.21.15.104:0/2653676836 shutdown_connections 2024-08-17T02:22:28.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.274+0000 7fb177076700 1 -- 172.21.15.104:0/2653676836 wait complete. 2024-08-17T02:22:28.284 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.2 2024-08-17T02:22:28.284 DEBUG:teuthology.parallel:result is None 2024-08-17T02:22:28.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.278+0000 7ffa1431f700 1 -- 172.21.15.104:0/2815748688 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7ffa0c0abe20 con 0x7ffa0c06a750 2024-08-17T02:22:28.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.278+0000 7ffa027fc700 1 -- 172.21.15.104:0/2815748688 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffa0c0abe20 con 0x7ffa0c06a750 2024-08-17T02:22:28.285 INFO:teuthology.orchestra.run.smithi104.stdout:64424509447 2024-08-17T02:22:28.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.278+0000 7fd496952700 1 -- 172.21.15.104:0/3765474476 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fd470005830 con 0x7fd4901503b0 2024-08-17T02:22:28.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.282+0000 7fd485ffb700 1 -- 172.21.15.104:0/3765474476 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd488022030 con 0x7fd4901503b0 2024-08-17T02:22:28.287 INFO:teuthology.orchestra.run.smithi104.stdout:64424509447 2024-08-17T02:22:28.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.282+0000 7ffa1431f700 1 -- 172.21.15.104:0/2815748688 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff9f0060860 msgr2=0x7ff9f0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:28.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.282+0000 7ffa1431f700 1 --2- 172.21.15.104:0/2815748688 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff9f0060860 0x7ff9f0062d10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c0aa8f0 tx=0x7ffa08016000 comp rx=0 tx=0).stop 2024-08-17T02:22:28.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.282+0000 7ffa1431f700 1 -- 172.21.15.104:0/2815748688 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffa0c06a750 msgr2=0x7ffa0c06eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:28.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.282+0000 7ffa1431f700 1 --2- 172.21.15.104:0/2815748688 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffa0c06a750 0x7ffa0c06eed0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ffa04013ab0 tx=0x7ffa040143c0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.282+0000 7ffa1431f700 1 -- 172.21.15.104:0/2815748688 shutdown_connections 2024-08-17T02:22:28.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.282+0000 7ffa1431f700 1 --2- 172.21.15.104:0/2815748688 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff9f0060860 0x7ff9f0062d10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.282+0000 7ffa1431f700 1 --2- 172.21.15.104:0/2815748688 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa0c156ee0 0x7ffa0c099180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.282+0000 7ffa1431f700 1 --2- 172.21.15.104:0/2815748688 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa0c0aa520 0x7ffa0c0ac100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.282+0000 7ffa1431f700 1 --2- 172.21.15.104:0/2815748688 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffa0c06a750 0x7ffa0c06eed0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.282+0000 7ffa1431f700 1 -- 172.21.15.104:0/2815748688 >> 172.21.15.104:0/2815748688 conn(0x7ffa0c068300 msgr2=0x7ffa0c06b540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:28.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.282+0000 7ffa1431f700 1 -- 172.21.15.104:0/2815748688 shutdown_connections 2024-08-17T02:22:28.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.282+0000 7ffa1431f700 1 -- 172.21.15.104:0/2815748688 wait complete. 2024-08-17T02:22:28.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.282+0000 7fd496952700 1 -- 172.21.15.104:0/3765474476 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fd474060860 msgr2=0x7fd474062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:28.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.282+0000 7fd496952700 1 --2- 172.21.15.104:0/3765474476 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fd474060860 0x7fd474062d10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd4900adfe0 tx=0x7fd480006f90 comp rx=0 tx=0).stop 2024-08-17T02:22:28.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.282+0000 7fd496952700 1 -- 172.21.15.104:0/3765474476 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd4901503b0 msgr2=0x7fd49016da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:28.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.282+0000 7fd496952700 1 --2- 172.21.15.104:0/3765474476 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd4901503b0 0x7fd49016da00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd48800bc30 tx=0x7fd488009820 comp rx=0 tx=0).stop 2024-08-17T02:22:28.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.282+0000 7fd496952700 1 -- 172.21.15.104:0/3765474476 shutdown_connections 2024-08-17T02:22:28.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.282+0000 7fd496952700 1 --2- 172.21.15.104:0/3765474476 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fd474060860 0x7fd474062d10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.282+0000 7fd496952700 1 --2- 172.21.15.104:0/3765474476 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd4901503b0 0x7fd49016da00 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.282+0000 7fd496952700 1 --2- 172.21.15.104:0/3765474476 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4900b0490 0x7fd49016d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.282+0000 7fd496952700 1 --2- 172.21.15.104:0/3765474476 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd49006eb70 0x7fd490096cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.282+0000 7fd496952700 1 -- 172.21.15.104:0/3765474476 >> 172.21.15.104:0/3765474476 conn(0x7fd490066e00 msgr2=0x7fd49006aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:28.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.282+0000 7fd496952700 1 -- 172.21.15.104:0/3765474476 shutdown_connections 2024-08-17T02:22:28.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.282+0000 7fd496952700 1 -- 172.21.15.104:0/3765474476 wait complete. 2024-08-17T02:22:28.292 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.1 2024-08-17T02:22:28.292 DEBUG:teuthology.parallel:result is None 2024-08-17T02:22:28.298 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.5 2024-08-17T02:22:28.298 DEBUG:teuthology.parallel:result is None 2024-08-17T02:22:28.299 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.4 2024-08-17T02:22:28.299 DEBUG:teuthology.parallel:result is None 2024-08-17T02:22:28.299 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-17T02:22:28.299 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:22:28.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.438+0000 7f54c9031700 1 Processor -- start 2024-08-17T02:22:28.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.438+0000 7f54c9031700 1 -- start start 2024-08-17T02:22:28.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.438+0000 7f54c9031700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f54c4142ea0 0x7f54c40b1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:28.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.438+0000 7f54c9031700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c4141a00 con 0x7f54c40b0d20 2024-08-17T02:22:28.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.438+0000 7f54c9031700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c4140b10 con 0x7f54c406e620 2024-08-17T02:22:28.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.438+0000 7f54c9031700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c4140df0 con 0x7f54c4142ea0 2024-08-17T02:22:28.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.438+0000 7f54c3fff700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f54c40b0d20 0x7f54c406df10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:56778/0 (socket says 172.21.15.104:56778) 2024-08-17T02:22:28.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.438+0000 7f54c3fff700 1 -- 172.21.15.104:0/1712559491 learned_addr learned my addr 172.21.15.104:0/1712559491 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:28.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.438+0000 7f54c8830700 1 --2- 172.21.15.104:0/1712559491 >> v2:172.21.15.117:3300/0 conn(0x7f54c4142ea0 0x7f54c40b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:28.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.438+0000 7f54c2ffd700 1 -- 172.21.15.104:0/1712559491 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 699278806 0 0) 0x7f54c4141a00 con 0x7f54c40b0d20 2024-08-17T02:22:28.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.438+0000 7f54c2ffd700 1 -- 172.21.15.104:0/1712559491 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54ac003570 con 0x7f54c40b0d20 2024-08-17T02:22:28.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.438+0000 7f54c2ffd700 1 -- 172.21.15.104:0/1712559491 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 579301345 0 0) 0x7f54c4140b10 con 0x7f54c406e620 2024-08-17T02:22:28.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.438+0000 7f54c2ffd700 1 -- 172.21.15.104:0/1712559491 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54c4141a00 con 0x7f54c406e620 2024-08-17T02:22:28.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.438+0000 7f54c2ffd700 1 -- 172.21.15.104:0/1712559491 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 265033502 0 0) 0x7f54ac003570 con 0x7f54c40b0d20 2024-08-17T02:22:28.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.438+0000 7f54c2ffd700 1 -- 172.21.15.104:0/1712559491 >> v2:172.21.15.117:3300/0 conn(0x7f54c4142ea0 msgr2=0x7f54c40b1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:28.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.438+0000 7f54c2ffd700 1 --2- 172.21.15.104:0/1712559491 >> v2:172.21.15.117:3300/0 conn(0x7f54c4142ea0 0x7f54c40b1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.438+0000 7f54c2ffd700 1 -- 172.21.15.104:0/1712559491 >> v1:172.21.15.117:6789/0 conn(0x7f54c406e620 legacy=0x7f54c40b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:28.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.438+0000 7f54c2ffd700 1 -- 172.21.15.104:0/1712559491 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c41410d0 con 0x7f54c40b0d20 2024-08-17T02:22:28.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.438+0000 7f54c2ffd700 1 -- 172.21.15.104:0/1712559491 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1279957748 0 0) 0x7f54b8001470 con 0x7f54c40b0d20 2024-08-17T02:22:28.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.438+0000 7f54c2ffd700 1 -- 172.21.15.104:0/1712559491 >> v1:172.21.15.104:6789/0 conn(0x7f54c40b0d20 legacy=0x7f54c406df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:28.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.438+0000 7f54c2ffd700 1 --2- 172.21.15.104:0/1712559491 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54ac003bf0 0x7f54ac003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:28.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.438+0000 7f54c2ffd700 1 --2- 172.21.15.104:0/1712559491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54ac004810 0x7f54ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:28.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.438+0000 7f54c2ffd700 1 --2- 172.21.15.104:0/1712559491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54ac0051c0 0x7f54ac00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:28.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.438+0000 7f54c2ffd700 1 -- 172.21.15.104:0/1712559491 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c4140df0 con 0x7f54ac003bf0 2024-08-17T02:22:28.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.438+0000 7f54c2ffd700 1 -- 172.21.15.104:0/1712559491 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ac00c0b0 con 0x7f54ac0051c0 2024-08-17T02:22:28.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.438+0000 7f54c2ffd700 1 -- 172.21.15.104:0/1712559491 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54ac00c270 con 0x7f54ac004810 2024-08-17T02:22:28.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.438+0000 7f54c3fff700 1 --2- 172.21.15.104:0/1712559491 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54ac003bf0 0x7f54ac003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:28.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.438+0000 7f54c8830700 1 --2- 172.21.15.104:0/1712559491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54ac0051c0 0x7f54ac00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:28.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.438+0000 7f54c37fe700 1 --2- 172.21.15.104:0/1712559491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54ac004810 0x7f54ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:28.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.438+0000 7f54c8830700 1 -- 172.21.15.104:0/1712559491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54ac004810 msgr2=0x7f54ac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:28.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.438+0000 7f54c8830700 1 --2- 172.21.15.104:0/1712559491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54ac004810 0x7f54ac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.438+0000 7f54c8830700 1 -- 172.21.15.104:0/1712559491 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54ac003bf0 msgr2=0x7f54ac003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:28.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.438+0000 7f54c8830700 1 --2- 172.21.15.104:0/1712559491 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54ac003bf0 0x7f54ac003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.438+0000 7f54c8830700 1 -- 172.21.15.104:0/1712559491 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ac003570 con 0x7f54ac0051c0 2024-08-17T02:22:28.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.438+0000 7f54c8830700 1 -- 172.21.15.104:0/1712559491 reap_dead start 2024-08-17T02:22:28.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.442+0000 7f54c8830700 1 --2- 172.21.15.104:0/1712559491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54ac0051c0 0x7f54ac00ba60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f54bc009c00 tx=0x7f54bc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95218b73461151c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:28.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.442+0000 7f54c2ffd700 1 -- 172.21.15.104:0/1712559491 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc00e710 con 0x7f54ac0051c0 2024-08-17T02:22:28.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.442+0000 7f54c2ffd700 1 -- 172.21.15.104:0/1712559491 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54bc00e870 con 0x7f54ac0051c0 2024-08-17T02:22:28.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.442+0000 7f54c2ffd700 1 -- 172.21.15.104:0/1712559491 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc00ec30 con 0x7f54ac0051c0 2024-08-17T02:22:28.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.442+0000 7f54c9031700 1 -- 172.21.15.104:0/1712559491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54ac0051c0 msgr2=0x7f54ac00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:28.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.442+0000 7f54c9031700 1 --2- 172.21.15.104:0/1712559491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54ac0051c0 0x7f54ac00ba60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f54bc009c00 tx=0x7f54bc0091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.442+0000 7f54c9031700 1 -- 172.21.15.104:0/1712559491 shutdown_connections 2024-08-17T02:22:28.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.442+0000 7f54c9031700 1 --2- 172.21.15.104:0/1712559491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54ac0051c0 0x7f54ac00ba60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.442+0000 7f54c9031700 1 -- 172.21.15.104:0/1712559491 >> 172.21.15.104:0/1712559491 conn(0x7f54c40678d0 msgr2=0x7f54c4067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:28.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.442+0000 7f54c9031700 1 -- 172.21.15.104:0/1712559491 shutdown_connections 2024-08-17T02:22:28.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.442+0000 7f54c9031700 1 -- 172.21.15.104:0/1712559491 wait complete. 2024-08-17T02:22:28.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.446+0000 7f54c9031700 1 Processor -- start 2024-08-17T02:22:28.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.446+0000 7f54c9031700 1 -- start start 2024-08-17T02:22:28.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.446+0000 7f54c9031700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54ac0051c0 0x7f54c4063060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:28.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.446+0000 7f54c9031700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54c40635a0 0x7f54c4171720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:28.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.446+0000 7f54c9031700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54c4171c60 0x7f54c416d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:28.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.446+0000 7f54c9031700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c40a6060 con 0x7f54c4171c60 2024-08-17T02:22:28.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.446+0000 7f54c9031700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c40639f0 con 0x7f54c40635a0 2024-08-17T02:22:28.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.446+0000 7f54c9031700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c40a64f0 con 0x7f54ac0051c0 2024-08-17T02:22:28.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.446+0000 7f54c8830700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54c4171c60 0x7f54c416d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:28.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.446+0000 7f54c8830700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54c4171c60 0x7f54c416d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42362/0 (socket says 172.21.15.104:42362) 2024-08-17T02:22:28.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.446+0000 7f54c8830700 1 -- 172.21.15.104:0/1376831813 learned_addr learned my addr 172.21.15.104:0/1376831813 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:28.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.446+0000 7f54c37fe700 1 --2- 172.21.15.104:0/1376831813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54c40635a0 0x7f54c4171720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:28.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.446+0000 7f54c3fff700 1 --2- 172.21.15.104:0/1376831813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54ac0051c0 0x7f54c4063060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:28.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.446+0000 7f54c8830700 1 -- 172.21.15.104:0/1376831813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54ac0051c0 msgr2=0x7f54c4063060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:28.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.446+0000 7f54c8830700 1 --2- 172.21.15.104:0/1376831813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54ac0051c0 0x7f54c4063060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.446+0000 7f54c8830700 1 -- 172.21.15.104:0/1376831813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54c40635a0 msgr2=0x7f54c4171720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:28.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.446+0000 7f54c8830700 1 --2- 172.21.15.104:0/1376831813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54c40635a0 0x7f54c4171720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.446+0000 7f54c8830700 1 -- 172.21.15.104:0/1376831813 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c40a5450 con 0x7f54c4171c60 2024-08-17T02:22:28.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.446+0000 7f54c3fff700 1 --2- 172.21.15.104:0/1376831813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54ac0051c0 0x7f54c4063060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:22:28.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.446+0000 7f54c8830700 1 --2- 172.21.15.104:0/1376831813 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54c4171c60 0x7f54c416d370 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f54c40cbb90 tx=0x7f54bc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:28.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.446+0000 7f54abfff700 1 -- 172.21.15.104:0/1376831813 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc022070 con 0x7f54c4171c60 2024-08-17T02:22:28.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.446+0000 7f54abfff700 1 -- 172.21.15.104:0/1376831813 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54bc00ebf0 con 0x7f54c4171c60 2024-08-17T02:22:28.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.446+0000 7f54c9031700 1 -- 172.21.15.104:0/1376831813 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54c40a5730 con 0x7f54c4171c60 2024-08-17T02:22:28.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.446+0000 7f54abfff700 1 -- 172.21.15.104:0/1376831813 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc006e50 con 0x7f54c4171c60 2024-08-17T02:22:28.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.446+0000 7f54c9031700 1 -- 172.21.15.104:0/1376831813 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c40a5cf0 con 0x7f54c4171c60 2024-08-17T02:22:28.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.450+0000 7f54c9031700 1 -- 172.21.15.104:0/1376831813 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54c40643a0 con 0x7f54c4171c60 2024-08-17T02:22:28.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.450+0000 7f54abfff700 1 -- 172.21.15.104:0/1376831813 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f54bc01c940 con 0x7f54c4171c60 2024-08-17T02:22:28.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.450+0000 7f54abfff700 1 --2- 172.21.15.104:0/1376831813 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f54b0060860 0x7f54b0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:28.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.450+0000 7f54abfff700 1 -- 172.21.15.104:0/1376831813 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f54bc07e3d0 con 0x7f54c4171c60 2024-08-17T02:22:28.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.450+0000 7f54c3fff700 1 --2- 172.21.15.104:0/1376831813 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f54b0060860 0x7f54b0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:28.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.450+0000 7f54c3fff700 1 --2- 172.21.15.104:0/1376831813 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f54b0060860 0x7f54b0062d10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f54b8001200 tx=0x7f54b8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:28.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.466+0000 7f54abfff700 1 -- 172.21.15.104:0/1376831813 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f54bc04e820 con 0x7f54c4171c60 2024-08-17T02:22:28.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.610+0000 7f54c9031700 1 -- 172.21.15.104:0/1376831813 --> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f54c406f5f0 con 0x7f54b0060860 2024-08-17T02:22:28.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.626+0000 7f54abfff700 1 -- 172.21.15.104:0/1376831813 <== mgr.4111 v2:172.21.15.117:6832/24084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264513 (secure 0 0 0) 0x7f54c406f5f0 con 0x7f54b0060860 2024-08-17T02:22:28.635 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:22:28.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.630+0000 7f54c9031700 1 -- 172.21.15.104:0/1376831813 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f54b0060860 msgr2=0x7f54b0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:28.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.630+0000 7f54c9031700 1 --2- 172.21.15.104:0/1376831813 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f54b0060860 0x7f54b0062d10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f54b8001200 tx=0x7f54b8009040 comp rx=0 tx=0).stop 2024-08-17T02:22:28.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.630+0000 7f54c9031700 1 -- 172.21.15.104:0/1376831813 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54c4171c60 msgr2=0x7f54c416d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:28.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.630+0000 7f54c9031700 1 --2- 172.21.15.104:0/1376831813 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54c4171c60 0x7f54c416d370 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f54c40cbb90 tx=0x7f54bc019000 comp rx=0 tx=0).stop 2024-08-17T02:22:28.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.630+0000 7f54c9031700 1 -- 172.21.15.104:0/1376831813 shutdown_connections 2024-08-17T02:22:28.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.630+0000 7f54c9031700 1 --2- 172.21.15.104:0/1376831813 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f54b0060860 0x7f54b0062d10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.630+0000 7f54c9031700 1 --2- 172.21.15.104:0/1376831813 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54c4171c60 0x7f54c416d370 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.630+0000 7f54c9031700 1 --2- 172.21.15.104:0/1376831813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54c40635a0 0x7f54c4171720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.630+0000 7f54c9031700 1 --2- 172.21.15.104:0/1376831813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54ac0051c0 0x7f54c4063060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.630+0000 7f54c9031700 1 -- 172.21.15.104:0/1376831813 >> 172.21.15.104:0/1376831813 conn(0x7f54c40678d0 msgr2=0x7f54c415db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:28.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.630+0000 7f54c9031700 1 -- 172.21.15.104:0/1376831813 shutdown_connections 2024-08-17T02:22:28.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.630+0000 7f54c9031700 1 -- 172.21.15.104:0/1376831813 wait complete. 2024-08-17T02:22:28.639 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-08-17T02:22:28.649 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-08-17T02:22:28.087771+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2386072,"kb_used_data":3048,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752588648,"statfs":{"total":773094113280,"available":770650775552,"internally_reserved":0,"allocated":3121152,"data_stored":1830460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.933708"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.213833+0000","last_change":"2024-08-17T02:22:22.207394+0000","last_active":"2024-08-17T02:22:22.213833+0000","last_peered":"2024-08-17T02:22:22.213833+0000","last_clean":"2024-08-17T02:22:22.213833+0000","last_became_active":"2024-08-17T02:22:22.207136+0000","last_became_peered":"2024-08-17T02:22:22.207136+0000","last_unstale":"2024-08-17T02:22:22.213833+0000","last_undegraded":"2024-08-17T02:22:22.213833+0000","last_fullsized":"2024-08-17T02:22:22.213833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:18:56.483735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.201158+0000","last_change":"2024-08-17T02:22:22.193365+0000","last_active":"2024-08-17T02:22:22.201158+0000","last_peered":"2024-08-17T02:22:22.201158+0000","last_clean":"2024-08-17T02:22:22.201158+0000","last_became_active":"2024-08-17T02:22:22.192975+0000","last_became_peered":"2024-08-17T02:22:22.192975+0000","last_unstale":"2024-08-17T02:22:22.201158+0000","last_undegraded":"2024-08-17T02:22:22.201158+0000","last_fullsized":"2024-08-17T02:22:22.201158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:21:01.768875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.201378+0000","last_change":"2024-08-17T02:22:22.195675+0000","last_active":"2024-08-17T02:22:22.201378+0000","last_peered":"2024-08-17T02:22:22.201378+0000","last_clean":"2024-08-17T02:22:22.201378+0000","last_became_active":"2024-08-17T02:22:22.195378+0000","last_became_peered":"2024-08-17T02:22:22.195378+0000","last_unstale":"2024-08-17T02:22:22.201378+0000","last_undegraded":"2024-08-17T02:22:22.201378+0000","last_fullsized":"2024-08-17T02:22:22.201378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:42:06.496970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.213303+0000","last_change":"2024-08-17T02:22:22.206371+0000","last_active":"2024-08-17T02:22:22.213303+0000","last_peered":"2024-08-17T02:22:22.213303+0000","last_clean":"2024-08-17T02:22:22.213303+0000","last_became_active":"2024-08-17T02:22:22.206060+0000","last_became_peered":"2024-08-17T02:22:22.206060+0000","last_unstale":"2024-08-17T02:22:22.213303+0000","last_undegraded":"2024-08-17T02:22:22.213303+0000","last_fullsized":"2024-08-17T02:22:22.213303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:14:09.179717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.214000+0000","last_change":"2024-08-17T02:22:22.205544+0000","last_active":"2024-08-17T02:22:22.214000+0000","last_peered":"2024-08-17T02:22:22.214000+0000","last_clean":"2024-08-17T02:22:22.214000+0000","last_became_active":"2024-08-17T02:22:22.204373+0000","last_became_peered":"2024-08-17T02:22:22.204373+0000","last_unstale":"2024-08-17T02:22:22.214000+0000","last_undegraded":"2024-08-17T02:22:22.214000+0000","last_fullsized":"2024-08-17T02:22:22.214000+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:12:21.015335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.210109+0000","last_change":"2024-08-17T02:22:22.203860+0000","last_active":"2024-08-17T02:22:22.210109+0000","last_peered":"2024-08-17T02:22:22.210109+0000","last_clean":"2024-08-17T02:22:22.210109+0000","last_became_active":"2024-08-17T02:22:22.203585+0000","last_became_peered":"2024-08-17T02:22:22.203585+0000","last_unstale":"2024-08-17T02:22:22.210109+0000","last_undegraded":"2024-08-17T02:22:22.210109+0000","last_fullsized":"2024-08-17T02:22:22.210109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:31:18.328390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.208402+0000","last_change":"2024-08-17T02:22:22.202691+0000","last_active":"2024-08-17T02:22:22.208402+0000","last_peered":"2024-08-17T02:22:22.208402+0000","last_clean":"2024-08-17T02:22:22.208402+0000","last_became_active":"2024-08-17T02:22:22.202339+0000","last_became_peered":"2024-08-17T02:22:22.202339+0000","last_unstale":"2024-08-17T02:22:22.208402+0000","last_undegraded":"2024-08-17T02:22:22.208402+0000","last_fullsized":"2024-08-17T02:22:22.208402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:42:06.496970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.204363+0000","last_change":"2024-08-17T02:22:22.198103+0000","last_active":"2024-08-17T02:22:22.204363+0000","last_peered":"2024-08-17T02:22:22.204363+0000","last_clean":"2024-08-17T02:22:22.204363+0000","last_became_active":"2024-08-17T02:22:22.197796+0000","last_became_peered":"2024-08-17T02:22:22.197796+0000","last_unstale":"2024-08-17T02:22:22.204363+0000","last_undegraded":"2024-08-17T02:22:22.204363+0000","last_fullsized":"2024-08-17T02:22:22.204363+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:52:23.293649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.207212+0000","last_change":"2024-08-17T02:22:22.202799+0000","last_active":"2024-08-17T02:22:22.207212+0000","last_peered":"2024-08-17T02:22:22.207212+0000","last_clean":"2024-08-17T02:22:22.207212+0000","last_became_active":"2024-08-17T02:22:22.202553+0000","last_became_peered":"2024-08-17T02:22:22.202553+0000","last_unstale":"2024-08-17T02:22:22.207212+0000","last_undegraded":"2024-08-17T02:22:22.207212+0000","last_fullsized":"2024-08-17T02:22:22.207212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:25:58.131547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.204173+0000","last_change":"2024-08-17T02:22:22.200665+0000","last_active":"2024-08-17T02:22:22.204173+0000","last_peered":"2024-08-17T02:22:22.204173+0000","last_clean":"2024-08-17T02:22:22.204173+0000","last_became_active":"2024-08-17T02:22:22.200068+0000","last_became_peered":"2024-08-17T02:22:22.200068+0000","last_unstale":"2024-08-17T02:22:22.204173+0000","last_undegraded":"2024-08-17T02:22:22.204173+0000","last_fullsized":"2024-08-17T02:22:22.204173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:45:56.296454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.211485+0000","last_change":"2024-08-17T02:22:22.205418+0000","last_active":"2024-08-17T02:22:22.211485+0000","last_peered":"2024-08-17T02:22:22.211485+0000","last_clean":"2024-08-17T02:22:22.211485+0000","last_became_active":"2024-08-17T02:22:22.205155+0000","last_became_peered":"2024-08-17T02:22:22.205155+0000","last_unstale":"2024-08-17T02:22:22.211485+0000","last_undegraded":"2024-08-17T02:22:22.211485+0000","last_fullsized":"2024-08-17T02:22:22.211485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:09:52.735534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.213936+0000","last_change":"2024-08-17T02:22:22.208616+0000","last_active":"2024-08-17T02:22:22.213936+0000","last_peered":"2024-08-17T02:22:22.213936+0000","last_clean":"2024-08-17T02:22:22.213936+0000","last_became_active":"2024-08-17T02:22:22.208243+0000","last_became_peered":"2024-08-17T02:22:22.208243+0000","last_unstale":"2024-08-17T02:22:22.213936+0000","last_undegraded":"2024-08-17T02:22:22.213936+0000","last_fullsized":"2024-08-17T02:22:22.213936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:06:36.575795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.207458+0000","last_change":"2024-08-17T02:22:22.201596+0000","last_active":"2024-08-17T02:22:22.207458+0000","last_peered":"2024-08-17T02:22:22.207458+0000","last_clean":"2024-08-17T02:22:22.207458+0000","last_became_active":"2024-08-17T02:22:22.201280+0000","last_became_peered":"2024-08-17T02:22:22.201280+0000","last_unstale":"2024-08-17T02:22:22.207458+0000","last_undegraded":"2024-08-17T02:22:22.207458+0000","last_fullsized":"2024-08-17T02:22:22.207458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:32:08.356996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.200897+0000","last_change":"2024-08-17T02:22:22.196235+0000","last_active":"2024-08-17T02:22:22.200897+0000","last_peered":"2024-08-17T02:22:22.200897+0000","last_clean":"2024-08-17T02:22:22.200897+0000","last_became_active":"2024-08-17T02:22:22.195933+0000","last_became_peered":"2024-08-17T02:22:22.195933+0000","last_unstale":"2024-08-17T02:22:22.200897+0000","last_undegraded":"2024-08-17T02:22:22.200897+0000","last_fullsized":"2024-08-17T02:22:22.200897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:24:36.708380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.205916+0000","last_change":"2024-08-17T02:22:22.203673+0000","last_active":"2024-08-17T02:22:22.205916+0000","last_peered":"2024-08-17T02:22:22.205916+0000","last_clean":"2024-08-17T02:22:22.205916+0000","last_became_active":"2024-08-17T02:22:22.203378+0000","last_became_peered":"2024-08-17T02:22:22.203378+0000","last_unstale":"2024-08-17T02:22:22.205916+0000","last_undegraded":"2024-08-17T02:22:22.205916+0000","last_fullsized":"2024-08-17T02:22:22.205916+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:14:55.331054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.207094+0000","last_change":"2024-08-17T02:22:22.204557+0000","last_active":"2024-08-17T02:22:22.207094+0000","last_peered":"2024-08-17T02:22:22.207094+0000","last_clean":"2024-08-17T02:22:22.207094+0000","last_became_active":"2024-08-17T02:22:22.203145+0000","last_became_peered":"2024-08-17T02:22:22.203145+0000","last_unstale":"2024-08-17T02:22:22.207094+0000","last_undegraded":"2024-08-17T02:22:22.207094+0000","last_fullsized":"2024-08-17T02:22:22.207094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:54:53.542063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.212534+0000","last_change":"2024-08-17T02:22:22.205880+0000","last_active":"2024-08-17T02:22:22.212534+0000","last_peered":"2024-08-17T02:22:22.212534+0000","last_clean":"2024-08-17T02:22:22.212534+0000","last_became_active":"2024-08-17T02:22:22.205133+0000","last_became_peered":"2024-08-17T02:22:22.205133+0000","last_unstale":"2024-08-17T02:22:22.212534+0000","last_undegraded":"2024-08-17T02:22:22.212534+0000","last_fullsized":"2024-08-17T02:22:22.212534+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:42:34.031508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.204812+0000","last_change":"2024-08-17T02:22:22.199981+0000","last_active":"2024-08-17T02:22:22.204812+0000","last_peered":"2024-08-17T02:22:22.204812+0000","last_clean":"2024-08-17T02:22:22.204812+0000","last_became_active":"2024-08-17T02:22:22.199695+0000","last_became_peered":"2024-08-17T02:22:22.199695+0000","last_unstale":"2024-08-17T02:22:22.204812+0000","last_undegraded":"2024-08-17T02:22:22.204812+0000","last_fullsized":"2024-08-17T02:22:22.204812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:10:01.636342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.203094+0000","last_change":"2024-08-17T02:22:22.195819+0000","last_active":"2024-08-17T02:22:22.203094+0000","last_peered":"2024-08-17T02:22:22.203094+0000","last_clean":"2024-08-17T02:22:22.203094+0000","last_became_active":"2024-08-17T02:22:22.195534+0000","last_became_peered":"2024-08-17T02:22:22.195534+0000","last_unstale":"2024-08-17T02:22:22.203094+0000","last_undegraded":"2024-08-17T02:22:22.203094+0000","last_fullsized":"2024-08-17T02:22:22.203094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:14:13.686376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.213954+0000","last_change":"2024-08-17T02:22:22.208982+0000","last_active":"2024-08-17T02:22:22.213954+0000","last_peered":"2024-08-17T02:22:22.213954+0000","last_clean":"2024-08-17T02:22:22.213954+0000","last_became_active":"2024-08-17T02:22:22.208519+0000","last_became_peered":"2024-08-17T02:22:22.208519+0000","last_unstale":"2024-08-17T02:22:22.213954+0000","last_undegraded":"2024-08-17T02:22:22.213954+0000","last_fullsized":"2024-08-17T02:22:22.213954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:14:55.331054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.216569+0000","last_change":"2024-08-17T02:22:22.208260+0000","last_active":"2024-08-17T02:22:22.216569+0000","last_peered":"2024-08-17T02:22:22.216569+0000","last_clean":"2024-08-17T02:22:22.216569+0000","last_became_active":"2024-08-17T02:22:22.207547+0000","last_became_peered":"2024-08-17T02:22:22.207547+0000","last_unstale":"2024-08-17T02:22:22.216569+0000","last_undegraded":"2024-08-17T02:22:22.216569+0000","last_fullsized":"2024-08-17T02:22:22.216569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:50:20.438197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.207287+0000","last_change":"2024-08-17T02:22:22.199523+0000","last_active":"2024-08-17T02:22:22.207287+0000","last_peered":"2024-08-17T02:22:22.207287+0000","last_clean":"2024-08-17T02:22:22.207287+0000","last_became_active":"2024-08-17T02:22:22.198679+0000","last_became_peered":"2024-08-17T02:22:22.198679+0000","last_unstale":"2024-08-17T02:22:22.207287+0000","last_undegraded":"2024-08-17T02:22:22.207287+0000","last_fullsized":"2024-08-17T02:22:22.207287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:52:03.967168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.205677+0000","last_change":"2024-08-17T02:22:22.200108+0000","last_active":"2024-08-17T02:22:22.205677+0000","last_peered":"2024-08-17T02:22:22.205677+0000","last_clean":"2024-08-17T02:22:22.205677+0000","last_became_active":"2024-08-17T02:22:22.199791+0000","last_became_peered":"2024-08-17T02:22:22.199791+0000","last_unstale":"2024-08-17T02:22:22.205677+0000","last_undegraded":"2024-08-17T02:22:22.205677+0000","last_fullsized":"2024-08-17T02:22:22.205677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:50:20.438197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.206397+0000","last_change":"2024-08-17T02:22:22.197872+0000","last_active":"2024-08-17T02:22:22.206397+0000","last_peered":"2024-08-17T02:22:22.206397+0000","last_clean":"2024-08-17T02:22:22.206397+0000","last_became_active":"2024-08-17T02:22:22.197575+0000","last_became_peered":"2024-08-17T02:22:22.197575+0000","last_unstale":"2024-08-17T02:22:22.206397+0000","last_undegraded":"2024-08-17T02:22:22.206397+0000","last_fullsized":"2024-08-17T02:22:22.206397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:19:48.379073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.201276+0000","last_change":"2024-08-17T02:22:22.192977+0000","last_active":"2024-08-17T02:22:22.201276+0000","last_peered":"2024-08-17T02:22:22.201276+0000","last_clean":"2024-08-17T02:22:22.201276+0000","last_became_active":"2024-08-17T02:22:22.192692+0000","last_became_peered":"2024-08-17T02:22:22.192692+0000","last_unstale":"2024-08-17T02:22:22.201276+0000","last_undegraded":"2024-08-17T02:22:22.201276+0000","last_fullsized":"2024-08-17T02:22:22.201276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:45:56.296454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.213112+0000","last_change":"2024-08-17T02:22:22.206334+0000","last_active":"2024-08-17T02:22:22.213112+0000","last_peered":"2024-08-17T02:22:22.213112+0000","last_clean":"2024-08-17T02:22:22.213112+0000","last_became_active":"2024-08-17T02:22:22.203810+0000","last_became_peered":"2024-08-17T02:22:22.203810+0000","last_unstale":"2024-08-17T02:22:22.213112+0000","last_undegraded":"2024-08-17T02:22:22.213112+0000","last_fullsized":"2024-08-17T02:22:22.213112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:44:23.689354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.200920+0000","last_change":"2024-08-17T02:22:22.196495+0000","last_active":"2024-08-17T02:22:22.200920+0000","last_peered":"2024-08-17T02:22:22.200920+0000","last_clean":"2024-08-17T02:22:22.200920+0000","last_became_active":"2024-08-17T02:22:22.196141+0000","last_became_peered":"2024-08-17T02:22:22.196141+0000","last_unstale":"2024-08-17T02:22:22.200920+0000","last_undegraded":"2024-08-17T02:22:22.200920+0000","last_fullsized":"2024-08-17T02:22:22.200920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:50:27.904463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.210390+0000","last_change":"2024-08-17T02:22:22.206082+0000","last_active":"2024-08-17T02:22:22.210390+0000","last_peered":"2024-08-17T02:22:22.210390+0000","last_clean":"2024-08-17T02:22:22.210390+0000","last_became_active":"2024-08-17T02:22:22.205748+0000","last_became_peered":"2024-08-17T02:22:22.205748+0000","last_unstale":"2024-08-17T02:22:22.210390+0000","last_undegraded":"2024-08-17T02:22:22.210390+0000","last_fullsized":"2024-08-17T02:22:22.210390+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:37:31.095543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.198292+0000","last_change":"2024-08-17T02:22:22.188239+0000","last_active":"2024-08-17T02:22:22.198292+0000","last_peered":"2024-08-17T02:22:22.198292+0000","last_clean":"2024-08-17T02:22:22.198292+0000","last_became_active":"2024-08-17T02:22:22.187975+0000","last_became_peered":"2024-08-17T02:22:22.187975+0000","last_unstale":"2024-08-17T02:22:22.198292+0000","last_undegraded":"2024-08-17T02:22:22.198292+0000","last_fullsized":"2024-08-17T02:22:22.198292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:01:06.448601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.203235+0000","last_change":"2024-08-17T02:22:22.200334+0000","last_active":"2024-08-17T02:22:22.203235+0000","last_peered":"2024-08-17T02:22:22.203235+0000","last_clean":"2024-08-17T02:22:22.203235+0000","last_became_active":"2024-08-17T02:22:22.200074+0000","last_became_peered":"2024-08-17T02:22:22.200074+0000","last_unstale":"2024-08-17T02:22:22.203235+0000","last_undegraded":"2024-08-17T02:22:22.203235+0000","last_fullsized":"2024-08-17T02:22:22.203235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:40:31.008079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.191172+0000","last_change":"2024-08-17T02:22:22.189468+0000","last_active":"2024-08-17T02:22:22.191172+0000","last_peered":"2024-08-17T02:22:22.191172+0000","last_clean":"2024-08-17T02:22:22.191172+0000","last_became_active":"2024-08-17T02:22:22.189055+0000","last_became_peered":"2024-08-17T02:22:22.189055+0000","last_unstale":"2024-08-17T02:22:22.191172+0000","last_undegraded":"2024-08-17T02:22:22.191172+0000","last_fullsized":"2024-08-17T02:22:22.191172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:14:09.179717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.211815+0000","last_change":"2024-08-17T02:22:22.204911+0000","last_active":"2024-08-17T02:22:22.211815+0000","last_peered":"2024-08-17T02:22:22.211815+0000","last_clean":"2024-08-17T02:22:22.211815+0000","last_became_active":"2024-08-17T02:22:22.204551+0000","last_became_peered":"2024-08-17T02:22:22.204551+0000","last_unstale":"2024-08-17T02:22:22.211815+0000","last_undegraded":"2024-08-17T02:22:22.211815+0000","last_fullsized":"2024-08-17T02:22:22.211815+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:47:31.414680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.207076+0000","last_change":"2024-08-17T02:22:22.193415+0000","last_active":"2024-08-17T02:22:22.207076+0000","last_peered":"2024-08-17T02:22:22.207076+0000","last_clean":"2024-08-17T02:22:22.207076+0000","last_became_active":"2024-08-17T02:22:22.193075+0000","last_became_peered":"2024-08-17T02:22:22.193075+0000","last_unstale":"2024-08-17T02:22:22.207076+0000","last_undegraded":"2024-08-17T02:22:22.207076+0000","last_fullsized":"2024-08-17T02:22:22.207076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:10:01.636342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.216386+0000","last_change":"2024-08-17T02:22:21.175481+0000","last_active":"2024-08-17T02:22:22.216386+0000","last_peered":"2024-08-17T02:22:22.216386+0000","last_clean":"2024-08-17T02:22:22.216386+0000","last_became_active":"2024-08-17T02:22:21.175155+0000","last_became_peered":"2024-08-17T02:22:21.175155+0000","last_unstale":"2024-08-17T02:22:22.216386+0000","last_undegraded":"2024-08-17T02:22:22.216386+0000","last_fullsized":"2024-08-17T02:22:22.216386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:35:31.942397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.205780+0000","last_change":"2024-08-17T02:22:22.204166+0000","last_active":"2024-08-17T02:22:22.205780+0000","last_peered":"2024-08-17T02:22:22.205780+0000","last_clean":"2024-08-17T02:22:22.205780+0000","last_became_active":"2024-08-17T02:22:22.203874+0000","last_became_peered":"2024-08-17T02:22:22.203874+0000","last_unstale":"2024-08-17T02:22:22.205780+0000","last_undegraded":"2024-08-17T02:22:22.205780+0000","last_fullsized":"2024-08-17T02:22:22.205780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:12:21.015335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.215833+0000","last_change":"2024-08-17T02:22:21.187087+0000","last_active":"2024-08-17T02:22:22.215833+0000","last_peered":"2024-08-17T02:22:22.215833+0000","last_clean":"2024-08-17T02:22:22.215833+0000","last_became_active":"2024-08-17T02:22:21.186780+0000","last_became_peered":"2024-08-17T02:22:21.186780+0000","last_unstale":"2024-08-17T02:22:22.215833+0000","last_undegraded":"2024-08-17T02:22:22.215833+0000","last_fullsized":"2024-08-17T02:22:22.215833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:53:21.168875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.191314+0000","last_change":"2024-08-17T02:22:21.184095+0000","last_active":"2024-08-17T02:22:22.191314+0000","last_peered":"2024-08-17T02:22:22.191314+0000","last_clean":"2024-08-17T02:22:22.191314+0000","last_became_active":"2024-08-17T02:22:21.183707+0000","last_became_peered":"2024-08-17T02:22:21.183707+0000","last_unstale":"2024-08-17T02:22:22.191314+0000","last_undegraded":"2024-08-17T02:22:22.191314+0000","last_fullsized":"2024-08-17T02:22:22.191314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:33:34.653965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.201739+0000","last_change":"2024-08-17T02:22:22.193669+0000","last_active":"2024-08-17T02:22:22.201739+0000","last_peered":"2024-08-17T02:22:22.201739+0000","last_clean":"2024-08-17T02:22:22.201739+0000","last_became_active":"2024-08-17T02:22:22.193231+0000","last_became_peered":"2024-08-17T02:22:22.193231+0000","last_unstale":"2024-08-17T02:22:22.201739+0000","last_undegraded":"2024-08-17T02:22:22.201739+0000","last_fullsized":"2024-08-17T02:22:22.201739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:34:22.570830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.190339+0000","last_change":"2024-08-17T02:22:21.178190+0000","last_active":"2024-08-17T02:22:22.190339+0000","last_peered":"2024-08-17T02:22:22.190339+0000","last_clean":"2024-08-17T02:22:22.190339+0000","last_became_active":"2024-08-17T02:22:21.177828+0000","last_became_peered":"2024-08-17T02:22:21.177828+0000","last_unstale":"2024-08-17T02:22:22.190339+0000","last_undegraded":"2024-08-17T02:22:22.190339+0000","last_fullsized":"2024-08-17T02:22:22.190339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:10:00.628584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.216728+0000","last_change":"2024-08-17T02:22:22.209400+0000","last_active":"2024-08-17T02:22:22.216728+0000","last_peered":"2024-08-17T02:22:22.216728+0000","last_clean":"2024-08-17T02:22:22.216728+0000","last_became_active":"2024-08-17T02:22:22.208986+0000","last_became_peered":"2024-08-17T02:22:22.208986+0000","last_unstale":"2024-08-17T02:22:22.216728+0000","last_undegraded":"2024-08-17T02:22:22.216728+0000","last_fullsized":"2024-08-17T02:22:22.216728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:01:06.448601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.182530+0000","last_change":"2024-08-17T02:22:21.171298+0000","last_active":"2024-08-17T02:22:22.182530+0000","last_peered":"2024-08-17T02:22:22.182530+0000","last_clean":"2024-08-17T02:22:22.182530+0000","last_became_active":"2024-08-17T02:22:21.170688+0000","last_became_peered":"2024-08-17T02:22:21.170688+0000","last_unstale":"2024-08-17T02:22:22.182530+0000","last_undegraded":"2024-08-17T02:22:22.182530+0000","last_fullsized":"2024-08-17T02:22:22.182530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:14:01.383880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.213088+0000","last_change":"2024-08-17T02:22:22.205723+0000","last_active":"2024-08-17T02:22:22.213088+0000","last_peered":"2024-08-17T02:22:22.213088+0000","last_clean":"2024-08-17T02:22:22.213088+0000","last_became_active":"2024-08-17T02:22:22.204195+0000","last_became_peered":"2024-08-17T02:22:22.204195+0000","last_unstale":"2024-08-17T02:22:22.213088+0000","last_undegraded":"2024-08-17T02:22:22.213088+0000","last_fullsized":"2024-08-17T02:22:22.213088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:53:22.176633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.201196+0000","last_change":"2024-08-17T02:22:21.176993+0000","last_active":"2024-08-17T02:22:22.201196+0000","last_peered":"2024-08-17T02:22:22.201196+0000","last_clean":"2024-08-17T02:22:22.201196+0000","last_became_active":"2024-08-17T02:22:21.175101+0000","last_became_peered":"2024-08-17T02:22:21.175101+0000","last_unstale":"2024-08-17T02:22:22.201196+0000","last_undegraded":"2024-08-17T02:22:22.201196+0000","last_fullsized":"2024-08-17T02:22:22.201196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:35:31.942397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.207541+0000","last_change":"2024-08-17T02:22:22.204502+0000","last_active":"2024-08-17T02:22:22.207541+0000","last_peered":"2024-08-17T02:22:22.207541+0000","last_clean":"2024-08-17T02:22:22.207541+0000","last_became_active":"2024-08-17T02:22:22.204194+0000","last_became_peered":"2024-08-17T02:22:22.204194+0000","last_unstale":"2024-08-17T02:22:22.207541+0000","last_undegraded":"2024-08-17T02:22:22.207541+0000","last_fullsized":"2024-08-17T02:22:22.207541+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:18:56.483735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.219276+0000","last_change":"2024-08-17T02:22:21.175948+0000","last_active":"2024-08-17T02:22:22.219276+0000","last_peered":"2024-08-17T02:22:22.219276+0000","last_clean":"2024-08-17T02:22:22.219276+0000","last_became_active":"2024-08-17T02:22:21.175638+0000","last_became_peered":"2024-08-17T02:22:21.175638+0000","last_unstale":"2024-08-17T02:22:22.219276+0000","last_undegraded":"2024-08-17T02:22:22.219276+0000","last_fullsized":"2024-08-17T02:22:22.219276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:14:01.383880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.208878+0000","last_change":"2024-08-17T02:22:22.203497+0000","last_active":"2024-08-17T02:22:22.208878+0000","last_peered":"2024-08-17T02:22:22.208878+0000","last_clean":"2024-08-17T02:22:22.208878+0000","last_became_active":"2024-08-17T02:22:22.203129+0000","last_became_peered":"2024-08-17T02:22:22.203129+0000","last_unstale":"2024-08-17T02:22:22.208878+0000","last_undegraded":"2024-08-17T02:22:22.208878+0000","last_fullsized":"2024-08-17T02:22:22.208878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:08:06.080463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.221812+0000","last_change":"2024-08-17T02:22:21.172088+0000","last_active":"2024-08-17T02:22:22.221812+0000","last_peered":"2024-08-17T02:22:22.221812+0000","last_clean":"2024-08-17T02:22:22.221812+0000","last_became_active":"2024-08-17T02:22:21.171674+0000","last_became_peered":"2024-08-17T02:22:21.171674+0000","last_unstale":"2024-08-17T02:22:22.221812+0000","last_undegraded":"2024-08-17T02:22:22.221812+0000","last_fullsized":"2024-08-17T02:22:22.221812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:20:14.853980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.204202+0000","last_change":"2024-08-17T02:22:22.200767+0000","last_active":"2024-08-17T02:22:22.204202+0000","last_peered":"2024-08-17T02:22:22.204202+0000","last_clean":"2024-08-17T02:22:22.204202+0000","last_became_active":"2024-08-17T02:22:22.200355+0000","last_became_peered":"2024-08-17T02:22:22.200355+0000","last_unstale":"2024-08-17T02:22:22.204202+0000","last_undegraded":"2024-08-17T02:22:22.204202+0000","last_fullsized":"2024-08-17T02:22:22.204202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:46:07.630925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.216387+0000","last_change":"2024-08-17T02:22:21.183259+0000","last_active":"2024-08-17T02:22:22.216387+0000","last_peered":"2024-08-17T02:22:22.216387+0000","last_clean":"2024-08-17T02:22:22.216387+0000","last_became_active":"2024-08-17T02:22:21.182967+0000","last_became_peered":"2024-08-17T02:22:21.182967+0000","last_unstale":"2024-08-17T02:22:22.216387+0000","last_undegraded":"2024-08-17T02:22:22.216387+0000","last_fullsized":"2024-08-17T02:22:22.216387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:43:54.663464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.207486+0000","last_change":"2024-08-17T02:22:22.203414+0000","last_active":"2024-08-17T02:22:22.207486+0000","last_peered":"2024-08-17T02:22:22.207486+0000","last_clean":"2024-08-17T02:22:22.207486+0000","last_became_active":"2024-08-17T02:22:22.203022+0000","last_became_peered":"2024-08-17T02:22:22.203022+0000","last_unstale":"2024-08-17T02:22:22.207486+0000","last_undegraded":"2024-08-17T02:22:22.207486+0000","last_fullsized":"2024-08-17T02:22:22.207486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:00:35.929768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.193755+0000","last_change":"2024-08-17T02:22:21.181277+0000","last_active":"2024-08-17T02:22:22.193755+0000","last_peered":"2024-08-17T02:22:22.193755+0000","last_clean":"2024-08-17T02:22:22.193755+0000","last_became_active":"2024-08-17T02:22:21.178480+0000","last_became_peered":"2024-08-17T02:22:21.178480+0000","last_unstale":"2024-08-17T02:22:22.193755+0000","last_undegraded":"2024-08-17T02:22:22.193755+0000","last_fullsized":"2024-08-17T02:22:22.193755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:31:17.320632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.207011+0000","last_change":"2024-08-17T02:22:22.203294+0000","last_active":"2024-08-17T02:22:22.207011+0000","last_peered":"2024-08-17T02:22:22.207011+0000","last_clean":"2024-08-17T02:22:22.207011+0000","last_became_active":"2024-08-17T02:22:22.202695+0000","last_became_peered":"2024-08-17T02:22:22.202695+0000","last_unstale":"2024-08-17T02:22:22.207011+0000","last_undegraded":"2024-08-17T02:22:22.207011+0000","last_fullsized":"2024-08-17T02:22:22.207011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:11:36.411933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.200472+0000","last_change":"2024-08-17T02:22:21.186990+0000","last_active":"2024-08-17T02:22:22.200472+0000","last_peered":"2024-08-17T02:22:22.200472+0000","last_clean":"2024-08-17T02:22:22.200472+0000","last_became_active":"2024-08-17T02:22:21.186627+0000","last_became_peered":"2024-08-17T02:22:21.186627+0000","last_unstale":"2024-08-17T02:22:22.200472+0000","last_undegraded":"2024-08-17T02:22:22.200472+0000","last_fullsized":"2024-08-17T02:22:22.200472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:10:00.628584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.201334+0000","last_change":"2024-08-17T02:22:22.191715+0000","last_active":"2024-08-17T02:22:22.201334+0000","last_peered":"2024-08-17T02:22:22.201334+0000","last_clean":"2024-08-17T02:22:22.201334+0000","last_became_active":"2024-08-17T02:22:22.191284+0000","last_became_peered":"2024-08-17T02:22:22.191284+0000","last_unstale":"2024-08-17T02:22:22.201334+0000","last_undegraded":"2024-08-17T02:22:22.201334+0000","last_fullsized":"2024-08-17T02:22:22.201334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:31:18.328390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.219572+0000","last_change":"2024-08-17T02:22:21.173553+0000","last_active":"2024-08-17T02:22:22.219572+0000","last_peered":"2024-08-17T02:22:22.219572+0000","last_clean":"2024-08-17T02:22:22.219572+0000","last_became_active":"2024-08-17T02:22:21.173159+0000","last_became_peered":"2024-08-17T02:22:21.173159+0000","last_unstale":"2024-08-17T02:22:22.219572+0000","last_undegraded":"2024-08-17T02:22:22.219572+0000","last_fullsized":"2024-08-17T02:22:22.219572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:35:31.942397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.212641+0000","last_change":"2024-08-17T02:22:22.206143+0000","last_active":"2024-08-17T02:22:22.212641+0000","last_peered":"2024-08-17T02:22:22.212641+0000","last_clean":"2024-08-17T02:22:22.212641+0000","last_became_active":"2024-08-17T02:22:22.203641+0000","last_became_peered":"2024-08-17T02:22:22.203641+0000","last_unstale":"2024-08-17T02:22:22.212641+0000","last_undegraded":"2024-08-17T02:22:22.212641+0000","last_fullsized":"2024-08-17T02:22:22.212641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:49:03.418573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.215239+0000","last_change":"2024-08-17T02:22:21.174493+0000","last_active":"2024-08-17T02:22:22.215239+0000","last_peered":"2024-08-17T02:22:22.215239+0000","last_clean":"2024-08-17T02:22:22.215239+0000","last_became_active":"2024-08-17T02:22:21.174142+0000","last_became_peered":"2024-08-17T02:22:21.174142+0000","last_unstale":"2024-08-17T02:22:22.215239+0000","last_undegraded":"2024-08-17T02:22:22.215239+0000","last_fullsized":"2024-08-17T02:22:22.215239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:14:08.171959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.206463+0000","last_change":"2024-08-17T02:22:22.201098+0000","last_active":"2024-08-17T02:22:22.206463+0000","last_peered":"2024-08-17T02:22:22.206463+0000","last_clean":"2024-08-17T02:22:22.206463+0000","last_became_active":"2024-08-17T02:22:22.200673+0000","last_became_peered":"2024-08-17T02:22:22.200673+0000","last_unstale":"2024-08-17T02:22:22.206463+0000","last_undegraded":"2024-08-17T02:22:22.206463+0000","last_fullsized":"2024-08-17T02:22:22.206463+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:25:58.131547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.218662+0000","last_change":"2024-08-17T02:22:21.175560+0000","last_active":"2024-08-17T02:22:22.218662+0000","last_peered":"2024-08-17T02:22:22.218662+0000","last_clean":"2024-08-17T02:22:22.218662+0000","last_became_active":"2024-08-17T02:22:21.175262+0000","last_became_peered":"2024-08-17T02:22:21.175262+0000","last_unstale":"2024-08-17T02:22:22.218662+0000","last_undegraded":"2024-08-17T02:22:22.218662+0000","last_fullsized":"2024-08-17T02:22:22.218662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:01:30.822179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.213856+0000","last_change":"2024-08-17T02:22:22.207471+0000","last_active":"2024-08-17T02:22:22.213856+0000","last_peered":"2024-08-17T02:22:22.213856+0000","last_clean":"2024-08-17T02:22:22.213856+0000","last_became_active":"2024-08-17T02:22:22.207237+0000","last_became_peered":"2024-08-17T02:22:22.207237+0000","last_unstale":"2024-08-17T02:22:22.213856+0000","last_undegraded":"2024-08-17T02:22:22.213856+0000","last_fullsized":"2024-08-17T02:22:22.213856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:52:23.293649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.216725+0000","last_change":"2024-08-17T02:22:21.173738+0000","last_active":"2024-08-17T02:22:22.216725+0000","last_peered":"2024-08-17T02:22:22.216725+0000","last_clean":"2024-08-17T02:22:22.216725+0000","last_became_active":"2024-08-17T02:22:21.173409+0000","last_became_peered":"2024-08-17T02:22:21.173409+0000","last_unstale":"2024-08-17T02:22:22.216725+0000","last_undegraded":"2024-08-17T02:22:22.216725+0000","last_fullsized":"2024-08-17T02:22:22.216725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:43:54.663464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.203920+0000","last_change":"2024-08-17T02:22:22.200396+0000","last_active":"2024-08-17T02:22:22.203920+0000","last_peered":"2024-08-17T02:22:22.203920+0000","last_clean":"2024-08-17T02:22:22.203920+0000","last_became_active":"2024-08-17T02:22:22.199830+0000","last_became_peered":"2024-08-17T02:22:22.199830+0000","last_unstale":"2024-08-17T02:22:22.203920+0000","last_undegraded":"2024-08-17T02:22:22.203920+0000","last_fullsized":"2024-08-17T02:22:22.203920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:08:06.080463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.191599+0000","last_change":"2024-08-17T02:22:21.179346+0000","last_active":"2024-08-17T02:22:22.191599+0000","last_peered":"2024-08-17T02:22:22.191599+0000","last_clean":"2024-08-17T02:22:22.191599+0000","last_became_active":"2024-08-17T02:22:21.179089+0000","last_became_peered":"2024-08-17T02:22:21.179089+0000","last_unstale":"2024-08-17T02:22:22.191599+0000","last_undegraded":"2024-08-17T02:22:22.191599+0000","last_fullsized":"2024-08-17T02:22:22.191599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:05:31.566094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.213029+0000","last_change":"2024-08-17T02:22:22.210702+0000","last_active":"2024-08-17T02:22:22.213029+0000","last_peered":"2024-08-17T02:22:22.213029+0000","last_clean":"2024-08-17T02:22:22.213029+0000","last_became_active":"2024-08-17T02:22:22.210369+0000","last_became_peered":"2024-08-17T02:22:22.210369+0000","last_unstale":"2024-08-17T02:22:22.213029+0000","last_undegraded":"2024-08-17T02:22:22.213029+0000","last_fullsized":"2024-08-17T02:22:22.213029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:18:56.483735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":163,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.181820+0000","last_change":"2024-08-17T02:22:11.967052+0000","last_active":"2024-08-17T02:22:22.181820+0000","last_peered":"2024-08-17T02:22:22.181820+0000","last_clean":"2024-08-17T02:22:22.181820+0000","last_became_active":"2024-08-17T02:22:11.965269+0000","last_became_peered":"2024-08-17T02:22:11.965269+0000","last_unstale":"2024-08-17T02:22:22.181820+0000","last_undegraded":"2024-08-17T02:22:22.181820+0000","last_fullsized":"2024-08-17T02:22:22.181820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:10.930862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:10.930862+0000","last_clean_scrub_stamp":"2024-08-17T02:22:10.930862+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:59:34.931003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.194953+0000","last_change":"2024-08-17T02:22:21.177962+0000","last_active":"2024-08-17T02:22:22.194953+0000","last_peered":"2024-08-17T02:22:22.194953+0000","last_clean":"2024-08-17T02:22:22.194953+0000","last_became_active":"2024-08-17T02:22:21.174574+0000","last_became_peered":"2024-08-17T02:22:21.174574+0000","last_unstale":"2024-08-17T02:22:22.194953+0000","last_undegraded":"2024-08-17T02:22:22.194953+0000","last_fullsized":"2024-08-17T02:22:22.194953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:44:22.681596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.216579+0000","last_change":"2024-08-17T02:22:22.207889+0000","last_active":"2024-08-17T02:22:22.216579+0000","last_peered":"2024-08-17T02:22:22.216579+0000","last_clean":"2024-08-17T02:22:22.216579+0000","last_became_active":"2024-08-17T02:22:22.207591+0000","last_became_peered":"2024-08-17T02:22:22.207591+0000","last_unstale":"2024-08-17T02:22:22.216579+0000","last_undegraded":"2024-08-17T02:22:22.216579+0000","last_fullsized":"2024-08-17T02:22:22.216579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:49:22.101879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.190447+0000","last_change":"2024-08-17T02:22:21.182666+0000","last_active":"2024-08-17T02:22:22.190447+0000","last_peered":"2024-08-17T02:22:22.190447+0000","last_clean":"2024-08-17T02:22:22.190447+0000","last_became_active":"2024-08-17T02:22:21.182346+0000","last_became_peered":"2024-08-17T02:22:21.182346+0000","last_unstale":"2024-08-17T02:22:22.190447+0000","last_undegraded":"2024-08-17T02:22:22.190447+0000","last_fullsized":"2024-08-17T02:22:22.190447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:14:08.171959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.213809+0000","last_change":"2024-08-17T02:22:22.204365+0000","last_active":"2024-08-17T02:22:22.213809+0000","last_peered":"2024-08-17T02:22:22.213809+0000","last_clean":"2024-08-17T02:22:22.213809+0000","last_became_active":"2024-08-17T02:22:22.204108+0000","last_became_peered":"2024-08-17T02:22:22.204108+0000","last_unstale":"2024-08-17T02:22:22.213809+0000","last_undegraded":"2024-08-17T02:22:22.213809+0000","last_fullsized":"2024-08-17T02:22:22.213809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:41:01.256282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.183170+0000","last_change":"2024-08-17T02:22:21.176738+0000","last_active":"2024-08-17T02:22:22.183170+0000","last_peered":"2024-08-17T02:22:22.183170+0000","last_clean":"2024-08-17T02:22:22.183170+0000","last_became_active":"2024-08-17T02:22:21.176368+0000","last_became_peered":"2024-08-17T02:22:21.176368+0000","last_unstale":"2024-08-17T02:22:22.183170+0000","last_undegraded":"2024-08-17T02:22:22.183170+0000","last_fullsized":"2024-08-17T02:22:22.183170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:39:49.581004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.198194+0000","last_change":"2024-08-17T02:22:22.188353+0000","last_active":"2024-08-17T02:22:22.198194+0000","last_peered":"2024-08-17T02:22:22.198194+0000","last_clean":"2024-08-17T02:22:22.198194+0000","last_became_active":"2024-08-17T02:22:22.187993+0000","last_became_peered":"2024-08-17T02:22:22.187993+0000","last_unstale":"2024-08-17T02:22:22.198194+0000","last_undegraded":"2024-08-17T02:22:22.198194+0000","last_fullsized":"2024-08-17T02:22:22.198194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:12:21.015335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.194610+0000","last_change":"2024-08-17T02:22:21.181422+0000","last_active":"2024-08-17T02:22:22.194610+0000","last_peered":"2024-08-17T02:22:22.194610+0000","last_clean":"2024-08-17T02:22:22.194610+0000","last_became_active":"2024-08-17T02:22:21.178824+0000","last_became_peered":"2024-08-17T02:22:21.178824+0000","last_unstale":"2024-08-17T02:22:22.194610+0000","last_undegraded":"2024-08-17T02:22:22.194610+0000","last_fullsized":"2024-08-17T02:22:22.194610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:57:25.435387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.206223+0000","last_change":"2024-08-17T02:22:22.201524+0000","last_active":"2024-08-17T02:22:22.206223+0000","last_peered":"2024-08-17T02:22:22.206223+0000","last_clean":"2024-08-17T02:22:22.206223+0000","last_became_active":"2024-08-17T02:22:22.200008+0000","last_became_peered":"2024-08-17T02:22:22.200008+0000","last_unstale":"2024-08-17T02:22:22.206223+0000","last_undegraded":"2024-08-17T02:22:22.206223+0000","last_fullsized":"2024-08-17T02:22:22.206223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:21:01.768875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.184222+0000","last_change":"2024-08-17T02:22:21.176312+0000","last_active":"2024-08-17T02:22:22.184222+0000","last_peered":"2024-08-17T02:22:22.184222+0000","last_clean":"2024-08-17T02:22:22.184222+0000","last_became_active":"2024-08-17T02:22:21.175977+0000","last_became_peered":"2024-08-17T02:22:21.175977+0000","last_unstale":"2024-08-17T02:22:22.184222+0000","last_undegraded":"2024-08-17T02:22:22.184222+0000","last_fullsized":"2024-08-17T02:22:22.184222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:36:42.673124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.212680+0000","last_change":"2024-08-17T02:22:22.205225+0000","last_active":"2024-08-17T02:22:22.212680+0000","last_peered":"2024-08-17T02:22:22.212680+0000","last_clean":"2024-08-17T02:22:22.212680+0000","last_became_active":"2024-08-17T02:22:22.204500+0000","last_became_peered":"2024-08-17T02:22:22.204500+0000","last_unstale":"2024-08-17T02:22:22.212680+0000","last_undegraded":"2024-08-17T02:22:22.212680+0000","last_fullsized":"2024-08-17T02:22:22.212680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:57:26.443145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.195174+0000","last_change":"2024-08-17T02:22:21.179488+0000","last_active":"2024-08-17T02:22:22.195174+0000","last_peered":"2024-08-17T02:22:22.195174+0000","last_clean":"2024-08-17T02:22:22.195174+0000","last_became_active":"2024-08-17T02:22:21.179206+0000","last_became_peered":"2024-08-17T02:22:21.179206+0000","last_unstale":"2024-08-17T02:22:22.195174+0000","last_undegraded":"2024-08-17T02:22:22.195174+0000","last_fullsized":"2024-08-17T02:22:22.195174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:25:57.123789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.204505+0000","last_change":"2024-08-17T02:22:22.198568+0000","last_active":"2024-08-17T02:22:22.204505+0000","last_peered":"2024-08-17T02:22:22.204505+0000","last_clean":"2024-08-17T02:22:22.204505+0000","last_became_active":"2024-08-17T02:22:22.198281+0000","last_became_peered":"2024-08-17T02:22:22.198281+0000","last_unstale":"2024-08-17T02:22:22.204505+0000","last_undegraded":"2024-08-17T02:22:22.204505+0000","last_fullsized":"2024-08-17T02:22:22.204505+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:37:52.949081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-08-17T02:22:23.191943+0000","last_change":"2024-08-17T02:22:21.174183+0000","last_active":"2024-08-17T02:22:23.191943+0000","last_peered":"2024-08-17T02:22:23.191943+0000","last_clean":"2024-08-17T02:22:23.191943+0000","last_became_active":"2024-08-17T02:22:21.173494+0000","last_became_peered":"2024-08-17T02:22:21.173494+0000","last_unstale":"2024-08-17T02:22:23.191943+0000","last_undegraded":"2024-08-17T02:22:23.191943+0000","last_fullsized":"2024-08-17T02:22:23.191943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:36:42.673124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.205718+0000","last_change":"2024-08-17T02:22:22.199900+0000","last_active":"2024-08-17T02:22:22.205718+0000","last_peered":"2024-08-17T02:22:22.205718+0000","last_clean":"2024-08-17T02:22:22.205718+0000","last_became_active":"2024-08-17T02:22:22.198791+0000","last_became_peered":"2024-08-17T02:22:22.198791+0000","last_unstale":"2024-08-17T02:22:22.205718+0000","last_undegraded":"2024-08-17T02:22:22.205718+0000","last_fullsized":"2024-08-17T02:22:22.205718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:47.721413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.216371+0000","last_change":"2024-08-17T02:22:21.187272+0000","last_active":"2024-08-17T02:22:22.216371+0000","last_peered":"2024-08-17T02:22:22.216371+0000","last_clean":"2024-08-17T02:22:22.216371+0000","last_became_active":"2024-08-17T02:22:21.186794+0000","last_became_peered":"2024-08-17T02:22:21.186794+0000","last_unstale":"2024-08-17T02:22:22.216371+0000","last_undegraded":"2024-08-17T02:22:22.216371+0000","last_fullsized":"2024-08-17T02:22:22.216371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:52:02.959411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.206287+0000","last_change":"2024-08-17T02:22:22.199762+0000","last_active":"2024-08-17T02:22:22.206287+0000","last_peered":"2024-08-17T02:22:22.206287+0000","last_clean":"2024-08-17T02:22:22.206287+0000","last_became_active":"2024-08-17T02:22:22.199436+0000","last_became_peered":"2024-08-17T02:22:22.199436+0000","last_unstale":"2024-08-17T02:22:22.206287+0000","last_undegraded":"2024-08-17T02:22:22.206287+0000","last_fullsized":"2024-08-17T02:22:22.206287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:34:22.570830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.200078+0000","last_change":"2024-08-17T02:22:21.176575+0000","last_active":"2024-08-17T02:22:22.200078+0000","last_peered":"2024-08-17T02:22:22.200078+0000","last_clean":"2024-08-17T02:22:22.200078+0000","last_became_active":"2024-08-17T02:22:21.175688+0000","last_became_peered":"2024-08-17T02:22:21.175688+0000","last_unstale":"2024-08-17T02:22:22.200078+0000","last_undegraded":"2024-08-17T02:22:22.200078+0000","last_fullsized":"2024-08-17T02:22:22.200078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:31:17.320632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.207067+0000","last_change":"2024-08-17T02:22:22.204419+0000","last_active":"2024-08-17T02:22:22.207067+0000","last_peered":"2024-08-17T02:22:22.207067+0000","last_clean":"2024-08-17T02:22:22.207067+0000","last_became_active":"2024-08-17T02:22:22.203728+0000","last_became_peered":"2024-08-17T02:22:22.203728+0000","last_unstale":"2024-08-17T02:22:22.207067+0000","last_undegraded":"2024-08-17T02:22:22.207067+0000","last_fullsized":"2024-08-17T02:22:22.207067+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:09:52.735534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.194675+0000","last_change":"2024-08-17T02:22:21.175288+0000","last_active":"2024-08-17T02:22:22.194675+0000","last_peered":"2024-08-17T02:22:22.194675+0000","last_clean":"2024-08-17T02:22:22.194675+0000","last_became_active":"2024-08-17T02:22:21.175003+0000","last_became_peered":"2024-08-17T02:22:21.175003+0000","last_unstale":"2024-08-17T02:22:22.194675+0000","last_undegraded":"2024-08-17T02:22:22.194675+0000","last_fullsized":"2024-08-17T02:22:22.194675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:14:08.171959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.205630+0000","last_change":"2024-08-17T02:22:22.199455+0000","last_active":"2024-08-17T02:22:22.205630+0000","last_peered":"2024-08-17T02:22:22.205630+0000","last_clean":"2024-08-17T02:22:22.205630+0000","last_became_active":"2024-08-17T02:22:22.198936+0000","last_became_peered":"2024-08-17T02:22:22.198936+0000","last_unstale":"2024-08-17T02:22:22.205630+0000","last_undegraded":"2024-08-17T02:22:22.205630+0000","last_fullsized":"2024-08-17T02:22:22.205630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:23.581757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.191747+0000","last_change":"2024-08-17T02:22:21.176180+0000","last_active":"2024-08-17T02:22:22.191747+0000","last_peered":"2024-08-17T02:22:22.191747+0000","last_clean":"2024-08-17T02:22:22.191747+0000","last_became_active":"2024-08-17T02:22:21.175771+0000","last_became_peered":"2024-08-17T02:22:21.175771+0000","last_unstale":"2024-08-17T02:22:22.191747+0000","last_undegraded":"2024-08-17T02:22:22.191747+0000","last_fullsized":"2024-08-17T02:22:22.191747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:14:32.873264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.198244+0000","last_change":"2024-08-17T02:22:22.194158+0000","last_active":"2024-08-17T02:22:22.198244+0000","last_peered":"2024-08-17T02:22:22.198244+0000","last_clean":"2024-08-17T02:22:22.198244+0000","last_became_active":"2024-08-17T02:22:22.193862+0000","last_became_peered":"2024-08-17T02:22:22.193862+0000","last_unstale":"2024-08-17T02:22:22.198244+0000","last_undegraded":"2024-08-17T02:22:22.198244+0000","last_fullsized":"2024-08-17T02:22:22.198244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:31:18.328390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.216316+0000","last_change":"2024-08-17T02:22:21.179787+0000","last_active":"2024-08-17T02:22:22.216316+0000","last_peered":"2024-08-17T02:22:22.216316+0000","last_clean":"2024-08-17T02:22:22.216316+0000","last_became_active":"2024-08-17T02:22:21.178882+0000","last_became_peered":"2024-08-17T02:22:21.178882+0000","last_unstale":"2024-08-17T02:22:22.216316+0000","last_undegraded":"2024-08-17T02:22:22.216316+0000","last_fullsized":"2024-08-17T02:22:22.216316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:11:57.093981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.212868+0000","last_change":"2024-08-17T02:22:22.209292+0000","last_active":"2024-08-17T02:22:22.212868+0000","last_peered":"2024-08-17T02:22:22.212868+0000","last_clean":"2024-08-17T02:22:22.212868+0000","last_became_active":"2024-08-17T02:22:22.208985+0000","last_became_peered":"2024-08-17T02:22:22.208985+0000","last_unstale":"2024-08-17T02:22:22.212868+0000","last_undegraded":"2024-08-17T02:22:22.212868+0000","last_fullsized":"2024-08-17T02:22:22.212868+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:06:36.575795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.206977+0000","last_change":"2024-08-17T02:22:22.202975+0000","last_active":"2024-08-17T02:22:22.206977+0000","last_peered":"2024-08-17T02:22:22.206977+0000","last_clean":"2024-08-17T02:22:22.206977+0000","last_became_active":"2024-08-17T02:22:22.202642+0000","last_became_peered":"2024-08-17T02:22:22.202642+0000","last_unstale":"2024-08-17T02:22:22.206977+0000","last_undegraded":"2024-08-17T02:22:22.206977+0000","last_fullsized":"2024-08-17T02:22:22.206977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:23:10.867889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.215387+0000","last_change":"2024-08-17T02:22:21.181265+0000","last_active":"2024-08-17T02:22:22.215387+0000","last_peered":"2024-08-17T02:22:22.215387+0000","last_clean":"2024-08-17T02:22:22.215387+0000","last_became_active":"2024-08-17T02:22:21.179868+0000","last_became_peered":"2024-08-17T02:22:21.179868+0000","last_unstale":"2024-08-17T02:22:22.215387+0000","last_undegraded":"2024-08-17T02:22:22.215387+0000","last_fullsized":"2024-08-17T02:22:22.215387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:01:30.822179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.209539+0000","last_change":"2024-08-17T02:22:22.204765+0000","last_active":"2024-08-17T02:22:22.209539+0000","last_peered":"2024-08-17T02:22:22.209539+0000","last_clean":"2024-08-17T02:22:22.209539+0000","last_became_active":"2024-08-17T02:22:22.204508+0000","last_became_peered":"2024-08-17T02:22:22.204508+0000","last_unstale":"2024-08-17T02:22:22.209539+0000","last_undegraded":"2024-08-17T02:22:22.209539+0000","last_fullsized":"2024-08-17T02:22:22.209539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:57:26.443145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.215321+0000","last_change":"2024-08-17T02:22:21.175884+0000","last_active":"2024-08-17T02:22:22.215321+0000","last_peered":"2024-08-17T02:22:22.215321+0000","last_clean":"2024-08-17T02:22:22.215321+0000","last_became_active":"2024-08-17T02:22:21.175130+0000","last_became_peered":"2024-08-17T02:22:21.175130+0000","last_unstale":"2024-08-17T02:22:22.215321+0000","last_undegraded":"2024-08-17T02:22:22.215321+0000","last_fullsized":"2024-08-17T02:22:22.215321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:47:30.406922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.201295+0000","last_change":"2024-08-17T02:22:22.193359+0000","last_active":"2024-08-17T02:22:22.201295+0000","last_peered":"2024-08-17T02:22:22.201295+0000","last_clean":"2024-08-17T02:22:22.201295+0000","last_became_active":"2024-08-17T02:22:22.192492+0000","last_became_peered":"2024-08-17T02:22:22.192492+0000","last_unstale":"2024-08-17T02:22:22.201295+0000","last_undegraded":"2024-08-17T02:22:22.201295+0000","last_fullsized":"2024-08-17T02:22:22.201295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:08:06.080463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.216505+0000","last_change":"2024-08-17T02:22:21.172581+0000","last_active":"2024-08-17T02:22:22.216505+0000","last_peered":"2024-08-17T02:22:22.216505+0000","last_clean":"2024-08-17T02:22:22.216505+0000","last_became_active":"2024-08-17T02:22:21.172139+0000","last_became_peered":"2024-08-17T02:22:21.172139+0000","last_unstale":"2024-08-17T02:22:22.216505+0000","last_undegraded":"2024-08-17T02:22:22.216505+0000","last_fullsized":"2024-08-17T02:22:22.216505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:01:30.822179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.201398+0000","last_change":"2024-08-17T02:22:22.196174+0000","last_active":"2024-08-17T02:22:22.201398+0000","last_peered":"2024-08-17T02:22:22.201398+0000","last_clean":"2024-08-17T02:22:22.201398+0000","last_became_active":"2024-08-17T02:22:22.195901+0000","last_became_peered":"2024-08-17T02:22:22.195901+0000","last_unstale":"2024-08-17T02:22:22.201398+0000","last_undegraded":"2024-08-17T02:22:22.201398+0000","last_fullsized":"2024-08-17T02:22:22.201398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:46:07.630925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.218844+0000","last_change":"2024-08-17T02:22:21.181273+0000","last_active":"2024-08-17T02:22:22.218844+0000","last_peered":"2024-08-17T02:22:22.218844+0000","last_clean":"2024-08-17T02:22:22.218844+0000","last_became_active":"2024-08-17T02:22:21.181022+0000","last_became_peered":"2024-08-17T02:22:21.181022+0000","last_unstale":"2024-08-17T02:22:22.218844+0000","last_undegraded":"2024-08-17T02:22:22.218844+0000","last_fullsized":"2024-08-17T02:22:22.218844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:47:30.406922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297592,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":241664,"data_stored":80755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]}]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298180,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073660,"statfs":{"total":96636764160,"available":96331427840,"internally_reserved":0,"allocated":835584,"data_stored":671091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]}]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":253952,"data_stored":82843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]}]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297588,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":237568,"data_stored":81201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.329}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]}]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297596,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074244,"statfs":{"total":96636764160,"available":96332025856,"internally_reserved":0,"allocated":245760,"data_stored":82183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298168,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073672,"statfs":{"total":96636764160,"available":96331440128,"internally_reserved":0,"allocated":831488,"data_stored":671069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2250000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.345}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5840000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297592,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":241664,"data_stored":80687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.0270000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.133}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301752,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070088,"statfs":{"total":96636764160,"available":96327770112,"internally_reserved":0,"allocated":233472,"data_stored":80631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2130000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3120000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2629999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:22:28.655 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:22:28.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.750+0000 7ff44bfff700 1 Processor -- start 2024-08-17T02:22:28.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.750+0000 7ff44bfff700 1 -- start start 2024-08-17T02:22:28.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.750+0000 7ff44bfff700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff44c154900 0x7ff44c0b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:28.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.750+0000 7ff44bfff700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff44c0b12d0 0x7ff44c0cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:28.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.750+0000 7ff44bfff700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff44c0b1730 con 0x7ff44c0cb390 2024-08-17T02:22:28.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.750+0000 7ff44bfff700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff44c068790 con 0x7ff44c0b12d0 2024-08-17T02:22:28.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.750+0000 7ff44bfff700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff44c1583f0 con 0x7ff44c154900 2024-08-17T02:22:28.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.750+0000 7ff44a7fc700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff44c0b12d0 0x7ff44c0cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:28.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.750+0000 7ff44affd700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff44c154900 0x7ff44c0b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:28.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.750+0000 7ff44a7fc700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff44c0b12d0 0x7ff44c0cae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42370/0 (socket says 172.21.15.104:42370) 2024-08-17T02:22:28.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.750+0000 7ff44a7fc700 1 -- 172.21.15.104:0/3297925146 learned_addr learned my addr 172.21.15.104:0/3297925146 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:28.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.750+0000 7ff44a7fc700 1 -- 172.21.15.104:0/3297925146 >> v2:172.21.15.117:3300/0 conn(0x7ff44c154900 msgr2=0x7ff44c0b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:28.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.750+0000 7ff449ffb700 1 -- 172.21.15.104:0/3297925146 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3739943398 0 0) 0x7ff444001490 con 0x7ff44c0cb390 2024-08-17T02:22:28.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.750+0000 7ff44a7fc700 1 --2- 172.21.15.104:0/3297925146 >> v2:172.21.15.117:3300/0 conn(0x7ff44c154900 0x7ff44c0b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.750+0000 7ff44a7fc700 1 -- 172.21.15.104:0/3297925146 >> v1:172.21.15.117:6789/0 conn(0x7ff44c0cb390 legacy=0x7ff44c06df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:28.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.750+0000 7ff44a7fc700 1 -- 172.21.15.104:0/3297925146 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff44c0cbaa0 con 0x7ff44c0b12d0 2024-08-17T02:22:28.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.750+0000 7ff44affd700 1 --2- 172.21.15.104:0/3297925146 >> v2:172.21.15.117:3300/0 conn(0x7ff44c154900 0x7ff44c0b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:22:28.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.754+0000 7ff44a7fc700 1 --2- 172.21.15.104:0/3297925146 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff44c0b12d0 0x7ff44c0cae50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff44c064e60 tx=0x7ff440009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e7014688702c52 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:28.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.754+0000 7ff449ffb700 1 -- 172.21.15.104:0/3297925146 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff440009e70 con 0x7ff44c0b12d0 2024-08-17T02:22:28.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.754+0000 7ff449ffb700 1 -- 172.21.15.104:0/3297925146 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff44000b860 con 0x7ff44c0b12d0 2024-08-17T02:22:28.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.754+0000 7ff449ffb700 1 -- 172.21.15.104:0/3297925146 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44000bc00 con 0x7ff44c0b12d0 2024-08-17T02:22:28.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.754+0000 7ff44bfff700 1 -- 172.21.15.104:0/3297925146 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff44c0b12d0 msgr2=0x7ff44c0cae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:28.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.754+0000 7ff44bfff700 1 --2- 172.21.15.104:0/3297925146 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff44c0b12d0 0x7ff44c0cae50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff44c064e60 tx=0x7ff440009250 comp rx=0 tx=0).stop 2024-08-17T02:22:28.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.754+0000 7ff44bfff700 1 -- 172.21.15.104:0/3297925146 shutdown_connections 2024-08-17T02:22:28.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.754+0000 7ff44bfff700 1 --2- 172.21.15.104:0/3297925146 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff44c0b12d0 0x7ff44c0cae50 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.754+0000 7ff44bfff700 1 --2- 172.21.15.104:0/3297925146 >> v2:172.21.15.117:3300/0 conn(0x7ff44c154900 0x7ff44c0b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.754+0000 7ff44bfff700 1 -- 172.21.15.104:0/3297925146 >> 172.21.15.104:0/3297925146 conn(0x7ff44c0678d0 msgr2=0x7ff44c067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:28.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.754+0000 7ff44bfff700 1 -- 172.21.15.104:0/3297925146 shutdown_connections 2024-08-17T02:22:28.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.754+0000 7ff44bfff700 1 -- 172.21.15.104:0/3297925146 wait complete. 2024-08-17T02:22:28.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.754+0000 7ff44bfff700 1 Processor -- start 2024-08-17T02:22:28.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.754+0000 7ff44bfff700 1 -- start start 2024-08-17T02:22:28.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.758+0000 7ff44bfff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff44c0b12d0 0x7ff44c14fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:28.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.758+0000 7ff44bfff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff44c0cb390 0x7ff44c069f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:28.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.758+0000 7ff44bfff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff44c154900 0x7ff44c06a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:28.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.758+0000 7ff44bfff700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c0a54f0 con 0x7ff44c0b12d0 2024-08-17T02:22:28.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.758+0000 7ff44bfff700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c0a57d0 con 0x7ff44c154900 2024-08-17T02:22:28.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.758+0000 7ff44bfff700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c0a5ab0 con 0x7ff44c0cb390 2024-08-17T02:22:28.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.758+0000 7ff44affd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff44c0b12d0 0x7ff44c14fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:28.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.758+0000 7ff44affd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff44c0b12d0 0x7ff44c14fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42380/0 (socket says 172.21.15.104:42380) 2024-08-17T02:22:28.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.758+0000 7ff44affd700 1 -- 172.21.15.104:0/2066692682 learned_addr learned my addr 172.21.15.104:0/2066692682 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:28.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.758+0000 7ff44a7fc700 1 --2- 172.21.15.104:0/2066692682 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff44c0cb390 0x7ff44c069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:28.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.758+0000 7ff44b7fe700 1 --2- 172.21.15.104:0/2066692682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff44c154900 0x7ff44c06a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:28.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.758+0000 7ff44affd700 1 -- 172.21.15.104:0/2066692682 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff44c0cb390 msgr2=0x7ff44c069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:28.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.758+0000 7ff44affd700 1 --2- 172.21.15.104:0/2066692682 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff44c0cb390 0x7ff44c069f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.758+0000 7ff44affd700 1 -- 172.21.15.104:0/2066692682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff44c154900 msgr2=0x7ff44c06a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:28.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.758+0000 7ff44affd700 1 --2- 172.21.15.104:0/2066692682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff44c154900 0x7ff44c06a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.758+0000 7ff44affd700 1 -- 172.21.15.104:0/2066692682 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff43c009420 con 0x7ff44c0b12d0 2024-08-17T02:22:28.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.758+0000 7ff44b7fe700 1 --2- 172.21.15.104:0/2066692682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff44c154900 0x7ff44c06a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:22:28.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.758+0000 7ff44affd700 1 --2- 172.21.15.104:0/2066692682 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff44c0b12d0 0x7ff44c14fec0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff43c00ec80 tx=0x7ff43c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:28.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.758+0000 7ff432ffd700 1 -- 172.21.15.104:0/2066692682 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c00c9d0 con 0x7ff44c0b12d0 2024-08-17T02:22:28.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.758+0000 7ff44bfff700 1 -- 172.21.15.104:0/2066692682 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4400094f0 con 0x7ff44c0b12d0 2024-08-17T02:22:28.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.758+0000 7ff432ffd700 1 -- 172.21.15.104:0/2066692682 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff43c00cb30 con 0x7ff44c0b12d0 2024-08-17T02:22:28.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.758+0000 7ff432ffd700 1 -- 172.21.15.104:0/2066692682 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c00ceb0 con 0x7ff44c0b12d0 2024-08-17T02:22:28.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.758+0000 7ff44bfff700 1 -- 172.21.15.104:0/2066692682 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff44c0a6070 con 0x7ff44c0b12d0 2024-08-17T02:22:28.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.758+0000 7ff44bfff700 1 -- 172.21.15.104:0/2066692682 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff44c0643a0 con 0x7ff44c0b12d0 2024-08-17T02:22:28.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.758+0000 7ff432ffd700 1 -- 172.21.15.104:0/2066692682 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff43c013680 con 0x7ff44c0b12d0 2024-08-17T02:22:28.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.758+0000 7ff432ffd700 1 --2- 172.21.15.104:0/2066692682 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff438060860 0x7ff438062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:28.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.758+0000 7ff432ffd700 1 -- 172.21.15.104:0/2066692682 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff43c07d050 con 0x7ff44c0b12d0 2024-08-17T02:22:28.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.762+0000 7ff44a7fc700 1 --2- 172.21.15.104:0/2066692682 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff438060860 0x7ff438062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:28.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.762+0000 7ff44a7fc700 1 --2- 172.21.15.104:0/2066692682 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff438060860 0x7ff438062d10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff44c064e60 tx=0x7ff440017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:28.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.770+0000 7ff432ffd700 1 -- 172.21.15.104:0/2066692682 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff43c04d4a0 con 0x7ff44c0b12d0 2024-08-17T02:22:28.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.918+0000 7ff44bfff700 1 -- 172.21.15.104:0/2066692682 --> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff44c06f5f0 con 0x7ff438060860 2024-08-17T02:22:28.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.934+0000 7ff432ffd700 1 -- 172.21.15.104:0/2066692682 <== mgr.4111 v2:172.21.15.117:6832/24084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264513 (secure 0 0 0) 0x7ff44c06f5f0 con 0x7ff438060860 2024-08-17T02:22:28.944 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:22:28.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.938+0000 7ff44bfff700 1 -- 172.21.15.104:0/2066692682 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff438060860 msgr2=0x7ff438062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:28.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.938+0000 7ff44bfff700 1 --2- 172.21.15.104:0/2066692682 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff438060860 0x7ff438062d10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff44c064e60 tx=0x7ff440017000 comp rx=0 tx=0).stop 2024-08-17T02:22:28.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.938+0000 7ff44bfff700 1 -- 172.21.15.104:0/2066692682 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff44c0b12d0 msgr2=0x7ff44c14fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:28.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.938+0000 7ff44bfff700 1 --2- 172.21.15.104:0/2066692682 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff44c0b12d0 0x7ff44c14fec0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff43c00ec80 tx=0x7ff43c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.938+0000 7ff44bfff700 1 -- 172.21.15.104:0/2066692682 shutdown_connections 2024-08-17T02:22:28.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.938+0000 7ff44bfff700 1 --2- 172.21.15.104:0/2066692682 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff438060860 0x7ff438062d10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.938+0000 7ff44bfff700 1 --2- 172.21.15.104:0/2066692682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff44c154900 0x7ff44c06a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.938+0000 7ff44bfff700 1 --2- 172.21.15.104:0/2066692682 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff44c0cb390 0x7ff44c069f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.938+0000 7ff44bfff700 1 --2- 172.21.15.104:0/2066692682 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff44c0b12d0 0x7ff44c14fec0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:28.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.938+0000 7ff44bfff700 1 -- 172.21.15.104:0/2066692682 >> 172.21.15.104:0/2066692682 conn(0x7ff44c0678d0 msgr2=0x7ff44c06cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:28.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.938+0000 7ff44bfff700 1 -- 172.21.15.104:0/2066692682 shutdown_connections 2024-08-17T02:22:28.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:28.938+0000 7ff44bfff700 1 -- 172.21.15.104:0/2066692682 wait complete. 2024-08-17T02:22:28.947 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-08-17T02:22:28.956 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-08-17T02:22:28.087771+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2386072,"kb_used_data":3048,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752588648,"statfs":{"total":773094113280,"available":770650775552,"internally_reserved":0,"allocated":3121152,"data_stored":1830460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.933708"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.213833+0000","last_change":"2024-08-17T02:22:22.207394+0000","last_active":"2024-08-17T02:22:22.213833+0000","last_peered":"2024-08-17T02:22:22.213833+0000","last_clean":"2024-08-17T02:22:22.213833+0000","last_became_active":"2024-08-17T02:22:22.207136+0000","last_became_peered":"2024-08-17T02:22:22.207136+0000","last_unstale":"2024-08-17T02:22:22.213833+0000","last_undegraded":"2024-08-17T02:22:22.213833+0000","last_fullsized":"2024-08-17T02:22:22.213833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:18:56.483735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.201158+0000","last_change":"2024-08-17T02:22:22.193365+0000","last_active":"2024-08-17T02:22:22.201158+0000","last_peered":"2024-08-17T02:22:22.201158+0000","last_clean":"2024-08-17T02:22:22.201158+0000","last_became_active":"2024-08-17T02:22:22.192975+0000","last_became_peered":"2024-08-17T02:22:22.192975+0000","last_unstale":"2024-08-17T02:22:22.201158+0000","last_undegraded":"2024-08-17T02:22:22.201158+0000","last_fullsized":"2024-08-17T02:22:22.201158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:21:01.768875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.201378+0000","last_change":"2024-08-17T02:22:22.195675+0000","last_active":"2024-08-17T02:22:22.201378+0000","last_peered":"2024-08-17T02:22:22.201378+0000","last_clean":"2024-08-17T02:22:22.201378+0000","last_became_active":"2024-08-17T02:22:22.195378+0000","last_became_peered":"2024-08-17T02:22:22.195378+0000","last_unstale":"2024-08-17T02:22:22.201378+0000","last_undegraded":"2024-08-17T02:22:22.201378+0000","last_fullsized":"2024-08-17T02:22:22.201378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:42:06.496970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.213303+0000","last_change":"2024-08-17T02:22:22.206371+0000","last_active":"2024-08-17T02:22:22.213303+0000","last_peered":"2024-08-17T02:22:22.213303+0000","last_clean":"2024-08-17T02:22:22.213303+0000","last_became_active":"2024-08-17T02:22:22.206060+0000","last_became_peered":"2024-08-17T02:22:22.206060+0000","last_unstale":"2024-08-17T02:22:22.213303+0000","last_undegraded":"2024-08-17T02:22:22.213303+0000","last_fullsized":"2024-08-17T02:22:22.213303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:14:09.179717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.214000+0000","last_change":"2024-08-17T02:22:22.205544+0000","last_active":"2024-08-17T02:22:22.214000+0000","last_peered":"2024-08-17T02:22:22.214000+0000","last_clean":"2024-08-17T02:22:22.214000+0000","last_became_active":"2024-08-17T02:22:22.204373+0000","last_became_peered":"2024-08-17T02:22:22.204373+0000","last_unstale":"2024-08-17T02:22:22.214000+0000","last_undegraded":"2024-08-17T02:22:22.214000+0000","last_fullsized":"2024-08-17T02:22:22.214000+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:12:21.015335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.210109+0000","last_change":"2024-08-17T02:22:22.203860+0000","last_active":"2024-08-17T02:22:22.210109+0000","last_peered":"2024-08-17T02:22:22.210109+0000","last_clean":"2024-08-17T02:22:22.210109+0000","last_became_active":"2024-08-17T02:22:22.203585+0000","last_became_peered":"2024-08-17T02:22:22.203585+0000","last_unstale":"2024-08-17T02:22:22.210109+0000","last_undegraded":"2024-08-17T02:22:22.210109+0000","last_fullsized":"2024-08-17T02:22:22.210109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:31:18.328390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.208402+0000","last_change":"2024-08-17T02:22:22.202691+0000","last_active":"2024-08-17T02:22:22.208402+0000","last_peered":"2024-08-17T02:22:22.208402+0000","last_clean":"2024-08-17T02:22:22.208402+0000","last_became_active":"2024-08-17T02:22:22.202339+0000","last_became_peered":"2024-08-17T02:22:22.202339+0000","last_unstale":"2024-08-17T02:22:22.208402+0000","last_undegraded":"2024-08-17T02:22:22.208402+0000","last_fullsized":"2024-08-17T02:22:22.208402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:42:06.496970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.204363+0000","last_change":"2024-08-17T02:22:22.198103+0000","last_active":"2024-08-17T02:22:22.204363+0000","last_peered":"2024-08-17T02:22:22.204363+0000","last_clean":"2024-08-17T02:22:22.204363+0000","last_became_active":"2024-08-17T02:22:22.197796+0000","last_became_peered":"2024-08-17T02:22:22.197796+0000","last_unstale":"2024-08-17T02:22:22.204363+0000","last_undegraded":"2024-08-17T02:22:22.204363+0000","last_fullsized":"2024-08-17T02:22:22.204363+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:52:23.293649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.207212+0000","last_change":"2024-08-17T02:22:22.202799+0000","last_active":"2024-08-17T02:22:22.207212+0000","last_peered":"2024-08-17T02:22:22.207212+0000","last_clean":"2024-08-17T02:22:22.207212+0000","last_became_active":"2024-08-17T02:22:22.202553+0000","last_became_peered":"2024-08-17T02:22:22.202553+0000","last_unstale":"2024-08-17T02:22:22.207212+0000","last_undegraded":"2024-08-17T02:22:22.207212+0000","last_fullsized":"2024-08-17T02:22:22.207212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:25:58.131547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.204173+0000","last_change":"2024-08-17T02:22:22.200665+0000","last_active":"2024-08-17T02:22:22.204173+0000","last_peered":"2024-08-17T02:22:22.204173+0000","last_clean":"2024-08-17T02:22:22.204173+0000","last_became_active":"2024-08-17T02:22:22.200068+0000","last_became_peered":"2024-08-17T02:22:22.200068+0000","last_unstale":"2024-08-17T02:22:22.204173+0000","last_undegraded":"2024-08-17T02:22:22.204173+0000","last_fullsized":"2024-08-17T02:22:22.204173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:45:56.296454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.211485+0000","last_change":"2024-08-17T02:22:22.205418+0000","last_active":"2024-08-17T02:22:22.211485+0000","last_peered":"2024-08-17T02:22:22.211485+0000","last_clean":"2024-08-17T02:22:22.211485+0000","last_became_active":"2024-08-17T02:22:22.205155+0000","last_became_peered":"2024-08-17T02:22:22.205155+0000","last_unstale":"2024-08-17T02:22:22.211485+0000","last_undegraded":"2024-08-17T02:22:22.211485+0000","last_fullsized":"2024-08-17T02:22:22.211485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:09:52.735534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.213936+0000","last_change":"2024-08-17T02:22:22.208616+0000","last_active":"2024-08-17T02:22:22.213936+0000","last_peered":"2024-08-17T02:22:22.213936+0000","last_clean":"2024-08-17T02:22:22.213936+0000","last_became_active":"2024-08-17T02:22:22.208243+0000","last_became_peered":"2024-08-17T02:22:22.208243+0000","last_unstale":"2024-08-17T02:22:22.213936+0000","last_undegraded":"2024-08-17T02:22:22.213936+0000","last_fullsized":"2024-08-17T02:22:22.213936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:06:36.575795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.207458+0000","last_change":"2024-08-17T02:22:22.201596+0000","last_active":"2024-08-17T02:22:22.207458+0000","last_peered":"2024-08-17T02:22:22.207458+0000","last_clean":"2024-08-17T02:22:22.207458+0000","last_became_active":"2024-08-17T02:22:22.201280+0000","last_became_peered":"2024-08-17T02:22:22.201280+0000","last_unstale":"2024-08-17T02:22:22.207458+0000","last_undegraded":"2024-08-17T02:22:22.207458+0000","last_fullsized":"2024-08-17T02:22:22.207458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:32:08.356996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.200897+0000","last_change":"2024-08-17T02:22:22.196235+0000","last_active":"2024-08-17T02:22:22.200897+0000","last_peered":"2024-08-17T02:22:22.200897+0000","last_clean":"2024-08-17T02:22:22.200897+0000","last_became_active":"2024-08-17T02:22:22.195933+0000","last_became_peered":"2024-08-17T02:22:22.195933+0000","last_unstale":"2024-08-17T02:22:22.200897+0000","last_undegraded":"2024-08-17T02:22:22.200897+0000","last_fullsized":"2024-08-17T02:22:22.200897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:24:36.708380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.205916+0000","last_change":"2024-08-17T02:22:22.203673+0000","last_active":"2024-08-17T02:22:22.205916+0000","last_peered":"2024-08-17T02:22:22.205916+0000","last_clean":"2024-08-17T02:22:22.205916+0000","last_became_active":"2024-08-17T02:22:22.203378+0000","last_became_peered":"2024-08-17T02:22:22.203378+0000","last_unstale":"2024-08-17T02:22:22.205916+0000","last_undegraded":"2024-08-17T02:22:22.205916+0000","last_fullsized":"2024-08-17T02:22:22.205916+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:14:55.331054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.207094+0000","last_change":"2024-08-17T02:22:22.204557+0000","last_active":"2024-08-17T02:22:22.207094+0000","last_peered":"2024-08-17T02:22:22.207094+0000","last_clean":"2024-08-17T02:22:22.207094+0000","last_became_active":"2024-08-17T02:22:22.203145+0000","last_became_peered":"2024-08-17T02:22:22.203145+0000","last_unstale":"2024-08-17T02:22:22.207094+0000","last_undegraded":"2024-08-17T02:22:22.207094+0000","last_fullsized":"2024-08-17T02:22:22.207094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:54:53.542063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.212534+0000","last_change":"2024-08-17T02:22:22.205880+0000","last_active":"2024-08-17T02:22:22.212534+0000","last_peered":"2024-08-17T02:22:22.212534+0000","last_clean":"2024-08-17T02:22:22.212534+0000","last_became_active":"2024-08-17T02:22:22.205133+0000","last_became_peered":"2024-08-17T02:22:22.205133+0000","last_unstale":"2024-08-17T02:22:22.212534+0000","last_undegraded":"2024-08-17T02:22:22.212534+0000","last_fullsized":"2024-08-17T02:22:22.212534+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:42:34.031508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.204812+0000","last_change":"2024-08-17T02:22:22.199981+0000","last_active":"2024-08-17T02:22:22.204812+0000","last_peered":"2024-08-17T02:22:22.204812+0000","last_clean":"2024-08-17T02:22:22.204812+0000","last_became_active":"2024-08-17T02:22:22.199695+0000","last_became_peered":"2024-08-17T02:22:22.199695+0000","last_unstale":"2024-08-17T02:22:22.204812+0000","last_undegraded":"2024-08-17T02:22:22.204812+0000","last_fullsized":"2024-08-17T02:22:22.204812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:10:01.636342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.203094+0000","last_change":"2024-08-17T02:22:22.195819+0000","last_active":"2024-08-17T02:22:22.203094+0000","last_peered":"2024-08-17T02:22:22.203094+0000","last_clean":"2024-08-17T02:22:22.203094+0000","last_became_active":"2024-08-17T02:22:22.195534+0000","last_became_peered":"2024-08-17T02:22:22.195534+0000","last_unstale":"2024-08-17T02:22:22.203094+0000","last_undegraded":"2024-08-17T02:22:22.203094+0000","last_fullsized":"2024-08-17T02:22:22.203094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:14:13.686376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.213954+0000","last_change":"2024-08-17T02:22:22.208982+0000","last_active":"2024-08-17T02:22:22.213954+0000","last_peered":"2024-08-17T02:22:22.213954+0000","last_clean":"2024-08-17T02:22:22.213954+0000","last_became_active":"2024-08-17T02:22:22.208519+0000","last_became_peered":"2024-08-17T02:22:22.208519+0000","last_unstale":"2024-08-17T02:22:22.213954+0000","last_undegraded":"2024-08-17T02:22:22.213954+0000","last_fullsized":"2024-08-17T02:22:22.213954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:14:55.331054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.216569+0000","last_change":"2024-08-17T02:22:22.208260+0000","last_active":"2024-08-17T02:22:22.216569+0000","last_peered":"2024-08-17T02:22:22.216569+0000","last_clean":"2024-08-17T02:22:22.216569+0000","last_became_active":"2024-08-17T02:22:22.207547+0000","last_became_peered":"2024-08-17T02:22:22.207547+0000","last_unstale":"2024-08-17T02:22:22.216569+0000","last_undegraded":"2024-08-17T02:22:22.216569+0000","last_fullsized":"2024-08-17T02:22:22.216569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:50:20.438197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.207287+0000","last_change":"2024-08-17T02:22:22.199523+0000","last_active":"2024-08-17T02:22:22.207287+0000","last_peered":"2024-08-17T02:22:22.207287+0000","last_clean":"2024-08-17T02:22:22.207287+0000","last_became_active":"2024-08-17T02:22:22.198679+0000","last_became_peered":"2024-08-17T02:22:22.198679+0000","last_unstale":"2024-08-17T02:22:22.207287+0000","last_undegraded":"2024-08-17T02:22:22.207287+0000","last_fullsized":"2024-08-17T02:22:22.207287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:52:03.967168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.205677+0000","last_change":"2024-08-17T02:22:22.200108+0000","last_active":"2024-08-17T02:22:22.205677+0000","last_peered":"2024-08-17T02:22:22.205677+0000","last_clean":"2024-08-17T02:22:22.205677+0000","last_became_active":"2024-08-17T02:22:22.199791+0000","last_became_peered":"2024-08-17T02:22:22.199791+0000","last_unstale":"2024-08-17T02:22:22.205677+0000","last_undegraded":"2024-08-17T02:22:22.205677+0000","last_fullsized":"2024-08-17T02:22:22.205677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:50:20.438197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.206397+0000","last_change":"2024-08-17T02:22:22.197872+0000","last_active":"2024-08-17T02:22:22.206397+0000","last_peered":"2024-08-17T02:22:22.206397+0000","last_clean":"2024-08-17T02:22:22.206397+0000","last_became_active":"2024-08-17T02:22:22.197575+0000","last_became_peered":"2024-08-17T02:22:22.197575+0000","last_unstale":"2024-08-17T02:22:22.206397+0000","last_undegraded":"2024-08-17T02:22:22.206397+0000","last_fullsized":"2024-08-17T02:22:22.206397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:19:48.379073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.201276+0000","last_change":"2024-08-17T02:22:22.192977+0000","last_active":"2024-08-17T02:22:22.201276+0000","last_peered":"2024-08-17T02:22:22.201276+0000","last_clean":"2024-08-17T02:22:22.201276+0000","last_became_active":"2024-08-17T02:22:22.192692+0000","last_became_peered":"2024-08-17T02:22:22.192692+0000","last_unstale":"2024-08-17T02:22:22.201276+0000","last_undegraded":"2024-08-17T02:22:22.201276+0000","last_fullsized":"2024-08-17T02:22:22.201276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:45:56.296454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.213112+0000","last_change":"2024-08-17T02:22:22.206334+0000","last_active":"2024-08-17T02:22:22.213112+0000","last_peered":"2024-08-17T02:22:22.213112+0000","last_clean":"2024-08-17T02:22:22.213112+0000","last_became_active":"2024-08-17T02:22:22.203810+0000","last_became_peered":"2024-08-17T02:22:22.203810+0000","last_unstale":"2024-08-17T02:22:22.213112+0000","last_undegraded":"2024-08-17T02:22:22.213112+0000","last_fullsized":"2024-08-17T02:22:22.213112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:44:23.689354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.200920+0000","last_change":"2024-08-17T02:22:22.196495+0000","last_active":"2024-08-17T02:22:22.200920+0000","last_peered":"2024-08-17T02:22:22.200920+0000","last_clean":"2024-08-17T02:22:22.200920+0000","last_became_active":"2024-08-17T02:22:22.196141+0000","last_became_peered":"2024-08-17T02:22:22.196141+0000","last_unstale":"2024-08-17T02:22:22.200920+0000","last_undegraded":"2024-08-17T02:22:22.200920+0000","last_fullsized":"2024-08-17T02:22:22.200920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:50:27.904463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.210390+0000","last_change":"2024-08-17T02:22:22.206082+0000","last_active":"2024-08-17T02:22:22.210390+0000","last_peered":"2024-08-17T02:22:22.210390+0000","last_clean":"2024-08-17T02:22:22.210390+0000","last_became_active":"2024-08-17T02:22:22.205748+0000","last_became_peered":"2024-08-17T02:22:22.205748+0000","last_unstale":"2024-08-17T02:22:22.210390+0000","last_undegraded":"2024-08-17T02:22:22.210390+0000","last_fullsized":"2024-08-17T02:22:22.210390+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:37:31.095543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.198292+0000","last_change":"2024-08-17T02:22:22.188239+0000","last_active":"2024-08-17T02:22:22.198292+0000","last_peered":"2024-08-17T02:22:22.198292+0000","last_clean":"2024-08-17T02:22:22.198292+0000","last_became_active":"2024-08-17T02:22:22.187975+0000","last_became_peered":"2024-08-17T02:22:22.187975+0000","last_unstale":"2024-08-17T02:22:22.198292+0000","last_undegraded":"2024-08-17T02:22:22.198292+0000","last_fullsized":"2024-08-17T02:22:22.198292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:01:06.448601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.203235+0000","last_change":"2024-08-17T02:22:22.200334+0000","last_active":"2024-08-17T02:22:22.203235+0000","last_peered":"2024-08-17T02:22:22.203235+0000","last_clean":"2024-08-17T02:22:22.203235+0000","last_became_active":"2024-08-17T02:22:22.200074+0000","last_became_peered":"2024-08-17T02:22:22.200074+0000","last_unstale":"2024-08-17T02:22:22.203235+0000","last_undegraded":"2024-08-17T02:22:22.203235+0000","last_fullsized":"2024-08-17T02:22:22.203235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:40:31.008079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.191172+0000","last_change":"2024-08-17T02:22:22.189468+0000","last_active":"2024-08-17T02:22:22.191172+0000","last_peered":"2024-08-17T02:22:22.191172+0000","last_clean":"2024-08-17T02:22:22.191172+0000","last_became_active":"2024-08-17T02:22:22.189055+0000","last_became_peered":"2024-08-17T02:22:22.189055+0000","last_unstale":"2024-08-17T02:22:22.191172+0000","last_undegraded":"2024-08-17T02:22:22.191172+0000","last_fullsized":"2024-08-17T02:22:22.191172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:14:09.179717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.211815+0000","last_change":"2024-08-17T02:22:22.204911+0000","last_active":"2024-08-17T02:22:22.211815+0000","last_peered":"2024-08-17T02:22:22.211815+0000","last_clean":"2024-08-17T02:22:22.211815+0000","last_became_active":"2024-08-17T02:22:22.204551+0000","last_became_peered":"2024-08-17T02:22:22.204551+0000","last_unstale":"2024-08-17T02:22:22.211815+0000","last_undegraded":"2024-08-17T02:22:22.211815+0000","last_fullsized":"2024-08-17T02:22:22.211815+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:47:31.414680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.207076+0000","last_change":"2024-08-17T02:22:22.193415+0000","last_active":"2024-08-17T02:22:22.207076+0000","last_peered":"2024-08-17T02:22:22.207076+0000","last_clean":"2024-08-17T02:22:22.207076+0000","last_became_active":"2024-08-17T02:22:22.193075+0000","last_became_peered":"2024-08-17T02:22:22.193075+0000","last_unstale":"2024-08-17T02:22:22.207076+0000","last_undegraded":"2024-08-17T02:22:22.207076+0000","last_fullsized":"2024-08-17T02:22:22.207076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:10:01.636342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.216386+0000","last_change":"2024-08-17T02:22:21.175481+0000","last_active":"2024-08-17T02:22:22.216386+0000","last_peered":"2024-08-17T02:22:22.216386+0000","last_clean":"2024-08-17T02:22:22.216386+0000","last_became_active":"2024-08-17T02:22:21.175155+0000","last_became_peered":"2024-08-17T02:22:21.175155+0000","last_unstale":"2024-08-17T02:22:22.216386+0000","last_undegraded":"2024-08-17T02:22:22.216386+0000","last_fullsized":"2024-08-17T02:22:22.216386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:35:31.942397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.205780+0000","last_change":"2024-08-17T02:22:22.204166+0000","last_active":"2024-08-17T02:22:22.205780+0000","last_peered":"2024-08-17T02:22:22.205780+0000","last_clean":"2024-08-17T02:22:22.205780+0000","last_became_active":"2024-08-17T02:22:22.203874+0000","last_became_peered":"2024-08-17T02:22:22.203874+0000","last_unstale":"2024-08-17T02:22:22.205780+0000","last_undegraded":"2024-08-17T02:22:22.205780+0000","last_fullsized":"2024-08-17T02:22:22.205780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:12:21.015335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.215833+0000","last_change":"2024-08-17T02:22:21.187087+0000","last_active":"2024-08-17T02:22:22.215833+0000","last_peered":"2024-08-17T02:22:22.215833+0000","last_clean":"2024-08-17T02:22:22.215833+0000","last_became_active":"2024-08-17T02:22:21.186780+0000","last_became_peered":"2024-08-17T02:22:21.186780+0000","last_unstale":"2024-08-17T02:22:22.215833+0000","last_undegraded":"2024-08-17T02:22:22.215833+0000","last_fullsized":"2024-08-17T02:22:22.215833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:53:21.168875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.191314+0000","last_change":"2024-08-17T02:22:21.184095+0000","last_active":"2024-08-17T02:22:22.191314+0000","last_peered":"2024-08-17T02:22:22.191314+0000","last_clean":"2024-08-17T02:22:22.191314+0000","last_became_active":"2024-08-17T02:22:21.183707+0000","last_became_peered":"2024-08-17T02:22:21.183707+0000","last_unstale":"2024-08-17T02:22:22.191314+0000","last_undegraded":"2024-08-17T02:22:22.191314+0000","last_fullsized":"2024-08-17T02:22:22.191314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:33:34.653965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.201739+0000","last_change":"2024-08-17T02:22:22.193669+0000","last_active":"2024-08-17T02:22:22.201739+0000","last_peered":"2024-08-17T02:22:22.201739+0000","last_clean":"2024-08-17T02:22:22.201739+0000","last_became_active":"2024-08-17T02:22:22.193231+0000","last_became_peered":"2024-08-17T02:22:22.193231+0000","last_unstale":"2024-08-17T02:22:22.201739+0000","last_undegraded":"2024-08-17T02:22:22.201739+0000","last_fullsized":"2024-08-17T02:22:22.201739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:34:22.570830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.190339+0000","last_change":"2024-08-17T02:22:21.178190+0000","last_active":"2024-08-17T02:22:22.190339+0000","last_peered":"2024-08-17T02:22:22.190339+0000","last_clean":"2024-08-17T02:22:22.190339+0000","last_became_active":"2024-08-17T02:22:21.177828+0000","last_became_peered":"2024-08-17T02:22:21.177828+0000","last_unstale":"2024-08-17T02:22:22.190339+0000","last_undegraded":"2024-08-17T02:22:22.190339+0000","last_fullsized":"2024-08-17T02:22:22.190339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:10:00.628584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.216728+0000","last_change":"2024-08-17T02:22:22.209400+0000","last_active":"2024-08-17T02:22:22.216728+0000","last_peered":"2024-08-17T02:22:22.216728+0000","last_clean":"2024-08-17T02:22:22.216728+0000","last_became_active":"2024-08-17T02:22:22.208986+0000","last_became_peered":"2024-08-17T02:22:22.208986+0000","last_unstale":"2024-08-17T02:22:22.216728+0000","last_undegraded":"2024-08-17T02:22:22.216728+0000","last_fullsized":"2024-08-17T02:22:22.216728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:01:06.448601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.182530+0000","last_change":"2024-08-17T02:22:21.171298+0000","last_active":"2024-08-17T02:22:22.182530+0000","last_peered":"2024-08-17T02:22:22.182530+0000","last_clean":"2024-08-17T02:22:22.182530+0000","last_became_active":"2024-08-17T02:22:21.170688+0000","last_became_peered":"2024-08-17T02:22:21.170688+0000","last_unstale":"2024-08-17T02:22:22.182530+0000","last_undegraded":"2024-08-17T02:22:22.182530+0000","last_fullsized":"2024-08-17T02:22:22.182530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:14:01.383880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.213088+0000","last_change":"2024-08-17T02:22:22.205723+0000","last_active":"2024-08-17T02:22:22.213088+0000","last_peered":"2024-08-17T02:22:22.213088+0000","last_clean":"2024-08-17T02:22:22.213088+0000","last_became_active":"2024-08-17T02:22:22.204195+0000","last_became_peered":"2024-08-17T02:22:22.204195+0000","last_unstale":"2024-08-17T02:22:22.213088+0000","last_undegraded":"2024-08-17T02:22:22.213088+0000","last_fullsized":"2024-08-17T02:22:22.213088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:53:22.176633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.201196+0000","last_change":"2024-08-17T02:22:21.176993+0000","last_active":"2024-08-17T02:22:22.201196+0000","last_peered":"2024-08-17T02:22:22.201196+0000","last_clean":"2024-08-17T02:22:22.201196+0000","last_became_active":"2024-08-17T02:22:21.175101+0000","last_became_peered":"2024-08-17T02:22:21.175101+0000","last_unstale":"2024-08-17T02:22:22.201196+0000","last_undegraded":"2024-08-17T02:22:22.201196+0000","last_fullsized":"2024-08-17T02:22:22.201196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:35:31.942397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.207541+0000","last_change":"2024-08-17T02:22:22.204502+0000","last_active":"2024-08-17T02:22:22.207541+0000","last_peered":"2024-08-17T02:22:22.207541+0000","last_clean":"2024-08-17T02:22:22.207541+0000","last_became_active":"2024-08-17T02:22:22.204194+0000","last_became_peered":"2024-08-17T02:22:22.204194+0000","last_unstale":"2024-08-17T02:22:22.207541+0000","last_undegraded":"2024-08-17T02:22:22.207541+0000","last_fullsized":"2024-08-17T02:22:22.207541+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:18:56.483735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.219276+0000","last_change":"2024-08-17T02:22:21.175948+0000","last_active":"2024-08-17T02:22:22.219276+0000","last_peered":"2024-08-17T02:22:22.219276+0000","last_clean":"2024-08-17T02:22:22.219276+0000","last_became_active":"2024-08-17T02:22:21.175638+0000","last_became_peered":"2024-08-17T02:22:21.175638+0000","last_unstale":"2024-08-17T02:22:22.219276+0000","last_undegraded":"2024-08-17T02:22:22.219276+0000","last_fullsized":"2024-08-17T02:22:22.219276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:14:01.383880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.208878+0000","last_change":"2024-08-17T02:22:22.203497+0000","last_active":"2024-08-17T02:22:22.208878+0000","last_peered":"2024-08-17T02:22:22.208878+0000","last_clean":"2024-08-17T02:22:22.208878+0000","last_became_active":"2024-08-17T02:22:22.203129+0000","last_became_peered":"2024-08-17T02:22:22.203129+0000","last_unstale":"2024-08-17T02:22:22.208878+0000","last_undegraded":"2024-08-17T02:22:22.208878+0000","last_fullsized":"2024-08-17T02:22:22.208878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:08:06.080463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.221812+0000","last_change":"2024-08-17T02:22:21.172088+0000","last_active":"2024-08-17T02:22:22.221812+0000","last_peered":"2024-08-17T02:22:22.221812+0000","last_clean":"2024-08-17T02:22:22.221812+0000","last_became_active":"2024-08-17T02:22:21.171674+0000","last_became_peered":"2024-08-17T02:22:21.171674+0000","last_unstale":"2024-08-17T02:22:22.221812+0000","last_undegraded":"2024-08-17T02:22:22.221812+0000","last_fullsized":"2024-08-17T02:22:22.221812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:20:14.853980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.204202+0000","last_change":"2024-08-17T02:22:22.200767+0000","last_active":"2024-08-17T02:22:22.204202+0000","last_peered":"2024-08-17T02:22:22.204202+0000","last_clean":"2024-08-17T02:22:22.204202+0000","last_became_active":"2024-08-17T02:22:22.200355+0000","last_became_peered":"2024-08-17T02:22:22.200355+0000","last_unstale":"2024-08-17T02:22:22.204202+0000","last_undegraded":"2024-08-17T02:22:22.204202+0000","last_fullsized":"2024-08-17T02:22:22.204202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:46:07.630925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.216387+0000","last_change":"2024-08-17T02:22:21.183259+0000","last_active":"2024-08-17T02:22:22.216387+0000","last_peered":"2024-08-17T02:22:22.216387+0000","last_clean":"2024-08-17T02:22:22.216387+0000","last_became_active":"2024-08-17T02:22:21.182967+0000","last_became_peered":"2024-08-17T02:22:21.182967+0000","last_unstale":"2024-08-17T02:22:22.216387+0000","last_undegraded":"2024-08-17T02:22:22.216387+0000","last_fullsized":"2024-08-17T02:22:22.216387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:43:54.663464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.207486+0000","last_change":"2024-08-17T02:22:22.203414+0000","last_active":"2024-08-17T02:22:22.207486+0000","last_peered":"2024-08-17T02:22:22.207486+0000","last_clean":"2024-08-17T02:22:22.207486+0000","last_became_active":"2024-08-17T02:22:22.203022+0000","last_became_peered":"2024-08-17T02:22:22.203022+0000","last_unstale":"2024-08-17T02:22:22.207486+0000","last_undegraded":"2024-08-17T02:22:22.207486+0000","last_fullsized":"2024-08-17T02:22:22.207486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:00:35.929768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.193755+0000","last_change":"2024-08-17T02:22:21.181277+0000","last_active":"2024-08-17T02:22:22.193755+0000","last_peered":"2024-08-17T02:22:22.193755+0000","last_clean":"2024-08-17T02:22:22.193755+0000","last_became_active":"2024-08-17T02:22:21.178480+0000","last_became_peered":"2024-08-17T02:22:21.178480+0000","last_unstale":"2024-08-17T02:22:22.193755+0000","last_undegraded":"2024-08-17T02:22:22.193755+0000","last_fullsized":"2024-08-17T02:22:22.193755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:31:17.320632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.207011+0000","last_change":"2024-08-17T02:22:22.203294+0000","last_active":"2024-08-17T02:22:22.207011+0000","last_peered":"2024-08-17T02:22:22.207011+0000","last_clean":"2024-08-17T02:22:22.207011+0000","last_became_active":"2024-08-17T02:22:22.202695+0000","last_became_peered":"2024-08-17T02:22:22.202695+0000","last_unstale":"2024-08-17T02:22:22.207011+0000","last_undegraded":"2024-08-17T02:22:22.207011+0000","last_fullsized":"2024-08-17T02:22:22.207011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:11:36.411933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.200472+0000","last_change":"2024-08-17T02:22:21.186990+0000","last_active":"2024-08-17T02:22:22.200472+0000","last_peered":"2024-08-17T02:22:22.200472+0000","last_clean":"2024-08-17T02:22:22.200472+0000","last_became_active":"2024-08-17T02:22:21.186627+0000","last_became_peered":"2024-08-17T02:22:21.186627+0000","last_unstale":"2024-08-17T02:22:22.200472+0000","last_undegraded":"2024-08-17T02:22:22.200472+0000","last_fullsized":"2024-08-17T02:22:22.200472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:10:00.628584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.201334+0000","last_change":"2024-08-17T02:22:22.191715+0000","last_active":"2024-08-17T02:22:22.201334+0000","last_peered":"2024-08-17T02:22:22.201334+0000","last_clean":"2024-08-17T02:22:22.201334+0000","last_became_active":"2024-08-17T02:22:22.191284+0000","last_became_peered":"2024-08-17T02:22:22.191284+0000","last_unstale":"2024-08-17T02:22:22.201334+0000","last_undegraded":"2024-08-17T02:22:22.201334+0000","last_fullsized":"2024-08-17T02:22:22.201334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:31:18.328390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.219572+0000","last_change":"2024-08-17T02:22:21.173553+0000","last_active":"2024-08-17T02:22:22.219572+0000","last_peered":"2024-08-17T02:22:22.219572+0000","last_clean":"2024-08-17T02:22:22.219572+0000","last_became_active":"2024-08-17T02:22:21.173159+0000","last_became_peered":"2024-08-17T02:22:21.173159+0000","last_unstale":"2024-08-17T02:22:22.219572+0000","last_undegraded":"2024-08-17T02:22:22.219572+0000","last_fullsized":"2024-08-17T02:22:22.219572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:35:31.942397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.212641+0000","last_change":"2024-08-17T02:22:22.206143+0000","last_active":"2024-08-17T02:22:22.212641+0000","last_peered":"2024-08-17T02:22:22.212641+0000","last_clean":"2024-08-17T02:22:22.212641+0000","last_became_active":"2024-08-17T02:22:22.203641+0000","last_became_peered":"2024-08-17T02:22:22.203641+0000","last_unstale":"2024-08-17T02:22:22.212641+0000","last_undegraded":"2024-08-17T02:22:22.212641+0000","last_fullsized":"2024-08-17T02:22:22.212641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:49:03.418573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.215239+0000","last_change":"2024-08-17T02:22:21.174493+0000","last_active":"2024-08-17T02:22:22.215239+0000","last_peered":"2024-08-17T02:22:22.215239+0000","last_clean":"2024-08-17T02:22:22.215239+0000","last_became_active":"2024-08-17T02:22:21.174142+0000","last_became_peered":"2024-08-17T02:22:21.174142+0000","last_unstale":"2024-08-17T02:22:22.215239+0000","last_undegraded":"2024-08-17T02:22:22.215239+0000","last_fullsized":"2024-08-17T02:22:22.215239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:14:08.171959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.206463+0000","last_change":"2024-08-17T02:22:22.201098+0000","last_active":"2024-08-17T02:22:22.206463+0000","last_peered":"2024-08-17T02:22:22.206463+0000","last_clean":"2024-08-17T02:22:22.206463+0000","last_became_active":"2024-08-17T02:22:22.200673+0000","last_became_peered":"2024-08-17T02:22:22.200673+0000","last_unstale":"2024-08-17T02:22:22.206463+0000","last_undegraded":"2024-08-17T02:22:22.206463+0000","last_fullsized":"2024-08-17T02:22:22.206463+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:25:58.131547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.218662+0000","last_change":"2024-08-17T02:22:21.175560+0000","last_active":"2024-08-17T02:22:22.218662+0000","last_peered":"2024-08-17T02:22:22.218662+0000","last_clean":"2024-08-17T02:22:22.218662+0000","last_became_active":"2024-08-17T02:22:21.175262+0000","last_became_peered":"2024-08-17T02:22:21.175262+0000","last_unstale":"2024-08-17T02:22:22.218662+0000","last_undegraded":"2024-08-17T02:22:22.218662+0000","last_fullsized":"2024-08-17T02:22:22.218662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:01:30.822179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.213856+0000","last_change":"2024-08-17T02:22:22.207471+0000","last_active":"2024-08-17T02:22:22.213856+0000","last_peered":"2024-08-17T02:22:22.213856+0000","last_clean":"2024-08-17T02:22:22.213856+0000","last_became_active":"2024-08-17T02:22:22.207237+0000","last_became_peered":"2024-08-17T02:22:22.207237+0000","last_unstale":"2024-08-17T02:22:22.213856+0000","last_undegraded":"2024-08-17T02:22:22.213856+0000","last_fullsized":"2024-08-17T02:22:22.213856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:52:23.293649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.216725+0000","last_change":"2024-08-17T02:22:21.173738+0000","last_active":"2024-08-17T02:22:22.216725+0000","last_peered":"2024-08-17T02:22:22.216725+0000","last_clean":"2024-08-17T02:22:22.216725+0000","last_became_active":"2024-08-17T02:22:21.173409+0000","last_became_peered":"2024-08-17T02:22:21.173409+0000","last_unstale":"2024-08-17T02:22:22.216725+0000","last_undegraded":"2024-08-17T02:22:22.216725+0000","last_fullsized":"2024-08-17T02:22:22.216725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:43:54.663464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.203920+0000","last_change":"2024-08-17T02:22:22.200396+0000","last_active":"2024-08-17T02:22:22.203920+0000","last_peered":"2024-08-17T02:22:22.203920+0000","last_clean":"2024-08-17T02:22:22.203920+0000","last_became_active":"2024-08-17T02:22:22.199830+0000","last_became_peered":"2024-08-17T02:22:22.199830+0000","last_unstale":"2024-08-17T02:22:22.203920+0000","last_undegraded":"2024-08-17T02:22:22.203920+0000","last_fullsized":"2024-08-17T02:22:22.203920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:08:06.080463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.191599+0000","last_change":"2024-08-17T02:22:21.179346+0000","last_active":"2024-08-17T02:22:22.191599+0000","last_peered":"2024-08-17T02:22:22.191599+0000","last_clean":"2024-08-17T02:22:22.191599+0000","last_became_active":"2024-08-17T02:22:21.179089+0000","last_became_peered":"2024-08-17T02:22:21.179089+0000","last_unstale":"2024-08-17T02:22:22.191599+0000","last_undegraded":"2024-08-17T02:22:22.191599+0000","last_fullsized":"2024-08-17T02:22:22.191599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:05:31.566094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.213029+0000","last_change":"2024-08-17T02:22:22.210702+0000","last_active":"2024-08-17T02:22:22.213029+0000","last_peered":"2024-08-17T02:22:22.213029+0000","last_clean":"2024-08-17T02:22:22.213029+0000","last_became_active":"2024-08-17T02:22:22.210369+0000","last_became_peered":"2024-08-17T02:22:22.210369+0000","last_unstale":"2024-08-17T02:22:22.213029+0000","last_undegraded":"2024-08-17T02:22:22.213029+0000","last_fullsized":"2024-08-17T02:22:22.213029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:18:56.483735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":163,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.181820+0000","last_change":"2024-08-17T02:22:11.967052+0000","last_active":"2024-08-17T02:22:22.181820+0000","last_peered":"2024-08-17T02:22:22.181820+0000","last_clean":"2024-08-17T02:22:22.181820+0000","last_became_active":"2024-08-17T02:22:11.965269+0000","last_became_peered":"2024-08-17T02:22:11.965269+0000","last_unstale":"2024-08-17T02:22:22.181820+0000","last_undegraded":"2024-08-17T02:22:22.181820+0000","last_fullsized":"2024-08-17T02:22:22.181820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:10.930862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:10.930862+0000","last_clean_scrub_stamp":"2024-08-17T02:22:10.930862+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:59:34.931003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.194953+0000","last_change":"2024-08-17T02:22:21.177962+0000","last_active":"2024-08-17T02:22:22.194953+0000","last_peered":"2024-08-17T02:22:22.194953+0000","last_clean":"2024-08-17T02:22:22.194953+0000","last_became_active":"2024-08-17T02:22:21.174574+0000","last_became_peered":"2024-08-17T02:22:21.174574+0000","last_unstale":"2024-08-17T02:22:22.194953+0000","last_undegraded":"2024-08-17T02:22:22.194953+0000","last_fullsized":"2024-08-17T02:22:22.194953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:44:22.681596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.216579+0000","last_change":"2024-08-17T02:22:22.207889+0000","last_active":"2024-08-17T02:22:22.216579+0000","last_peered":"2024-08-17T02:22:22.216579+0000","last_clean":"2024-08-17T02:22:22.216579+0000","last_became_active":"2024-08-17T02:22:22.207591+0000","last_became_peered":"2024-08-17T02:22:22.207591+0000","last_unstale":"2024-08-17T02:22:22.216579+0000","last_undegraded":"2024-08-17T02:22:22.216579+0000","last_fullsized":"2024-08-17T02:22:22.216579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:49:22.101879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.190447+0000","last_change":"2024-08-17T02:22:21.182666+0000","last_active":"2024-08-17T02:22:22.190447+0000","last_peered":"2024-08-17T02:22:22.190447+0000","last_clean":"2024-08-17T02:22:22.190447+0000","last_became_active":"2024-08-17T02:22:21.182346+0000","last_became_peered":"2024-08-17T02:22:21.182346+0000","last_unstale":"2024-08-17T02:22:22.190447+0000","last_undegraded":"2024-08-17T02:22:22.190447+0000","last_fullsized":"2024-08-17T02:22:22.190447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:14:08.171959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.213809+0000","last_change":"2024-08-17T02:22:22.204365+0000","last_active":"2024-08-17T02:22:22.213809+0000","last_peered":"2024-08-17T02:22:22.213809+0000","last_clean":"2024-08-17T02:22:22.213809+0000","last_became_active":"2024-08-17T02:22:22.204108+0000","last_became_peered":"2024-08-17T02:22:22.204108+0000","last_unstale":"2024-08-17T02:22:22.213809+0000","last_undegraded":"2024-08-17T02:22:22.213809+0000","last_fullsized":"2024-08-17T02:22:22.213809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:41:01.256282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.183170+0000","last_change":"2024-08-17T02:22:21.176738+0000","last_active":"2024-08-17T02:22:22.183170+0000","last_peered":"2024-08-17T02:22:22.183170+0000","last_clean":"2024-08-17T02:22:22.183170+0000","last_became_active":"2024-08-17T02:22:21.176368+0000","last_became_peered":"2024-08-17T02:22:21.176368+0000","last_unstale":"2024-08-17T02:22:22.183170+0000","last_undegraded":"2024-08-17T02:22:22.183170+0000","last_fullsized":"2024-08-17T02:22:22.183170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:39:49.581004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.198194+0000","last_change":"2024-08-17T02:22:22.188353+0000","last_active":"2024-08-17T02:22:22.198194+0000","last_peered":"2024-08-17T02:22:22.198194+0000","last_clean":"2024-08-17T02:22:22.198194+0000","last_became_active":"2024-08-17T02:22:22.187993+0000","last_became_peered":"2024-08-17T02:22:22.187993+0000","last_unstale":"2024-08-17T02:22:22.198194+0000","last_undegraded":"2024-08-17T02:22:22.198194+0000","last_fullsized":"2024-08-17T02:22:22.198194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:12:21.015335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.194610+0000","last_change":"2024-08-17T02:22:21.181422+0000","last_active":"2024-08-17T02:22:22.194610+0000","last_peered":"2024-08-17T02:22:22.194610+0000","last_clean":"2024-08-17T02:22:22.194610+0000","last_became_active":"2024-08-17T02:22:21.178824+0000","last_became_peered":"2024-08-17T02:22:21.178824+0000","last_unstale":"2024-08-17T02:22:22.194610+0000","last_undegraded":"2024-08-17T02:22:22.194610+0000","last_fullsized":"2024-08-17T02:22:22.194610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:57:25.435387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.206223+0000","last_change":"2024-08-17T02:22:22.201524+0000","last_active":"2024-08-17T02:22:22.206223+0000","last_peered":"2024-08-17T02:22:22.206223+0000","last_clean":"2024-08-17T02:22:22.206223+0000","last_became_active":"2024-08-17T02:22:22.200008+0000","last_became_peered":"2024-08-17T02:22:22.200008+0000","last_unstale":"2024-08-17T02:22:22.206223+0000","last_undegraded":"2024-08-17T02:22:22.206223+0000","last_fullsized":"2024-08-17T02:22:22.206223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:21:01.768875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.184222+0000","last_change":"2024-08-17T02:22:21.176312+0000","last_active":"2024-08-17T02:22:22.184222+0000","last_peered":"2024-08-17T02:22:22.184222+0000","last_clean":"2024-08-17T02:22:22.184222+0000","last_became_active":"2024-08-17T02:22:21.175977+0000","last_became_peered":"2024-08-17T02:22:21.175977+0000","last_unstale":"2024-08-17T02:22:22.184222+0000","last_undegraded":"2024-08-17T02:22:22.184222+0000","last_fullsized":"2024-08-17T02:22:22.184222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:36:42.673124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.212680+0000","last_change":"2024-08-17T02:22:22.205225+0000","last_active":"2024-08-17T02:22:22.212680+0000","last_peered":"2024-08-17T02:22:22.212680+0000","last_clean":"2024-08-17T02:22:22.212680+0000","last_became_active":"2024-08-17T02:22:22.204500+0000","last_became_peered":"2024-08-17T02:22:22.204500+0000","last_unstale":"2024-08-17T02:22:22.212680+0000","last_undegraded":"2024-08-17T02:22:22.212680+0000","last_fullsized":"2024-08-17T02:22:22.212680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:57:26.443145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.195174+0000","last_change":"2024-08-17T02:22:21.179488+0000","last_active":"2024-08-17T02:22:22.195174+0000","last_peered":"2024-08-17T02:22:22.195174+0000","last_clean":"2024-08-17T02:22:22.195174+0000","last_became_active":"2024-08-17T02:22:21.179206+0000","last_became_peered":"2024-08-17T02:22:21.179206+0000","last_unstale":"2024-08-17T02:22:22.195174+0000","last_undegraded":"2024-08-17T02:22:22.195174+0000","last_fullsized":"2024-08-17T02:22:22.195174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:25:57.123789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.204505+0000","last_change":"2024-08-17T02:22:22.198568+0000","last_active":"2024-08-17T02:22:22.204505+0000","last_peered":"2024-08-17T02:22:22.204505+0000","last_clean":"2024-08-17T02:22:22.204505+0000","last_became_active":"2024-08-17T02:22:22.198281+0000","last_became_peered":"2024-08-17T02:22:22.198281+0000","last_unstale":"2024-08-17T02:22:22.204505+0000","last_undegraded":"2024-08-17T02:22:22.204505+0000","last_fullsized":"2024-08-17T02:22:22.204505+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:37:52.949081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-08-17T02:22:23.191943+0000","last_change":"2024-08-17T02:22:21.174183+0000","last_active":"2024-08-17T02:22:23.191943+0000","last_peered":"2024-08-17T02:22:23.191943+0000","last_clean":"2024-08-17T02:22:23.191943+0000","last_became_active":"2024-08-17T02:22:21.173494+0000","last_became_peered":"2024-08-17T02:22:21.173494+0000","last_unstale":"2024-08-17T02:22:23.191943+0000","last_undegraded":"2024-08-17T02:22:23.191943+0000","last_fullsized":"2024-08-17T02:22:23.191943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:36:42.673124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.205718+0000","last_change":"2024-08-17T02:22:22.199900+0000","last_active":"2024-08-17T02:22:22.205718+0000","last_peered":"2024-08-17T02:22:22.205718+0000","last_clean":"2024-08-17T02:22:22.205718+0000","last_became_active":"2024-08-17T02:22:22.198791+0000","last_became_peered":"2024-08-17T02:22:22.198791+0000","last_unstale":"2024-08-17T02:22:22.205718+0000","last_undegraded":"2024-08-17T02:22:22.205718+0000","last_fullsized":"2024-08-17T02:22:22.205718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:47.721413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.216371+0000","last_change":"2024-08-17T02:22:21.187272+0000","last_active":"2024-08-17T02:22:22.216371+0000","last_peered":"2024-08-17T02:22:22.216371+0000","last_clean":"2024-08-17T02:22:22.216371+0000","last_became_active":"2024-08-17T02:22:21.186794+0000","last_became_peered":"2024-08-17T02:22:21.186794+0000","last_unstale":"2024-08-17T02:22:22.216371+0000","last_undegraded":"2024-08-17T02:22:22.216371+0000","last_fullsized":"2024-08-17T02:22:22.216371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:52:02.959411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.206287+0000","last_change":"2024-08-17T02:22:22.199762+0000","last_active":"2024-08-17T02:22:22.206287+0000","last_peered":"2024-08-17T02:22:22.206287+0000","last_clean":"2024-08-17T02:22:22.206287+0000","last_became_active":"2024-08-17T02:22:22.199436+0000","last_became_peered":"2024-08-17T02:22:22.199436+0000","last_unstale":"2024-08-17T02:22:22.206287+0000","last_undegraded":"2024-08-17T02:22:22.206287+0000","last_fullsized":"2024-08-17T02:22:22.206287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:34:22.570830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.200078+0000","last_change":"2024-08-17T02:22:21.176575+0000","last_active":"2024-08-17T02:22:22.200078+0000","last_peered":"2024-08-17T02:22:22.200078+0000","last_clean":"2024-08-17T02:22:22.200078+0000","last_became_active":"2024-08-17T02:22:21.175688+0000","last_became_peered":"2024-08-17T02:22:21.175688+0000","last_unstale":"2024-08-17T02:22:22.200078+0000","last_undegraded":"2024-08-17T02:22:22.200078+0000","last_fullsized":"2024-08-17T02:22:22.200078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:31:17.320632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.207067+0000","last_change":"2024-08-17T02:22:22.204419+0000","last_active":"2024-08-17T02:22:22.207067+0000","last_peered":"2024-08-17T02:22:22.207067+0000","last_clean":"2024-08-17T02:22:22.207067+0000","last_became_active":"2024-08-17T02:22:22.203728+0000","last_became_peered":"2024-08-17T02:22:22.203728+0000","last_unstale":"2024-08-17T02:22:22.207067+0000","last_undegraded":"2024-08-17T02:22:22.207067+0000","last_fullsized":"2024-08-17T02:22:22.207067+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:09:52.735534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.194675+0000","last_change":"2024-08-17T02:22:21.175288+0000","last_active":"2024-08-17T02:22:22.194675+0000","last_peered":"2024-08-17T02:22:22.194675+0000","last_clean":"2024-08-17T02:22:22.194675+0000","last_became_active":"2024-08-17T02:22:21.175003+0000","last_became_peered":"2024-08-17T02:22:21.175003+0000","last_unstale":"2024-08-17T02:22:22.194675+0000","last_undegraded":"2024-08-17T02:22:22.194675+0000","last_fullsized":"2024-08-17T02:22:22.194675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:14:08.171959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.205630+0000","last_change":"2024-08-17T02:22:22.199455+0000","last_active":"2024-08-17T02:22:22.205630+0000","last_peered":"2024-08-17T02:22:22.205630+0000","last_clean":"2024-08-17T02:22:22.205630+0000","last_became_active":"2024-08-17T02:22:22.198936+0000","last_became_peered":"2024-08-17T02:22:22.198936+0000","last_unstale":"2024-08-17T02:22:22.205630+0000","last_undegraded":"2024-08-17T02:22:22.205630+0000","last_fullsized":"2024-08-17T02:22:22.205630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:23.581757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.191747+0000","last_change":"2024-08-17T02:22:21.176180+0000","last_active":"2024-08-17T02:22:22.191747+0000","last_peered":"2024-08-17T02:22:22.191747+0000","last_clean":"2024-08-17T02:22:22.191747+0000","last_became_active":"2024-08-17T02:22:21.175771+0000","last_became_peered":"2024-08-17T02:22:21.175771+0000","last_unstale":"2024-08-17T02:22:22.191747+0000","last_undegraded":"2024-08-17T02:22:22.191747+0000","last_fullsized":"2024-08-17T02:22:22.191747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:14:32.873264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.198244+0000","last_change":"2024-08-17T02:22:22.194158+0000","last_active":"2024-08-17T02:22:22.198244+0000","last_peered":"2024-08-17T02:22:22.198244+0000","last_clean":"2024-08-17T02:22:22.198244+0000","last_became_active":"2024-08-17T02:22:22.193862+0000","last_became_peered":"2024-08-17T02:22:22.193862+0000","last_unstale":"2024-08-17T02:22:22.198244+0000","last_undegraded":"2024-08-17T02:22:22.198244+0000","last_fullsized":"2024-08-17T02:22:22.198244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:31:18.328390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.216316+0000","last_change":"2024-08-17T02:22:21.179787+0000","last_active":"2024-08-17T02:22:22.216316+0000","last_peered":"2024-08-17T02:22:22.216316+0000","last_clean":"2024-08-17T02:22:22.216316+0000","last_became_active":"2024-08-17T02:22:21.178882+0000","last_became_peered":"2024-08-17T02:22:21.178882+0000","last_unstale":"2024-08-17T02:22:22.216316+0000","last_undegraded":"2024-08-17T02:22:22.216316+0000","last_fullsized":"2024-08-17T02:22:22.216316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:11:57.093981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.212868+0000","last_change":"2024-08-17T02:22:22.209292+0000","last_active":"2024-08-17T02:22:22.212868+0000","last_peered":"2024-08-17T02:22:22.212868+0000","last_clean":"2024-08-17T02:22:22.212868+0000","last_became_active":"2024-08-17T02:22:22.208985+0000","last_became_peered":"2024-08-17T02:22:22.208985+0000","last_unstale":"2024-08-17T02:22:22.212868+0000","last_undegraded":"2024-08-17T02:22:22.212868+0000","last_fullsized":"2024-08-17T02:22:22.212868+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:06:36.575795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.206977+0000","last_change":"2024-08-17T02:22:22.202975+0000","last_active":"2024-08-17T02:22:22.206977+0000","last_peered":"2024-08-17T02:22:22.206977+0000","last_clean":"2024-08-17T02:22:22.206977+0000","last_became_active":"2024-08-17T02:22:22.202642+0000","last_became_peered":"2024-08-17T02:22:22.202642+0000","last_unstale":"2024-08-17T02:22:22.206977+0000","last_undegraded":"2024-08-17T02:22:22.206977+0000","last_fullsized":"2024-08-17T02:22:22.206977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:23:10.867889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.215387+0000","last_change":"2024-08-17T02:22:21.181265+0000","last_active":"2024-08-17T02:22:22.215387+0000","last_peered":"2024-08-17T02:22:22.215387+0000","last_clean":"2024-08-17T02:22:22.215387+0000","last_became_active":"2024-08-17T02:22:21.179868+0000","last_became_peered":"2024-08-17T02:22:21.179868+0000","last_unstale":"2024-08-17T02:22:22.215387+0000","last_undegraded":"2024-08-17T02:22:22.215387+0000","last_fullsized":"2024-08-17T02:22:22.215387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:01:30.822179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.209539+0000","last_change":"2024-08-17T02:22:22.204765+0000","last_active":"2024-08-17T02:22:22.209539+0000","last_peered":"2024-08-17T02:22:22.209539+0000","last_clean":"2024-08-17T02:22:22.209539+0000","last_became_active":"2024-08-17T02:22:22.204508+0000","last_became_peered":"2024-08-17T02:22:22.204508+0000","last_unstale":"2024-08-17T02:22:22.209539+0000","last_undegraded":"2024-08-17T02:22:22.209539+0000","last_fullsized":"2024-08-17T02:22:22.209539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:57:26.443145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.215321+0000","last_change":"2024-08-17T02:22:21.175884+0000","last_active":"2024-08-17T02:22:22.215321+0000","last_peered":"2024-08-17T02:22:22.215321+0000","last_clean":"2024-08-17T02:22:22.215321+0000","last_became_active":"2024-08-17T02:22:21.175130+0000","last_became_peered":"2024-08-17T02:22:21.175130+0000","last_unstale":"2024-08-17T02:22:22.215321+0000","last_undegraded":"2024-08-17T02:22:22.215321+0000","last_fullsized":"2024-08-17T02:22:22.215321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:47:30.406922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.201295+0000","last_change":"2024-08-17T02:22:22.193359+0000","last_active":"2024-08-17T02:22:22.201295+0000","last_peered":"2024-08-17T02:22:22.201295+0000","last_clean":"2024-08-17T02:22:22.201295+0000","last_became_active":"2024-08-17T02:22:22.192492+0000","last_became_peered":"2024-08-17T02:22:22.192492+0000","last_unstale":"2024-08-17T02:22:22.201295+0000","last_undegraded":"2024-08-17T02:22:22.201295+0000","last_fullsized":"2024-08-17T02:22:22.201295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:08:06.080463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.216505+0000","last_change":"2024-08-17T02:22:21.172581+0000","last_active":"2024-08-17T02:22:22.216505+0000","last_peered":"2024-08-17T02:22:22.216505+0000","last_clean":"2024-08-17T02:22:22.216505+0000","last_became_active":"2024-08-17T02:22:21.172139+0000","last_became_peered":"2024-08-17T02:22:21.172139+0000","last_unstale":"2024-08-17T02:22:22.216505+0000","last_undegraded":"2024-08-17T02:22:22.216505+0000","last_fullsized":"2024-08-17T02:22:22.216505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:01:30.822179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.201398+0000","last_change":"2024-08-17T02:22:22.196174+0000","last_active":"2024-08-17T02:22:22.201398+0000","last_peered":"2024-08-17T02:22:22.201398+0000","last_clean":"2024-08-17T02:22:22.201398+0000","last_became_active":"2024-08-17T02:22:22.195901+0000","last_became_peered":"2024-08-17T02:22:22.195901+0000","last_unstale":"2024-08-17T02:22:22.201398+0000","last_undegraded":"2024-08-17T02:22:22.201398+0000","last_fullsized":"2024-08-17T02:22:22.201398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:21.146877+0000","last_clean_scrub_stamp":"2024-08-17T02:22:21.146877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:46:07.630925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:22:22.218844+0000","last_change":"2024-08-17T02:22:21.181273+0000","last_active":"2024-08-17T02:22:22.218844+0000","last_peered":"2024-08-17T02:22:22.218844+0000","last_clean":"2024-08-17T02:22:22.218844+0000","last_became_active":"2024-08-17T02:22:21.181022+0000","last_became_peered":"2024-08-17T02:22:21.181022+0000","last_unstale":"2024-08-17T02:22:22.218844+0000","last_undegraded":"2024-08-17T02:22:22.218844+0000","last_fullsized":"2024-08-17T02:22:22.218844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:20.139119+0000","last_clean_scrub_stamp":"2024-08-17T02:22:20.139119+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:47:30.406922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297592,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":241664,"data_stored":80755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]}]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298180,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073660,"statfs":{"total":96636764160,"available":96331427840,"internally_reserved":0,"allocated":835584,"data_stored":671091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]}]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":253952,"data_stored":82843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]}]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297588,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":237568,"data_stored":81201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.329}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]}]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297596,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074244,"statfs":{"total":96636764160,"available":96332025856,"internally_reserved":0,"allocated":245760,"data_stored":82183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298168,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073672,"statfs":{"total":96636764160,"available":96331440128,"internally_reserved":0,"allocated":831488,"data_stored":671069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2250000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.345}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5840000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297592,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":241664,"data_stored":80687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.0270000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.133}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301752,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070088,"statfs":{"total":96636764160,"available":96327770112,"internally_reserved":0,"allocated":233472,"data_stored":80631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2130000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3120000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2629999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:22:28.960 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-17T02:22:28.960 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-17T02:22:28.960 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-08-17T02:22:28.960 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-08-17T02:22:29.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.050+0000 7f7c0f59e700 1 Processor -- start 2024-08-17T02:22:29.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.050+0000 7f7c0f59e700 1 -- start start 2024-08-17T02:22:29.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.050+0000 7f7c0f59e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c100b0d20 0x7f7c1006df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:29.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.050+0000 7f7c0f59e700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7c100b1800 0x7f7c10141e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:29.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.050+0000 7f7c0f59e700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c10141a00 con 0x7f7c1006e450 2024-08-17T02:22:29.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.050+0000 7f7c0f59e700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c1006e8a0 con 0x7f7c100b1800 2024-08-17T02:22:29.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.050+0000 7f7c0f59e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c10140b10 con 0x7f7c100b0d20 2024-08-17T02:22:29.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.050+0000 7f7c0dd9b700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f7c1006e450 0x7f7c100b10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:56780/0 (socket says 172.21.15.104:56780) 2024-08-17T02:22:29.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.050+0000 7f7c0dd9b700 1 -- 172.21.15.104:0/2111235855 learned_addr learned my addr 172.21.15.104:0/2111235855 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:29.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.050+0000 7f7c0ed9d700 1 --2- 172.21.15.104:0/2111235855 >> v2:172.21.15.104:3300/0 conn(0x7f7c100b1800 0x7f7c10141e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:29.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.050+0000 7f7c0e59c700 1 --2- 172.21.15.104:0/2111235855 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c100b0d20 0x7f7c1006df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:29.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.050+0000 7f7c0d59a700 1 -- 172.21.15.104:0/2111235855 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2184814060 0 0) 0x7f7c10141a00 con 0x7f7c1006e450 2024-08-17T02:22:29.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.050+0000 7f7c0d59a700 1 -- 172.21.15.104:0/2111235855 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bf8003570 con 0x7f7c1006e450 2024-08-17T02:22:29.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.050+0000 7f7c0d59a700 1 -- 172.21.15.104:0/2111235855 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 974375951 0 0) 0x7f7bf8003570 con 0x7f7c1006e450 2024-08-17T02:22:29.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.050+0000 7f7c0ed9d700 1 -- 172.21.15.104:0/2111235855 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c100b0d20 msgr2=0x7f7c1006df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:29.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.050+0000 7f7c0ed9d700 1 --2- 172.21.15.104:0/2111235855 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c100b0d20 0x7f7c1006df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:29.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.050+0000 7f7c0ed9d700 1 -- 172.21.15.104:0/2111235855 >> v1:172.21.15.104:6789/0 conn(0x7f7c1006e450 legacy=0x7f7c100b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:29.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.050+0000 7f7c0ed9d700 1 -- 172.21.15.104:0/2111235855 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c10140df0 con 0x7f7c100b1800 2024-08-17T02:22:29.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.050+0000 7f7c0ed9d700 1 --2- 172.21.15.104:0/2111235855 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c100b1800 0x7f7c10141e90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7c08009e60 tx=0x7f7c08009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=496eec217ce6b81b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:29.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.050+0000 7f7c0d59a700 1 -- 172.21.15.104:0/2111235855 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0800e070 con 0x7f7c100b1800 2024-08-17T02:22:29.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.050+0000 7f7c0d59a700 1 -- 172.21.15.104:0/2111235855 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0800b7a0 con 0x7f7c100b1800 2024-08-17T02:22:29.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.050+0000 7f7c0d59a700 1 -- 172.21.15.104:0/2111235855 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c00001470 con 0x7f7c100b1800 2024-08-17T02:22:29.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.054+0000 7f7c0f59e700 1 -- 172.21.15.104:0/2111235855 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c100b1800 msgr2=0x7f7c10141e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:29.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.054+0000 7f7c0f59e700 1 --2- 172.21.15.104:0/2111235855 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c100b1800 0x7f7c10141e90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7c08009e60 tx=0x7f7c08009780 comp rx=0 tx=0).stop 2024-08-17T02:22:29.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.054+0000 7f7c0f59e700 1 -- 172.21.15.104:0/2111235855 shutdown_connections 2024-08-17T02:22:29.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.054+0000 7f7c0f59e700 1 --2- 172.21.15.104:0/2111235855 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c100b1800 0x7f7c10141e90 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:29.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.054+0000 7f7c0f59e700 1 --2- 172.21.15.104:0/2111235855 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c100b0d20 0x7f7c1006df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:29.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.054+0000 7f7c0f59e700 1 -- 172.21.15.104:0/2111235855 >> 172.21.15.104:0/2111235855 conn(0x7f7c100678d0 msgr2=0x7f7c10067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:29.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.054+0000 7f7c0f59e700 1 -- 172.21.15.104:0/2111235855 shutdown_connections 2024-08-17T02:22:29.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.054+0000 7f7c0f59e700 1 -- 172.21.15.104:0/2111235855 wait complete. 2024-08-17T02:22:29.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.054+0000 7f7c0f59e700 1 Processor -- start 2024-08-17T02:22:29.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.054+0000 7f7c0f59e700 1 -- start start 2024-08-17T02:22:29.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.058+0000 7f7c0f59e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c1006e450 0x7f7c1013fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:29.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.058+0000 7f7c0f59e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c100b0d20 0x7f7c10146630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:29.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.058+0000 7f7c0f59e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c100b1800 0x7f7c10146b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:29.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.058+0000 7f7c0f59e700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c10170f60 con 0x7f7c1006e450 2024-08-17T02:22:29.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.058+0000 7f7c0f59e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c10171240 con 0x7f7c100b1800 2024-08-17T02:22:29.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.058+0000 7f7c0f59e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c10171520 con 0x7f7c100b0d20 2024-08-17T02:22:29.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.058+0000 7f7c0e59c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c1006e450 0x7f7c1013fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:29.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.058+0000 7f7c0e59c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c1006e450 0x7f7c1013fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42394/0 (socket says 172.21.15.104:42394) 2024-08-17T02:22:29.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.058+0000 7f7c0e59c700 1 -- 172.21.15.104:0/2486236732 learned_addr learned my addr 172.21.15.104:0/2486236732 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:29.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.058+0000 7f7c0dd9b700 1 --2- 172.21.15.104:0/2486236732 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c100b0d20 0x7f7c10146630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:29.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.058+0000 7f7c0ed9d700 1 --2- 172.21.15.104:0/2486236732 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c100b1800 0x7f7c10146b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:29.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.058+0000 7f7c0e59c700 1 -- 172.21.15.104:0/2486236732 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c100b0d20 msgr2=0x7f7c10146630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:29.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.058+0000 7f7c0e59c700 1 --2- 172.21.15.104:0/2486236732 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c100b0d20 0x7f7c10146630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:29.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.058+0000 7f7c0e59c700 1 -- 172.21.15.104:0/2486236732 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c100b1800 msgr2=0x7f7c10146b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:29.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.058+0000 7f7c0e59c700 1 --2- 172.21.15.104:0/2486236732 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c100b1800 0x7f7c10146b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:29.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.058+0000 7f7c0e59c700 1 -- 172.21.15.104:0/2486236732 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c08009a20 con 0x7f7c1006e450 2024-08-17T02:22:29.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.058+0000 7f7c0dd9b700 1 --2- 172.21.15.104:0/2486236732 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c100b0d20 0x7f7c10146630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:22:29.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.058+0000 7f7c0ed9d700 1 --2- 172.21.15.104:0/2486236732 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c100b1800 0x7f7c10146b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:22:29.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.058+0000 7f7c0e59c700 1 --2- 172.21.15.104:0/2486236732 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c1006e450 0x7f7c1013fe60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7c0400e930 tx=0x7f7c040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:29.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.058+0000 7f7bfe7fc700 1 -- 172.21.15.104:0/2486236732 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0400eed0 con 0x7f7c1006e450 2024-08-17T02:22:29.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.058+0000 7f7bfe7fc700 1 -- 172.21.15.104:0/2486236732 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0400c850 con 0x7f7c1006e450 2024-08-17T02:22:29.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.058+0000 7f7bfe7fc700 1 -- 172.21.15.104:0/2486236732 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0400cbf0 con 0x7f7c1006e450 2024-08-17T02:22:29.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.058+0000 7f7c0f59e700 1 -- 172.21.15.104:0/2486236732 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c10171800 con 0x7f7c1006e450 2024-08-17T02:22:29.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.058+0000 7f7c0f59e700 1 -- 172.21.15.104:0/2486236732 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c1016d960 con 0x7f7c1006e450 2024-08-17T02:22:29.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.058+0000 7f7c0f59e700 1 -- 172.21.15.104:0/2486236732 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c100643a0 con 0x7f7c1006e450 2024-08-17T02:22:29.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.062+0000 7f7bfe7fc700 1 -- 172.21.15.104:0/2486236732 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7c04013470 con 0x7f7c1006e450 2024-08-17T02:22:29.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.062+0000 7f7bfe7fc700 1 --2- 172.21.15.104:0/2486236732 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7bf0060860 0x7f7bf0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:29.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.062+0000 7f7bfe7fc700 1 -- 172.21.15.104:0/2486236732 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7c0407cdb0 con 0x7f7c1006e450 2024-08-17T02:22:29.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.062+0000 7f7c0dd9b700 1 --2- 172.21.15.104:0/2486236732 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7bf0060860 0x7f7bf0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:29.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.062+0000 7f7c0dd9b700 1 --2- 172.21.15.104:0/2486236732 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7bf0060860 0x7f7bf0062d10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7c10170ec0 tx=0x7f7c00001580 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:29.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.074+0000 7f7bfe7fc700 1 -- 172.21.15.104:0/2486236732 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f7c0404d200 con 0x7f7c1006e450 2024-08-17T02:22:29.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.258+0000 7f7c0f59e700 1 -- 172.21.15.104:0/2486236732 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f7c1006f5f0 con 0x7f7c1006e450 2024-08-17T02:22:29.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.258+0000 7f7bfe7fc700 1 -- 172.21.15.104:0/2486236732 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f7c04050820 con 0x7f7c1006e450 2024-08-17T02:22:29.265 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:22:29.265 INFO:teuthology.orchestra.run.smithi104.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-17T02:22:29.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.258+0000 7f7c0f59e700 1 -- 172.21.15.104:0/2486236732 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7bf0060860 msgr2=0x7f7bf0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:29.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.258+0000 7f7c0f59e700 1 --2- 172.21.15.104:0/2486236732 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7bf0060860 0x7f7bf0062d10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7c10170ec0 tx=0x7f7c00001580 comp rx=0 tx=0).stop 2024-08-17T02:22:29.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.258+0000 7f7c0f59e700 1 -- 172.21.15.104:0/2486236732 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c1006e450 msgr2=0x7f7c1013fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:29.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.258+0000 7f7c0f59e700 1 --2- 172.21.15.104:0/2486236732 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c1006e450 0x7f7c1013fe60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7c0400e930 tx=0x7f7c040091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:29.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.258+0000 7f7c0f59e700 1 -- 172.21.15.104:0/2486236732 shutdown_connections 2024-08-17T02:22:29.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.258+0000 7f7c0f59e700 1 --2- 172.21.15.104:0/2486236732 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7bf0060860 0x7f7bf0062d10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:29.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.258+0000 7f7c0f59e700 1 --2- 172.21.15.104:0/2486236732 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c100b1800 0x7f7c10146b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:29.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.258+0000 7f7c0f59e700 1 --2- 172.21.15.104:0/2486236732 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c100b0d20 0x7f7c10146630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:29.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.258+0000 7f7c0f59e700 1 --2- 172.21.15.104:0/2486236732 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c1006e450 0x7f7c1013fe60 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:29.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.258+0000 7f7c0f59e700 1 -- 172.21.15.104:0/2486236732 >> 172.21.15.104:0/2486236732 conn(0x7f7c100678d0 msgr2=0x7f7c1015bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:29.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.262+0000 7f7c0f59e700 1 -- 172.21.15.104:0/2486236732 shutdown_connections 2024-08-17T02:22:29.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.262+0000 7f7c0f59e700 1 -- 172.21.15.104:0/2486236732 wait complete. 2024-08-17T02:22:29.277 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-08-17T02:22:29.278 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:22:29.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.366+0000 7ff98d063700 1 Processor -- start 2024-08-17T02:22:29.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.366+0000 7ff98d063700 1 -- start start 2024-08-17T02:22:29.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.370+0000 7ff98d063700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff98806e9d0 0x7ff98806eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:29.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.370+0000 7ff98d063700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff9880ab540 0x7ff9880b1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:29.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.370+0000 7ff98d063700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9880aba70 con 0x7ff98806df10 2024-08-17T02:22:29.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.370+0000 7ff98d063700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9880abd50 con 0x7ff9880ab540 2024-08-17T02:22:29.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.370+0000 7ff98d063700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9880ac030 con 0x7ff98806e9d0 2024-08-17T02:22:29.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.370+0000 7ff9877fe700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff9880ab540 0x7ff9880b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:29.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.370+0000 7ff9877fe700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff9880ab540 0x7ff9880b1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42406/0 (socket says 172.21.15.104:42406) 2024-08-17T02:22:29.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.370+0000 7ff9877fe700 1 -- 172.21.15.104:0/3994182411 learned_addr learned my addr 172.21.15.104:0/3994182411 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:29.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.370+0000 7ff987fff700 1 --2- 172.21.15.104:0/3994182411 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff98806e9d0 0x7ff98806eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:29.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.370+0000 7ff9877fe700 1 -- 172.21.15.104:0/3994182411 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff98806e9d0 msgr2=0x7ff98806eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:29.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.370+0000 7ff9877fe700 1 --2- 172.21.15.104:0/3994182411 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff98806e9d0 0x7ff98806eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:29.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.370+0000 7ff9877fe700 1 -- 172.21.15.104:0/3994182411 >> v1:172.21.15.104:6789/0 conn(0x7ff98806df10 legacy=0x7ff988155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:29.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.370+0000 7ff9877fe700 1 -- 172.21.15.104:0/3994182411 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9880ac310 con 0x7ff9880ab540 2024-08-17T02:22:29.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.370+0000 7ff986ffd700 1 -- 172.21.15.104:0/3994182411 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1858298049 0 0) 0x7ff9880aba70 con 0x7ff98806df10 2024-08-17T02:22:29.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.370+0000 7ff987fff700 1 --2- 172.21.15.104:0/3994182411 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff98806e9d0 0x7ff98806eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:22:29.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.370+0000 7ff9877fe700 1 --2- 172.21.15.104:0/3994182411 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9880ab540 0x7ff9880b1320 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff9700099b0 tx=0x7ff970009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fcf2d4cb611e18a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:29.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.370+0000 7ff986ffd700 1 -- 172.21.15.104:0/3994182411 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97000b860 con 0x7ff9880ab540 2024-08-17T02:22:29.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.370+0000 7ff986ffd700 1 -- 172.21.15.104:0/3994182411 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff97000b9c0 con 0x7ff9880ab540 2024-08-17T02:22:29.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.370+0000 7ff986ffd700 1 -- 172.21.15.104:0/3994182411 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97000bd60 con 0x7ff9880ab540 2024-08-17T02:22:29.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.370+0000 7ff98d063700 1 -- 172.21.15.104:0/3994182411 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9880ab540 msgr2=0x7ff9880b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:29.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.370+0000 7ff98d063700 1 --2- 172.21.15.104:0/3994182411 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9880ab540 0x7ff9880b1320 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff9700099b0 tx=0x7ff970009250 comp rx=0 tx=0).stop 2024-08-17T02:22:29.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.370+0000 7ff98d063700 1 -- 172.21.15.104:0/3994182411 shutdown_connections 2024-08-17T02:22:29.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.370+0000 7ff98d063700 1 --2- 172.21.15.104:0/3994182411 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9880ab540 0x7ff9880b1320 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:29.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.370+0000 7ff98d063700 1 --2- 172.21.15.104:0/3994182411 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff98806e9d0 0x7ff98806eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:29.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.370+0000 7ff98d063700 1 -- 172.21.15.104:0/3994182411 >> 172.21.15.104:0/3994182411 conn(0x7ff9880678d0 msgr2=0x7ff988067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:29.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.370+0000 7ff98d063700 1 -- 172.21.15.104:0/3994182411 shutdown_connections 2024-08-17T02:22:29.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.370+0000 7ff98d063700 1 -- 172.21.15.104:0/3994182411 wait complete. 2024-08-17T02:22:29.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.370+0000 7ff98d063700 1 Processor -- start 2024-08-17T02:22:29.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.370+0000 7ff98d063700 1 -- start start 2024-08-17T02:22:29.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.374+0000 7ff98d063700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff98806df10 0x7ff98813a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:29.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.374+0000 7ff98d063700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff98806e9d0 0x7ff98814a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:29.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.374+0000 7ff98d063700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9880ab540 0x7ff98814a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:29.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.374+0000 7ff98d063700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98814ae00 con 0x7ff9880ab540 2024-08-17T02:22:29.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.374+0000 7ff98d063700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff988156690 con 0x7ff98806e9d0 2024-08-17T02:22:29.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.374+0000 7ff98d063700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff988169890 con 0x7ff98806df10 2024-08-17T02:22:29.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.374+0000 7ff98c862700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9880ab540 0x7ff98814a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:29.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.374+0000 7ff98c862700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9880ab540 0x7ff98814a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42412/0 (socket says 172.21.15.104:42412) 2024-08-17T02:22:29.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.374+0000 7ff98c862700 1 -- 172.21.15.104:0/1020080592 learned_addr learned my addr 172.21.15.104:0/1020080592 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:29.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.374+0000 7ff987fff700 1 --2- 172.21.15.104:0/1020080592 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff98806df10 0x7ff98813a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:29.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.374+0000 7ff9877fe700 1 --2- 172.21.15.104:0/1020080592 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff98806e9d0 0x7ff98814a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:29.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.374+0000 7ff98c862700 1 -- 172.21.15.104:0/1020080592 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff98806df10 msgr2=0x7ff98813a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:29.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.374+0000 7ff98c862700 1 --2- 172.21.15.104:0/1020080592 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff98806df10 0x7ff98813a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:29.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.374+0000 7ff98c862700 1 -- 172.21.15.104:0/1020080592 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff98806e9d0 msgr2=0x7ff98814a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:29.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.374+0000 7ff98c862700 1 --2- 172.21.15.104:0/1020080592 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff98806e9d0 0x7ff98814a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:29.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.374+0000 7ff98c862700 1 -- 172.21.15.104:0/1020080592 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9700094f0 con 0x7ff9880ab540 2024-08-17T02:22:29.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.374+0000 7ff98c862700 1 --2- 172.21.15.104:0/1020080592 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9880ab540 0x7ff98814a7f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff98000c910 tx=0x7ff980001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:29.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.374+0000 7ff97ffff700 1 -- 172.21.15.104:0/1020080592 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98000a7e0 con 0x7ff9880ab540 2024-08-17T02:22:29.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.374+0000 7ff97ffff700 1 -- 172.21.15.104:0/1020080592 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff98000a960 con 0x7ff9880ab540 2024-08-17T02:22:29.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.374+0000 7ff98d063700 1 -- 172.21.15.104:0/1020080592 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff988155d60 con 0x7ff9880ab540 2024-08-17T02:22:29.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.374+0000 7ff97ffff700 1 -- 172.21.15.104:0/1020080592 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98000ad20 con 0x7ff9880ab540 2024-08-17T02:22:29.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.374+0000 7ff98d063700 1 -- 172.21.15.104:0/1020080592 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff988156320 con 0x7ff9880ab540 2024-08-17T02:22:29.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.374+0000 7ff98d063700 1 -- 172.21.15.104:0/1020080592 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff988156800 con 0x7ff9880ab540 2024-08-17T02:22:29.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.378+0000 7ff97ffff700 1 -- 172.21.15.104:0/1020080592 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff980012630 con 0x7ff9880ab540 2024-08-17T02:22:29.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.378+0000 7ff97ffff700 1 --2- 172.21.15.104:0/1020080592 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff968060860 0x7ff968062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:29.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.378+0000 7ff97ffff700 1 -- 172.21.15.104:0/1020080592 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff98007ca10 con 0x7ff9880ab540 2024-08-17T02:22:29.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.378+0000 7ff987fff700 1 --2- 172.21.15.104:0/1020080592 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff968060860 0x7ff968062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:29.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.378+0000 7ff987fff700 1 --2- 172.21.15.104:0/1020080592 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff968060860 0x7ff968062d10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff9880a5970 tx=0x7ff978006f90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:29.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.382+0000 7ff97ffff700 1 -- 172.21.15.104:0/1020080592 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff98004ce60 con 0x7ff9880ab540 2024-08-17T02:22:29.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.534+0000 7ff98d063700 1 -- 172.21.15.104:0/1020080592 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9880643a0 con 0x7ff9880ab540 2024-08-17T02:22:29.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.534+0000 7ff97ffff700 1 -- 172.21.15.104:0/1020080592 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+15398 (secure 0 0 0) 0x7ff980016020 con 0x7ff9880ab540 2024-08-17T02:22:29.542 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:22:29.542 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":23,"fsid":"fd5f7fb8-d34b-49bb-89a8-62b7dad1bc25","created":"2024-08-17T02:21:57.891389+0000","modified":"2024-08-17T02:22:23.175831+0000","last_up_change":"2024-08-17T02:22:08.924546+0000","last_in_change":"2024-08-17T02:21:59.938028+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:22:10.143970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:22:20.082708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:22:20.521582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"606b9088-590e-4709-aa3a-b0f6e22972ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":24257},{"type":"v1","addr":"172.21.15.104:6809","nonce":24257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":24257},{"type":"v1","addr":"172.21.15.104:6811","nonce":24257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":24257},{"type":"v1","addr":"172.21.15.104:6815","nonce":24257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":24257},{"type":"v1","addr":"172.21.15.104:6813","nonce":24257}]},"public_addr":"172.21.15.104:6809/24257","cluster_addr":"172.21.15.104:6811/24257","heartbeat_back_addr":"172.21.15.104:6815/24257","heartbeat_front_addr":"172.21.15.104:6813/24257","state":["exists","up"]},{"osd":1,"uuid":"9bc6a909-0c2f-4889-afe7-4a47f89b0f64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":24256},{"type":"v1","addr":"172.21.15.104:6825","nonce":24256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":24256},{"type":"v1","addr":"172.21.15.104:6827","nonce":24256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":24256},{"type":"v1","addr":"172.21.15.104:6831","nonce":24256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":24256},{"type":"v1","addr":"172.21.15.104:6829","nonce":24256}]},"public_addr":"172.21.15.104:6825/24256","cluster_addr":"172.21.15.104:6827/24256","heartbeat_back_addr":"172.21.15.104:6831/24256","heartbeat_front_addr":"172.21.15.104:6829/24256","state":["exists","up"]},{"osd":2,"uuid":"23da31d5-aefb-4edb-b79d-fa05e1becef7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":24255},{"type":"v1","addr":"172.21.15.104:6817","nonce":24255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":24255},{"type":"v1","addr":"172.21.15.104:6819","nonce":24255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":24255},{"type":"v1","addr":"172.21.15.104:6823","nonce":24255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":24255},{"type":"v1","addr":"172.21.15.104:6821","nonce":24255}]},"public_addr":"172.21.15.104:6817/24255","cluster_addr":"172.21.15.104:6819/24255","heartbeat_back_addr":"172.21.15.104:6823/24255","heartbeat_front_addr":"172.21.15.104:6821/24255","state":["exists","up"]},{"osd":3,"uuid":"6e4a5ec2-b415-45ef-8381-61a59eb65224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":24254},{"type":"v1","addr":"172.21.15.104:6801","nonce":24254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":24254},{"type":"v1","addr":"172.21.15.104:6803","nonce":24254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":24254},{"type":"v1","addr":"172.21.15.104:6807","nonce":24254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":24254},{"type":"v1","addr":"172.21.15.104:6805","nonce":24254}]},"public_addr":"172.21.15.104:6801/24254","cluster_addr":"172.21.15.104:6803/24254","heartbeat_back_addr":"172.21.15.104:6807/24254","heartbeat_front_addr":"172.21.15.104:6805/24254","state":["exists","up"]},{"osd":4,"uuid":"8d5bea2d-9039-4013-8c99-2c046c5b8a17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":24421},{"type":"v1","addr":"172.21.15.117:6804","nonce":24421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":24421},{"type":"v1","addr":"172.21.15.117:6809","nonce":24421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":24421},{"type":"v1","addr":"172.21.15.117:6815","nonce":24421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":24421},{"type":"v1","addr":"172.21.15.117:6813","nonce":24421}]},"public_addr":"172.21.15.117:6804/24421","cluster_addr":"172.21.15.117:6809/24421","heartbeat_back_addr":"172.21.15.117:6815/24421","heartbeat_front_addr":"172.21.15.117:6813/24421","state":["exists","up"]},{"osd":5,"uuid":"de8b36fc-121c-4f05-8f5b-28f513d9f21f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":24422},{"type":"v1","addr":"172.21.15.117:6817","nonce":24422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":24422},{"type":"v1","addr":"172.21.15.117:6819","nonce":24422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":24422},{"type":"v1","addr":"172.21.15.117:6823","nonce":24422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":24422},{"type":"v1","addr":"172.21.15.117:6821","nonce":24422}]},"public_addr":"172.21.15.117:6817/24422","cluster_addr":"172.21.15.117:6819/24422","heartbeat_back_addr":"172.21.15.117:6823/24422","heartbeat_front_addr":"172.21.15.117:6821/24422","state":["exists","up"]},{"osd":6,"uuid":"6a87f09f-7bf7-4f7a-be87-530ac1ff8ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":24420},{"type":"v1","addr":"172.21.15.117:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6803","nonce":24420},{"type":"v1","addr":"172.21.15.117:6805","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":24420},{"type":"v1","addr":"172.21.15.117:6811","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":24420},{"type":"v1","addr":"172.21.15.117:6808","nonce":24420}]},"public_addr":"172.21.15.117:6801/24420","cluster_addr":"172.21.15.117:6805/24420","heartbeat_back_addr":"172.21.15.117:6811/24420","heartbeat_front_addr":"172.21.15.117:6808/24420","state":["exists","up"]},{"osd":7,"uuid":"e31d8041-1aa1-4b5d-83b3-0a373426dd9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":24423},{"type":"v1","addr":"172.21.15.117:6825","nonce":24423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":24423},{"type":"v1","addr":"172.21.15.117:6827","nonce":24423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":24423},{"type":"v1","addr":"172.21.15.117:6831","nonce":24423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":24423},{"type":"v1","addr":"172.21.15.117:6829","nonce":24423}]},"public_addr":"172.21.15.117:6825/24423","cluster_addr":"172.21.15.117:6827/24423","heartbeat_back_addr":"172.21.15.117:6831/24423","heartbeat_front_addr":"172.21.15.117:6829/24423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.220874+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.210039+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.434762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.247206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.184316+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.306325+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.035719+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.400303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:22:29.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.538+0000 7ff98d063700 1 -- 172.21.15.104:0/1020080592 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff968060860 msgr2=0x7ff968062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:29.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.538+0000 7ff98d063700 1 --2- 172.21.15.104:0/1020080592 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff968060860 0x7ff968062d10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff9880a5970 tx=0x7ff978006f90 comp rx=0 tx=0).stop 2024-08-17T02:22:29.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.538+0000 7ff98d063700 1 -- 172.21.15.104:0/1020080592 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9880ab540 msgr2=0x7ff98814a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:29.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.538+0000 7ff98d063700 1 --2- 172.21.15.104:0/1020080592 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9880ab540 0x7ff98814a7f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff98000c910 tx=0x7ff980001770 comp rx=0 tx=0).stop 2024-08-17T02:22:29.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.538+0000 7ff98d063700 1 -- 172.21.15.104:0/1020080592 shutdown_connections 2024-08-17T02:22:29.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.538+0000 7ff98d063700 1 --2- 172.21.15.104:0/1020080592 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff968060860 0x7ff968062d10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:29.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.538+0000 7ff98d063700 1 --2- 172.21.15.104:0/1020080592 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9880ab540 0x7ff98814a7f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:29.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.538+0000 7ff98d063700 1 --2- 172.21.15.104:0/1020080592 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff98806e9d0 0x7ff98814a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:29.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.538+0000 7ff98d063700 1 --2- 172.21.15.104:0/1020080592 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff98806df10 0x7ff98813a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:29.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.538+0000 7ff98d063700 1 -- 172.21.15.104:0/1020080592 >> 172.21.15.104:0/1020080592 conn(0x7ff9880678d0 msgr2=0x7ff9880ade20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:29.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.538+0000 7ff98d063700 1 -- 172.21.15.104:0/1020080592 shutdown_connections 2024-08-17T02:22:29.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.538+0000 7ff98d063700 1 -- 172.21.15.104:0/1020080592 wait complete. 2024-08-17T02:22:29.556 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:22:10.143970+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:22:20.082708+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:22:20.521582+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:22:29.556 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:22:29.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.658+0000 7f31affff700 1 Processor -- start 2024-08-17T02:22:29.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.658+0000 7f31affff700 1 -- start start 2024-08-17T02:22:29.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.658+0000 7f31affff700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f31b006ee10 0x7f31b00ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:29.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.658+0000 7f31affff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31b00aebe0 0x7f31b00b0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:29.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.658+0000 7f31affff700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31b00ad090 con 0x7f31b0142940 2024-08-17T02:22:29.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.658+0000 7f31affff700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31b00ad330 con 0x7f31b006ee10 2024-08-17T02:22:29.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.658+0000 7f31affff700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b00ad610 con 0x7f31b00aebe0 2024-08-17T02:22:29.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.658+0000 7f31aeffd700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f31b0142940 0x7f31b006e700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:56792/0 (socket says 172.21.15.104:56792) 2024-08-17T02:22:29.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.658+0000 7f31aeffd700 1 -- 172.21.15.104:0/3054126456 learned_addr learned my addr 172.21.15.104:0/3054126456 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:29.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.658+0000 7f31af7fe700 1 --2- 172.21.15.104:0/3054126456 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31b00aebe0 0x7f31b00b0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:29.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.658+0000 7f31ae7fc700 1 --2- 172.21.15.104:0/3054126456 >> v2:172.21.15.117:3300/0 conn(0x7f31b006ee10 0x7f31b00ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:29.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.658+0000 7f31adffb700 1 -- 172.21.15.104:0/3054126456 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3269618862 0 0) 0x7f31b00ad090 con 0x7f31b0142940 2024-08-17T02:22:29.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.658+0000 7f31adffb700 1 -- 172.21.15.104:0/3054126456 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3198003570 con 0x7f31b0142940 2024-08-17T02:22:29.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.658+0000 7f31adffb700 1 -- 172.21.15.104:0/3054126456 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2735835291 0 0) 0x7f3198003570 con 0x7f31b0142940 2024-08-17T02:22:29.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.658+0000 7f31adffb700 1 -- 172.21.15.104:0/3054126456 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31b00aebe0 msgr2=0x7f31b00b0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:29.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.658+0000 7f31adffb700 1 --2- 172.21.15.104:0/3054126456 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31b00aebe0 0x7f31b00b0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:29.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.658+0000 7f31adffb700 1 -- 172.21.15.104:0/3054126456 >> v2:172.21.15.117:3300/0 conn(0x7f31b006ee10 msgr2=0x7f31b00ae6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:29.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.658+0000 7f31adffb700 1 --2- 172.21.15.104:0/3054126456 >> v2:172.21.15.117:3300/0 conn(0x7f31b006ee10 0x7f31b00ae6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:29.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.658+0000 7f31adffb700 1 -- 172.21.15.104:0/3054126456 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b00ad8f0 con 0x7f31b0142940 2024-08-17T02:22:29.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.658+0000 7f31adffb700 1 -- 172.21.15.104:0/3054126456 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1279957748 0 0) 0x7f31a0001490 con 0x7f31b0142940 2024-08-17T02:22:29.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.658+0000 7f31adffb700 1 -- 172.21.15.104:0/3054126456 >> v1:172.21.15.104:6789/0 conn(0x7f31b0142940 legacy=0x7f31b006e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:29.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.658+0000 7f31adffb700 1 --2- 172.21.15.104:0/3054126456 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3198003a60 0x7f3198003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:29.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.658+0000 7f31adffb700 1 --2- 172.21.15.104:0/3054126456 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31b00aebe0 0x7f3198004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:29.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.658+0000 7f31adffb700 1 --2- 172.21.15.104:0/3054126456 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3198004d50 0x7f31980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:29.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.658+0000 7f31adffb700 1 -- 172.21.15.104:0/3054126456 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b00ad330 con 0x7f3198003a60 2024-08-17T02:22:29.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.658+0000 7f31adffb700 1 -- 172.21.15.104:0/3054126456 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b00ad610 con 0x7f3198004d50 2024-08-17T02:22:29.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.658+0000 7f31adffb700 1 -- 172.21.15.104:0/3054126456 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319800ba60 con 0x7f31b00aebe0 2024-08-17T02:22:29.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.658+0000 7f31aeffd700 1 --2- 172.21.15.104:0/3054126456 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3198003a60 0x7f3198003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:29.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.662+0000 7f31ae7fc700 1 --2- 172.21.15.104:0/3054126456 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31b00aebe0 0x7f3198004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:29.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.662+0000 7f31af7fe700 1 --2- 172.21.15.104:0/3054126456 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3198004d50 0x7f31980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:29.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.662+0000 7f31aeffd700 1 -- 172.21.15.104:0/3054126456 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31b00aebe0 msgr2=0x7f3198004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:29.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.662+0000 7f31aeffd700 1 --2- 172.21.15.104:0/3054126456 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31b00aebe0 0x7f3198004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:29.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.662+0000 7f31aeffd700 1 -- 172.21.15.104:0/3054126456 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3198004d50 msgr2=0x7f31980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:29.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.662+0000 7f31aeffd700 1 --2- 172.21.15.104:0/3054126456 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3198004d50 0x7f31980051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:29.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.662+0000 7f31aeffd700 1 -- 172.21.15.104:0/3054126456 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3198003570 con 0x7f3198003a60 2024-08-17T02:22:29.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.662+0000 7f31ae7fc700 1 --2- 172.21.15.104:0/3054126456 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31b00aebe0 0x7f3198004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:22:29.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.662+0000 7f31aeffd700 1 --2- 172.21.15.104:0/3054126456 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3198003a60 0x7f3198003e70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f31b00c73d0 tx=0x7f31a0007940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5778ec13a9c3da1b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:29.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.662+0000 7f31adffb700 1 -- 172.21.15.104:0/3054126456 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a000cbd0 con 0x7f3198003a60 2024-08-17T02:22:29.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.662+0000 7f31adffb700 1 -- 172.21.15.104:0/3054126456 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a000cd50 con 0x7f3198003a60 2024-08-17T02:22:29.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.662+0000 7f31adffb700 1 -- 172.21.15.104:0/3054126456 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a0004b40 con 0x7f3198003a60 2024-08-17T02:22:29.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.662+0000 7f31affff700 1 -- 172.21.15.104:0/3054126456 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3198003a60 msgr2=0x7f3198003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:29.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.662+0000 7f31affff700 1 --2- 172.21.15.104:0/3054126456 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3198003a60 0x7f3198003e70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f31b00c73d0 tx=0x7f31a0007940 comp rx=0 tx=0).stop 2024-08-17T02:22:29.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.662+0000 7f31af7fe700 1 -- 172.21.15.104:0/3054126456 reap_dead start 2024-08-17T02:22:29.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.662+0000 7f31affff700 1 -- 172.21.15.104:0/3054126456 shutdown_connections 2024-08-17T02:22:29.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.662+0000 7f31affff700 1 -- 172.21.15.104:0/3054126456 >> 172.21.15.104:0/3054126456 conn(0x7f31b00ca2c0 msgr2=0x7f31b006dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:29.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.662+0000 7f31affff700 1 -- 172.21.15.104:0/3054126456 shutdown_connections 2024-08-17T02:22:29.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.662+0000 7f31affff700 1 -- 172.21.15.104:0/3054126456 wait complete. 2024-08-17T02:22:29.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.662+0000 7f31affff700 1 Processor -- start 2024-08-17T02:22:29.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.662+0000 7f31affff700 1 -- start start 2024-08-17T02:22:29.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.662+0000 7f31affff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3198003a60 0x7f31b013b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:29.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.662+0000 7f31affff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31b013bad0 0x7f31b01585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:29.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.662+0000 7f31affff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31b016caf0 0x7f31b016cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:29.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.662+0000 7f31affff700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b016d4a0 con 0x7f3198003a60 2024-08-17T02:22:29.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.662+0000 7f31affff700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b013c240 con 0x7f31b013bad0 2024-08-17T02:22:29.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.662+0000 7f31affff700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b013c520 con 0x7f31b016caf0 2024-08-17T02:22:29.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.662+0000 7f31aeffd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3198003a60 0x7f31b013b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:29.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.662+0000 7f31aeffd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3198003a60 0x7f31b013b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42418/0 (socket says 172.21.15.104:42418) 2024-08-17T02:22:29.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.662+0000 7f31aeffd700 1 -- 172.21.15.104:0/545894113 learned_addr learned my addr 172.21.15.104:0/545894113 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:29.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.662+0000 7f31ae7fc700 1 --2- 172.21.15.104:0/545894113 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31b013bad0 0x7f31b01585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:29.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.666+0000 7f31af7fe700 1 --2- 172.21.15.104:0/545894113 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31b016caf0 0x7f31b016cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:29.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.666+0000 7f31aeffd700 1 -- 172.21.15.104:0/545894113 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31b016caf0 msgr2=0x7f31b016cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:29.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.666+0000 7f31aeffd700 1 --2- 172.21.15.104:0/545894113 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31b016caf0 0x7f31b016cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:29.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.666+0000 7f31aeffd700 1 -- 172.21.15.104:0/545894113 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31b013bad0 msgr2=0x7f31b01585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:29.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.666+0000 7f31aeffd700 1 --2- 172.21.15.104:0/545894113 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31b013bad0 0x7f31b01585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:29.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.666+0000 7f31aeffd700 1 -- 172.21.15.104:0/545894113 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b013c800 con 0x7f3198003a60 2024-08-17T02:22:29.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.666+0000 7f31aeffd700 1 --2- 172.21.15.104:0/545894113 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3198003a60 0x7f31b013b4e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3198004730 tx=0x7f31a0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:29.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.666+0000 7f3196ffd700 1 -- 172.21.15.104:0/545894113 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a0023070 con 0x7f3198003a60 2024-08-17T02:22:29.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.666+0000 7f3196ffd700 1 -- 172.21.15.104:0/545894113 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a000cbd0 con 0x7f3198003a60 2024-08-17T02:22:29.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.666+0000 7f3196ffd700 1 -- 172.21.15.104:0/545894113 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a00075b0 con 0x7f3198003a60 2024-08-17T02:22:29.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.666+0000 7f31affff700 1 -- 172.21.15.104:0/545894113 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31b013cae0 con 0x7f3198003a60 2024-08-17T02:22:29.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.666+0000 7f31affff700 1 -- 172.21.15.104:0/545894113 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31b013bf40 con 0x7f3198003a60 2024-08-17T02:22:29.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.666+0000 7f31affff700 1 -- 172.21.15.104:0/545894113 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31b013cf60 con 0x7f3198003a60 2024-08-17T02:22:29.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.666+0000 7f3196ffd700 1 -- 172.21.15.104:0/545894113 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f31a0014420 con 0x7f3198003a60 2024-08-17T02:22:29.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.670+0000 7f3196ffd700 1 --2- 172.21.15.104:0/545894113 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f319c060890 0x7f319c062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:29.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.670+0000 7f3196ffd700 1 -- 172.21.15.104:0/545894113 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f31a007de30 con 0x7f3198003a60 2024-08-17T02:22:29.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.670+0000 7f31ae7fc700 1 --2- 172.21.15.104:0/545894113 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f319c060890 0x7f319c062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:29.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.670+0000 7f31ae7fc700 1 --2- 172.21.15.104:0/545894113 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f319c060890 0x7f319c062d40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f31b016ca50 tx=0x7f31a4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:29.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.674+0000 7f3196ffd700 1 -- 172.21.15.104:0/545894113 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f31a004e280 con 0x7f3198003a60 2024-08-17T02:22:29.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.826+0000 7f31affff700 1 -- 172.21.15.104:0/545894113 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f31b00638f0 con 0x7f3198003a60 2024-08-17T02:22:29.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.826+0000 7f3196ffd700 1 -- 172.21.15.104:0/545894113 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f31a00518a0 con 0x7f3198003a60 2024-08-17T02:22:29.834 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-08-17T02:22:29.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.830+0000 7f31affff700 1 -- 172.21.15.104:0/545894113 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f319c060890 msgr2=0x7f319c062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:29.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.830+0000 7f31affff700 1 --2- 172.21.15.104:0/545894113 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f319c060890 0x7f319c062d40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f31b016ca50 tx=0x7f31a4008040 comp rx=0 tx=0).stop 2024-08-17T02:22:29.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.830+0000 7f31affff700 1 -- 172.21.15.104:0/545894113 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3198003a60 msgr2=0x7f31b013b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:29.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.830+0000 7f31affff700 1 --2- 172.21.15.104:0/545894113 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3198003a60 0x7f31b013b4e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3198004730 tx=0x7f31a0015000 comp rx=0 tx=0).stop 2024-08-17T02:22:29.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.830+0000 7f31affff700 1 -- 172.21.15.104:0/545894113 shutdown_connections 2024-08-17T02:22:29.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.830+0000 7f31affff700 1 --2- 172.21.15.104:0/545894113 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f319c060890 0x7f319c062d40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:29.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.830+0000 7f31affff700 1 --2- 172.21.15.104:0/545894113 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31b016caf0 0x7f31b016cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:29.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.830+0000 7f31affff700 1 --2- 172.21.15.104:0/545894113 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31b013bad0 0x7f31b01585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:29.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.830+0000 7f31affff700 1 --2- 172.21.15.104:0/545894113 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3198003a60 0x7f31b013b4e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:29.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.830+0000 7f31affff700 1 -- 172.21.15.104:0/545894113 >> 172.21.15.104:0/545894113 conn(0x7f31b00ca2c0 msgr2=0x7f31b00c7400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:29.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.830+0000 7f31affff700 1 -- 172.21.15.104:0/545894113 shutdown_connections 2024-08-17T02:22:29.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.830+0000 7f31affff700 1 -- 172.21.15.104:0/545894113 wait complete. 2024-08-17T02:22:29.847 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:22:29.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.946+0000 7f33bb07c700 1 Processor -- start 2024-08-17T02:22:29.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.946+0000 7f33bb07c700 1 -- start start 2024-08-17T02:22:29.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.946+0000 7f33bb07c700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f33b4159470 0x7f33b40cb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:29.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.946+0000 7f33bb07c700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f33b40cb600 0x7f33b4066e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:29.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.946+0000 7f33bb07c700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33b40cf520 con 0x7f33b41590a0 2024-08-17T02:22:29.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.946+0000 7f33bb07c700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33b41598a0 con 0x7f33b4159470 2024-08-17T02:22:29.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.946+0000 7f33bb07c700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33b40d0f40 con 0x7f33b40cb600 2024-08-17T02:22:29.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.946+0000 7f33b9879700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f33b4159470 0x7f33b40cb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:29.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.946+0000 7f33b9879700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f33b4159470 0x7f33b40cb0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42432/0 (socket says 172.21.15.104:42432) 2024-08-17T02:22:29.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.946+0000 7f33b9879700 1 -- 172.21.15.104:0/716083113 learned_addr learned my addr 172.21.15.104:0/716083113 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:29.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.946+0000 7f33ba87b700 1 --2- 172.21.15.104:0/716083113 >> v2:172.21.15.117:3300/0 conn(0x7f33b40cb600 0x7f33b4066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:29.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.946+0000 7f33b9879700 1 -- 172.21.15.104:0/716083113 >> v2:172.21.15.117:3300/0 conn(0x7f33b40cb600 msgr2=0x7f33b4066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:29.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.946+0000 7f33b9879700 1 --2- 172.21.15.104:0/716083113 >> v2:172.21.15.117:3300/0 conn(0x7f33b40cb600 0x7f33b4066e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:29.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.946+0000 7f33b9879700 1 -- 172.21.15.104:0/716083113 >> v1:172.21.15.117:6789/0 conn(0x7f33b41590a0 legacy=0x7f33b40cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:29.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.946+0000 7f33b9879700 1 -- 172.21.15.104:0/716083113 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b40ce690 con 0x7f33b4159470 2024-08-17T02:22:29.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.946+0000 7f33ba87b700 1 --2- 172.21.15.104:0/716083113 >> v2:172.21.15.117:3300/0 conn(0x7f33b40cb600 0x7f33b4066e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:22:29.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.946+0000 7f33b9879700 1 --2- 172.21.15.104:0/716083113 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33b4159470 0x7f33b40cb0c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f33b40cdbe0 tx=0x7f33a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5084d14e3d80c3bc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:29.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.946+0000 7f33b9078700 1 -- 172.21.15.104:0/716083113 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a400b820 con 0x7f33b4159470 2024-08-17T02:22:29.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.950+0000 7f33b9078700 1 -- 172.21.15.104:0/716083113 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a400b980 con 0x7f33b4159470 2024-08-17T02:22:29.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.950+0000 7f33b9078700 1 -- 172.21.15.104:0/716083113 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a400bd20 con 0x7f33b4159470 2024-08-17T02:22:29.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.950+0000 7f33bb07c700 1 -- 172.21.15.104:0/716083113 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33b4159470 msgr2=0x7f33b40cb0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:29.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.950+0000 7f33bb07c700 1 --2- 172.21.15.104:0/716083113 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33b4159470 0x7f33b40cb0c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f33b40cdbe0 tx=0x7f33a4009250 comp rx=0 tx=0).stop 2024-08-17T02:22:29.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.950+0000 7f33bb07c700 1 -- 172.21.15.104:0/716083113 shutdown_connections 2024-08-17T02:22:29.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.950+0000 7f33bb07c700 1 --2- 172.21.15.104:0/716083113 >> v2:172.21.15.117:3300/0 conn(0x7f33b40cb600 0x7f33b4066e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:29.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.950+0000 7f33bb07c700 1 --2- 172.21.15.104:0/716083113 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33b4159470 0x7f33b40cb0c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:29.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.950+0000 7f33bb07c700 1 -- 172.21.15.104:0/716083113 >> 172.21.15.104:0/716083113 conn(0x7f33b4068c80 msgr2=0x7f33b40d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:29.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.950+0000 7f33bb07c700 1 -- 172.21.15.104:0/716083113 shutdown_connections 2024-08-17T02:22:29.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.950+0000 7f33bb07c700 1 -- 172.21.15.104:0/716083113 wait complete. 2024-08-17T02:22:29.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.950+0000 7f33bb07c700 1 Processor -- start 2024-08-17T02:22:29.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.950+0000 7f33bb07c700 1 -- start start 2024-08-17T02:22:29.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.950+0000 7f33bb07c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33b40cb600 0x7f33b40c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:29.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.950+0000 7f33bb07c700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33b41590a0 0x7f33b4152730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:29.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.950+0000 7f33bb07c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33b4159470 0x7f33b41555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:29.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.950+0000 7f33bb07c700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b40c74a0 con 0x7f33b4159470 2024-08-17T02:22:29.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.950+0000 7f33bb07c700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b40ca020 con 0x7f33b40cb600 2024-08-17T02:22:29.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.950+0000 7f33bb07c700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b40b5d30 con 0x7f33b41590a0 2024-08-17T02:22:29.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.954+0000 7f33ba87b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33b4159470 0x7f33b41555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:29.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.954+0000 7f33ba87b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33b4159470 0x7f33b41555f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42438/0 (socket says 172.21.15.104:42438) 2024-08-17T02:22:29.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.954+0000 7f33ba87b700 1 -- 172.21.15.104:0/1060681254 learned_addr learned my addr 172.21.15.104:0/1060681254 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:29.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.954+0000 7f33ba07a700 1 --2- 172.21.15.104:0/1060681254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33b40cb600 0x7f33b40c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:29.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.954+0000 7f33b9879700 1 --2- 172.21.15.104:0/1060681254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33b41590a0 0x7f33b4152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:29.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.954+0000 7f33ba87b700 1 -- 172.21.15.104:0/1060681254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33b41590a0 msgr2=0x7f33b4152730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:29.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.954+0000 7f33ba87b700 1 --2- 172.21.15.104:0/1060681254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33b41590a0 0x7f33b4152730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:29.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.954+0000 7f33ba87b700 1 -- 172.21.15.104:0/1060681254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33b40cb600 msgr2=0x7f33b40c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:29.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.954+0000 7f33ba87b700 1 --2- 172.21.15.104:0/1060681254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33b40cb600 0x7f33b40c9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:29.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.954+0000 7f33ba87b700 1 -- 172.21.15.104:0/1060681254 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a40094f0 con 0x7f33b4159470 2024-08-17T02:22:29.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.954+0000 7f33ba07a700 1 --2- 172.21.15.104:0/1060681254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33b40cb600 0x7f33b40c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:22:29.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.954+0000 7f33ba87b700 1 --2- 172.21.15.104:0/1060681254 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33b4159470 0x7f33b41555f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f33ac00cfb0 tx=0x7f33ac0078c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:29.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.954+0000 7f33aa7fc700 1 -- 172.21.15.104:0/1060681254 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac015440 con 0x7f33b4159470 2024-08-17T02:22:29.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.954+0000 7f33aa7fc700 1 -- 172.21.15.104:0/1060681254 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ac0155a0 con 0x7f33b4159470 2024-08-17T02:22:29.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.954+0000 7f33bb07c700 1 -- 172.21.15.104:0/1060681254 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33b40b5490 con 0x7f33b4159470 2024-08-17T02:22:29.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.954+0000 7f33aa7fc700 1 -- 172.21.15.104:0/1060681254 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac015960 con 0x7f33b4159470 2024-08-17T02:22:29.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.954+0000 7f33bb07c700 1 -- 172.21.15.104:0/1060681254 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33b40b5a50 con 0x7f33b4159470 2024-08-17T02:22:29.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.954+0000 7f33bb07c700 1 -- 172.21.15.104:0/1060681254 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33b40c7610 con 0x7f33b4159470 2024-08-17T02:22:29.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.954+0000 7f33aa7fc700 1 -- 172.21.15.104:0/1060681254 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f33ac003020 con 0x7f33b4159470 2024-08-17T02:22:29.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.958+0000 7f33aa7fc700 1 --2- 172.21.15.104:0/1060681254 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3398060860 0x7f3398062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:29.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.958+0000 7f33ba07a700 1 --2- 172.21.15.104:0/1060681254 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3398060860 0x7f3398062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:29.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.958+0000 7f33aa7fc700 1 -- 172.21.15.104:0/1060681254 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f33ac07d340 con 0x7f33b4159470 2024-08-17T02:22:29.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.958+0000 7f33ba07a700 1 --2- 172.21.15.104:0/1060681254 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3398060860 0x7f3398062d10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f33b0007fd0 tx=0x7f33b0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:29.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:29.966+0000 7f33aa7fc700 1 -- 172.21.15.104:0/1060681254 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f33ac04c480 con 0x7f33b4159470 2024-08-17T02:22:30.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.118+0000 7f33bb07c700 1 -- 172.21.15.104:0/1060681254 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f33b4064330 con 0x7f33b4159470 2024-08-17T02:22:30.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.118+0000 7f33aa7fc700 1 -- 172.21.15.104:0/1060681254 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f33b40c7610 con 0x7f33b4159470 2024-08-17T02:22:30.124 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 32 2024-08-17T02:22:30.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.122+0000 7f33bb07c700 1 -- 172.21.15.104:0/1060681254 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3398060860 msgr2=0x7f3398062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:30.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.122+0000 7f33bb07c700 1 --2- 172.21.15.104:0/1060681254 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3398060860 0x7f3398062d10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f33b0007fd0 tx=0x7f33b0009040 comp rx=0 tx=0).stop 2024-08-17T02:22:30.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.122+0000 7f33bb07c700 1 -- 172.21.15.104:0/1060681254 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33b4159470 msgr2=0x7f33b41555f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:30.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.122+0000 7f33bb07c700 1 --2- 172.21.15.104:0/1060681254 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33b4159470 0x7f33b41555f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f33ac00cfb0 tx=0x7f33ac0078c0 comp rx=0 tx=0).stop 2024-08-17T02:22:30.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.122+0000 7f33bb07c700 1 -- 172.21.15.104:0/1060681254 shutdown_connections 2024-08-17T02:22:30.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.122+0000 7f33bb07c700 1 --2- 172.21.15.104:0/1060681254 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3398060860 0x7f3398062d10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:30.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.122+0000 7f33bb07c700 1 --2- 172.21.15.104:0/1060681254 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33b4159470 0x7f33b41555f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:30.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.122+0000 7f33bb07c700 1 --2- 172.21.15.104:0/1060681254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33b41590a0 0x7f33b4152730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:30.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.122+0000 7f33bb07c700 1 --2- 172.21.15.104:0/1060681254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33b40cb600 0x7f33b40c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:30.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.122+0000 7f33bb07c700 1 -- 172.21.15.104:0/1060681254 >> 172.21.15.104:0/1060681254 conn(0x7f33b4068c80 msgr2=0x7f33b41537c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:30.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.122+0000 7f33bb07c700 1 -- 172.21.15.104:0/1060681254 shutdown_connections 2024-08-17T02:22:30.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.122+0000 7f33bb07c700 1 -- 172.21.15.104:0/1060681254 wait complete. 2024-08-17T02:22:30.143 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:22:30.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.238+0000 7f3ac085f700 1 Processor -- start 2024-08-17T02:22:30.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.238+0000 7f3ac085f700 1 -- start start 2024-08-17T02:22:30.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.238+0000 7f3ac085f700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f3abc0b2710 0x7f3abc0af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:30.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.238+0000 7f3ac085f700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3abc160c50 0x7f3abc066e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:30.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.238+0000 7f3ac085f700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3abc0cea40 con 0x7f3abc160880 2024-08-17T02:22:30.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.238+0000 7f3ac085f700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3abc0af730 con 0x7f3abc0b2710 2024-08-17T02:22:30.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.238+0000 7f3ac085f700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3abc0cde30 con 0x7f3abc160c50 2024-08-17T02:22:30.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.238+0000 7f3aba59c700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f3abc0b2710 0x7f3abc0af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:30.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.238+0000 7f3abad9d700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f3abc160880 0x7f3abc0b2000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:56800/0 (socket says 172.21.15.104:56800) 2024-08-17T02:22:30.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.238+0000 7f3abad9d700 1 -- 172.21.15.104:0/1665398859 learned_addr learned my addr 172.21.15.104:0/1665398859 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:30.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.238+0000 7f3abb59e700 1 --2- 172.21.15.104:0/1665398859 >> v2:172.21.15.117:3300/0 conn(0x7f3abc160c50 0x7f3abc066e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:30.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.238+0000 7f3ab9d9b700 1 -- 172.21.15.104:0/1665398859 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 912653990 0 0) 0x7f3abc0cea40 con 0x7f3abc160880 2024-08-17T02:22:30.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.238+0000 7f3ab9d9b700 1 -- 172.21.15.104:0/1665398859 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3aa8003570 con 0x7f3abc160880 2024-08-17T02:22:30.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.238+0000 7f3aba59c700 1 -- 172.21.15.104:0/1665398859 >> v2:172.21.15.117:3300/0 conn(0x7f3abc160c50 msgr2=0x7f3abc066e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:30.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.238+0000 7f3aba59c700 1 --2- 172.21.15.104:0/1665398859 >> v2:172.21.15.117:3300/0 conn(0x7f3abc160c50 0x7f3abc066e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:30.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.238+0000 7f3aba59c700 1 -- 172.21.15.104:0/1665398859 >> v1:172.21.15.104:6789/0 conn(0x7f3abc160880 legacy=0x7f3abc0b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:30.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.238+0000 7f3aba59c700 1 -- 172.21.15.104:0/1665398859 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3abc0ce110 con 0x7f3abc0b2710 2024-08-17T02:22:30.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.238+0000 7f3aba59c700 1 --2- 172.21.15.104:0/1665398859 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3abc0b2710 0x7f3abc0af1f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3abc0ca690 tx=0x7f3aac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d13ab0ad8386e6f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:30.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.238+0000 7f3ab9d9b700 1 -- 172.21.15.104:0/1665398859 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac011630 con 0x7f3abc0b2710 2024-08-17T02:22:30.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.238+0000 7f3ab9d9b700 1 -- 172.21.15.104:0/1665398859 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aac0117b0 con 0x7f3abc0b2710 2024-08-17T02:22:30.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.238+0000 7f3ab9d9b700 1 -- 172.21.15.104:0/1665398859 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac011b70 con 0x7f3abc0b2710 2024-08-17T02:22:30.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.238+0000 7f3ac085f700 1 -- 172.21.15.104:0/1665398859 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3abc0b2710 msgr2=0x7f3abc0af1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:30.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.238+0000 7f3ac085f700 1 --2- 172.21.15.104:0/1665398859 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3abc0b2710 0x7f3abc0af1f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3abc0ca690 tx=0x7f3aac0091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:30.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.238+0000 7f3ac085f700 1 -- 172.21.15.104:0/1665398859 shutdown_connections 2024-08-17T02:22:30.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.238+0000 7f3ac085f700 1 --2- 172.21.15.104:0/1665398859 >> v2:172.21.15.117:3300/0 conn(0x7f3abc160c50 0x7f3abc066e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:30.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.238+0000 7f3ac085f700 1 --2- 172.21.15.104:0/1665398859 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3abc0b2710 0x7f3abc0af1f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:30.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.238+0000 7f3ac085f700 1 -- 172.21.15.104:0/1665398859 >> 172.21.15.104:0/1665398859 conn(0x7f3abc0d0b50 msgr2=0x7f3abc0ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:30.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.242+0000 7f3ac085f700 1 -- 172.21.15.104:0/1665398859 shutdown_connections 2024-08-17T02:22:30.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.242+0000 7f3ac085f700 1 -- 172.21.15.104:0/1665398859 wait complete. 2024-08-17T02:22:30.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.242+0000 7f3ac085f700 1 Processor -- start 2024-08-17T02:22:30.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.242+0000 7f3ac085f700 1 -- start start 2024-08-17T02:22:30.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.242+0000 7f3ac085f700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3abc160880 0x7f3abc14ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:30.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.242+0000 7f3ac085f700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3abc160c50 0x7f3abc15b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:30.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.242+0000 7f3ac085f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3abc15bdd0 0x7f3abc0b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:30.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.242+0000 7f3ac085f700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc171bf0 con 0x7f3abc160c50 2024-08-17T02:22:30.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.242+0000 7f3ac085f700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc170fe0 con 0x7f3abc15bdd0 2024-08-17T02:22:30.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.242+0000 7f3ac085f700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc1712c0 con 0x7f3abc160880 2024-08-17T02:22:30.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.242+0000 7f3aba59c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3abc160c50 0x7f3abc15b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:30.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.242+0000 7f3aba59c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3abc160c50 0x7f3abc15b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42460/0 (socket says 172.21.15.104:42460) 2024-08-17T02:22:30.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.242+0000 7f3aba59c700 1 -- 172.21.15.104:0/2514960504 learned_addr learned my addr 172.21.15.104:0/2514960504 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:30.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.242+0000 7f3abad9d700 1 --2- 172.21.15.104:0/2514960504 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3abc160880 0x7f3abc14ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:30.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.242+0000 7f3abb59e700 1 --2- 172.21.15.104:0/2514960504 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3abc15bdd0 0x7f3abc0b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:30.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.242+0000 7f3aba59c700 1 -- 172.21.15.104:0/2514960504 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3abc160880 msgr2=0x7f3abc14ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:30.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.242+0000 7f3aba59c700 1 --2- 172.21.15.104:0/2514960504 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3abc160880 0x7f3abc14ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:30.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.242+0000 7f3aba59c700 1 -- 172.21.15.104:0/2514960504 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3abc15bdd0 msgr2=0x7f3abc0b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:30.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.242+0000 7f3aba59c700 1 --2- 172.21.15.104:0/2514960504 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3abc15bdd0 0x7f3abc0b43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:30.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.242+0000 7f3aba59c700 1 -- 172.21.15.104:0/2514960504 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aac009420 con 0x7f3abc160c50 2024-08-17T02:22:30.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.242+0000 7f3aba59c700 1 --2- 172.21.15.104:0/2514960504 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3abc160c50 0x7f3abc15b890 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3aac013000 tx=0x7f3aac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:30.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.246+0000 7f3ab2ffd700 1 -- 172.21.15.104:0/2514960504 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac01f070 con 0x7f3abc160c50 2024-08-17T02:22:30.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.246+0000 7f3ab2ffd700 1 -- 172.21.15.104:0/2514960504 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aac000bc0 con 0x7f3abc160c50 2024-08-17T02:22:30.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.246+0000 7f3ac085f700 1 -- 172.21.15.104:0/2514960504 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3abc1715a0 con 0x7f3abc160c50 2024-08-17T02:22:30.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.246+0000 7f3ab2ffd700 1 -- 172.21.15.104:0/2514960504 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac025420 con 0x7f3abc160c50 2024-08-17T02:22:30.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.246+0000 7f3ac085f700 1 -- 172.21.15.104:0/2514960504 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3abc15b240 con 0x7f3abc160c50 2024-08-17T02:22:30.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.246+0000 7f3ac085f700 1 -- 172.21.15.104:0/2514960504 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3abc171da0 con 0x7f3abc160c50 2024-08-17T02:22:30.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.246+0000 7f3ab2ffd700 1 -- 172.21.15.104:0/2514960504 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f3aac023070 con 0x7f3abc160c50 2024-08-17T02:22:30.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.246+0000 7f3ab2ffd700 1 --2- 172.21.15.104:0/2514960504 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3a9c060860 0x7f3a9c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:30.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.246+0000 7f3ab2ffd700 1 -- 172.21.15.104:0/2514960504 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3aac07ddb0 con 0x7f3abc160c50 2024-08-17T02:22:30.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.246+0000 7f3abad9d700 1 --2- 172.21.15.104:0/2514960504 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3a9c060860 0x7f3a9c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:30.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.250+0000 7f3abad9d700 1 --2- 172.21.15.104:0/2514960504 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3a9c060860 0x7f3a9c062d10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4007fd0 tx=0x7f3aa4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:30.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.254+0000 7f3ab2ffd700 1 -- 172.21.15.104:0/2514960504 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f3abc171da0 con 0x7f3abc160c50 2024-08-17T02:22:30.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.418+0000 7f3ac085f700 1 -- 172.21.15.104:0/2514960504 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3abc0638f0 con 0x7f3abc160c50 2024-08-17T02:22:30.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.418+0000 7f3ab2ffd700 1 -- 172.21.15.104:0/2514960504 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3aac04e200 con 0x7f3abc160c50 2024-08-17T02:22:30.426 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 64 2024-08-17T02:22:30.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.422+0000 7f3ac085f700 1 -- 172.21.15.104:0/2514960504 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3a9c060860 msgr2=0x7f3a9c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:30.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.422+0000 7f3ac085f700 1 --2- 172.21.15.104:0/2514960504 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3a9c060860 0x7f3a9c062d10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4007fd0 tx=0x7f3aa4009040 comp rx=0 tx=0).stop 2024-08-17T02:22:30.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.422+0000 7f3ac085f700 1 -- 172.21.15.104:0/2514960504 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3abc160c50 msgr2=0x7f3abc15b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:30.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.422+0000 7f3ac085f700 1 --2- 172.21.15.104:0/2514960504 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3abc160c50 0x7f3abc15b890 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3aac013000 tx=0x7f3aac017000 comp rx=0 tx=0).stop 2024-08-17T02:22:30.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.422+0000 7f3ac085f700 1 -- 172.21.15.104:0/2514960504 shutdown_connections 2024-08-17T02:22:30.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.422+0000 7f3ac085f700 1 --2- 172.21.15.104:0/2514960504 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3a9c060860 0x7f3a9c062d10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:30.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.422+0000 7f3ac085f700 1 --2- 172.21.15.104:0/2514960504 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3abc15bdd0 0x7f3abc0b43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:30.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.422+0000 7f3ac085f700 1 --2- 172.21.15.104:0/2514960504 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3abc160c50 0x7f3abc15b890 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:30.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.422+0000 7f3ac085f700 1 --2- 172.21.15.104:0/2514960504 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3abc160880 0x7f3abc14ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:30.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.422+0000 7f3ac085f700 1 -- 172.21.15.104:0/2514960504 >> 172.21.15.104:0/2514960504 conn(0x7f3abc0d0b50 msgr2=0x7f3abc0b0600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:30.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.422+0000 7f3ac085f700 1 -- 172.21.15.104:0/2514960504 shutdown_connections 2024-08-17T02:22:30.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.422+0000 7f3ac085f700 1 -- 172.21.15.104:0/2514960504 wait complete. 2024-08-17T02:22:30.440 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:22:30.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.534+0000 7f444421a700 1 Processor -- start 2024-08-17T02:22:30.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.534+0000 7f444421a700 1 -- start start 2024-08-17T02:22:30.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.534+0000 7f444421a700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f443c0aac50 0x7f443c15aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:30.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.534+0000 7f444421a700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f443c15a2e0 0x7f443c1574a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:30.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.534+0000 7f444421a700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f443c0b3b30 0x7f443c0b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:30.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.534+0000 7f444421a700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f443c15bc90 con 0x7f443c0b3b30 2024-08-17T02:22:30.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.534+0000 7f444421a700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f443c0b4490 con 0x7f443c15a2e0 2024-08-17T02:22:30.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.534+0000 7f444421a700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f443c15b010 con 0x7f443c0aac50 2024-08-17T02:22:30.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.534+0000 7f44427b7700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f443c0b3b30 0x7f443c0b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:30.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.534+0000 7f44427b7700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f443c0b3b30 0x7f443c0b3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42468/0 (socket says 172.21.15.104:42468) 2024-08-17T02:22:30.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.534+0000 7f44427b7700 1 -- 172.21.15.104:0/2885393738 learned_addr learned my addr 172.21.15.104:0/2885393738 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:30.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.534+0000 7f44417b5700 1 --2- 172.21.15.104:0/2885393738 >> v2:172.21.15.117:3300/0 conn(0x7f443c15a2e0 0x7f443c1574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:30.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.534+0000 7f4441fb6700 1 --2- 172.21.15.104:0/2885393738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f443c0aac50 0x7f443c15aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:30.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.534+0000 7f44427b7700 1 -- 172.21.15.104:0/2885393738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f443c0aac50 msgr2=0x7f443c15aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:30.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.534+0000 7f44427b7700 1 --2- 172.21.15.104:0/2885393738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f443c0aac50 0x7f443c15aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:30.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.534+0000 7f44427b7700 1 -- 172.21.15.104:0/2885393738 >> v2:172.21.15.117:3300/0 conn(0x7f443c15a2e0 msgr2=0x7f443c1574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:30.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.534+0000 7f44427b7700 1 --2- 172.21.15.104:0/2885393738 >> v2:172.21.15.117:3300/0 conn(0x7f443c15a2e0 0x7f443c1574a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:30.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.534+0000 7f44427b7700 1 -- 172.21.15.104:0/2885393738 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f443c15b2f0 con 0x7f443c0b3b30 2024-08-17T02:22:30.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.534+0000 7f4441fb6700 1 --2- 172.21.15.104:0/2885393738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f443c0aac50 0x7f443c15aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:22:30.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.534+0000 7f44427b7700 1 --2- 172.21.15.104:0/2885393738 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f443c0b3b30 0x7f443c0b3f50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f443c0892f0 tx=0x7f4434009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93c7a08ddedf762d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:30.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.534+0000 7f4440fb4700 1 -- 172.21.15.104:0/2885393738 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443400e070 con 0x7f443c0b3b30 2024-08-17T02:22:30.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.534+0000 7f4440fb4700 1 -- 172.21.15.104:0/2885393738 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443400ba50 con 0x7f443c0b3b30 2024-08-17T02:22:30.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.534+0000 7f4440fb4700 1 -- 172.21.15.104:0/2885393738 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44340092e0 con 0x7f443c0b3b30 2024-08-17T02:22:30.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.534+0000 7f444421a700 1 -- 172.21.15.104:0/2885393738 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f443c0b3b30 msgr2=0x7f443c0b3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:30.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.534+0000 7f444421a700 1 --2- 172.21.15.104:0/2885393738 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f443c0b3b30 0x7f443c0b3f50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f443c0892f0 tx=0x7f4434009840 comp rx=0 tx=0).stop 2024-08-17T02:22:30.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.534+0000 7f444421a700 1 -- 172.21.15.104:0/2885393738 shutdown_connections 2024-08-17T02:22:30.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.534+0000 7f444421a700 1 --2- 172.21.15.104:0/2885393738 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f443c0b3b30 0x7f443c0b3f50 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:30.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.534+0000 7f444421a700 1 --2- 172.21.15.104:0/2885393738 >> v2:172.21.15.117:3300/0 conn(0x7f443c15a2e0 0x7f443c1574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:30.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.534+0000 7f444421a700 1 --2- 172.21.15.104:0/2885393738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f443c0aac50 0x7f443c15aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:30.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.534+0000 7f444421a700 1 -- 172.21.15.104:0/2885393738 >> 172.21.15.104:0/2885393738 conn(0x7f443c0994d0 msgr2=0x7f443c0675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:30.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.534+0000 7f444421a700 1 -- 172.21.15.104:0/2885393738 shutdown_connections 2024-08-17T02:22:30.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.534+0000 7f444421a700 1 -- 172.21.15.104:0/2885393738 wait complete. 2024-08-17T02:22:30.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.534+0000 7f444421a700 1 Processor -- start 2024-08-17T02:22:30.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.534+0000 7f444421a700 1 -- start start 2024-08-17T02:22:30.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.538+0000 7f444421a700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f443c0aac50 0x7f443c152d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:30.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.538+0000 7f444421a700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f443c0b3b30 0x7f443c0ae110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:30.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.538+0000 7f444421a700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f443c15a2e0 0x7f443c156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:30.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.538+0000 7f444421a700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443c09aec0 con 0x7f443c0aac50 2024-08-17T02:22:30.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.538+0000 7f444421a700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443c0adc80 con 0x7f443c0b3b30 2024-08-17T02:22:30.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.538+0000 7f444421a700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f443c09abe0 con 0x7f443c15a2e0 2024-08-17T02:22:30.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.538+0000 7f4441fb6700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f443c0aac50 0x7f443c152d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:30.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.538+0000 7f4441fb6700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f443c0aac50 0x7f443c152d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42470/0 (socket says 172.21.15.104:42470) 2024-08-17T02:22:30.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.538+0000 7f4441fb6700 1 -- 172.21.15.104:0/1657393605 learned_addr learned my addr 172.21.15.104:0/1657393605 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:30.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.538+0000 7f44417b5700 1 --2- 172.21.15.104:0/1657393605 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f443c0b3b30 0x7f443c0ae110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:30.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.538+0000 7f44427b7700 1 --2- 172.21.15.104:0/1657393605 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f443c15a2e0 0x7f443c156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:30.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.538+0000 7f4441fb6700 1 -- 172.21.15.104:0/1657393605 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f443c15a2e0 msgr2=0x7f443c156280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:30.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.538+0000 7f4441fb6700 1 --2- 172.21.15.104:0/1657393605 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f443c15a2e0 0x7f443c156280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:30.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.538+0000 7f4441fb6700 1 -- 172.21.15.104:0/1657393605 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f443c0b3b30 msgr2=0x7f443c0ae110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:30.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.538+0000 7f4441fb6700 1 --2- 172.21.15.104:0/1657393605 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f443c0b3b30 0x7f443c0ae110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:30.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.538+0000 7f4441fb6700 1 -- 172.21.15.104:0/1657393605 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4434009ae0 con 0x7f443c0aac50 2024-08-17T02:22:30.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.538+0000 7f44427b7700 1 --2- 172.21.15.104:0/1657393605 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f443c15a2e0 0x7f443c156280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:22:30.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.538+0000 7f4441fb6700 1 --2- 172.21.15.104:0/1657393605 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f443c0aac50 0x7f443c152d70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f443800c880 tx=0x7f4438008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:30.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.538+0000 7f4431ffb700 1 -- 172.21.15.104:0/1657393605 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4438005a00 con 0x7f443c0aac50 2024-08-17T02:22:30.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.538+0000 7f4431ffb700 1 -- 172.21.15.104:0/1657393605 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4438005b60 con 0x7f443c0aac50 2024-08-17T02:22:30.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.538+0000 7f444421a700 1 -- 172.21.15.104:0/1657393605 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f443c0ad630 con 0x7f443c0aac50 2024-08-17T02:22:30.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.538+0000 7f4431ffb700 1 -- 172.21.15.104:0/1657393605 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4438011600 con 0x7f443c0aac50 2024-08-17T02:22:30.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.538+0000 7f444421a700 1 -- 172.21.15.104:0/1657393605 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f443c1532b0 con 0x7f443c0aac50 2024-08-17T02:22:30.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.538+0000 7f444421a700 1 -- 172.21.15.104:0/1657393605 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f443c0ad490 con 0x7f443c0aac50 2024-08-17T02:22:30.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.542+0000 7f4431ffb700 1 -- 172.21.15.104:0/1657393605 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f44380119f0 con 0x7f443c0aac50 2024-08-17T02:22:30.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.542+0000 7f4431ffb700 1 --2- 172.21.15.104:0/1657393605 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4420060890 0x7f4420062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:30.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.542+0000 7f4431ffb700 1 -- 172.21.15.104:0/1657393605 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f443807c8e0 con 0x7f443c0aac50 2024-08-17T02:22:30.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.542+0000 7f44417b5700 1 --2- 172.21.15.104:0/1657393605 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4420060890 0x7f4420062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:30.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.542+0000 7f44417b5700 1 --2- 172.21.15.104:0/1657393605 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4420060890 0x7f4420062d40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f443c068260 tx=0x7f442c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:30.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.550+0000 7f4431ffb700 1 -- 172.21.15.104:0/1657393605 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f443c0ad490 con 0x7f443c0aac50 2024-08-17T02:22:30.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.730+0000 7f444421a700 1 -- 172.21.15.104:0/1657393605 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f443c0ad490 con 0x7f443c0aac50 2024-08-17T02:22:30.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.730+0000 7f4431ffb700 1 -- 172.21.15.104:0/1657393605 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4603 (secure 0 0 0) 0x7f443c0ad490 con 0x7f443c0aac50 2024-08-17T02:22:30.739 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:22:30.739 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/1242386459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":1242386459},{"type":"v1","addr":"172.21.15.104:6835","nonce":1242386459}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/2581980475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2581980475},{"type":"v1","addr":"172.21.15.104:6833","nonce":2581980475}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1039240942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1039240942},{"type":"v1","addr":"172.21.15.117:6835","nonce":1039240942}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:22:21.527207+0000","modified":"2024-08-17T02:22:25.187188+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/4197149840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":4197149840},{"type":"v1","addr":"172.21.15.117:6837","nonce":4197149840}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:22:30.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.742+0000 7f444421a700 1 -- 172.21.15.104:0/1657393605 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4420060890 msgr2=0x7f4420062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:30.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.742+0000 7f444421a700 1 --2- 172.21.15.104:0/1657393605 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4420060890 0x7f4420062d40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f443c068260 tx=0x7f442c008040 comp rx=0 tx=0).stop 2024-08-17T02:22:30.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.742+0000 7f444421a700 1 -- 172.21.15.104:0/1657393605 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f443c0aac50 msgr2=0x7f443c152d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:30.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.742+0000 7f444421a700 1 --2- 172.21.15.104:0/1657393605 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f443c0aac50 0x7f443c152d70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f443800c880 tx=0x7f4438008040 comp rx=0 tx=0).stop 2024-08-17T02:22:30.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.742+0000 7f444421a700 1 -- 172.21.15.104:0/1657393605 shutdown_connections 2024-08-17T02:22:30.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.742+0000 7f444421a700 1 --2- 172.21.15.104:0/1657393605 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4420060890 0x7f4420062d40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:30.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.742+0000 7f444421a700 1 --2- 172.21.15.104:0/1657393605 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f443c15a2e0 0x7f443c156280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:30.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.742+0000 7f444421a700 1 --2- 172.21.15.104:0/1657393605 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f443c0b3b30 0x7f443c0ae110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:30.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.742+0000 7f444421a700 1 --2- 172.21.15.104:0/1657393605 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f443c0aac50 0x7f443c152d70 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:30.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.742+0000 7f444421a700 1 -- 172.21.15.104:0/1657393605 >> 172.21.15.104:0/1657393605 conn(0x7f443c0994d0 msgr2=0x7f443c0b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:30.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.742+0000 7f444421a700 1 -- 172.21.15.104:0/1657393605 shutdown_connections 2024-08-17T02:22:30.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.742+0000 7f444421a700 1 -- 172.21.15.104:0/1657393605 wait complete. 2024-08-17T02:22:30.745 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 7 2024-08-17T02:22:30.759 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:22:30.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.854+0000 7f7ca615f700 1 Processor -- start 2024-08-17T02:22:30.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.854+0000 7f7ca615f700 1 -- start start 2024-08-17T02:22:30.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.854+0000 7f7ca615f700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7ca0156f80 0x7f7ca00ae3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:30.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.854+0000 7f7ca615f700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7ca006f040 0x7f7ca00aab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:30.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.854+0000 7f7ca615f700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca00adf50 con 0x7f7ca00ace80 2024-08-17T02:22:30.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.854+0000 7f7ca615f700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ca00ae920 con 0x7f7ca0156f80 2024-08-17T02:22:30.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.854+0000 7f7ca615f700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ca00ad340 con 0x7f7ca006f040 2024-08-17T02:22:30.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.854+0000 7f7c96ffd700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f7ca00ace80 0x7f7ca0157350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:56814/0 (socket says 172.21.15.104:56814) 2024-08-17T02:22:30.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.854+0000 7f7c9f7fe700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7ca0156f80 0x7f7ca00ae3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:30.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.854+0000 7f7c96ffd700 1 -- 172.21.15.104:0/3194226313 learned_addr learned my addr 172.21.15.104:0/3194226313 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:30.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.854+0000 7f7c9ffff700 1 --2- 172.21.15.104:0/3194226313 >> v2:172.21.15.117:3300/0 conn(0x7f7ca006f040 0x7f7ca00aab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:30.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.854+0000 7f7c9f7fe700 1 -- 172.21.15.104:0/3194226313 >> v2:172.21.15.117:3300/0 conn(0x7f7ca006f040 msgr2=0x7f7ca00aab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:30.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.854+0000 7f7c9f7fe700 1 --2- 172.21.15.104:0/3194226313 >> v2:172.21.15.117:3300/0 conn(0x7f7ca006f040 0x7f7ca00aab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:30.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.854+0000 7f7c9f7fe700 1 -- 172.21.15.104:0/3194226313 >> v1:172.21.15.104:6789/0 conn(0x7f7ca00ace80 legacy=0x7f7ca0157350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:30.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.854+0000 7f7c9f7fe700 1 -- 172.21.15.104:0/3194226313 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca00ad620 con 0x7f7ca0156f80 2024-08-17T02:22:30.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.854+0000 7f7c9f7fe700 1 --2- 172.21.15.104:0/3194226313 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ca0156f80 0x7f7ca00ae3e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7ca00abe40 tx=0x7f7c900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7be1a7a2c804a56f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:30.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.854+0000 7f7c9effd700 1 -- 172.21.15.104:0/3194226313 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9000b6b0 con 0x7f7ca0156f80 2024-08-17T02:22:30.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.854+0000 7f7c9effd700 1 -- 172.21.15.104:0/3194226313 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9000b810 con 0x7f7ca0156f80 2024-08-17T02:22:30.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.854+0000 7f7c9effd700 1 -- 172.21.15.104:0/3194226313 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9000bbb0 con 0x7f7ca0156f80 2024-08-17T02:22:30.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.854+0000 7f7ca615f700 1 -- 172.21.15.104:0/3194226313 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ca0156f80 msgr2=0x7f7ca00ae3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:30.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.854+0000 7f7ca615f700 1 --2- 172.21.15.104:0/3194226313 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ca0156f80 0x7f7ca00ae3e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7ca00abe40 tx=0x7f7c900091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:30.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.854+0000 7f7ca615f700 1 -- 172.21.15.104:0/3194226313 shutdown_connections 2024-08-17T02:22:30.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.854+0000 7f7ca615f700 1 --2- 172.21.15.104:0/3194226313 >> v2:172.21.15.117:3300/0 conn(0x7f7ca006f040 0x7f7ca00aab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:30.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.854+0000 7f7ca615f700 1 --2- 172.21.15.104:0/3194226313 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ca0156f80 0x7f7ca00ae3e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:30.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.854+0000 7f7ca615f700 1 -- 172.21.15.104:0/3194226313 >> 172.21.15.104:0/3194226313 conn(0x7f7ca0066e00 msgr2=0x7f7ca0067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:30.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.854+0000 7f7ca615f700 1 -- 172.21.15.104:0/3194226313 shutdown_connections 2024-08-17T02:22:30.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.854+0000 7f7ca615f700 1 -- 172.21.15.104:0/3194226313 wait complete. 2024-08-17T02:22:30.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.858+0000 7f7ca615f700 1 Processor -- start 2024-08-17T02:22:30.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.858+0000 7f7ca615f700 1 -- start start 2024-08-17T02:22:30.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.858+0000 7f7ca615f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ca006f040 0x7f7ca014ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:30.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.858+0000 7f7ca615f700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ca00ace80 0x7f7ca0096ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:30.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.858+0000 7f7ca615f700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ca0156f80 0x7f7ca00aa6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:30.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.858+0000 7f7ca615f700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca00973d0 con 0x7f7ca0156f80 2024-08-17T02:22:30.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.858+0000 7f7ca615f700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca00976b0 con 0x7f7ca006f040 2024-08-17T02:22:30.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.858+0000 7f7ca615f700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca0097990 con 0x7f7ca00ace80 2024-08-17T02:22:30.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.858+0000 7f7c9ffff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ca0156f80 0x7f7ca00aa6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:30.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.858+0000 7f7c9ffff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ca0156f80 0x7f7ca00aa6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42492/0 (socket says 172.21.15.104:42492) 2024-08-17T02:22:30.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.858+0000 7f7c9ffff700 1 -- 172.21.15.104:0/185885130 learned_addr learned my addr 172.21.15.104:0/185885130 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:30.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.858+0000 7f7c9f7fe700 1 --2- 172.21.15.104:0/185885130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ca006f040 0x7f7ca014ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:30.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.858+0000 7f7c96ffd700 1 --2- 172.21.15.104:0/185885130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ca00ace80 0x7f7ca0096ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:30.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.858+0000 7f7c9ffff700 1 -- 172.21.15.104:0/185885130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ca00ace80 msgr2=0x7f7ca0096ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:30.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.858+0000 7f7c9ffff700 1 --2- 172.21.15.104:0/185885130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ca00ace80 0x7f7ca0096ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:30.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.858+0000 7f7c9ffff700 1 -- 172.21.15.104:0/185885130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ca006f040 msgr2=0x7f7ca014ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:30.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.858+0000 7f7c9ffff700 1 --2- 172.21.15.104:0/185885130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ca006f040 0x7f7ca014ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:30.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.858+0000 7f7c9ffff700 1 -- 172.21.15.104:0/185885130 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c90009420 con 0x7f7ca0156f80 2024-08-17T02:22:30.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.858+0000 7f7c9ffff700 1 --2- 172.21.15.104:0/185885130 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ca0156f80 0x7f7ca00aa6f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7c98007ef0 tx=0x7f7c98009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:30.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.858+0000 7f7c97fff700 1 -- 172.21.15.104:0/185885130 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9800eb30 con 0x7f7ca0156f80 2024-08-17T02:22:30.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.858+0000 7f7c97fff700 1 -- 172.21.15.104:0/185885130 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9800ec90 con 0x7f7ca0156f80 2024-08-17T02:22:30.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.858+0000 7f7c97fff700 1 -- 172.21.15.104:0/185885130 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c98014670 con 0x7f7ca0156f80 2024-08-17T02:22:30.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.858+0000 7f7ca615f700 1 -- 172.21.15.104:0/185885130 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ca0097c70 con 0x7f7ca0156f80 2024-08-17T02:22:30.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.858+0000 7f7ca615f700 1 -- 172.21.15.104:0/185885130 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca014b1d0 con 0x7f7ca0156f80 2024-08-17T02:22:30.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.862+0000 7f7ca615f700 1 -- 172.21.15.104:0/185885130 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ca0097e00 con 0x7f7ca0156f80 2024-08-17T02:22:30.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.862+0000 7f7c97fff700 1 -- 172.21.15.104:0/185885130 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7c98014a60 con 0x7f7ca0156f80 2024-08-17T02:22:30.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.862+0000 7f7c97fff700 1 --2- 172.21.15.104:0/185885130 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7c80060860 0x7f7c80062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:30.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.862+0000 7f7c97fff700 1 -- 172.21.15.104:0/185885130 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7c9807d130 con 0x7f7ca0156f80 2024-08-17T02:22:30.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.862+0000 7f7c9f7fe700 1 --2- 172.21.15.104:0/185885130 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7c80060860 0x7f7c80062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:30.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.866+0000 7f7c9f7fe700 1 --2- 172.21.15.104:0/185885130 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7c80060860 0x7f7c80062d10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7c900093f0 tx=0x7f7c90017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:30.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:30.874+0000 7f7c97fff700 1 -- 172.21.15.104:0/185885130 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f7c9804d580 con 0x7f7ca0156f80 2024-08-17T02:22:31.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.034+0000 7f7ca615f700 1 -- 172.21.15.104:0/185885130 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ca00645c0 con 0x7f7ca0156f80 2024-08-17T02:22:31.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.038+0000 7f7c97fff700 1 -- 172.21.15.104:0/185885130 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f7c98050ba0 con 0x7f7ca0156f80 2024-08-17T02:22:31.045 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:22:31.045 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":23,"fsid":"fd5f7fb8-d34b-49bb-89a8-62b7dad1bc25","created":"2024-08-17T02:21:57.891389+0000","modified":"2024-08-17T02:22:23.175831+0000","last_up_change":"2024-08-17T02:22:08.924546+0000","last_in_change":"2024-08-17T02:21:59.938028+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:22:10.143970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:22:20.082708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:22:20.521582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"606b9088-590e-4709-aa3a-b0f6e22972ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":24257},{"type":"v1","addr":"172.21.15.104:6809","nonce":24257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":24257},{"type":"v1","addr":"172.21.15.104:6811","nonce":24257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":24257},{"type":"v1","addr":"172.21.15.104:6815","nonce":24257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":24257},{"type":"v1","addr":"172.21.15.104:6813","nonce":24257}]},"public_addr":"172.21.15.104:6809/24257","cluster_addr":"172.21.15.104:6811/24257","heartbeat_back_addr":"172.21.15.104:6815/24257","heartbeat_front_addr":"172.21.15.104:6813/24257","state":["exists","up"]},{"osd":1,"uuid":"9bc6a909-0c2f-4889-afe7-4a47f89b0f64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":24256},{"type":"v1","addr":"172.21.15.104:6825","nonce":24256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":24256},{"type":"v1","addr":"172.21.15.104:6827","nonce":24256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":24256},{"type":"v1","addr":"172.21.15.104:6831","nonce":24256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":24256},{"type":"v1","addr":"172.21.15.104:6829","nonce":24256}]},"public_addr":"172.21.15.104:6825/24256","cluster_addr":"172.21.15.104:6827/24256","heartbeat_back_addr":"172.21.15.104:6831/24256","heartbeat_front_addr":"172.21.15.104:6829/24256","state":["exists","up"]},{"osd":2,"uuid":"23da31d5-aefb-4edb-b79d-fa05e1becef7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":24255},{"type":"v1","addr":"172.21.15.104:6817","nonce":24255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":24255},{"type":"v1","addr":"172.21.15.104:6819","nonce":24255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":24255},{"type":"v1","addr":"172.21.15.104:6823","nonce":24255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":24255},{"type":"v1","addr":"172.21.15.104:6821","nonce":24255}]},"public_addr":"172.21.15.104:6817/24255","cluster_addr":"172.21.15.104:6819/24255","heartbeat_back_addr":"172.21.15.104:6823/24255","heartbeat_front_addr":"172.21.15.104:6821/24255","state":["exists","up"]},{"osd":3,"uuid":"6e4a5ec2-b415-45ef-8381-61a59eb65224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":24254},{"type":"v1","addr":"172.21.15.104:6801","nonce":24254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":24254},{"type":"v1","addr":"172.21.15.104:6803","nonce":24254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":24254},{"type":"v1","addr":"172.21.15.104:6807","nonce":24254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":24254},{"type":"v1","addr":"172.21.15.104:6805","nonce":24254}]},"public_addr":"172.21.15.104:6801/24254","cluster_addr":"172.21.15.104:6803/24254","heartbeat_back_addr":"172.21.15.104:6807/24254","heartbeat_front_addr":"172.21.15.104:6805/24254","state":["exists","up"]},{"osd":4,"uuid":"8d5bea2d-9039-4013-8c99-2c046c5b8a17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":24421},{"type":"v1","addr":"172.21.15.117:6804","nonce":24421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":24421},{"type":"v1","addr":"172.21.15.117:6809","nonce":24421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":24421},{"type":"v1","addr":"172.21.15.117:6815","nonce":24421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":24421},{"type":"v1","addr":"172.21.15.117:6813","nonce":24421}]},"public_addr":"172.21.15.117:6804/24421","cluster_addr":"172.21.15.117:6809/24421","heartbeat_back_addr":"172.21.15.117:6815/24421","heartbeat_front_addr":"172.21.15.117:6813/24421","state":["exists","up"]},{"osd":5,"uuid":"de8b36fc-121c-4f05-8f5b-28f513d9f21f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":24422},{"type":"v1","addr":"172.21.15.117:6817","nonce":24422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":24422},{"type":"v1","addr":"172.21.15.117:6819","nonce":24422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":24422},{"type":"v1","addr":"172.21.15.117:6823","nonce":24422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":24422},{"type":"v1","addr":"172.21.15.117:6821","nonce":24422}]},"public_addr":"172.21.15.117:6817/24422","cluster_addr":"172.21.15.117:6819/24422","heartbeat_back_addr":"172.21.15.117:6823/24422","heartbeat_front_addr":"172.21.15.117:6821/24422","state":["exists","up"]},{"osd":6,"uuid":"6a87f09f-7bf7-4f7a-be87-530ac1ff8ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":24420},{"type":"v1","addr":"172.21.15.117:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6803","nonce":24420},{"type":"v1","addr":"172.21.15.117:6805","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":24420},{"type":"v1","addr":"172.21.15.117:6811","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":24420},{"type":"v1","addr":"172.21.15.117:6808","nonce":24420}]},"public_addr":"172.21.15.117:6801/24420","cluster_addr":"172.21.15.117:6805/24420","heartbeat_back_addr":"172.21.15.117:6811/24420","heartbeat_front_addr":"172.21.15.117:6808/24420","state":["exists","up"]},{"osd":7,"uuid":"e31d8041-1aa1-4b5d-83b3-0a373426dd9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":24423},{"type":"v1","addr":"172.21.15.117:6825","nonce":24423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":24423},{"type":"v1","addr":"172.21.15.117:6827","nonce":24423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":24423},{"type":"v1","addr":"172.21.15.117:6831","nonce":24423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":24423},{"type":"v1","addr":"172.21.15.117:6829","nonce":24423}]},"public_addr":"172.21.15.117:6825/24423","cluster_addr":"172.21.15.117:6827/24423","heartbeat_back_addr":"172.21.15.117:6831/24423","heartbeat_front_addr":"172.21.15.117:6829/24423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.220874+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.210039+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.434762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.247206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.184316+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.306325+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.035719+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.400303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:22:31.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.042+0000 7f7ca615f700 1 -- 172.21.15.104:0/185885130 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7c80060860 msgr2=0x7f7c80062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:31.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.042+0000 7f7ca615f700 1 --2- 172.21.15.104:0/185885130 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7c80060860 0x7f7c80062d10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7c900093f0 tx=0x7f7c90017000 comp rx=0 tx=0).stop 2024-08-17T02:22:31.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.042+0000 7f7ca615f700 1 -- 172.21.15.104:0/185885130 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ca0156f80 msgr2=0x7f7ca00aa6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:31.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.042+0000 7f7ca615f700 1 --2- 172.21.15.104:0/185885130 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ca0156f80 0x7f7ca00aa6f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7c98007ef0 tx=0x7f7c98009840 comp rx=0 tx=0).stop 2024-08-17T02:22:31.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.042+0000 7f7ca615f700 1 -- 172.21.15.104:0/185885130 shutdown_connections 2024-08-17T02:22:31.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.042+0000 7f7ca615f700 1 --2- 172.21.15.104:0/185885130 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7c80060860 0x7f7c80062d10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:31.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.042+0000 7f7ca615f700 1 --2- 172.21.15.104:0/185885130 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ca0156f80 0x7f7ca00aa6f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:31.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.042+0000 7f7ca615f700 1 --2- 172.21.15.104:0/185885130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ca00ace80 0x7f7ca0096ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:31.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.042+0000 7f7ca615f700 1 --2- 172.21.15.104:0/185885130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ca006f040 0x7f7ca014ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:31.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.042+0000 7f7ca615f700 1 -- 172.21.15.104:0/185885130 >> 172.21.15.104:0/185885130 conn(0x7f7ca0066e00 msgr2=0x7f7ca006d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:31.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.042+0000 7f7ca615f700 1 -- 172.21.15.104:0/185885130 shutdown_connections 2024-08-17T02:22:31.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.042+0000 7f7ca615f700 1 -- 172.21.15.104:0/185885130 wait complete. 2024-08-17T02:22:31.059 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:22:10.143970+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:22:20.082708+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:22:20.521582+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:22:31.060 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:22:31.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.158+0000 7fb74e53f700 1 Processor -- start 2024-08-17T02:22:31.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.158+0000 7fb74e53f700 1 -- start start 2024-08-17T02:22:31.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.158+0000 7fb74e53f700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb748067510 0x7fb748164330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:31.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.158+0000 7fb74e53f700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7480cba90 con 0x7fb7481596d0 2024-08-17T02:22:31.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.158+0000 7fb74e53f700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7480cb160 con 0x7fb748159300 2024-08-17T02:22:31.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.158+0000 7fb74e53f700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7480b2b60 con 0x7fb748067510 2024-08-17T02:22:31.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.158+0000 7fb74cadc700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb748067510 0x7fb748164330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:31.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.158+0000 7fb74cadc700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb748067510 0x7fb748164330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42496/0 (socket says 172.21.15.104:42496) 2024-08-17T02:22:31.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.158+0000 7fb74cadc700 1 -- 172.21.15.104:0/1456424576 learned_addr learned my addr 172.21.15.104:0/1456424576 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:31.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.162+0000 7fb74cadc700 1 -- 172.21.15.104:0/1456424576 >> v1:172.21.15.117:6789/0 conn(0x7fb748159300 legacy=0x7fb7480b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:31.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.162+0000 7fb74cadc700 1 -- 172.21.15.104:0/1456424576 >> v1:172.21.15.104:6789/0 conn(0x7fb7481596d0 legacy=0x7fb748066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:31.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.162+0000 7fb746ffd700 1 -- 172.21.15.104:0/1456424576 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3778244747 0 0) 0x7fb7480cba90 con 0x7fb7481596d0 2024-08-17T02:22:31.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.162+0000 7fb74cadc700 1 -- 172.21.15.104:0/1456424576 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7480cb440 con 0x7fb748067510 2024-08-17T02:22:31.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.162+0000 7fb74cadc700 1 --2- 172.21.15.104:0/1456424576 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb748067510 0x7fb748164330 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb740009f20 tx=0x7fb740009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=685e51b7ef167a7d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:31.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.162+0000 7fb746ffd700 1 -- 172.21.15.104:0/1456424576 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74000e070 con 0x7fb748067510 2024-08-17T02:22:31.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.162+0000 7fb746ffd700 1 -- 172.21.15.104:0/1456424576 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb74000ba80 con 0x7fb748067510 2024-08-17T02:22:31.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.162+0000 7fb746ffd700 1 -- 172.21.15.104:0/1456424576 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7400092e0 con 0x7fb748067510 2024-08-17T02:22:31.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.162+0000 7fb74e53f700 1 -- 172.21.15.104:0/1456424576 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb748067510 msgr2=0x7fb748164330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:31.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.162+0000 7fb74e53f700 1 --2- 172.21.15.104:0/1456424576 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb748067510 0x7fb748164330 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb740009f20 tx=0x7fb740009840 comp rx=0 tx=0).stop 2024-08-17T02:22:31.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.162+0000 7fb74e53f700 1 -- 172.21.15.104:0/1456424576 shutdown_connections 2024-08-17T02:22:31.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.162+0000 7fb74e53f700 1 --2- 172.21.15.104:0/1456424576 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb748067510 0x7fb748164330 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:31.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.162+0000 7fb74e53f700 1 -- 172.21.15.104:0/1456424576 >> 172.21.15.104:0/1456424576 conn(0x7fb7480682c0 msgr2=0x7fb7480686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:31.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.162+0000 7fb74e53f700 1 -- 172.21.15.104:0/1456424576 shutdown_connections 2024-08-17T02:22:31.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.162+0000 7fb74e53f700 1 -- 172.21.15.104:0/1456424576 wait complete. 2024-08-17T02:22:31.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.166+0000 7fb74e53f700 1 Processor -- start 2024-08-17T02:22:31.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.166+0000 7fb74e53f700 1 -- start start 2024-08-17T02:22:31.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.166+0000 7fb74e53f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb748067510 0x7fb7480c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:31.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.166+0000 7fb74e53f700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb748159300 0x7fb74816ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:31.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.166+0000 7fb74e53f700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7481596d0 0x7fb74814f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:31.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.166+0000 7fb74e53f700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74815d1b0 con 0x7fb748159300 2024-08-17T02:22:31.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.166+0000 7fb74e53f700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74816d9f0 con 0x7fb748067510 2024-08-17T02:22:31.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.166+0000 7fb74e53f700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb74816d150 con 0x7fb7481596d0 2024-08-17T02:22:31.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.166+0000 7fb7477fe700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb748159300 0x7fb74816ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:31.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.166+0000 7fb7477fe700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb748159300 0x7fb74816ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42502/0 (socket says 172.21.15.104:42502) 2024-08-17T02:22:31.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.166+0000 7fb7477fe700 1 -- 172.21.15.104:0/3279288106 learned_addr learned my addr 172.21.15.104:0/3279288106 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:31.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.166+0000 7fb747fff700 1 --2- 172.21.15.104:0/3279288106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb748067510 0x7fb7480c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:31.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.170+0000 7fb74cadc700 1 --2- 172.21.15.104:0/3279288106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7481596d0 0x7fb74814f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:31.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.170+0000 7fb7477fe700 1 -- 172.21.15.104:0/3279288106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7481596d0 msgr2=0x7fb74814f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:31.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.170+0000 7fb7477fe700 1 --2- 172.21.15.104:0/3279288106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7481596d0 0x7fb74814f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:31.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.170+0000 7fb7477fe700 1 -- 172.21.15.104:0/3279288106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb748067510 msgr2=0x7fb7480c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:31.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.170+0000 7fb7477fe700 1 --2- 172.21.15.104:0/3279288106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb748067510 0x7fb7480c5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:31.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.170+0000 7fb7477fe700 1 -- 172.21.15.104:0/3279288106 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb740009ae0 con 0x7fb748159300 2024-08-17T02:22:31.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.170+0000 7fb7477fe700 1 --2- 172.21.15.104:0/3279288106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb748159300 0x7fb74816ca50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb73800c5e0 tx=0x7fb738007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:31.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.170+0000 7fb72ffff700 1 -- 172.21.15.104:0/3279288106 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb738011590 con 0x7fb748159300 2024-08-17T02:22:31.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.170+0000 7fb72ffff700 1 -- 172.21.15.104:0/3279288106 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb738011710 con 0x7fb748159300 2024-08-17T02:22:31.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.170+0000 7fb72ffff700 1 -- 172.21.15.104:0/3279288106 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb738011ad0 con 0x7fb748159300 2024-08-17T02:22:31.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.170+0000 7fb74e53f700 1 -- 172.21.15.104:0/3279288106 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb74816d430 con 0x7fb748159300 2024-08-17T02:22:31.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.170+0000 7fb74e53f700 1 -- 172.21.15.104:0/3279288106 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb74814fad0 con 0x7fb748159300 2024-08-17T02:22:31.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.170+0000 7fb74e53f700 1 -- 172.21.15.104:0/3279288106 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb74815cf80 con 0x7fb748159300 2024-08-17T02:22:31.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.170+0000 7fb72ffff700 1 -- 172.21.15.104:0/3279288106 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb73801b3b0 con 0x7fb748159300 2024-08-17T02:22:31.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.170+0000 7fb72ffff700 1 --2- 172.21.15.104:0/3279288106 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb734060860 0x7fb734062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:31.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.170+0000 7fb72ffff700 1 -- 172.21.15.104:0/3279288106 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb73807bfc0 con 0x7fb748159300 2024-08-17T02:22:31.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.170+0000 7fb747fff700 1 --2- 172.21.15.104:0/3279288106 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb734060860 0x7fb734062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:31.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.174+0000 7fb747fff700 1 --2- 172.21.15.104:0/3279288106 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb734060860 0x7fb734062d10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb7480b5250 tx=0x7fb73c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:31.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.182+0000 7fb72ffff700 1 -- 172.21.15.104:0/3279288106 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb74815cf80 con 0x7fb748159300 2024-08-17T02:22:31.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.338+0000 7fb74e53f700 1 -- 172.21.15.104:0/3279288106 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb74815cf80 con 0x7fb748159300 2024-08-17T02:22:31.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.338+0000 7fb72ffff700 1 -- 172.21.15.104:0/3279288106 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb74815cf80 con 0x7fb748159300 2024-08-17T02:22:31.346 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-08-17T02:22:31.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.342+0000 7fb74e53f700 1 -- 172.21.15.104:0/3279288106 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb734060860 msgr2=0x7fb734062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:31.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.342+0000 7fb74e53f700 1 --2- 172.21.15.104:0/3279288106 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb734060860 0x7fb734062d10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb7480b5250 tx=0x7fb73c009040 comp rx=0 tx=0).stop 2024-08-17T02:22:31.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.342+0000 7fb74e53f700 1 -- 172.21.15.104:0/3279288106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb748159300 msgr2=0x7fb74816ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:31.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.342+0000 7fb74e53f700 1 --2- 172.21.15.104:0/3279288106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb748159300 0x7fb74816ca50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb73800c5e0 tx=0x7fb738007f60 comp rx=0 tx=0).stop 2024-08-17T02:22:31.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.342+0000 7fb74e53f700 1 -- 172.21.15.104:0/3279288106 shutdown_connections 2024-08-17T02:22:31.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.342+0000 7fb74e53f700 1 --2- 172.21.15.104:0/3279288106 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb734060860 0x7fb734062d10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:31.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.342+0000 7fb74e53f700 1 --2- 172.21.15.104:0/3279288106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7481596d0 0x7fb74814f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:31.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.342+0000 7fb74e53f700 1 --2- 172.21.15.104:0/3279288106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb748159300 0x7fb74816ca50 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:31.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.342+0000 7fb74e53f700 1 --2- 172.21.15.104:0/3279288106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb748067510 0x7fb7480c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:31.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.342+0000 7fb74e53f700 1 -- 172.21.15.104:0/3279288106 >> 172.21.15.104:0/3279288106 conn(0x7fb7480682c0 msgr2=0x7fb7480b3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:31.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.342+0000 7fb74e53f700 1 -- 172.21.15.104:0/3279288106 shutdown_connections 2024-08-17T02:22:31.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.342+0000 7fb74e53f700 1 -- 172.21.15.104:0/3279288106 wait complete. 2024-08-17T02:22:31.360 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:22:31.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.466+0000 7f22552c3700 1 Processor -- start 2024-08-17T02:22:31.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.466+0000 7f22552c3700 1 -- start start 2024-08-17T02:22:31.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.470+0000 7f22552c3700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f22500cc840 0x7f22500ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:31.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.470+0000 7f22552c3700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22500b2210 0x7f22500b2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:31.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.470+0000 7f22552c3700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22500cd150 con 0x7f22500b5040 2024-08-17T02:22:31.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.470+0000 7f22552c3700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22500b2b80 con 0x7f22500cc840 2024-08-17T02:22:31.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.470+0000 7f22552c3700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22500af570 con 0x7f22500b2210 2024-08-17T02:22:31.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.470+0000 7f224effd700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f22500cc840 0x7f22500ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:31.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.470+0000 7f224f7fe700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f22500b5040 0x7f22500b54c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:56828/0 (socket says 172.21.15.104:56828) 2024-08-17T02:22:31.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.470+0000 7f224f7fe700 1 -- 172.21.15.104:0/3569049943 learned_addr learned my addr 172.21.15.104:0/3569049943 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:31.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.470+0000 7f224e7fc700 1 --2- 172.21.15.104:0/3569049943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22500b2210 0x7f22500b2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:31.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.470+0000 7f224dffb700 1 -- 172.21.15.104:0/3569049943 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1902693571 0 0) 0x7f22500cd150 con 0x7f22500b5040 2024-08-17T02:22:31.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.470+0000 7f224dffb700 1 -- 172.21.15.104:0/3569049943 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2238003570 con 0x7f22500b5040 2024-08-17T02:22:31.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.470+0000 7f224effd700 1 -- 172.21.15.104:0/3569049943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22500b2210 msgr2=0x7f22500b2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:31.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.470+0000 7f224effd700 1 --2- 172.21.15.104:0/3569049943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22500b2210 0x7f22500b2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:31.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.470+0000 7f224effd700 1 -- 172.21.15.104:0/3569049943 >> v1:172.21.15.104:6789/0 conn(0x7f22500b5040 legacy=0x7f22500b54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:31.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.470+0000 7f224effd700 1 -- 172.21.15.104:0/3569049943 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2250159ce0 con 0x7f22500cc840 2024-08-17T02:22:31.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.470+0000 7f224e7fc700 1 --2- 172.21.15.104:0/3569049943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22500b2210 0x7f22500b2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:22:31.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.470+0000 7f224effd700 1 --2- 172.21.15.104:0/3569049943 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22500cc840 0x7f22500ccc10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f22440098e0 tx=0x7f22440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa99c9a802a7febf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:31.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.470+0000 7f224dffb700 1 -- 172.21.15.104:0/3569049943 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224400b640 con 0x7f22500cc840 2024-08-17T02:22:31.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.470+0000 7f224dffb700 1 -- 172.21.15.104:0/3569049943 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f224400b7a0 con 0x7f22500cc840 2024-08-17T02:22:31.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.470+0000 7f224dffb700 1 -- 172.21.15.104:0/3569049943 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224400bb40 con 0x7f22500cc840 2024-08-17T02:22:31.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.474+0000 7f22552c3700 1 -- 172.21.15.104:0/3569049943 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22500cc840 msgr2=0x7f22500ccc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:31.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.474+0000 7f22552c3700 1 --2- 172.21.15.104:0/3569049943 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22500cc840 0x7f22500ccc10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f22440098e0 tx=0x7f22440091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:31.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.474+0000 7f22552c3700 1 -- 172.21.15.104:0/3569049943 shutdown_connections 2024-08-17T02:22:31.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.474+0000 7f22552c3700 1 --2- 172.21.15.104:0/3569049943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22500b2210 0x7f22500b2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:31.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.474+0000 7f22552c3700 1 --2- 172.21.15.104:0/3569049943 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22500cc840 0x7f22500ccc10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:31.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.474+0000 7f22552c3700 1 -- 172.21.15.104:0/3569049943 >> 172.21.15.104:0/3569049943 conn(0x7f22500682c0 msgr2=0x7f22500686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:31.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.474+0000 7f22552c3700 1 -- 172.21.15.104:0/3569049943 shutdown_connections 2024-08-17T02:22:31.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.474+0000 7f22552c3700 1 -- 172.21.15.104:0/3569049943 wait complete. 2024-08-17T02:22:31.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.474+0000 7f22552c3700 1 Processor -- start 2024-08-17T02:22:31.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.474+0000 7f22552c3700 1 -- start start 2024-08-17T02:22:31.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.474+0000 7f22552c3700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22500b2210 0x7f22500c5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:31.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.474+0000 7f22552c3700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22500b5040 0x7f22500c4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:31.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.474+0000 7f22552c3700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22500cc840 0x7f22500b4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:31.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.474+0000 7f22552c3700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22500c6ee0 con 0x7f22500b2210 2024-08-17T02:22:31.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.474+0000 7f22552c3700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22500c7420 con 0x7f22500cc840 2024-08-17T02:22:31.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.474+0000 7f22552c3700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2250152cb0 con 0x7f22500b5040 2024-08-17T02:22:31.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.474+0000 7f224effd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22500b2210 0x7f22500c5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:31.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.474+0000 7f224effd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22500b2210 0x7f22500c5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42518/0 (socket says 172.21.15.104:42518) 2024-08-17T02:22:31.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.474+0000 7f224effd700 1 -- 172.21.15.104:0/3290386188 learned_addr learned my addr 172.21.15.104:0/3290386188 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:31.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.478+0000 7f224e7fc700 1 --2- 172.21.15.104:0/3290386188 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22500b5040 0x7f22500c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:31.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.478+0000 7f224f7fe700 1 --2- 172.21.15.104:0/3290386188 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22500cc840 0x7f22500b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:31.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.478+0000 7f224effd700 1 -- 172.21.15.104:0/3290386188 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22500b5040 msgr2=0x7f22500c4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:31.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.478+0000 7f224effd700 1 --2- 172.21.15.104:0/3290386188 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22500b5040 0x7f22500c4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:31.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.478+0000 7f224effd700 1 -- 172.21.15.104:0/3290386188 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22500cc840 msgr2=0x7f22500b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:31.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.478+0000 7f224effd700 1 --2- 172.21.15.104:0/3290386188 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22500cc840 0x7f22500b4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:31.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.478+0000 7f224effd700 1 -- 172.21.15.104:0/3290386188 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2244009420 con 0x7f22500b2210 2024-08-17T02:22:31.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.478+0000 7f224f7fe700 1 --2- 172.21.15.104:0/3290386188 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22500cc840 0x7f22500b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:22:31.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.478+0000 7f224effd700 1 --2- 172.21.15.104:0/3290386188 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22500b2210 0x7f22500c5e60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f22500884f0 tx=0x7f2244017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:31.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.478+0000 7f2236ffd700 1 -- 172.21.15.104:0/3290386188 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224401bcf0 con 0x7f22500b2210 2024-08-17T02:22:31.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.478+0000 7f2236ffd700 1 -- 172.21.15.104:0/3290386188 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f224401be70 con 0x7f22500b2210 2024-08-17T02:22:31.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.478+0000 7f2236ffd700 1 -- 172.21.15.104:0/3290386188 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2244011650 con 0x7f22500b2210 2024-08-17T02:22:31.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.478+0000 7f22552c3700 1 -- 172.21.15.104:0/3290386188 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22500c63a0 con 0x7f22500b2210 2024-08-17T02:22:31.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.478+0000 7f22552c3700 1 -- 172.21.15.104:0/3290386188 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22500c6920 con 0x7f22500b2210 2024-08-17T02:22:31.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.478+0000 7f22552c3700 1 -- 172.21.15.104:0/3290386188 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22500645c0 con 0x7f22500b2210 2024-08-17T02:22:31.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.478+0000 7f2236ffd700 1 -- 172.21.15.104:0/3290386188 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2244011a00 con 0x7f22500b2210 2024-08-17T02:22:31.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.478+0000 7f2236ffd700 1 --2- 172.21.15.104:0/3290386188 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f223c060890 0x7f223c062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:31.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.478+0000 7f2236ffd700 1 -- 172.21.15.104:0/3290386188 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f224407e020 con 0x7f22500b2210 2024-08-17T02:22:31.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.478+0000 7f224e7fc700 1 --2- 172.21.15.104:0/3290386188 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f223c060890 0x7f223c062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:31.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.482+0000 7f224e7fc700 1 --2- 172.21.15.104:0/3290386188 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f223c060890 0x7f223c062d40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2250153580 tx=0x7f2240008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:31.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.482+0000 7f2236ffd700 1 -- 172.21.15.104:0/3290386188 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f224404e470 con 0x7f22500b2210 2024-08-17T02:22:31.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.646+0000 7f22552c3700 1 -- 172.21.15.104:0/3290386188 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2250159980 con 0x7f22500b2210 2024-08-17T02:22:31.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.650+0000 7f2236ffd700 1 -- 172.21.15.104:0/3290386188 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2244011cb0 con 0x7f22500b2210 2024-08-17T02:22:31.656 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 32 2024-08-17T02:22:31.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.650+0000 7f22552c3700 1 -- 172.21.15.104:0/3290386188 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f223c060890 msgr2=0x7f223c062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:31.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.650+0000 7f22552c3700 1 --2- 172.21.15.104:0/3290386188 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f223c060890 0x7f223c062d40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2250153580 tx=0x7f2240008040 comp rx=0 tx=0).stop 2024-08-17T02:22:31.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.650+0000 7f22552c3700 1 -- 172.21.15.104:0/3290386188 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22500b2210 msgr2=0x7f22500c5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:31.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.650+0000 7f22552c3700 1 --2- 172.21.15.104:0/3290386188 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22500b2210 0x7f22500c5e60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f22500884f0 tx=0x7f2244017000 comp rx=0 tx=0).stop 2024-08-17T02:22:31.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.650+0000 7f22552c3700 1 -- 172.21.15.104:0/3290386188 shutdown_connections 2024-08-17T02:22:31.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.650+0000 7f22552c3700 1 --2- 172.21.15.104:0/3290386188 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f223c060890 0x7f223c062d40 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:31.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.650+0000 7f22552c3700 1 --2- 172.21.15.104:0/3290386188 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22500cc840 0x7f22500b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:31.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.650+0000 7f22552c3700 1 --2- 172.21.15.104:0/3290386188 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22500b5040 0x7f22500c4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:31.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.650+0000 7f22552c3700 1 --2- 172.21.15.104:0/3290386188 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22500b2210 0x7f22500c5e60 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:31.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.650+0000 7f22552c3700 1 -- 172.21.15.104:0/3290386188 >> 172.21.15.104:0/3290386188 conn(0x7f22500682c0 msgr2=0x7f22500cb020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:31.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.650+0000 7f22552c3700 1 -- 172.21.15.104:0/3290386188 shutdown_connections 2024-08-17T02:22:31.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.650+0000 7f22552c3700 1 -- 172.21.15.104:0/3290386188 wait complete. 2024-08-17T02:22:31.669 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:22:31.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.770+0000 7f67c097c700 1 Processor -- start 2024-08-17T02:22:31.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.770+0000 7f67c097c700 1 -- start start 2024-08-17T02:22:31.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.778+0000 7f67c097c700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67bc067030 0x7f67bc067400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:31.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.778+0000 7f67c097c700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f67bc0cfb00 0x7f67bc0cb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:31.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.778+0000 7f67c097c700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67bc0cf670 con 0x7f67bc0cb5c0 2024-08-17T02:22:31.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.778+0000 7f67c097c700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67bc0cea60 con 0x7f67bc0cfb00 2024-08-17T02:22:31.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.778+0000 7f67c097c700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67bc0ced40 con 0x7f67bc067030 2024-08-17T02:22:31.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.778+0000 7f67ba59c700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f67bc0cfb00 0x7f67bc0cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:31.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.778+0000 7f67bb59e700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f67bc0cb5c0 0x7f67bc158cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.104:60762/0 (socket says 172.21.15.104:60762) 2024-08-17T02:22:31.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.778+0000 7f67bad9d700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67bc067030 0x7f67bc067400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:31.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.778+0000 7f67bb59e700 1 -- 172.21.15.104:0/487354088 learned_addr learned my addr 172.21.15.104:0/487354088 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:31.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.778+0000 7f67ba59c700 1 -- 172.21.15.104:0/487354088 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67bc067030 msgr2=0x7f67bc067400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:31.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.778+0000 7f67ba59c700 1 --2- 172.21.15.104:0/487354088 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67bc067030 0x7f67bc067400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:31.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.778+0000 7f67ba59c700 1 -- 172.21.15.104:0/487354088 >> v1:172.21.15.117:6789/0 conn(0x7f67bc0cb5c0 legacy=0x7f67bc158cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:31.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.778+0000 7f67ba59c700 1 -- 172.21.15.104:0/487354088 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67bc0cf020 con 0x7f67bc0cfb00 2024-08-17T02:22:31.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.778+0000 7f67ba59c700 1 --2- 172.21.15.104:0/487354088 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67bc0cfb00 0x7f67bc0cb080 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f67ac0098e0 tx=0x7f67ac0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3dc4278a3af01031 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:31.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.778+0000 7f67b9d9b700 1 -- 172.21.15.104:0/487354088 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ac00b640 con 0x7f67bc0cfb00 2024-08-17T02:22:31.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.778+0000 7f67b9d9b700 1 -- 172.21.15.104:0/487354088 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67ac00b7a0 con 0x7f67bc0cfb00 2024-08-17T02:22:31.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.778+0000 7f67b9d9b700 1 -- 172.21.15.104:0/487354088 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ac00bb40 con 0x7f67bc0cfb00 2024-08-17T02:22:31.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.778+0000 7f67c097c700 1 -- 172.21.15.104:0/487354088 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67bc0cfb00 msgr2=0x7f67bc0cb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:31.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.778+0000 7f67c097c700 1 --2- 172.21.15.104:0/487354088 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67bc0cfb00 0x7f67bc0cb080 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f67ac0098e0 tx=0x7f67ac0091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:31.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.778+0000 7f67c097c700 1 -- 172.21.15.104:0/487354088 shutdown_connections 2024-08-17T02:22:31.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.778+0000 7f67c097c700 1 --2- 172.21.15.104:0/487354088 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67bc0cfb00 0x7f67bc0cb080 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:31.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.778+0000 7f67c097c700 1 --2- 172.21.15.104:0/487354088 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67bc067030 0x7f67bc067400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:31.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.778+0000 7f67c097c700 1 -- 172.21.15.104:0/487354088 >> 172.21.15.104:0/487354088 conn(0x7f67bc0d0b50 msgr2=0x7f67bc0ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:31.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.778+0000 7f67c097c700 1 -- 172.21.15.104:0/487354088 shutdown_connections 2024-08-17T02:22:31.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.778+0000 7f67c097c700 1 -- 172.21.15.104:0/487354088 wait complete. 2024-08-17T02:22:31.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.778+0000 7f67c097c700 1 Processor -- start 2024-08-17T02:22:31.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.778+0000 7f67c097c700 1 -- start start 2024-08-17T02:22:31.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.778+0000 7f67c097c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67bc067030 0x7f67bc1503c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:31.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.778+0000 7f67c097c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67bc0cb5c0 0x7f67bc13c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:31.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.778+0000 7f67c097c700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67bc0cfb00 0x7f67bc14d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:31.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.778+0000 7f67c097c700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67bc14a370 con 0x7f67bc0cb5c0 2024-08-17T02:22:31.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.778+0000 7f67c097c700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67bc14ff30 con 0x7f67bc067030 2024-08-17T02:22:31.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.778+0000 7f67c097c700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67bc14f320 con 0x7f67bc0cfb00 2024-08-17T02:22:31.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.778+0000 7f67ba59c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67bc0cb5c0 0x7f67bc13c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:31.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.778+0000 7f67ba59c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67bc0cb5c0 0x7f67bc13c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42520/0 (socket says 172.21.15.104:42520) 2024-08-17T02:22:31.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.778+0000 7f67ba59c700 1 -- 172.21.15.104:0/327866306 learned_addr learned my addr 172.21.15.104:0/327866306 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:31.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.778+0000 7f67bb59e700 1 --2- 172.21.15.104:0/327866306 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67bc0cfb00 0x7f67bc14d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:31.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.778+0000 7f67bad9d700 1 --2- 172.21.15.104:0/327866306 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67bc067030 0x7f67bc1503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:31.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.778+0000 7f67ba59c700 1 -- 172.21.15.104:0/327866306 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67bc0cfb00 msgr2=0x7f67bc14d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:31.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.778+0000 7f67ba59c700 1 --2- 172.21.15.104:0/327866306 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67bc0cfb00 0x7f67bc14d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:31.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.778+0000 7f67ba59c700 1 -- 172.21.15.104:0/327866306 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67bc067030 msgr2=0x7f67bc1503c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:31.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.778+0000 7f67ba59c700 1 --2- 172.21.15.104:0/327866306 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67bc067030 0x7f67bc1503c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:31.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.778+0000 7f67ba59c700 1 -- 172.21.15.104:0/327866306 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67ac009420 con 0x7f67bc0cb5c0 2024-08-17T02:22:31.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.782+0000 7f67ba59c700 1 --2- 172.21.15.104:0/327866306 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67bc0cb5c0 0x7f67bc13c960 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f67ac0093f0 tx=0x7f67ac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:31.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.782+0000 7f67a2ffd700 1 -- 172.21.15.104:0/327866306 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ac01bc80 con 0x7f67bc0cb5c0 2024-08-17T02:22:31.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.782+0000 7f67a2ffd700 1 -- 172.21.15.104:0/327866306 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67ac01be20 con 0x7f67bc0cb5c0 2024-08-17T02:22:31.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.782+0000 7f67c097c700 1 -- 172.21.15.104:0/327866306 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67bc14f600 con 0x7f67bc0cb5c0 2024-08-17T02:22:31.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.782+0000 7f67a2ffd700 1 -- 172.21.15.104:0/327866306 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ac011670 con 0x7f67bc0cb5c0 2024-08-17T02:22:31.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.782+0000 7f67c097c700 1 -- 172.21.15.104:0/327866306 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67bc14fbc0 con 0x7f67bc0cb5c0 2024-08-17T02:22:31.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.782+0000 7f67c097c700 1 -- 172.21.15.104:0/327866306 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67bc0638f0 con 0x7f67bc0cb5c0 2024-08-17T02:22:31.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.782+0000 7f67a2ffd700 1 -- 172.21.15.104:0/327866306 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f67ac0119e0 con 0x7f67bc0cb5c0 2024-08-17T02:22:31.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.782+0000 7f67a2ffd700 1 --2- 172.21.15.104:0/327866306 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f67a8060890 0x7f67a8062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:31.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.782+0000 7f67a2ffd700 1 -- 172.21.15.104:0/327866306 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f67ac07e350 con 0x7f67bc0cb5c0 2024-08-17T02:22:31.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.782+0000 7f67bad9d700 1 --2- 172.21.15.104:0/327866306 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f67a8060890 0x7f67a8062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:31.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.786+0000 7f67bad9d700 1 --2- 172.21.15.104:0/327866306 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f67a8060890 0x7f67a8062d40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f67b0009db0 tx=0x7f67b00091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:31.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.794+0000 7f67a2ffd700 1 -- 172.21.15.104:0/327866306 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f67ac04e7a0 con 0x7f67bc0cb5c0 2024-08-17T02:22:31.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.954+0000 7f67c097c700 1 -- 172.21.15.104:0/327866306 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f67bc150070 con 0x7f67bc0cb5c0 2024-08-17T02:22:31.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.958+0000 7f67a2ffd700 1 -- 172.21.15.104:0/327866306 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f67ac051dc0 con 0x7f67bc0cb5c0 2024-08-17T02:22:31.963 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 64 2024-08-17T02:22:31.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.958+0000 7f67c097c700 1 -- 172.21.15.104:0/327866306 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f67a8060890 msgr2=0x7f67a8062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:31.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.958+0000 7f67c097c700 1 --2- 172.21.15.104:0/327866306 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f67a8060890 0x7f67a8062d40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f67b0009db0 tx=0x7f67b00091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:31.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.958+0000 7f67c097c700 1 -- 172.21.15.104:0/327866306 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67bc0cb5c0 msgr2=0x7f67bc13c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:31.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.958+0000 7f67c097c700 1 --2- 172.21.15.104:0/327866306 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67bc0cb5c0 0x7f67bc13c960 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f67ac0093f0 tx=0x7f67ac017000 comp rx=0 tx=0).stop 2024-08-17T02:22:31.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.958+0000 7f67c097c700 1 -- 172.21.15.104:0/327866306 shutdown_connections 2024-08-17T02:22:31.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.958+0000 7f67c097c700 1 --2- 172.21.15.104:0/327866306 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f67a8060890 0x7f67a8062d40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:31.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.958+0000 7f67c097c700 1 --2- 172.21.15.104:0/327866306 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67bc0cfb00 0x7f67bc14d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:31.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.958+0000 7f67c097c700 1 --2- 172.21.15.104:0/327866306 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67bc0cb5c0 0x7f67bc13c960 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:31.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.958+0000 7f67c097c700 1 --2- 172.21.15.104:0/327866306 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67bc067030 0x7f67bc1503c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:31.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.958+0000 7f67c097c700 1 -- 172.21.15.104:0/327866306 >> 172.21.15.104:0/327866306 conn(0x7f67bc0d0b50 msgr2=0x7f67bc0c62c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:31.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.958+0000 7f67c097c700 1 -- 172.21.15.104:0/327866306 shutdown_connections 2024-08-17T02:22:31.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:31.958+0000 7f67c097c700 1 -- 172.21.15.104:0/327866306 wait complete. 2024-08-17T02:22:31.977 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:22:32.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.078+0000 7f702ffff700 1 Processor -- start 2024-08-17T02:22:32.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.078+0000 7f702ffff700 1 -- start start 2024-08-17T02:22:32.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.078+0000 7f702ffff700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7030154900 0x7f70300b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:32.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.078+0000 7f702ffff700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f70300cb560 0x7f7030160ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:32.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.078+0000 7f702ffff700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70300b1730 con 0x7f70300b12d0 2024-08-17T02:22:32.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.078+0000 7f702ffff700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7030068790 con 0x7f7030154900 2024-08-17T02:22:32.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.078+0000 7f702ffff700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70301583f0 con 0x7f70300cb560 2024-08-17T02:22:32.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.078+0000 7f702e7fc700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f70300b12d0 0x7f70300cae50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:56834/0 (socket says 172.21.15.104:56834) 2024-08-17T02:22:32.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.078+0000 7f702e7fc700 1 -- 172.21.15.104:0/1837912967 learned_addr learned my addr 172.21.15.104:0/1837912967 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:32.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.078+0000 7f702effd700 1 --2- 172.21.15.104:0/1837912967 >> v2:172.21.15.104:3300/0 conn(0x7f7030154900 0x7f70300b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:32.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.078+0000 7f702f7fe700 1 --2- 172.21.15.104:0/1837912967 >> v2:172.21.15.117:3300/0 conn(0x7f70300cb560 0x7f7030160ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:32.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.078+0000 7f702dffb700 1 -- 172.21.15.104:0/1837912967 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 722541574 0 0) 0x7f7018001110 con 0x7f70300b12d0 2024-08-17T02:22:32.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.078+0000 7f702dffb700 1 -- 172.21.15.104:0/1837912967 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7010003570 con 0x7f70300b12d0 2024-08-17T02:22:32.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.078+0000 7f702effd700 1 -- 172.21.15.104:0/1837912967 >> v2:172.21.15.117:3300/0 conn(0x7f70300cb560 msgr2=0x7f7030160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:32.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.078+0000 7f702effd700 1 --2- 172.21.15.104:0/1837912967 >> v2:172.21.15.117:3300/0 conn(0x7f70300cb560 0x7f7030160ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:32.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.078+0000 7f702effd700 1 -- 172.21.15.104:0/1837912967 >> v1:172.21.15.104:6789/0 conn(0x7f70300b12d0 legacy=0x7f70300cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:32.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.078+0000 7f702effd700 1 -- 172.21.15.104:0/1837912967 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70300cbaa0 con 0x7f7030154900 2024-08-17T02:22:32.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.078+0000 7f702f7fe700 1 --2- 172.21.15.104:0/1837912967 >> v2:172.21.15.117:3300/0 conn(0x7f70300cb560 0x7f7030160ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:22:32.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.082+0000 7f702effd700 1 --2- 172.21.15.104:0/1837912967 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7030154900 0x7f70300b0d90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f703006c980 tx=0x7f70200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d7bc6613c4d57b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:32.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.082+0000 7f702dffb700 1 -- 172.21.15.104:0/1837912967 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7020011630 con 0x7f7030154900 2024-08-17T02:22:32.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.082+0000 7f702dffb700 1 -- 172.21.15.104:0/1837912967 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7020011790 con 0x7f7030154900 2024-08-17T02:22:32.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.082+0000 7f702dffb700 1 -- 172.21.15.104:0/1837912967 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7020011b10 con 0x7f7030154900 2024-08-17T02:22:32.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.082+0000 7f702ffff700 1 -- 172.21.15.104:0/1837912967 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7030154900 msgr2=0x7f70300b0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:32.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.082+0000 7f702ffff700 1 --2- 172.21.15.104:0/1837912967 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7030154900 0x7f70300b0d90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f703006c980 tx=0x7f70200091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:32.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.082+0000 7f702ffff700 1 -- 172.21.15.104:0/1837912967 shutdown_connections 2024-08-17T02:22:32.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.082+0000 7f702ffff700 1 --2- 172.21.15.104:0/1837912967 >> v2:172.21.15.117:3300/0 conn(0x7f70300cb560 0x7f7030160ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:32.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.082+0000 7f702ffff700 1 --2- 172.21.15.104:0/1837912967 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7030154900 0x7f70300b0d90 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:32.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.082+0000 7f702ffff700 1 -- 172.21.15.104:0/1837912967 >> 172.21.15.104:0/1837912967 conn(0x7f70300678d0 msgr2=0x7f7030067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:32.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.082+0000 7f702ffff700 1 -- 172.21.15.104:0/1837912967 shutdown_connections 2024-08-17T02:22:32.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.082+0000 7f702ffff700 1 -- 172.21.15.104:0/1837912967 wait complete. 2024-08-17T02:22:32.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.082+0000 7f702ffff700 1 Processor -- start 2024-08-17T02:22:32.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.082+0000 7f702ffff700 1 -- start start 2024-08-17T02:22:32.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.086+0000 7f702ffff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70300b12d0 0x7f70300c7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:32.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.086+0000 7f702ffff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70300cb560 0x7f70300ac990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:32.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.086+0000 7f702ffff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7030154900 0x7f70300aced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:32.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.086+0000 7f702ffff700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70300a62f0 con 0x7f70300b12d0 2024-08-17T02:22:32.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.086+0000 7f702ffff700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70300a6030 con 0x7f70300cb560 2024-08-17T02:22:32.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.086+0000 7f702ffff700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70300a6870 con 0x7f7030154900 2024-08-17T02:22:32.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.086+0000 7f702effd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70300b12d0 0x7f70300c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:32.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.086+0000 7f702effd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70300b12d0 0x7f70300c7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42552/0 (socket says 172.21.15.104:42552) 2024-08-17T02:22:32.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.086+0000 7f702effd700 1 -- 172.21.15.104:0/3080117806 learned_addr learned my addr 172.21.15.104:0/3080117806 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:32.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.086+0000 7f702f7fe700 1 --2- 172.21.15.104:0/3080117806 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7030154900 0x7f70300aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:32.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.086+0000 7f702e7fc700 1 --2- 172.21.15.104:0/3080117806 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70300cb560 0x7f70300ac990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:32.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.086+0000 7f702effd700 1 -- 172.21.15.104:0/3080117806 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7030154900 msgr2=0x7f70300aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:32.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.086+0000 7f702effd700 1 --2- 172.21.15.104:0/3080117806 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7030154900 0x7f70300aced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:32.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.086+0000 7f702effd700 1 -- 172.21.15.104:0/3080117806 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70300cb560 msgr2=0x7f70300ac990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:32.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.086+0000 7f702effd700 1 --2- 172.21.15.104:0/3080117806 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70300cb560 0x7f70300ac990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:32.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.086+0000 7f702effd700 1 -- 172.21.15.104:0/3080117806 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7020009420 con 0x7f70300b12d0 2024-08-17T02:22:32.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.086+0000 7f702effd700 1 --2- 172.21.15.104:0/3080117806 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70300b12d0 0x7f70300c7110 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7020009f50 tx=0x7f7020017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:32.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.086+0000 7f7026ffd700 1 -- 172.21.15.104:0/3080117806 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7020000cc0 con 0x7f70300b12d0 2024-08-17T02:22:32.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.086+0000 7f7026ffd700 1 -- 172.21.15.104:0/3080117806 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7020011900 con 0x7f70300b12d0 2024-08-17T02:22:32.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.086+0000 7f7026ffd700 1 -- 172.21.15.104:0/3080117806 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7020025650 con 0x7f70300b12d0 2024-08-17T02:22:32.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.086+0000 7f702ffff700 1 -- 172.21.15.104:0/3080117806 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70300ab050 con 0x7f70300b12d0 2024-08-17T02:22:32.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.086+0000 7f702ffff700 1 -- 172.21.15.104:0/3080117806 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70300a6500 con 0x7f70300b12d0 2024-08-17T02:22:32.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.086+0000 7f702ffff700 1 -- 172.21.15.104:0/3080117806 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70300643a0 con 0x7f70300b12d0 2024-08-17T02:22:32.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.090+0000 7f7026ffd700 1 -- 172.21.15.104:0/3080117806 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7020023070 con 0x7f70300b12d0 2024-08-17T02:22:32.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.090+0000 7f7026ffd700 1 --2- 172.21.15.104:0/3080117806 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7014060860 0x7f7014062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:32.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.090+0000 7f7026ffd700 1 -- 172.21.15.104:0/3080117806 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f702007e1b0 con 0x7f70300b12d0 2024-08-17T02:22:32.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.090+0000 7f702e7fc700 1 --2- 172.21.15.104:0/3080117806 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7014060860 0x7f7014062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:32.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.090+0000 7f702e7fc700 1 --2- 172.21.15.104:0/3080117806 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7014060860 0x7f7014062d10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f703006e600 tx=0x7f7018009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:32.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.094+0000 7f7026ffd700 1 -- 172.21.15.104:0/3080117806 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f702004e620 con 0x7f70300b12d0 2024-08-17T02:22:32.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.294+0000 7f702ffff700 1 -- 172.21.15.104:0/3080117806 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f703006f5f0 con 0x7f70300b12d0 2024-08-17T02:22:32.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.294+0000 7f7026ffd700 1 -- 172.21.15.104:0/3080117806 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4603 (secure 0 0 0) 0x7f7020051c00 con 0x7f70300b12d0 2024-08-17T02:22:32.300 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:22:32.300 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/1242386459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":1242386459},{"type":"v1","addr":"172.21.15.104:6835","nonce":1242386459}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/2581980475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2581980475},{"type":"v1","addr":"172.21.15.104:6833","nonce":2581980475}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1039240942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1039240942},{"type":"v1","addr":"172.21.15.117:6835","nonce":1039240942}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:22:21.527207+0000","modified":"2024-08-17T02:22:25.187188+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/4197149840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":4197149840},{"type":"v1","addr":"172.21.15.117:6837","nonce":4197149840}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:22:32.303 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.294+0000 7f702ffff700 1 -- 172.21.15.104:0/3080117806 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7014060860 msgr2=0x7f7014062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:32.303 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.294+0000 7f702ffff700 1 --2- 172.21.15.104:0/3080117806 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7014060860 0x7f7014062d10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f703006e600 tx=0x7f7018009040 comp rx=0 tx=0).stop 2024-08-17T02:22:32.303 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.294+0000 7f702ffff700 1 -- 172.21.15.104:0/3080117806 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70300b12d0 msgr2=0x7f70300c7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:32.303 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.294+0000 7f702ffff700 1 --2- 172.21.15.104:0/3080117806 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70300b12d0 0x7f70300c7110 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7020009f50 tx=0x7f7020017000 comp rx=0 tx=0).stop 2024-08-17T02:22:32.303 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.294+0000 7f702ffff700 1 -- 172.21.15.104:0/3080117806 shutdown_connections 2024-08-17T02:22:32.303 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.294+0000 7f702ffff700 1 --2- 172.21.15.104:0/3080117806 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7014060860 0x7f7014062d10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:32.303 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.294+0000 7f702ffff700 1 --2- 172.21.15.104:0/3080117806 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7030154900 0x7f70300aced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:32.303 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.294+0000 7f702ffff700 1 --2- 172.21.15.104:0/3080117806 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70300cb560 0x7f70300ac990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:32.303 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.294+0000 7f702ffff700 1 --2- 172.21.15.104:0/3080117806 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70300b12d0 0x7f70300c7110 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:32.304 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.294+0000 7f702ffff700 1 -- 172.21.15.104:0/3080117806 >> 172.21.15.104:0/3080117806 conn(0x7f70300678d0 msgr2=0x7f7030153ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:32.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.294+0000 7f702ffff700 1 -- 172.21.15.104:0/3080117806 shutdown_connections 2024-08-17T02:22:32.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.294+0000 7f702ffff700 1 -- 172.21.15.104:0/3080117806 wait complete. 2024-08-17T02:22:32.305 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 7 2024-08-17T02:22:32.314 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:22:32.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.414+0000 7f59fc976700 1 Processor -- start 2024-08-17T02:22:32.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.414+0000 7f59fc976700 1 -- start start 2024-08-17T02:22:32.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.414+0000 7f59fc976700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59f80b0d20 0x7f59f806df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:32.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.414+0000 7f59fc976700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f59f806e450 0x7f59f80b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:32.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.414+0000 7f59fc976700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59f8141a00 con 0x7f59f80b1630 2024-08-17T02:22:32.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.414+0000 7f59fc976700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59f806e8a0 con 0x7f59f806e450 2024-08-17T02:22:32.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.414+0000 7f59fc976700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f8140b10 con 0x7f59f80b0d20 2024-08-17T02:22:32.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.414+0000 7f59f7fff700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f59f80b1630 0x7f59f81610f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:56838/0 (socket says 172.21.15.104:56838) 2024-08-17T02:22:32.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.414+0000 7f59f7fff700 1 -- 172.21.15.104:0/506358138 learned_addr learned my addr 172.21.15.104:0/506358138 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:32.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.414+0000 7f59f77fe700 1 --2- 172.21.15.104:0/506358138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59f80b0d20 0x7f59f806df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:32.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.414+0000 7f59f6ffd700 1 --2- 172.21.15.104:0/506358138 >> v2:172.21.15.117:3300/0 conn(0x7f59f806e450 0x7f59f80b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:32.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.414+0000 7f59f67fc700 1 -- 172.21.15.104:0/506358138 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3022814855 0 0) 0x7f59f8141a00 con 0x7f59f80b1630 2024-08-17T02:22:32.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.414+0000 7f59f67fc700 1 -- 172.21.15.104:0/506358138 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59d8003570 con 0x7f59f80b1630 2024-08-17T02:22:32.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.414+0000 7f59f6ffd700 1 -- 172.21.15.104:0/506358138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59f80b0d20 msgr2=0x7f59f806df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:32.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.414+0000 7f59f6ffd700 1 --2- 172.21.15.104:0/506358138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59f80b0d20 0x7f59f806df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:32.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.414+0000 7f59f6ffd700 1 -- 172.21.15.104:0/506358138 >> v1:172.21.15.104:6789/0 conn(0x7f59f80b1630 legacy=0x7f59f81610f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:32.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.414+0000 7f59f6ffd700 1 -- 172.21.15.104:0/506358138 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f8140df0 con 0x7f59f806e450 2024-08-17T02:22:32.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.414+0000 7f59f6ffd700 1 --2- 172.21.15.104:0/506358138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59f806e450 0x7f59f80b10f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f59e00098e0 tx=0x7f59e00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e2c959c097480f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:32.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.414+0000 7f59f67fc700 1 -- 172.21.15.104:0/506358138 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e0011630 con 0x7f59f806e450 2024-08-17T02:22:32.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.414+0000 7f59f67fc700 1 -- 172.21.15.104:0/506358138 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e0011790 con 0x7f59f806e450 2024-08-17T02:22:32.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.414+0000 7f59f67fc700 1 -- 172.21.15.104:0/506358138 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e0011b30 con 0x7f59f806e450 2024-08-17T02:22:32.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.414+0000 7f59fc976700 1 -- 172.21.15.104:0/506358138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59f806e450 msgr2=0x7f59f80b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:32.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.414+0000 7f59fc976700 1 --2- 172.21.15.104:0/506358138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59f806e450 0x7f59f80b10f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f59e00098e0 tx=0x7f59e00091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:32.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.414+0000 7f59fc976700 1 -- 172.21.15.104:0/506358138 shutdown_connections 2024-08-17T02:22:32.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.414+0000 7f59fc976700 1 --2- 172.21.15.104:0/506358138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59f806e450 0x7f59f80b10f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:32.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.414+0000 7f59fc976700 1 --2- 172.21.15.104:0/506358138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59f80b0d20 0x7f59f806df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:32.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.414+0000 7f59fc976700 1 -- 172.21.15.104:0/506358138 >> 172.21.15.104:0/506358138 conn(0x7f59f80678d0 msgr2=0x7f59f8067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:32.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.414+0000 7f59fc976700 1 -- 172.21.15.104:0/506358138 shutdown_connections 2024-08-17T02:22:32.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.414+0000 7f59fc976700 1 -- 172.21.15.104:0/506358138 wait complete. 2024-08-17T02:22:32.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.418+0000 7f59fc976700 1 Processor -- start 2024-08-17T02:22:32.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.418+0000 7f59fc976700 1 -- start start 2024-08-17T02:22:32.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.418+0000 7f59fc976700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59f806e450 0x7f59f815b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:32.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.418+0000 7f59fc976700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59f80b0d20 0x7f59f80a6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:32.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.418+0000 7f59fc976700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59f80b1630 0x7f59f815eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:32.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.418+0000 7f59fc976700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f80a9d80 con 0x7f59f80b1630 2024-08-17T02:22:32.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.418+0000 7f59fc976700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f815b7f0 con 0x7f59f80b0d20 2024-08-17T02:22:32.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.418+0000 7f59fc976700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f80a55f0 con 0x7f59f806e450 2024-08-17T02:22:32.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.418+0000 7f59f7fff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59f80b1630 0x7f59f815eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:32.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.418+0000 7f59f7fff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59f80b1630 0x7f59f815eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42558/0 (socket says 172.21.15.104:42558) 2024-08-17T02:22:32.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.418+0000 7f59f7fff700 1 -- 172.21.15.104:0/3563950467 learned_addr learned my addr 172.21.15.104:0/3563950467 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:32.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.418+0000 7f59f6ffd700 1 --2- 172.21.15.104:0/3563950467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59f80b0d20 0x7f59f80a6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:32.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.418+0000 7f59f77fe700 1 --2- 172.21.15.104:0/3563950467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59f806e450 0x7f59f815b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:32.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.418+0000 7f59f7fff700 1 -- 172.21.15.104:0/3563950467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59f806e450 msgr2=0x7f59f815b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:32.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.418+0000 7f59f7fff700 1 --2- 172.21.15.104:0/3563950467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59f806e450 0x7f59f815b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:32.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.418+0000 7f59f7fff700 1 -- 172.21.15.104:0/3563950467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59f80b0d20 msgr2=0x7f59f80a6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:32.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.418+0000 7f59f7fff700 1 --2- 172.21.15.104:0/3563950467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59f80b0d20 0x7f59f80a6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:32.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.418+0000 7f59f7fff700 1 -- 172.21.15.104:0/3563950467 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e0009420 con 0x7f59f80b1630 2024-08-17T02:22:32.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.418+0000 7f59f7fff700 1 --2- 172.21.15.104:0/3563950467 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59f80b1630 0x7f59f815eb70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f59f000cca0 tx=0x7f59f0001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:32.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.418+0000 7f59ef7fe700 1 -- 172.21.15.104:0/3563950467 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f000a8d0 con 0x7f59f80b1630 2024-08-17T02:22:32.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.418+0000 7f59ef7fe700 1 -- 172.21.15.104:0/3563950467 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f000aa30 con 0x7f59f80b1630 2024-08-17T02:22:32.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.418+0000 7f59fc976700 1 -- 172.21.15.104:0/3563950467 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59f80a5890 con 0x7f59f80b1630 2024-08-17T02:22:32.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.418+0000 7f59ef7fe700 1 -- 172.21.15.104:0/3563950467 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f000adb0 con 0x7f59f80b1630 2024-08-17T02:22:32.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.418+0000 7f59fc976700 1 -- 172.21.15.104:0/3563950467 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59f80a5e50 con 0x7f59f80b1630 2024-08-17T02:22:32.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.422+0000 7f59fc976700 1 -- 172.21.15.104:0/3563950467 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59f80643a0 con 0x7f59f80b1630 2024-08-17T02:22:32.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.422+0000 7f59ef7fe700 1 -- 172.21.15.104:0/3563950467 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f59f0007300 con 0x7f59f80b1630 2024-08-17T02:22:32.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.422+0000 7f59ef7fe700 1 --2- 172.21.15.104:0/3563950467 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f59dc060860 0x7f59dc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:32.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.422+0000 7f59ef7fe700 1 -- 172.21.15.104:0/3563950467 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f59f007cff0 con 0x7f59f80b1630 2024-08-17T02:22:32.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.422+0000 7f59f77fe700 1 --2- 172.21.15.104:0/3563950467 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f59dc060860 0x7f59dc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:32.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.426+0000 7f59f77fe700 1 --2- 172.21.15.104:0/3563950467 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f59dc060860 0x7f59dc062d10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f59f815c070 tx=0x7f59e80091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:32.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.434+0000 7f59ef7fe700 1 -- 172.21.15.104:0/3563950467 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f59f004d3d0 con 0x7f59f80b1630 2024-08-17T02:22:32.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.602+0000 7f59fc976700 1 -- 172.21.15.104:0/3563950467 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59f806f5f0 con 0x7f59f80b1630 2024-08-17T02:22:32.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.602+0000 7f59ef7fe700 1 -- 172.21.15.104:0/3563950467 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f59f00509f0 con 0x7f59f80b1630 2024-08-17T02:22:32.611 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:22:32.611 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":23,"fsid":"fd5f7fb8-d34b-49bb-89a8-62b7dad1bc25","created":"2024-08-17T02:21:57.891389+0000","modified":"2024-08-17T02:22:23.175831+0000","last_up_change":"2024-08-17T02:22:08.924546+0000","last_in_change":"2024-08-17T02:21:59.938028+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:22:10.143970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:22:20.082708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:22:20.521582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"606b9088-590e-4709-aa3a-b0f6e22972ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":24257},{"type":"v1","addr":"172.21.15.104:6809","nonce":24257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":24257},{"type":"v1","addr":"172.21.15.104:6811","nonce":24257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":24257},{"type":"v1","addr":"172.21.15.104:6815","nonce":24257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":24257},{"type":"v1","addr":"172.21.15.104:6813","nonce":24257}]},"public_addr":"172.21.15.104:6809/24257","cluster_addr":"172.21.15.104:6811/24257","heartbeat_back_addr":"172.21.15.104:6815/24257","heartbeat_front_addr":"172.21.15.104:6813/24257","state":["exists","up"]},{"osd":1,"uuid":"9bc6a909-0c2f-4889-afe7-4a47f89b0f64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":24256},{"type":"v1","addr":"172.21.15.104:6825","nonce":24256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":24256},{"type":"v1","addr":"172.21.15.104:6827","nonce":24256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":24256},{"type":"v1","addr":"172.21.15.104:6831","nonce":24256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":24256},{"type":"v1","addr":"172.21.15.104:6829","nonce":24256}]},"public_addr":"172.21.15.104:6825/24256","cluster_addr":"172.21.15.104:6827/24256","heartbeat_back_addr":"172.21.15.104:6831/24256","heartbeat_front_addr":"172.21.15.104:6829/24256","state":["exists","up"]},{"osd":2,"uuid":"23da31d5-aefb-4edb-b79d-fa05e1becef7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":24255},{"type":"v1","addr":"172.21.15.104:6817","nonce":24255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":24255},{"type":"v1","addr":"172.21.15.104:6819","nonce":24255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":24255},{"type":"v1","addr":"172.21.15.104:6823","nonce":24255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":24255},{"type":"v1","addr":"172.21.15.104:6821","nonce":24255}]},"public_addr":"172.21.15.104:6817/24255","cluster_addr":"172.21.15.104:6819/24255","heartbeat_back_addr":"172.21.15.104:6823/24255","heartbeat_front_addr":"172.21.15.104:6821/24255","state":["exists","up"]},{"osd":3,"uuid":"6e4a5ec2-b415-45ef-8381-61a59eb65224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":24254},{"type":"v1","addr":"172.21.15.104:6801","nonce":24254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":24254},{"type":"v1","addr":"172.21.15.104:6803","nonce":24254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":24254},{"type":"v1","addr":"172.21.15.104:6807","nonce":24254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":24254},{"type":"v1","addr":"172.21.15.104:6805","nonce":24254}]},"public_addr":"172.21.15.104:6801/24254","cluster_addr":"172.21.15.104:6803/24254","heartbeat_back_addr":"172.21.15.104:6807/24254","heartbeat_front_addr":"172.21.15.104:6805/24254","state":["exists","up"]},{"osd":4,"uuid":"8d5bea2d-9039-4013-8c99-2c046c5b8a17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":24421},{"type":"v1","addr":"172.21.15.117:6804","nonce":24421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":24421},{"type":"v1","addr":"172.21.15.117:6809","nonce":24421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":24421},{"type":"v1","addr":"172.21.15.117:6815","nonce":24421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":24421},{"type":"v1","addr":"172.21.15.117:6813","nonce":24421}]},"public_addr":"172.21.15.117:6804/24421","cluster_addr":"172.21.15.117:6809/24421","heartbeat_back_addr":"172.21.15.117:6815/24421","heartbeat_front_addr":"172.21.15.117:6813/24421","state":["exists","up"]},{"osd":5,"uuid":"de8b36fc-121c-4f05-8f5b-28f513d9f21f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":24422},{"type":"v1","addr":"172.21.15.117:6817","nonce":24422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":24422},{"type":"v1","addr":"172.21.15.117:6819","nonce":24422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":24422},{"type":"v1","addr":"172.21.15.117:6823","nonce":24422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":24422},{"type":"v1","addr":"172.21.15.117:6821","nonce":24422}]},"public_addr":"172.21.15.117:6817/24422","cluster_addr":"172.21.15.117:6819/24422","heartbeat_back_addr":"172.21.15.117:6823/24422","heartbeat_front_addr":"172.21.15.117:6821/24422","state":["exists","up"]},{"osd":6,"uuid":"6a87f09f-7bf7-4f7a-be87-530ac1ff8ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":24420},{"type":"v1","addr":"172.21.15.117:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6803","nonce":24420},{"type":"v1","addr":"172.21.15.117:6805","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":24420},{"type":"v1","addr":"172.21.15.117:6811","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":24420},{"type":"v1","addr":"172.21.15.117:6808","nonce":24420}]},"public_addr":"172.21.15.117:6801/24420","cluster_addr":"172.21.15.117:6805/24420","heartbeat_back_addr":"172.21.15.117:6811/24420","heartbeat_front_addr":"172.21.15.117:6808/24420","state":["exists","up"]},{"osd":7,"uuid":"e31d8041-1aa1-4b5d-83b3-0a373426dd9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":24423},{"type":"v1","addr":"172.21.15.117:6825","nonce":24423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":24423},{"type":"v1","addr":"172.21.15.117:6827","nonce":24423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":24423},{"type":"v1","addr":"172.21.15.117:6831","nonce":24423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":24423},{"type":"v1","addr":"172.21.15.117:6829","nonce":24423}]},"public_addr":"172.21.15.117:6825/24423","cluster_addr":"172.21.15.117:6827/24423","heartbeat_back_addr":"172.21.15.117:6831/24423","heartbeat_front_addr":"172.21.15.117:6829/24423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.220874+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.210039+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.434762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.247206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.184316+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.306325+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.035719+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.400303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:22:32.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.606+0000 7f59fc976700 1 -- 172.21.15.104:0/3563950467 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f59dc060860 msgr2=0x7f59dc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:32.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.606+0000 7f59fc976700 1 --2- 172.21.15.104:0/3563950467 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f59dc060860 0x7f59dc062d10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f59f815c070 tx=0x7f59e80091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:32.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.606+0000 7f59fc976700 1 -- 172.21.15.104:0/3563950467 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59f80b1630 msgr2=0x7f59f815eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:32.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.606+0000 7f59fc976700 1 --2- 172.21.15.104:0/3563950467 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59f80b1630 0x7f59f815eb70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f59f000cca0 tx=0x7f59f0001ae0 comp rx=0 tx=0).stop 2024-08-17T02:22:32.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.606+0000 7f59fc976700 1 -- 172.21.15.104:0/3563950467 shutdown_connections 2024-08-17T02:22:32.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.606+0000 7f59fc976700 1 --2- 172.21.15.104:0/3563950467 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f59dc060860 0x7f59dc062d10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:32.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.606+0000 7f59fc976700 1 --2- 172.21.15.104:0/3563950467 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59f80b1630 0x7f59f815eb70 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:32.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.606+0000 7f59fc976700 1 --2- 172.21.15.104:0/3563950467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59f80b0d20 0x7f59f80a6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:32.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.606+0000 7f59fc976700 1 --2- 172.21.15.104:0/3563950467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59f806e450 0x7f59f815b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:32.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.606+0000 7f59fc976700 1 -- 172.21.15.104:0/3563950467 >> 172.21.15.104:0/3563950467 conn(0x7f59f80678d0 msgr2=0x7f59f8063060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:32.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.606+0000 7f59fc976700 1 -- 172.21.15.104:0/3563950467 shutdown_connections 2024-08-17T02:22:32.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.606+0000 7f59fc976700 1 -- 172.21.15.104:0/3563950467 wait complete. 2024-08-17T02:22:32.630 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:22:32.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.730+0000 7f685c9c8700 1 Processor -- start 2024-08-17T02:22:32.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.730+0000 7f685c9c8700 1 -- start start 2024-08-17T02:22:32.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.730+0000 7f685c9c8700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6858153a40 0x7f68580c9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:32.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.730+0000 7f685c9c8700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f685815a260 0x7f68580ada90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:32.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.730+0000 7f685c9c8700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68580c9e00 con 0x7f68580b29f0 2024-08-17T02:22:32.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.730+0000 7f685c9c8700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68580ccd20 con 0x7f685815a260 2024-08-17T02:22:32.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.730+0000 7f685c9c8700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68580cc890 con 0x7f6858153a40 2024-08-17T02:22:32.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.730+0000 7f6856d9d700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f685815a260 0x7f68580ada90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:32.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.730+0000 7f6856d9d700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f685815a260 0x7f68580ada90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42562/0 (socket says 172.21.15.104:42562) 2024-08-17T02:22:32.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.730+0000 7f6856d9d700 1 -- 172.21.15.104:0/1390258497 learned_addr learned my addr 172.21.15.104:0/1390258497 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:32.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.730+0000 7f685659c700 1 --2- 172.21.15.104:0/1390258497 >> v2:172.21.15.117:3300/0 conn(0x7f6858153a40 0x7f68580c9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:32.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.730+0000 7f6856d9d700 1 -- 172.21.15.104:0/1390258497 >> v2:172.21.15.117:3300/0 conn(0x7f6858153a40 msgr2=0x7f68580c9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:32.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.730+0000 7f6856d9d700 1 --2- 172.21.15.104:0/1390258497 >> v2:172.21.15.117:3300/0 conn(0x7f6858153a40 0x7f68580c9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:32.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.730+0000 7f6856d9d700 1 -- 172.21.15.104:0/1390258497 >> v1:172.21.15.117:6789/0 conn(0x7f68580b29f0 legacy=0x7f6858159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:32.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.730+0000 7f6856d9d700 1 -- 172.21.15.104:0/1390258497 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68580cbf60 con 0x7f685815a260 2024-08-17T02:22:32.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.730+0000 7f6856d9d700 1 --2- 172.21.15.104:0/1390258497 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f685815a260 0x7f68580ada90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f68580701a0 tx=0x7f6848009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2d45edbbdf07229 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:32.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.730+0000 7f685559a700 1 -- 172.21.15.104:0/1390258497 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6848009e70 con 0x7f685815a260 2024-08-17T02:22:32.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.730+0000 7f685559a700 1 -- 172.21.15.104:0/1390258497 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f684800b860 con 0x7f685815a260 2024-08-17T02:22:32.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.730+0000 7f685559a700 1 -- 172.21.15.104:0/1390258497 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684800bc00 con 0x7f685815a260 2024-08-17T02:22:32.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.730+0000 7f685c9c8700 1 -- 172.21.15.104:0/1390258497 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f685815a260 msgr2=0x7f68580ada90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:32.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.730+0000 7f685c9c8700 1 --2- 172.21.15.104:0/1390258497 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f685815a260 0x7f68580ada90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f68580701a0 tx=0x7f6848009250 comp rx=0 tx=0).stop 2024-08-17T02:22:32.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.734+0000 7f685c9c8700 1 -- 172.21.15.104:0/1390258497 shutdown_connections 2024-08-17T02:22:32.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.734+0000 7f685c9c8700 1 --2- 172.21.15.104:0/1390258497 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f685815a260 0x7f68580ada90 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:32.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.734+0000 7f685c9c8700 1 --2- 172.21.15.104:0/1390258497 >> v2:172.21.15.117:3300/0 conn(0x7f6858153a40 0x7f68580c9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:32.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.734+0000 7f685c9c8700 1 -- 172.21.15.104:0/1390258497 >> 172.21.15.104:0/1390258497 conn(0x7f68580a9db0 msgr2=0x7f68580ac1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:32.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.734+0000 7f685c9c8700 1 -- 172.21.15.104:0/1390258497 shutdown_connections 2024-08-17T02:22:32.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.734+0000 7f685c9c8700 1 -- 172.21.15.104:0/1390258497 wait complete. 2024-08-17T02:22:32.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.734+0000 7f685c9c8700 1 Processor -- start 2024-08-17T02:22:32.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.734+0000 7f685c9c8700 1 -- start start 2024-08-17T02:22:32.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.734+0000 7f685c9c8700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68580b29f0 0x7f685814ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:32.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.734+0000 7f685c9c8700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6858153a40 0x7f68580991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:32.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.734+0000 7f685c9c8700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f685815a260 0x7f6858153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:32.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.734+0000 7f685c9c8700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68580acd40 con 0x7f68580b29f0 2024-08-17T02:22:32.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.734+0000 7f685c9c8700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68580ad8c0 con 0x7f685815a260 2024-08-17T02:22:32.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.734+0000 7f685c9c8700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68580acf90 con 0x7f6858153a40 2024-08-17T02:22:32.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.734+0000 7f685659c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68580b29f0 0x7f685814ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:32.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.734+0000 7f685659c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68580b29f0 0x7f685814ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42576/0 (socket says 172.21.15.104:42576) 2024-08-17T02:22:32.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.734+0000 7f685659c700 1 -- 172.21.15.104:0/2729087473 learned_addr learned my addr 172.21.15.104:0/2729087473 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:32.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.734+0000 7f6856d9d700 1 --2- 172.21.15.104:0/2729087473 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f685815a260 0x7f6858153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:32.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.734+0000 7f6855d9b700 1 --2- 172.21.15.104:0/2729087473 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6858153a40 0x7f68580991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:32.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.734+0000 7f685659c700 1 -- 172.21.15.104:0/2729087473 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6858153a40 msgr2=0x7f68580991d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:32.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.734+0000 7f685659c700 1 --2- 172.21.15.104:0/2729087473 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6858153a40 0x7f68580991d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:32.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.734+0000 7f685659c700 1 -- 172.21.15.104:0/2729087473 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f685815a260 msgr2=0x7f6858153e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:32.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.734+0000 7f685659c700 1 --2- 172.21.15.104:0/2729087473 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f685815a260 0x7f6858153e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:32.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.734+0000 7f685659c700 1 -- 172.21.15.104:0/2729087473 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68480094f0 con 0x7f68580b29f0 2024-08-17T02:22:32.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.734+0000 7f6855d9b700 1 --2- 172.21.15.104:0/2729087473 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6858153a40 0x7f68580991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:22:32.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.734+0000 7f685659c700 1 --2- 172.21.15.104:0/2729087473 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68580b29f0 0x7f685814ea10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6850009f20 tx=0x7f685000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:32.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.734+0000 7f684e7fc700 1 -- 172.21.15.104:0/2729087473 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685000cc80 con 0x7f68580b29f0 2024-08-17T02:22:32.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.734+0000 7f684e7fc700 1 -- 172.21.15.104:0/2729087473 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685000f040 con 0x7f68580b29f0 2024-08-17T02:22:32.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.738+0000 7f684e7fc700 1 -- 172.21.15.104:0/2729087473 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6850014480 con 0x7f68580b29f0 2024-08-17T02:22:32.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.738+0000 7f685c9c8700 1 -- 172.21.15.104:0/2729087473 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68580ad270 con 0x7f68580b29f0 2024-08-17T02:22:32.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.738+0000 7f685c9c8700 1 -- 172.21.15.104:0/2729087473 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f685814ef50 con 0x7f68580b29f0 2024-08-17T02:22:32.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.738+0000 7f685c9c8700 1 -- 172.21.15.104:0/2729087473 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68580645c0 con 0x7f68580b29f0 2024-08-17T02:22:32.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.738+0000 7f684e7fc700 1 -- 172.21.15.104:0/2729087473 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f68500147f0 con 0x7f68580b29f0 2024-08-17T02:22:32.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.742+0000 7f684e7fc700 1 --2- 172.21.15.104:0/2729087473 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f683c060860 0x7f683c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:32.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.742+0000 7f684e7fc700 1 -- 172.21.15.104:0/2729087473 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f685007d9b0 con 0x7f68580b29f0 2024-08-17T02:22:32.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.742+0000 7f6855d9b700 1 --2- 172.21.15.104:0/2729087473 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f683c060860 0x7f683c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:32.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.742+0000 7f6855d9b700 1 --2- 172.21.15.104:0/2729087473 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f683c060860 0x7f683c062d10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6858168320 tx=0x7f6840009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:32.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.746+0000 7f684e7fc700 1 -- 172.21.15.104:0/2729087473 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f685004dd60 con 0x7f68580b29f0 2024-08-17T02:22:32.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.946+0000 7f685c9c8700 1 -- 172.21.15.104:0/2729087473 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68580b0230 con 0x7f68580b29f0 2024-08-17T02:22:32.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.950+0000 7f684e7fc700 1 -- 172.21.15.104:0/2729087473 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4603 (secure 0 0 0) 0x7f6850051380 con 0x7f68580b29f0 2024-08-17T02:22:32.955 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:22:32.956 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/1242386459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":1242386459},{"type":"v1","addr":"172.21.15.104:6835","nonce":1242386459}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/2581980475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2581980475},{"type":"v1","addr":"172.21.15.104:6833","nonce":2581980475}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1039240942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1039240942},{"type":"v1","addr":"172.21.15.117:6835","nonce":1039240942}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:22:21.527207+0000","modified":"2024-08-17T02:22:25.187188+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/4197149840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":4197149840},{"type":"v1","addr":"172.21.15.117:6837","nonce":4197149840}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:22:32.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.950+0000 7f685c9c8700 1 -- 172.21.15.104:0/2729087473 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f683c060860 msgr2=0x7f683c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:32.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.950+0000 7f685c9c8700 1 --2- 172.21.15.104:0/2729087473 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f683c060860 0x7f683c062d10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6858168320 tx=0x7f6840009040 comp rx=0 tx=0).stop 2024-08-17T02:22:32.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.950+0000 7f685c9c8700 1 -- 172.21.15.104:0/2729087473 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68580b29f0 msgr2=0x7f685814ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:32.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.950+0000 7f685c9c8700 1 --2- 172.21.15.104:0/2729087473 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68580b29f0 0x7f685814ea10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6850009f20 tx=0x7f685000b040 comp rx=0 tx=0).stop 2024-08-17T02:22:32.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.950+0000 7f685c9c8700 1 -- 172.21.15.104:0/2729087473 shutdown_connections 2024-08-17T02:22:32.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.950+0000 7f685c9c8700 1 --2- 172.21.15.104:0/2729087473 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f683c060860 0x7f683c062d10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:32.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.950+0000 7f685c9c8700 1 --2- 172.21.15.104:0/2729087473 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f685815a260 0x7f6858153e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:32.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.950+0000 7f685c9c8700 1 --2- 172.21.15.104:0/2729087473 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6858153a40 0x7f68580991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:32.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.950+0000 7f685c9c8700 1 --2- 172.21.15.104:0/2729087473 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68580b29f0 0x7f685814ea10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:32.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.950+0000 7f685c9c8700 1 -- 172.21.15.104:0/2729087473 >> 172.21.15.104:0/2729087473 conn(0x7f68580a9db0 msgr2=0x7f685814f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:32.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.950+0000 7f685c9c8700 1 -- 172.21.15.104:0/2729087473 shutdown_connections 2024-08-17T02:22:32.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:32.950+0000 7f685c9c8700 1 -- 172.21.15.104:0/2729087473 wait complete. 2024-08-17T02:22:32.959 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 7 2024-08-17T02:22:33.375 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-17T02:22:21.527207+0000', 'modified': '2024-08-17T02:22:25.187188+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4288}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4288': {'gid': 4288, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.117:6837/4197149840', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6836', 'nonce': 4197149840}, {'type': 'v1', 'addr': '172.21.15.117:6837', 'nonce': 4197149840}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-08-17T02:22:33.376 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-17T02:22:33.376 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-08-17T02:22:33.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.486+0000 7f45ce6c6700 1 Processor -- start 2024-08-17T02:22:33.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.486+0000 7f45ce6c6700 1 -- start start 2024-08-17T02:22:33.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.486+0000 7f45ce6c6700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f45c81590a0 0x7f45c80adda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:33.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.486+0000 7f45ce6c6700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f45c80b23d0 0x7f45c8162df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:33.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.486+0000 7f45ce6c6700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45c80b0cd0 con 0x7f45c80ae2e0 2024-08-17T02:22:33.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.486+0000 7f45ce6c6700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45c80b0fb0 con 0x7f45c80b23d0 2024-08-17T02:22:33.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.486+0000 7f45ce6c6700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45c80b1290 con 0x7f45c81590a0 2024-08-17T02:22:33.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.486+0000 7f45cdec5700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f45c80b23d0 0x7f45c8162df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:33.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.486+0000 7f45cdec5700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f45c80b23d0 0x7f45c8162df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42580/0 (socket says 172.21.15.104:42580) 2024-08-17T02:22:33.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.486+0000 7f45cdec5700 1 -- 172.21.15.104:0/3550319778 learned_addr learned my addr 172.21.15.104:0/3550319778 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:33.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.486+0000 7f45cd6c4700 1 --2- 172.21.15.104:0/3550319778 >> v2:172.21.15.117:3300/0 conn(0x7f45c81590a0 0x7f45c80adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:33.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.486+0000 7f45cdec5700 1 -- 172.21.15.104:0/3550319778 >> v2:172.21.15.117:3300/0 conn(0x7f45c81590a0 msgr2=0x7f45c80adda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:33.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.486+0000 7f45cdec5700 1 --2- 172.21.15.104:0/3550319778 >> v2:172.21.15.117:3300/0 conn(0x7f45c81590a0 0x7f45c80adda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:33.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.486+0000 7f45cdec5700 1 -- 172.21.15.104:0/3550319778 >> v1:172.21.15.117:6789/0 conn(0x7f45c80ae2e0 legacy=0x7f45c80b1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:33.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.486+0000 7f45cdec5700 1 -- 172.21.15.104:0/3550319778 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c80b1570 con 0x7f45c80b23d0 2024-08-17T02:22:33.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.486+0000 7f45cdec5700 1 --2- 172.21.15.104:0/3550319778 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f45c80b23d0 0x7f45c8162df0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f45c8070230 tx=0x7f45c0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e851f86f19fa02b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:33.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.486+0000 7f45bffff700 1 -- 172.21.15.104:0/3550319778 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c000e070 con 0x7f45c80b23d0 2024-08-17T02:22:33.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.486+0000 7f45bffff700 1 -- 172.21.15.104:0/3550319778 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c000ba50 con 0x7f45c80b23d0 2024-08-17T02:22:33.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.486+0000 7f45bffff700 1 -- 172.21.15.104:0/3550319778 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c00092e0 con 0x7f45c80b23d0 2024-08-17T02:22:33.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.486+0000 7f45ce6c6700 1 -- 172.21.15.104:0/3550319778 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f45c80b23d0 msgr2=0x7f45c8162df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:33.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.486+0000 7f45ce6c6700 1 --2- 172.21.15.104:0/3550319778 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f45c80b23d0 0x7f45c8162df0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f45c8070230 tx=0x7f45c0009840 comp rx=0 tx=0).stop 2024-08-17T02:22:33.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.486+0000 7f45ce6c6700 1 -- 172.21.15.104:0/3550319778 shutdown_connections 2024-08-17T02:22:33.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.486+0000 7f45ce6c6700 1 --2- 172.21.15.104:0/3550319778 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f45c80b23d0 0x7f45c8162df0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:33.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.486+0000 7f45ce6c6700 1 --2- 172.21.15.104:0/3550319778 >> v2:172.21.15.117:3300/0 conn(0x7f45c81590a0 0x7f45c80adda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:33.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.486+0000 7f45ce6c6700 1 -- 172.21.15.104:0/3550319778 >> 172.21.15.104:0/3550319778 conn(0x7f45c80c9840 msgr2=0x7f45c80c9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:33.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.486+0000 7f45ce6c6700 1 -- 172.21.15.104:0/3550319778 shutdown_connections 2024-08-17T02:22:33.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.486+0000 7f45ce6c6700 1 -- 172.21.15.104:0/3550319778 wait complete. 2024-08-17T02:22:33.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.490+0000 7f45ce6c6700 1 Processor -- start 2024-08-17T02:22:33.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.490+0000 7f45ce6c6700 1 -- start start 2024-08-17T02:22:33.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.498+0000 7f45ce6c6700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45c80ae2e0 0x7f45c8159ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:33.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.498+0000 7f45ce6c6700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45c80b23d0 0x7f45c8169eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:33.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.498+0000 7f45ce6c6700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f45c81590a0 0x7f45c813ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:33.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.498+0000 7f45ce6c6700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c816a3f0 con 0x7f45c81590a0 2024-08-17T02:22:33.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.498+0000 7f45ce6c6700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c815ae90 con 0x7f45c80ae2e0 2024-08-17T02:22:33.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.498+0000 7f45ce6c6700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c815a280 con 0x7f45c80b23d0 2024-08-17T02:22:33.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.498+0000 7f45cdec5700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f45c81590a0 0x7f45c813ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:33.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.498+0000 7f45cdec5700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f45c81590a0 0x7f45c813ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42588/0 (socket says 172.21.15.104:42588) 2024-08-17T02:22:33.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.498+0000 7f45cdec5700 1 -- 172.21.15.104:0/895520036 learned_addr learned my addr 172.21.15.104:0/895520036 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:33.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.498+0000 7f45cd6c4700 1 --2- 172.21.15.104:0/895520036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45c80ae2e0 0x7f45c8159ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:33.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.498+0000 7f45ccec3700 1 --2- 172.21.15.104:0/895520036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45c80b23d0 0x7f45c8169eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:33.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.498+0000 7f45cdec5700 1 -- 172.21.15.104:0/895520036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45c80b23d0 msgr2=0x7f45c8169eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:33.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.498+0000 7f45cdec5700 1 --2- 172.21.15.104:0/895520036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45c80b23d0 0x7f45c8169eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:33.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.498+0000 7f45cdec5700 1 -- 172.21.15.104:0/895520036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45c80ae2e0 msgr2=0x7f45c8159ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:33.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.498+0000 7f45cdec5700 1 --2- 172.21.15.104:0/895520036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45c80ae2e0 0x7f45c8159ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:33.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.498+0000 7f45cdec5700 1 -- 172.21.15.104:0/895520036 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c0009ae0 con 0x7f45c81590a0 2024-08-17T02:22:33.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.498+0000 7f45cdec5700 1 --2- 172.21.15.104:0/895520036 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f45c81590a0 0x7f45c813ff10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f45c806d390 tx=0x7f45c0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:33.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.498+0000 7f45bd7fa700 1 -- 172.21.15.104:0/895520036 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c00094e0 con 0x7f45c81590a0 2024-08-17T02:22:33.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.498+0000 7f45bd7fa700 1 -- 172.21.15.104:0/895520036 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c000be60 con 0x7f45c81590a0 2024-08-17T02:22:33.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.498+0000 7f45ce6c6700 1 -- 172.21.15.104:0/895520036 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45c815a560 con 0x7f45c81590a0 2024-08-17T02:22:33.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.498+0000 7f45bd7fa700 1 -- 172.21.15.104:0/895520036 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c0025460 con 0x7f45c81590a0 2024-08-17T02:22:33.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.498+0000 7f45ce6c6700 1 -- 172.21.15.104:0/895520036 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45c815ab20 con 0x7f45c81590a0 2024-08-17T02:22:33.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.498+0000 7f45bd7fa700 1 -- 172.21.15.104:0/895520036 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f45c0003040 con 0x7f45c81590a0 2024-08-17T02:22:33.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.498+0000 7f45bd7fa700 1 --2- 172.21.15.104:0/895520036 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f45ac060860 0x7f45ac062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:33.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.498+0000 7f45bd7fa700 1 -- 172.21.15.104:0/895520036 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f45c007e700 con 0x7f45c81590a0 2024-08-17T02:22:33.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.498+0000 7f45cd6c4700 1 --2- 172.21.15.104:0/895520036 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f45ac060860 0x7f45ac062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:33.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.498+0000 7f45cd6c4700 1 --2- 172.21.15.104:0/895520036 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f45ac060860 0x7f45ac062d10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f45b8006fd0 tx=0x7f45b8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:33.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.498+0000 7f45d1bd7740 1 Processor -- start 2024-08-17T02:22:33.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.498+0000 7f45d1bd7740 1 -- start start 2024-08-17T02:22:33.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.502+0000 7f45d1bd7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x21dcae0 0x24101d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:33.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.502+0000 7f45d1bd7740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x21dc710 0x2410710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:33.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.502+0000 7f45d1bd7740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x2227790 0x2413c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:33.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.502+0000 7f45d1bd7740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x2388ba0 con 0x21dc710 2024-08-17T02:22:33.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.502+0000 7f45d1bd7740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x2384b40 con 0x21dcae0 2024-08-17T02:22:33.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.502+0000 7f45d1bd7740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x234a0a0 con 0x2227790 2024-08-17T02:22:33.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.502+0000 7f45ccec3700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x21dc710 0x2410710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:33.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.502+0000 7f45ccec3700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x21dc710 0x2410710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42600/0 (socket says 172.21.15.104:42600) 2024-08-17T02:22:33.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.502+0000 7f45ccec3700 1 -- 172.21.15.104:0/1212294335 learned_addr learned my addr 172.21.15.104:0/1212294335 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:33.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.502+0000 7f45cdec5700 1 --2- 172.21.15.104:0/1212294335 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x2227790 0x2413c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:33.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.502+0000 7f45cd6c4700 1 --2- 172.21.15.104:0/1212294335 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x21dcae0 0x24101d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:33.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.502+0000 7f45ccec3700 1 -- 172.21.15.104:0/1212294335 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x2227790 msgr2=0x2413c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:33.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.502+0000 7f45ccec3700 1 --2- 172.21.15.104:0/1212294335 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x2227790 0x2413c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:33.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.502+0000 7f45ccec3700 1 -- 172.21.15.104:0/1212294335 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x21dcae0 msgr2=0x24101d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:33.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.502+0000 7f45ccec3700 1 --2- 172.21.15.104:0/1212294335 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x21dcae0 0x24101d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:33.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.502+0000 7f45ccec3700 1 -- 172.21.15.104:0/1212294335 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x22289e0 con 0x21dc710 2024-08-17T02:22:33.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.502+0000 7f45cdec5700 1 --2- 172.21.15.104:0/1212294335 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x2227790 0x2413c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:22:33.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.502+0000 7f45ccec3700 1 --2- 172.21.15.104:0/1212294335 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x21dc710 0x2410710 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f45c4003750 tx=0x7f45c4007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b8e0c6ca76bbc6d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:33.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.502+0000 7f45b27fc700 1 -- 172.21.15.104:0/1212294335 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c4003370 con 0x21dc710 2024-08-17T02:22:33.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.502+0000 7f45b27fc700 1 -- 172.21.15.104:0/1212294335 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c40026b0 con 0x21dc710 2024-08-17T02:22:33.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.502+0000 7f45b27fc700 1 -- 172.21.15.104:0/1212294335 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c4002a30 con 0x21dc710 2024-08-17T02:22:33.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.502+0000 7f45d1bd7740 1 -- 172.21.15.104:0/1212294335 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x21dc710 msgr2=0x2410710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:33.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.502+0000 7f45d1bd7740 1 --2- 172.21.15.104:0/1212294335 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x21dc710 0x2410710 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f45c4003750 tx=0x7f45c4007ea0 comp rx=0 tx=0).stop 2024-08-17T02:22:33.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.502+0000 7f45d1bd7740 1 -- 172.21.15.104:0/1212294335 shutdown_connections 2024-08-17T02:22:33.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.502+0000 7f45d1bd7740 1 --2- 172.21.15.104:0/1212294335 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x2227790 0x2413c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:33.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.502+0000 7f45d1bd7740 1 --2- 172.21.15.104:0/1212294335 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x21dc710 0x2410710 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:33.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.502+0000 7f45d1bd7740 1 --2- 172.21.15.104:0/1212294335 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x21dcae0 0x24101d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:33.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.502+0000 7f45d1bd7740 1 -- 172.21.15.104:0/1212294335 >> 172.21.15.104:0/1212294335 conn(0x21dceb0 msgr2=0x24160b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:33.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.502+0000 7f45d1bd7740 1 -- 172.21.15.104:0/1212294335 shutdown_connections 2024-08-17T02:22:33.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.502+0000 7f45d1bd7740 1 -- 172.21.15.104:0/1212294335 wait complete. 2024-08-17T02:22:33.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.502+0000 7f45d1bd7740 1 -- start start 2024-08-17T02:22:33.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.502+0000 7f45d1bd7740 1 Processor -- start 2024-08-17T02:22:33.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.506+0000 7f45d1bd7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x21dc710 0x245daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:33.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.506+0000 7f45d1bd7740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x21dcae0 0x245dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:33.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.506+0000 7f45d1bd7740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x2227790 0x2417fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:33.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.506+0000 7f45d1bd7740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x2349d40 con 0x2227790 2024-08-17T02:22:33.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.506+0000 7f45d1bd7740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x2322970 con 0x21dc710 2024-08-17T02:22:33.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.506+0000 7f45d1bd7740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x2384350 con 0x21dcae0 2024-08-17T02:22:33.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.506+0000 7f45d1bd7740 10 client.0 _ll_register_callbacks cb 0x2326f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:22:33.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.506+0000 7f45cdec5700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x2227790 0x2417fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:33.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.506+0000 7f45cdec5700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x2227790 0x2417fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42612/0 (socket says 172.21.15.104:42612) 2024-08-17T02:22:33.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.506+0000 7f45cdec5700 1 -- 172.21.15.104:0/4140205023 learned_addr learned my addr 172.21.15.104:0/4140205023 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:33.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.506+0000 7f45cd6c4700 1 --2- 172.21.15.104:0/4140205023 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x21dc710 0x245daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:33.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.506+0000 7f45ccec3700 1 --2- 172.21.15.104:0/4140205023 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x21dcae0 0x245dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:33.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.506+0000 7f45cdec5700 1 -- 172.21.15.104:0/4140205023 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x21dcae0 msgr2=0x245dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:33.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.506+0000 7f45cdec5700 1 --2- 172.21.15.104:0/4140205023 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x21dcae0 0x245dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:33.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.506+0000 7f45cdec5700 1 -- 172.21.15.104:0/4140205023 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x21dc710 msgr2=0x245daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:33.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.506+0000 7f45cdec5700 1 --2- 172.21.15.104:0/4140205023 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x21dc710 0x245daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:33.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.506+0000 7f45cdec5700 1 -- 172.21.15.104:0/4140205023 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45c80b0cd0 con 0x2227790 2024-08-17T02:22:33.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.506+0000 7f45ccec3700 1 --2- 172.21.15.104:0/4140205023 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x21dcae0 0x245dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:22:33.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.506+0000 7f45cdec5700 1 --2- 172.21.15.104:0/4140205023 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x2227790 0x2417fd0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f45c0052510 tx=0x7f45c000bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59fec854642a88d6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:33.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.506+0000 7f45a77fe700 10 client.0 ms_handle_connect on v2:172.21.15.104:3300/0 2024-08-17T02:22:33.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.506+0000 7f45a77fe700 1 -- 172.21.15.104:0/4140205023 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c000e040 con 0x2227790 2024-08-17T02:22:33.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.506+0000 7f45a77fe700 1 -- 172.21.15.104:0/4140205023 <== mon.0 v2:172.21.15.104:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f45c0050bb0 con 0x2227790 2024-08-17T02:22:33.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.506+0000 7f45d1bd7740 1 -- 172.21.15.104:0/4140205023 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x21ea260 con 0x2227790 2024-08-17T02:22:33.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.506+0000 7f45a77fe700 1 -- 172.21.15.104:0/4140205023 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45c0052cc0 con 0x2227790 2024-08-17T02:22:33.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.506+0000 7f45d1bd7740 10 client.4632 fetch_fsmap learned FSMap version 7 2024-08-17T02:22:33.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.506+0000 7f45d1bd7740 1 -- 172.21.15.104:0/4140205023 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x2352370 con 0x2227790 2024-08-17T02:22:33.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.506+0000 7f45a77fe700 1 -- 172.21.15.104:0/4140205023 <== mon.0 v2:172.21.15.104:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x21ea260 con 0x2227790 2024-08-17T02:22:33.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.506+0000 7f45a77fe700 1 -- 172.21.15.104:0/4140205023 <== mon.0 v2:172.21.15.104:3300/0 5 ==== fsmap(e 7) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f45c0051d00 con 0x2227790 2024-08-17T02:22:33.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.506+0000 7f45d1bd7740 10 client.4632 fetch_fsmap finished waiting for FSMap version 7 2024-08-17T02:22:33.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.506+0000 7f45d1bd7740 10 client.4632 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-17T02:22:33.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.506+0000 7f45d1bd7740 20 client.4632 populate_metadata read hostname 'smithi104' 2024-08-17T02:22:33.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.506+0000 7f45d1bd7740 1 --2- 172.21.15.104:0/4140205023 >> [v2:172.21.15.117:6836/4197149840,v1:172.21.15.117:6837/4197149840] conn(0x2466c30 0x2469010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:33.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.506+0000 7f45d1bd7740 4 client.4632 mds_command: new command op to 4288 tid=0[{"prefix": "get_command_descriptions"}] 2024-08-17T02:22:33.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.506+0000 7f45d1bd7740 1 -- 172.21.15.104:0/4140205023 --> [v2:172.21.15.117:6836/4197149840,v1:172.21.15.117:6837/4197149840] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x22344e0 con 0x2466c30 2024-08-17T02:22:33.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.506+0000 7f45cd6c4700 1 --2- 172.21.15.104:0/4140205023 >> [v2:172.21.15.117:6836/4197149840,v1:172.21.15.117:6837/4197149840] conn(0x2466c30 0x2469010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:33.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.514+0000 7f45a77fe700 10 client.4632 ms_handle_connect on v2:172.21.15.117:6836/4197149840 2024-08-17T02:22:33.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.514+0000 7f45cd6c4700 1 --2- 172.21.15.104:0/4140205023 >> [v2:172.21.15.117:6836/4197149840,v1:172.21.15.117:6837/4197149840] conn(0x2466c30 0x2469010 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c27f1ed04586b01e server_cookie=1196e71fcde482f2 in_seq=0 out_seq=0 2024-08-17T02:22:33.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.514+0000 7f45a77fe700 1 -- 172.21.15.104:0/4140205023 <== mds.0 v2:172.21.15.117:6836/4197149840 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17536 (crc 0 0 0) 0x22344e0 con 0x2466c30 2024-08-17T02:22:33.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.514+0000 7f45a77fe700 10 client.4632 handle_command_reply: tid=0 2024-08-17T02:22:33.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.514+0000 7f45d1bd7740 1 client.4632 shutdown 2024-08-17T02:22:33.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.514+0000 7f45d1bd7740 1 -- 172.21.15.104:0/4140205023 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x2227790 msgr2=0x2417fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:33.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.514+0000 7f45d1bd7740 1 --2- 172.21.15.104:0/4140205023 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x2227790 0x2417fd0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f45c0052510 tx=0x7f45c000bfd0 comp rx=0 tx=0).stop 2024-08-17T02:22:33.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.514+0000 7f45d1bd7740 1 -- 172.21.15.104:0/4140205023 shutdown_connections 2024-08-17T02:22:33.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.514+0000 7f45d1bd7740 1 --2- 172.21.15.104:0/4140205023 >> [v2:172.21.15.117:6836/4197149840,v1:172.21.15.117:6837/4197149840] conn(0x2466c30 0x2469010 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:33.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.514+0000 7f45d1bd7740 1 --2- 172.21.15.104:0/4140205023 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x2227790 0x2417fd0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:33.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.514+0000 7f45a77fe700 0 client.4632 ms_handle_reset on v2:172.21.15.117:6836/4197149840 2024-08-17T02:22:33.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.514+0000 7f45d1bd7740 1 --2- 172.21.15.104:0/4140205023 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x21dcae0 0x245dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:33.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.514+0000 7f45d1bd7740 1 --2- 172.21.15.104:0/4140205023 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x21dc710 0x245daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:33.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.514+0000 7f45d1bd7740 1 -- 172.21.15.104:0/4140205023 >> 172.21.15.104:0/4140205023 conn(0x21dceb0 msgr2=0x2415ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:33.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.514+0000 7f45d1bd7740 1 -- 172.21.15.104:0/4140205023 shutdown_connections 2024-08-17T02:22:33.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.514+0000 7f45d1bd7740 1 -- 172.21.15.104:0/4140205023 wait complete. 2024-08-17T02:22:33.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.514+0000 7f45d1bd7740 20 client.4632 trim_cache size 0 max 16384 2024-08-17T02:22:33.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.534+0000 7f45d1bd7740 1 Processor -- start 2024-08-17T02:22:33.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.534+0000 7f45d1bd7740 1 -- start start 2024-08-17T02:22:33.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.534+0000 7f45d1bd7740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x21dc710 0x24101a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:33.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.534+0000 7f45d1bd7740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x21dcae0 0x24106e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:33.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.534+0000 7f45d1bd7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x2227790 0x2413c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:33.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.534+0000 7f45d1bd7740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x237f080 con 0x21dc710 2024-08-17T02:22:33.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.534+0000 7f45d1bd7740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x2259650 con 0x2227790 2024-08-17T02:22:33.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.534+0000 7f45d1bd7740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x2382500 con 0x21dcae0 2024-08-17T02:22:33.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.534+0000 7f45cd6c4700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x21dc710 0x24101a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:33.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.534+0000 7f45cd6c4700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x21dc710 0x24101a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42618/0 (socket says 172.21.15.104:42618) 2024-08-17T02:22:33.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.534+0000 7f45cd6c4700 1 -- 172.21.15.104:0/2197584705 learned_addr learned my addr 172.21.15.104:0/2197584705 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:33.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.534+0000 7f45ccec3700 1 --2- 172.21.15.104:0/2197584705 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x21dcae0 0x24106e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:33.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.534+0000 7f45cdec5700 1 --2- 172.21.15.104:0/2197584705 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x2227790 0x2413c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:33.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.534+0000 7f45cd6c4700 1 -- 172.21.15.104:0/2197584705 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x21dcae0 msgr2=0x24106e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:33.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.534+0000 7f45cd6c4700 1 --2- 172.21.15.104:0/2197584705 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x21dcae0 0x24106e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:33.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.534+0000 7f45cd6c4700 1 -- 172.21.15.104:0/2197584705 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x2227790 msgr2=0x2413c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:33.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.534+0000 7f45cd6c4700 1 --2- 172.21.15.104:0/2197584705 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x2227790 0x2413c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:33.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.534+0000 7f45cd6c4700 1 -- 172.21.15.104:0/2197584705 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2338d80 con 0x21dc710 2024-08-17T02:22:33.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.534+0000 7f45cd6c4700 1 --2- 172.21.15.104:0/2197584705 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x21dc710 0x24101a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x23001a0 tx=0x7f45b8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2325b18bf2c05c2c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:33.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.534+0000 7f45b2ffd700 1 -- 172.21.15.104:0/2197584705 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b8010e50 con 0x21dc710 2024-08-17T02:22:33.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.534+0000 7f45b2ffd700 1 -- 172.21.15.104:0/2197584705 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b802c070 con 0x21dc710 2024-08-17T02:22:33.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.534+0000 7f45b2ffd700 1 -- 172.21.15.104:0/2197584705 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b8028030 con 0x21dc710 2024-08-17T02:22:33.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.534+0000 7f45d1bd7740 1 -- 172.21.15.104:0/2197584705 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x21dc710 msgr2=0x24101a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:33.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.534+0000 7f45d1bd7740 1 --2- 172.21.15.104:0/2197584705 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x21dc710 0x24101a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x23001a0 tx=0x7f45b8015000 comp rx=0 tx=0).stop 2024-08-17T02:22:33.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.534+0000 7f45d1bd7740 1 -- 172.21.15.104:0/2197584705 shutdown_connections 2024-08-17T02:22:33.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.534+0000 7f45d1bd7740 1 --2- 172.21.15.104:0/2197584705 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x2227790 0x2413c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:33.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.534+0000 7f45d1bd7740 1 --2- 172.21.15.104:0/2197584705 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x21dcae0 0x24106e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:33.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.534+0000 7f45d1bd7740 1 --2- 172.21.15.104:0/2197584705 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x21dc710 0x24101a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:33.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.534+0000 7f45d1bd7740 1 -- 172.21.15.104:0/2197584705 >> 172.21.15.104:0/2197584705 conn(0x21dceb0 msgr2=0x245ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:33.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.534+0000 7f45d1bd7740 1 -- 172.21.15.104:0/2197584705 shutdown_connections 2024-08-17T02:22:33.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.534+0000 7f45d1bd7740 1 -- 172.21.15.104:0/2197584705 wait complete. 2024-08-17T02:22:33.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.534+0000 7f45d1bd7740 1 -- start start 2024-08-17T02:22:33.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.534+0000 7f45d1bd7740 1 Processor -- start 2024-08-17T02:22:33.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.538+0000 7f45d1bd7740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x21dc710 0x246a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:33.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.538+0000 7f45d1bd7740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x21dcae0 0x247a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:33.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.538+0000 7f45d1bd7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x2227790 0x247abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:33.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.538+0000 7f45d1bd7740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x2333140 con 0x21dc710 2024-08-17T02:22:33.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.538+0000 7f45d1bd7740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x232fec0 con 0x2227790 2024-08-17T02:22:33.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.538+0000 7f45d1bd7740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x238b070 con 0x21dcae0 2024-08-17T02:22:33.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.538+0000 7f45d1bd7740 10 client.0 _ll_register_callbacks cb 0x21a89d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:22:33.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.538+0000 7f45cd6c4700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x21dc710 0x246a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:33.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.538+0000 7f45cd6c4700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x21dc710 0x246a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42632/0 (socket says 172.21.15.104:42632) 2024-08-17T02:22:33.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.538+0000 7f45cd6c4700 1 -- 172.21.15.104:0/3685591749 learned_addr learned my addr 172.21.15.104:0/3685591749 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:33.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.538+0000 7f45ccec3700 1 --2- 172.21.15.104:0/3685591749 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x21dcae0 0x247a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:33.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.538+0000 7f45cdec5700 1 --2- 172.21.15.104:0/3685591749 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x2227790 0x247abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:33.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.538+0000 7f45cd6c4700 1 -- 172.21.15.104:0/3685591749 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x21dcae0 msgr2=0x247a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:33.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.538+0000 7f45cd6c4700 1 --2- 172.21.15.104:0/3685591749 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x21dcae0 0x247a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:33.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.538+0000 7f45cd6c4700 1 -- 172.21.15.104:0/3685591749 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x2227790 msgr2=0x247abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:33.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.538+0000 7f45cd6c4700 1 --2- 172.21.15.104:0/3685591749 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x2227790 0x247abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:33.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.538+0000 7f45cd6c4700 1 -- 172.21.15.104:0/3685591749 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45b801f040 con 0x21dc710 2024-08-17T02:22:33.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.538+0000 7f45cd6c4700 1 --2- 172.21.15.104:0/3685591749 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x21dc710 0x246a3a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f45b80109a0 tx=0x7f45b8019070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dda17b6b32d92367 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:33.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.538+0000 7f45a77fe700 10 client.0 ms_handle_connect on v2:172.21.15.104:3300/0 2024-08-17T02:22:33.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.538+0000 7f45a77fe700 1 -- 172.21.15.104:0/3685591749 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b8016e20 con 0x21dc710 2024-08-17T02:22:33.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.538+0000 7f45a77fe700 1 -- 172.21.15.104:0/3685591749 <== mon.0 v2:172.21.15.104:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f45b80287f0 con 0x21dc710 2024-08-17T02:22:33.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.538+0000 7f45d1bd7740 1 -- 172.21.15.104:0/3685591749 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f45c40026b0 con 0x21dc710 2024-08-17T02:22:33.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.538+0000 7f45a77fe700 1 -- 172.21.15.104:0/3685591749 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45b8028bc0 con 0x21dc710 2024-08-17T02:22:33.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.538+0000 7f45d1bd7740 10 client.4638 fetch_fsmap learned FSMap version 7 2024-08-17T02:22:33.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.538+0000 7f45d1bd7740 1 -- 172.21.15.104:0/3685591749 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x232d130 con 0x21dc710 2024-08-17T02:22:33.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.538+0000 7f45a77fe700 1 -- 172.21.15.104:0/3685591749 <== mon.0 v2:172.21.15.104:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c40026b0 con 0x21dc710 2024-08-17T02:22:33.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.538+0000 7f45a77fe700 1 -- 172.21.15.104:0/3685591749 <== mon.0 v2:172.21.15.104:3300/0 5 ==== fsmap(e 7) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f45b8028d20 con 0x21dc710 2024-08-17T02:22:33.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.538+0000 7f45d1bd7740 10 client.4638 fetch_fsmap finished waiting for FSMap version 7 2024-08-17T02:22:33.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.538+0000 7f45d1bd7740 10 client.4638 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-17T02:22:33.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.538+0000 7f45d1bd7740 20 client.4638 populate_metadata read hostname 'smithi104' 2024-08-17T02:22:33.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.538+0000 7f45d1bd7740 1 --2- 172.21.15.104:0/3685591749 >> [v2:172.21.15.117:6836/4197149840,v1:172.21.15.117:6837/4197149840] conn(0x247b120 0x24bdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:33.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.538+0000 7f45d1bd7740 4 client.4638 mds_command: new command op to 4288 tid=0[{"prefix": "status"}] 2024-08-17T02:22:33.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.538+0000 7f45d1bd7740 1 -- 172.21.15.104:0/3685591749 --> [v2:172.21.15.117:6836/4197149840,v1:172.21.15.117:6837/4197149840] -- command(tid 0: {"prefix": "status"}) v1 -- 0x2259260 con 0x247b120 2024-08-17T02:22:33.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.542+0000 7f45ccec3700 1 --2- 172.21.15.104:0/3685591749 >> [v2:172.21.15.117:6836/4197149840,v1:172.21.15.117:6837/4197149840] conn(0x247b120 0x24bdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:33.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.542+0000 7f45a77fe700 10 client.4638 ms_handle_connect on v2:172.21.15.117:6836/4197149840 2024-08-17T02:22:33.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.542+0000 7f45ccec3700 1 --2- 172.21.15.104:0/3685591749 >> [v2:172.21.15.117:6836/4197149840,v1:172.21.15.117:6837/4197149840] conn(0x247b120 0x24bdef0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=721da557282f0d72 server_cookie=367119c51ce1fd16 in_seq=0 out_seq=0 2024-08-17T02:22:33.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.542+0000 7f45a77fe700 1 -- 172.21.15.104:0/3685591749 <== mds.0 v2:172.21.15.117:6836/4197149840 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x2259260 con 0x247b120 2024-08-17T02:22:33.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.542+0000 7f45a77fe700 10 client.4638 handle_command_reply: tid=0 2024-08-17T02:22:33.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.542+0000 7f45d1bd7740 1 client.4638 shutdown 2024-08-17T02:22:33.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.542+0000 7f45d1bd7740 1 -- 172.21.15.104:0/3685591749 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x21dc710 msgr2=0x246a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:33.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.542+0000 7f45d1bd7740 1 --2- 172.21.15.104:0/3685591749 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x21dc710 0x246a3a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f45b80109a0 tx=0x7f45b8019070 comp rx=0 tx=0).stop 2024-08-17T02:22:33.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.542+0000 7f45d1bd7740 1 -- 172.21.15.104:0/3685591749 shutdown_connections 2024-08-17T02:22:33.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.542+0000 7f45d1bd7740 1 --2- 172.21.15.104:0/3685591749 >> [v2:172.21.15.117:6836/4197149840,v1:172.21.15.117:6837/4197149840] conn(0x247b120 0x24bdef0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:33.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.542+0000 7f45d1bd7740 1 --2- 172.21.15.104:0/3685591749 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x2227790 0x247abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:33.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.542+0000 7f45a77fe700 0 client.4638 ms_handle_reset on v2:172.21.15.117:6836/4197149840 2024-08-17T02:22:33.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.542+0000 7f45d1bd7740 1 --2- 172.21.15.104:0/3685591749 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x21dcae0 0x247a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:33.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.542+0000 7f45d1bd7740 1 --2- 172.21.15.104:0/3685591749 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x21dc710 0x246a3a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:33.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.542+0000 7f45d1bd7740 1 -- 172.21.15.104:0/3685591749 >> 172.21.15.104:0/3685591749 conn(0x21dceb0 msgr2=0x245c570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:33.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.542+0000 7f45d1bd7740 1 -- 172.21.15.104:0/3685591749 shutdown_connections 2024-08-17T02:22:33.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.542+0000 7f45d1bd7740 1 -- 172.21.15.104:0/3685591749 wait complete. 2024-08-17T02:22:33.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.542+0000 7f45d1bd7740 20 client.4638 trim_cache size 0 max 16384 2024-08-17T02:22:33.552 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-08-17T02:22:33.552 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_fsid": "fd5f7fb8-d34b-49bb-89a8-62b7dad1bc25", 2024-08-17T02:22:33.553 INFO:teuthology.orchestra.run.smithi104.stdout: "whoami": 0, 2024-08-17T02:22:33.553 INFO:teuthology.orchestra.run.smithi104.stdout: "id": 4288, 2024-08-17T02:22:33.553 INFO:teuthology.orchestra.run.smithi104.stdout: "want_state": "up:active", 2024-08-17T02:22:33.553 INFO:teuthology.orchestra.run.smithi104.stdout: "state": "up:active", 2024-08-17T02:22:33.553 INFO:teuthology.orchestra.run.smithi104.stdout: "fs_name": "cephfs", 2024-08-17T02:22:33.553 INFO:teuthology.orchestra.run.smithi104.stdout: "rank_uptime": 11.346605059, 2024-08-17T02:22:33.553 INFO:teuthology.orchestra.run.smithi104.stdout: "mdsmap_epoch": 7, 2024-08-17T02:22:33.553 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_epoch": 23, 2024-08-17T02:22:33.553 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_epoch_barrier": 23, 2024-08-17T02:22:33.553 INFO:teuthology.orchestra.run.smithi104.stdout: "uptime": 17.926273493 2024-08-17T02:22:33.553 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-08-17T02:22:33.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.542+0000 7f45ce6c6700 1 -- 172.21.15.104:0/895520036 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f45ac060860 msgr2=0x7f45ac062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:33.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.542+0000 7f45ce6c6700 1 --2- 172.21.15.104:0/895520036 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f45ac060860 0x7f45ac062d10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f45b8006fd0 tx=0x7f45b8008040 comp rx=0 tx=0).stop 2024-08-17T02:22:33.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.542+0000 7f45ce6c6700 1 -- 172.21.15.104:0/895520036 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f45c81590a0 msgr2=0x7f45c813ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:33.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.542+0000 7f45ce6c6700 1 --2- 172.21.15.104:0/895520036 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f45c81590a0 0x7f45c813ff10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f45c806d390 tx=0x7f45c0018000 comp rx=0 tx=0).stop 2024-08-17T02:22:33.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.542+0000 7f45ce6c6700 1 -- 172.21.15.104:0/895520036 shutdown_connections 2024-08-17T02:22:33.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.542+0000 7f45ce6c6700 1 --2- 172.21.15.104:0/895520036 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f45ac060860 0x7f45ac062d10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:33.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.542+0000 7f45ce6c6700 1 --2- 172.21.15.104:0/895520036 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f45c81590a0 0x7f45c813ff10 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:33.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.542+0000 7f45ce6c6700 1 --2- 172.21.15.104:0/895520036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45c80b23d0 0x7f45c8169eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:33.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.542+0000 7f45ce6c6700 1 --2- 172.21.15.104:0/895520036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45c80ae2e0 0x7f45c8159ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:33.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.542+0000 7f45ce6c6700 1 -- 172.21.15.104:0/895520036 >> 172.21.15.104:0/895520036 conn(0x7f45c80c9840 msgr2=0x7f45c80a5ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:33.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.542+0000 7f45ce6c6700 1 -- 172.21.15.104:0/895520036 shutdown_connections 2024-08-17T02:22:33.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.542+0000 7f45ce6c6700 1 -- 172.21.15.104:0/895520036 wait complete. 2024-08-17T02:22:33.566 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-08-17T02:22:33.593 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-08-17T02:22:33.593 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-08-17T02:22:33.593 INFO:tasks.ceph_fuse:client.0 config is {} 2024-08-17T02:22:33.594 INFO:tasks.ceph_fuse:client.2 config is {} 2024-08-17T02:22:33.594 INFO:tasks.ceph_fuse:client.1 config is {} 2024-08-17T02:22:33.594 INFO:tasks.ceph_fuse:client.3 config is {} 2024-08-17T02:22:33.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:33.594 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2024-08-17T02:22:33.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:33.603 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link delete ceph-brx 2024-08-17T02:22:33.621 INFO:teuthology.orchestra.run.smithi104.stderr:Cannot find device "ceph-brx" 2024-08-17T02:22:33.621 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:22:33.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:33.622 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2024-08-17T02:22:33.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:33.630 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link delete ceph-brx 2024-08-17T02:22:33.651 INFO:teuthology.orchestra.run.smithi117.stderr:Cannot find device "ceph-brx" 2024-08-17T02:22:33.652 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:22:33.652 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-08-17T02:22:33.653 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:22:33.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.770+0000 7f89863e5700 1 Processor -- start 2024-08-17T02:22:33.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.770+0000 7f89863e5700 1 -- start start 2024-08-17T02:22:33.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.770+0000 7f89863e5700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89800c8610 0x7f89800c1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:33.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.770+0000 7f89863e5700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f89800cbba0 0x7f89800cc000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:33.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.770+0000 7f89863e5700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89800cc540 con 0x7f8980159140 2024-08-17T02:22:33.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.770+0000 7f89863e5700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89800c8dd0 con 0x7f89800cbba0 2024-08-17T02:22:33.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.770+0000 7f89863e5700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8980068f90 con 0x7f89800c8610 2024-08-17T02:22:33.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.770+0000 7f897ffff700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f8980159140 0x7f89800ca280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:56844/0 (socket says 172.21.15.104:56844) 2024-08-17T02:22:33.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.770+0000 7f897ffff700 1 -- 172.21.15.104:0/2666216197 learned_addr learned my addr 172.21.15.104:0/2666216197 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:33.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.770+0000 7f8984982700 1 --2- 172.21.15.104:0/2666216197 >> v2:172.21.15.104:3300/0 conn(0x7f89800cbba0 0x7f89800cc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:33.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.770+0000 7f897f7fe700 1 --2- 172.21.15.104:0/2666216197 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89800c8610 0x7f89800c1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:33.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.770+0000 7f897effd700 1 -- 172.21.15.104:0/2666216197 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1894100644 0 0) 0x7f8978001490 con 0x7f8980159140 2024-08-17T02:22:33.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.770+0000 7f897effd700 1 -- 172.21.15.104:0/2666216197 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f896c003570 con 0x7f8980159140 2024-08-17T02:22:33.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.770+0000 7f8984982700 1 -- 172.21.15.104:0/2666216197 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89800c8610 msgr2=0x7f89800c1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:33.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.770+0000 7f8984982700 1 --2- 172.21.15.104:0/2666216197 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89800c8610 0x7f89800c1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:33.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.770+0000 7f8984982700 1 -- 172.21.15.104:0/2666216197 >> v1:172.21.15.104:6789/0 conn(0x7f8980159140 legacy=0x7f89800ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:33.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.770+0000 7f8984982700 1 -- 172.21.15.104:0/2666216197 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89800c8af0 con 0x7f89800cbba0 2024-08-17T02:22:33.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.770+0000 7f8984982700 1 --2- 172.21.15.104:0/2666216197 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f89800cbba0 0x7f89800cc000 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f89700098e0 tx=0x7f89700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3036247aa451efa9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:33.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.770+0000 7f897effd700 1 -- 172.21.15.104:0/2666216197 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8970011630 con 0x7f89800cbba0 2024-08-17T02:22:33.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.770+0000 7f897effd700 1 -- 172.21.15.104:0/2666216197 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8970011790 con 0x7f89800cbba0 2024-08-17T02:22:33.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.770+0000 7f897effd700 1 -- 172.21.15.104:0/2666216197 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8970011b30 con 0x7f89800cbba0 2024-08-17T02:22:33.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.770+0000 7f89863e5700 1 -- 172.21.15.104:0/2666216197 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f89800cbba0 msgr2=0x7f89800cc000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:33.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.770+0000 7f89863e5700 1 --2- 172.21.15.104:0/2666216197 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f89800cbba0 0x7f89800cc000 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f89700098e0 tx=0x7f89700091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:33.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.770+0000 7f89863e5700 1 -- 172.21.15.104:0/2666216197 shutdown_connections 2024-08-17T02:22:33.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.770+0000 7f89863e5700 1 --2- 172.21.15.104:0/2666216197 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f89800cbba0 0x7f89800cc000 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:33.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.770+0000 7f89863e5700 1 --2- 172.21.15.104:0/2666216197 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89800c8610 0x7f89800c1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:33.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.770+0000 7f89863e5700 1 -- 172.21.15.104:0/2666216197 >> 172.21.15.104:0/2666216197 conn(0x7f89800caa40 msgr2=0x7f89800cae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:33.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.770+0000 7f89863e5700 1 -- 172.21.15.104:0/2666216197 shutdown_connections 2024-08-17T02:22:33.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.770+0000 7f89863e5700 1 -- 172.21.15.104:0/2666216197 wait complete. 2024-08-17T02:22:33.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.778+0000 7f89863e5700 1 Processor -- start 2024-08-17T02:22:33.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.778+0000 7f89863e5700 1 -- start start 2024-08-17T02:22:33.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.782+0000 7f89863e5700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f89800c8610 0x7f89800c6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:33.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.782+0000 7f89863e5700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89800cbba0 0x7f8980157a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:33.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.782+0000 7f89863e5700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8980159140 0x7f89801481c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:33.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.782+0000 7f89863e5700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89800c6ba0 con 0x7f89800c8610 2024-08-17T02:22:33.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.782+0000 7f89863e5700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89800c79e0 con 0x7f8980159140 2024-08-17T02:22:33.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.782+0000 7f89863e5700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8980157f40 con 0x7f89800cbba0 2024-08-17T02:22:33.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.782+0000 7f897ffff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f89800c8610 0x7f89800c6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:33.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.782+0000 7f897ffff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f89800c8610 0x7f89800c6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42658/0 (socket says 172.21.15.104:42658) 2024-08-17T02:22:33.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.782+0000 7f897ffff700 1 -- 172.21.15.104:0/2238041425 learned_addr learned my addr 172.21.15.104:0/2238041425 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:33.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.782+0000 7f897f7fe700 1 --2- 172.21.15.104:0/2238041425 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89800cbba0 0x7f8980157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:33.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.782+0000 7f8984982700 1 --2- 172.21.15.104:0/2238041425 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8980159140 0x7f89801481c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:33.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.782+0000 7f897ffff700 1 -- 172.21.15.104:0/2238041425 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89800cbba0 msgr2=0x7f8980157a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:33.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.782+0000 7f897ffff700 1 --2- 172.21.15.104:0/2238041425 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89800cbba0 0x7f8980157a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:33.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.782+0000 7f897ffff700 1 -- 172.21.15.104:0/2238041425 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8980159140 msgr2=0x7f89801481c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:33.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.782+0000 7f897ffff700 1 --2- 172.21.15.104:0/2238041425 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8980159140 0x7f89801481c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:33.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.782+0000 7f897ffff700 1 -- 172.21.15.104:0/2238041425 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8970009420 con 0x7f89800c8610 2024-08-17T02:22:33.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.782+0000 7f897ffff700 1 --2- 172.21.15.104:0/2238041425 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f89800c8610 0x7f89800c6660 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f897800cc70 tx=0x7f8978001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:33.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.782+0000 7f8977fff700 1 -- 172.21.15.104:0/2238041425 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897800a850 con 0x7f89800c8610 2024-08-17T02:22:33.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.782+0000 7f8977fff700 1 -- 172.21.15.104:0/2238041425 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f897800a9d0 con 0x7f89800c8610 2024-08-17T02:22:33.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.782+0000 7f89863e5700 1 -- 172.21.15.104:0/2238041425 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89800c7e70 con 0x7f89800c8610 2024-08-17T02:22:33.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.782+0000 7f8977fff700 1 -- 172.21.15.104:0/2238041425 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897800ad90 con 0x7f89800c8610 2024-08-17T02:22:33.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.782+0000 7f89863e5700 1 -- 172.21.15.104:0/2238041425 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89800c70b0 con 0x7f89800c8610 2024-08-17T02:22:33.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.782+0000 7f89863e5700 1 -- 172.21.15.104:0/2238041425 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89800644b0 con 0x7f89800c8610 2024-08-17T02:22:33.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.782+0000 7f8977fff700 1 -- 172.21.15.104:0/2238041425 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8978007300 con 0x7f89800c8610 2024-08-17T02:22:33.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.782+0000 7f8977fff700 1 --2- 172.21.15.104:0/2238041425 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8960060860 0x7f8960062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:33.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.782+0000 7f8977fff700 1 -- 172.21.15.104:0/2238041425 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f897807cd40 con 0x7f89800c8610 2024-08-17T02:22:33.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.782+0000 7f897f7fe700 1 --2- 172.21.15.104:0/2238041425 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8960060860 0x7f8960062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:33.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.782+0000 7f897f7fe700 1 --2- 172.21.15.104:0/2238041425 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8960060860 0x7f8960062d10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f898015db60 tx=0x7f89680091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:33.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.794+0000 7f8977fff700 1 -- 172.21.15.104:0/2238041425 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f897804d210 con 0x7f89800c8610 2024-08-17T02:22:33.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.990+0000 7f89863e5700 1 -- 172.21.15.104:0/2238041425 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f89800c4390 con 0x7f89800c8610 2024-08-17T02:22:33.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.990+0000 7f8977fff700 1 -- 172.21.15.104:0/2238041425 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8978050830 con 0x7f89800c8610 2024-08-17T02:22:33.999 INFO:teuthology.orchestra.run.smithi104.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:22:34.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.994+0000 7f89863e5700 1 -- 172.21.15.104:0/2238041425 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8960060860 msgr2=0x7f8960062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:34.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.994+0000 7f89863e5700 1 --2- 172.21.15.104:0/2238041425 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8960060860 0x7f8960062d10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f898015db60 tx=0x7f89680091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:34.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.994+0000 7f89863e5700 1 -- 172.21.15.104:0/2238041425 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f89800c8610 msgr2=0x7f89800c6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:34.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.994+0000 7f89863e5700 1 --2- 172.21.15.104:0/2238041425 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f89800c8610 0x7f89800c6660 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f897800cc70 tx=0x7f8978001a70 comp rx=0 tx=0).stop 2024-08-17T02:22:34.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.994+0000 7f89863e5700 1 -- 172.21.15.104:0/2238041425 shutdown_connections 2024-08-17T02:22:34.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.994+0000 7f89863e5700 1 --2- 172.21.15.104:0/2238041425 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8960060860 0x7f8960062d10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:34.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.994+0000 7f89863e5700 1 --2- 172.21.15.104:0/2238041425 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8980159140 0x7f89801481c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:34.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.994+0000 7f89863e5700 1 --2- 172.21.15.104:0/2238041425 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89800cbba0 0x7f8980157a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:34.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.994+0000 7f89863e5700 1 --2- 172.21.15.104:0/2238041425 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f89800c8610 0x7f89800c6660 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:34.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.994+0000 7f89863e5700 1 -- 172.21.15.104:0/2238041425 >> 172.21.15.104:0/2238041425 conn(0x7f89800caa40 msgr2=0x7f8980158330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:34.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.994+0000 7f89863e5700 1 -- 172.21.15.104:0/2238041425 shutdown_connections 2024-08-17T02:22:34.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:33.994+0000 7f89863e5700 1 -- 172.21.15.104:0/2238041425 wait complete. 2024-08-17T02:22:34.013 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:22:34.013 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:22:34.013 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi104.front.sepia.ceph.com 2024-08-17T02:22:34.013 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-17T02:22:34.013 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-17T02:22:34.013 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:22:34.013 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:22:34.013 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:22:34.014 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:22:34.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:34.014 DEBUG:teuthology.orchestra.run.smithi104:> ip addr 2024-08-17T02:22:34.021 INFO:teuthology.orchestra.run.smithi104.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:22:34.022 INFO:teuthology.orchestra.run.smithi104.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:22:34.022 INFO:teuthology.orchestra.run.smithi104.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:22:34.022 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:22:34.022 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 ::1/128 scope host 2024-08-17T02:22:34.022 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:22:34.022 INFO:teuthology.orchestra.run.smithi104.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:22:34.022 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1c brd ff:ff:ff:ff:ff:ff 2024-08-17T02:22:34.022 INFO:teuthology.orchestra.run.smithi104.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:22:34.022 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1d brd ff:ff:ff:ff:ff:ff 2024-08-17T02:22:34.022 INFO:teuthology.orchestra.run.smithi104.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:22:34.022 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:88 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:22:34.022 INFO:teuthology.orchestra.run.smithi104.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:22:34.023 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:89 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:22:34.023 INFO:teuthology.orchestra.run.smithi104.stdout: inet 172.21.15.104/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-08-17T02:22:34.023 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft 42589sec preferred_lft 42589sec 2024-08-17T02:22:34.023 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::ec4:7aff:fe8f:ce89/64 scope link 2024-08-17T02:22:34.023 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:22:34.023 INFO:teuthology.orchestra.run.smithi104.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-17T02:22:34.023 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 02:42:50:27:da:d0 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:22:34.023 INFO:teuthology.orchestra.run.smithi104.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-17T02:22:34.023 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:22:34.023 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-17T02:22:34.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:34.024 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec bash -c ' 2024-08-17T02:22:34.024 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-08-17T02:22:34.024 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link add name ceph-brx type bridge 2024-08-17T02:22:34.024 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip addr flush dev ceph-brx 2024-08-17T02:22:34.024 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set ceph-brx up 2024-08-17T02:22:34.024 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-17T02:22:34.024 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-08-17T02:22:34.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:34.064 DEBUG:teuthology.orchestra.run.smithi104:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:22:34.123 INFO:teuthology.orchestra.run.smithi104.stdout:1 2024-08-17T02:22:34.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:34.125 DEBUG:teuthology.orchestra.run.smithi104:> route 2024-08-17T02:22:34.150 INFO:teuthology.orchestra.run.smithi104.stdout:Kernel IP routing table 2024-08-17T02:22:34.150 INFO:teuthology.orchestra.run.smithi104.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:22:34.150 INFO:teuthology.orchestra.run.smithi104.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-08-17T02:22:34.150 INFO:teuthology.orchestra.run.smithi104.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:22:34.150 INFO:teuthology.orchestra.run.smithi104.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-17T02:22:34.150 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-08-17T02:22:34.150 INFO:teuthology.orchestra.run.smithi104.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-17T02:22:34.150 INFO:teuthology.orchestra.run.smithi104.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:22:34.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:34.151 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec bash -c ' 2024-08-17T02:22:34.151 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-08-17T02:22:34.151 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:22:34.151 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:22:34.151 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:22:34.151 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-08-17T02:22:34.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:34.195 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2024-08-17T02:22:34.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:34.201 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list-id 2024-08-17T02:22:34.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:34.251 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec bash -c ' 2024-08-17T02:22:34.251 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-08-17T02:22:34.251 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:22:34.251 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-08-17T02:22:34.251 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-08-17T02:22:34.283 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-08-17T02:22:34.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:34.284 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec bash -c ' 2024-08-17T02:22:34.284 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-08-17T02:22:34.284 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-08-17T02:22:34.284 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-17T02:22:34.284 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-08-17T02:22:34.284 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-08-17T02:22:34.284 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-08-17T02:22:34.284 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-08-17T02:22:34.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:34.358 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec bash -c ' 2024-08-17T02:22:34.358 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-08-17T02:22:34.358 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set brx.0 up 2024-08-17T02:22:34.358 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set dev brx.0 master ceph-brx 2024-08-17T02:22:34.358 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-08-17T02:22:34.385 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-08-17T02:22:34.385 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:22:34.385 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-17T02:22:34.393 INFO:teuthology.orchestra.run.smithi104.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:22:34.393 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:22:34.393 DEBUG:teuthology.orchestra.run.smithi104:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:22:34.400 DEBUG:teuthology.orchestra.run.smithi104:> sudo modprobe fuse 2024-08-17T02:22:34.463 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:22:34.464 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:22:34.479 INFO:teuthology.orchestra.run.smithi104.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:22:34.480 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:22:34.480 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:22:34.480 DEBUG:teuthology.orchestra.run.smithi104:> ls /sys/fs/fuse/connections 2024-08-17T02:22:34.488 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-17T02:22:34.488 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-08-17T02:22:34.490 DEBUG:teuthology.orchestra.run.smithi104:> sudo modprobe fuse 2024-08-17T02:22:34.505 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:22:34.505 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:22:34.518 INFO:teuthology.orchestra.run.smithi104.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:22:34.519 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:22:34.519 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:22:34.519 DEBUG:teuthology.orchestra.run.smithi104:> ls /sys/fs/fuse/connections 2024-08-17T02:22:34.572 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi104.stderr:2024-08-17T02:22:34.566+0000 7f2285257380 -1 init, newargv = 0x55df23450af0 newargc=15 2024-08-17T02:22:34.572 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi104.stderr:ceph-fuse[31352]: starting ceph client 2024-08-17T02:22:34.582 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi104.stderr:ceph-fuse[31352]: starting fuse 2024-08-17T02:22:35.626 DEBUG:teuthology.orchestra.run.smithi104:> sudo modprobe fuse 2024-08-17T02:22:35.646 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:22:35.646 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:22:35.657 INFO:teuthology.orchestra.run.smithi104.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:22:35.658 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:22:35.659 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:22:35.659 DEBUG:teuthology.orchestra.run.smithi104:> ls /sys/fs/fuse/connections 2024-08-17T02:22:35.664 INFO:teuthology.orchestra.run.smithi104.stdout:52 2024-08-17T02:22:35.664 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-08-17T02:22:35.665 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-08-17T02:22:35.665 DEBUG:teuthology.orchestra.run.smithi104:> import glob 2024-08-17T02:22:35.665 DEBUG:teuthology.orchestra.run.smithi104:> import re 2024-08-17T02:22:35.665 DEBUG:teuthology.orchestra.run.smithi104:> import os 2024-08-17T02:22:35.665 DEBUG:teuthology.orchestra.run.smithi104:> import subprocess 2024-08-17T02:22:35.665 DEBUG:teuthology.orchestra.run.smithi104:> 2024-08-17T02:22:35.665 DEBUG:teuthology.orchestra.run.smithi104:> def _find_admin_socket(client_name): 2024-08-17T02:22:35.665 DEBUG:teuthology.orchestra.run.smithi104:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-08-17T02:22:35.665 DEBUG:teuthology.orchestra.run.smithi104:> files = glob.glob(asok_path) 2024-08-17T02:22:35.665 DEBUG:teuthology.orchestra.run.smithi104:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-08-17T02:22:35.665 DEBUG:teuthology.orchestra.run.smithi104:> 2024-08-17T02:22:35.665 DEBUG:teuthology.orchestra.run.smithi104:> # Given a non-glob path, it better be there 2024-08-17T02:22:35.665 DEBUG:teuthology.orchestra.run.smithi104:> if "*" not in asok_path: 2024-08-17T02:22:35.666 DEBUG:teuthology.orchestra.run.smithi104:> assert(len(files) == 1) 2024-08-17T02:22:35.666 DEBUG:teuthology.orchestra.run.smithi104:> return files[0] 2024-08-17T02:22:35.666 DEBUG:teuthology.orchestra.run.smithi104:> 2024-08-17T02:22:35.666 DEBUG:teuthology.orchestra.run.smithi104:> for f in files: 2024-08-17T02:22:35.666 DEBUG:teuthology.orchestra.run.smithi104:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-17T02:22:35.666 DEBUG:teuthology.orchestra.run.smithi104:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-17T02:22:35.666 DEBUG:teuthology.orchestra.run.smithi104:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-17T02:22:35.666 DEBUG:teuthology.orchestra.run.smithi104:> contents = proc_f.read() 2024-08-17T02:22:35.666 DEBUG:teuthology.orchestra.run.smithi104:> if mountpoint in contents: 2024-08-17T02:22:35.666 DEBUG:teuthology.orchestra.run.smithi104:> return f 2024-08-17T02:22:35.666 DEBUG:teuthology.orchestra.run.smithi104:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-17T02:22:35.666 DEBUG:teuthology.orchestra.run.smithi104:> 2024-08-17T02:22:35.666 DEBUG:teuthology.orchestra.run.smithi104:> print(_find_admin_socket("client.0")) 2024-08-17T02:22:35.666 DEBUG:teuthology.orchestra.run.smithi104:> ' 2024-08-17T02:22:35.749 INFO:teuthology.orchestra.run.smithi104.stdout:/var/run/ceph/ceph-client.0.31352.asok 2024-08-17T02:22:35.934 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.31352.asok 2024-08-17T02:22:35.934 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:22:35.934 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.31352.asok status 2024-08-17T02:22:36.073 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-08-17T02:22:36.073 INFO:teuthology.orchestra.run.smithi104.stdout: "metadata": { 2024-08-17T02:22:36.073 INFO:teuthology.orchestra.run.smithi104.stdout: "ceph_sha1": "2577e8139c6b8786f9d6d6ea21b8da9244b9260e", 2024-08-17T02:22:36.073 INFO:teuthology.orchestra.run.smithi104.stdout: "ceph_version": "ceph version 17.2.7-1375-g2577e813 (2577e8139c6b8786f9d6d6ea21b8da9244b9260e) quincy (stable)", 2024-08-17T02:22:36.073 INFO:teuthology.orchestra.run.smithi104.stdout: "entity_id": "0", 2024-08-17T02:22:36.073 INFO:teuthology.orchestra.run.smithi104.stdout: "hostname": "smithi104", 2024-08-17T02:22:36.074 INFO:teuthology.orchestra.run.smithi104.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-08-17T02:22:36.074 INFO:teuthology.orchestra.run.smithi104.stdout: "pid": "31352", 2024-08-17T02:22:36.074 INFO:teuthology.orchestra.run.smithi104.stdout: "root": "/" 2024-08-17T02:22:36.074 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-08-17T02:22:36.074 INFO:teuthology.orchestra.run.smithi104.stdout: "dentry_count": 0, 2024-08-17T02:22:36.074 INFO:teuthology.orchestra.run.smithi104.stdout: "dentry_pinned_count": 0, 2024-08-17T02:22:36.074 INFO:teuthology.orchestra.run.smithi104.stdout: "id": 4653, 2024-08-17T02:22:36.074 INFO:teuthology.orchestra.run.smithi104.stdout: "inst": { 2024-08-17T02:22:36.074 INFO:teuthology.orchestra.run.smithi104.stdout: "name": { 2024-08-17T02:22:36.074 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "client", 2024-08-17T02:22:36.074 INFO:teuthology.orchestra.run.smithi104.stdout: "num": 4653 2024-08-17T02:22:36.074 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-08-17T02:22:36.074 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": { 2024-08-17T02:22:36.074 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-08-17T02:22:36.075 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "192.168.0.1:0", 2024-08-17T02:22:36.075 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 70408283 2024-08-17T02:22:36.075 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-08-17T02:22:36.075 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-08-17T02:22:36.075 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": { 2024-08-17T02:22:36.075 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-08-17T02:22:36.075 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "192.168.0.1:0", 2024-08-17T02:22:36.075 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 70408283 2024-08-17T02:22:36.075 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-08-17T02:22:36.075 INFO:teuthology.orchestra.run.smithi104.stdout: "inst_str": "client.4653 192.168.0.1:0/70408283", 2024-08-17T02:22:36.075 INFO:teuthology.orchestra.run.smithi104.stdout: "addr_str": "192.168.0.1:0/70408283", 2024-08-17T02:22:36.075 INFO:teuthology.orchestra.run.smithi104.stdout: "inode_count": 1, 2024-08-17T02:22:36.075 INFO:teuthology.orchestra.run.smithi104.stdout: "mds_epoch": 7, 2024-08-17T02:22:36.075 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_epoch": 23, 2024-08-17T02:22:36.076 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_epoch_barrier": 0, 2024-08-17T02:22:36.076 INFO:teuthology.orchestra.run.smithi104.stdout: "blocklisted": false, 2024-08-17T02:22:36.076 INFO:teuthology.orchestra.run.smithi104.stdout: "fs_name": "cephfs" 2024-08-17T02:22:36.076 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-08-17T02:22:36.082 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:22:36.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.182+0000 7efec3fff700 1 Processor -- start 2024-08-17T02:22:36.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.182+0000 7efec3fff700 1 -- start start 2024-08-17T02:22:36.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.186+0000 7efec3fff700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7efec4158f10 0x7efec40ac650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:36.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.186+0000 7efec3fff700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efec406f740 con 0x7efec4158b40 2024-08-17T02:22:36.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.186+0000 7efec3fff700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efec406eb30 con 0x7efec4067da0 2024-08-17T02:22:36.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.186+0000 7efec3fff700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efec406ee10 con 0x7efec4158f10 2024-08-17T02:22:36.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.186+0000 7efec2ffd700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7efec4158b40 0x7efec4067690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:56856/0 (socket says 172.21.15.104:56856) 2024-08-17T02:22:36.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.186+0000 7efec2ffd700 1 -- 172.21.15.104:0/1940878944 learned_addr learned my addr 172.21.15.104:0/1940878944 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:36.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.186+0000 7efec37fe700 1 --2- 172.21.15.104:0/1940878944 >> v2:172.21.15.117:3300/0 conn(0x7efec4158f10 0x7efec40ac650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:36.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.186+0000 7efec27fc700 1 -- 172.21.15.104:0/1940878944 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1965987274 0 0) 0x7efec406f740 con 0x7efec4158b40 2024-08-17T02:22:36.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.186+0000 7efec27fc700 1 -- 172.21.15.104:0/1940878944 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efeb0003570 con 0x7efec4158b40 2024-08-17T02:22:36.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.186+0000 7efec27fc700 1 -- 172.21.15.104:0/1940878944 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 101311457 0 0) 0x7efec406eb30 con 0x7efec4067da0 2024-08-17T02:22:36.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.186+0000 7efec27fc700 1 -- 172.21.15.104:0/1940878944 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efec406f740 con 0x7efec4067da0 2024-08-17T02:22:36.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.186+0000 7efec37fe700 1 -- 172.21.15.104:0/1940878944 >> v1:172.21.15.117:6789/0 conn(0x7efec4067da0 legacy=0x7efec40abf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:36.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.186+0000 7efec37fe700 1 -- 172.21.15.104:0/1940878944 >> v1:172.21.15.104:6789/0 conn(0x7efec4158b40 legacy=0x7efec4067690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:36.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.186+0000 7efec37fe700 1 -- 172.21.15.104:0/1940878944 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec406f0f0 con 0x7efec4158f10 2024-08-17T02:22:36.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.186+0000 7efec37fe700 1 --2- 172.21.15.104:0/1940878944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efec4158f10 0x7efec40ac650 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efebc009e60 tx=0x7efebc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79ec087c8693eecb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:36.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.186+0000 7efec27fc700 1 -- 172.21.15.104:0/1940878944 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc00e070 con 0x7efec4158f10 2024-08-17T02:22:36.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.186+0000 7efec27fc700 1 -- 172.21.15.104:0/1940878944 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efebc00bab0 con 0x7efec4158f10 2024-08-17T02:22:36.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.186+0000 7efec27fc700 1 -- 172.21.15.104:0/1940878944 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc00be70 con 0x7efec4158f10 2024-08-17T02:22:36.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.186+0000 7efec3fff700 1 -- 172.21.15.104:0/1940878944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efec4158f10 msgr2=0x7efec40ac650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:36.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.186+0000 7efec3fff700 1 --2- 172.21.15.104:0/1940878944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efec4158f10 0x7efec40ac650 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efebc009e60 tx=0x7efebc009780 comp rx=0 tx=0).stop 2024-08-17T02:22:36.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.186+0000 7efec3fff700 1 -- 172.21.15.104:0/1940878944 shutdown_connections 2024-08-17T02:22:36.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.186+0000 7efec3fff700 1 --2- 172.21.15.104:0/1940878944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efec4158f10 0x7efec40ac650 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:36.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.186+0000 7efec3fff700 1 -- 172.21.15.104:0/1940878944 >> 172.21.15.104:0/1940878944 conn(0x7efec40ccb70 msgr2=0x7efec40a8f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:36.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.186+0000 7efec3fff700 1 -- 172.21.15.104:0/1940878944 shutdown_connections 2024-08-17T02:22:36.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.186+0000 7efec3fff700 1 -- 172.21.15.104:0/1940878944 wait complete. 2024-08-17T02:22:36.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.190+0000 7efec3fff700 1 Processor -- start 2024-08-17T02:22:36.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.190+0000 7efec3fff700 1 -- start start 2024-08-17T02:22:36.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.190+0000 7efec3fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efec4067da0 0x7efec413af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:36.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.190+0000 7efec3fff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efec4158b40 0x7efec414f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:36.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.190+0000 7efec3fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efec4158f10 0x7efec414fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:36.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.190+0000 7efec3fff700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec40b1c60 con 0x7efec4158b40 2024-08-17T02:22:36.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.190+0000 7efec3fff700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec413b460 con 0x7efec4067da0 2024-08-17T02:22:36.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.190+0000 7efec3fff700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec40b1050 con 0x7efec4158f10 2024-08-17T02:22:36.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.194+0000 7efeba7fc700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efec4158b40 0x7efec414f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:36.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.194+0000 7efeba7fc700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efec4158b40 0x7efec414f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42674/0 (socket says 172.21.15.104:42674) 2024-08-17T02:22:36.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.194+0000 7efeba7fc700 1 -- 172.21.15.104:0/3341183676 learned_addr learned my addr 172.21.15.104:0/3341183676 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:36.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.194+0000 7efec2ffd700 1 --2- 172.21.15.104:0/3341183676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efec4067da0 0x7efec413af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:36.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.194+0000 7efec37fe700 1 --2- 172.21.15.104:0/3341183676 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efec4158f10 0x7efec414fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:36.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.194+0000 7efeba7fc700 1 -- 172.21.15.104:0/3341183676 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efec4158f10 msgr2=0x7efec414fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:36.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.194+0000 7efeba7fc700 1 --2- 172.21.15.104:0/3341183676 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efec4158f10 0x7efec414fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:36.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.194+0000 7efeba7fc700 1 -- 172.21.15.104:0/3341183676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efec4067da0 msgr2=0x7efec413af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:36.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.194+0000 7efeba7fc700 1 --2- 172.21.15.104:0/3341183676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efec4067da0 0x7efec413af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:36.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.194+0000 7efeba7fc700 1 -- 172.21.15.104:0/3341183676 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efebc009a20 con 0x7efec4158b40 2024-08-17T02:22:36.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.194+0000 7efeba7fc700 1 --2- 172.21.15.104:0/3341183676 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efec4158b40 0x7efec414f900 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7efeac00c7c0 tx=0x7efeac007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:36.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.194+0000 7efebb7fe700 1 -- 172.21.15.104:0/3341183676 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac010510 con 0x7efec4158b40 2024-08-17T02:22:36.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.194+0000 7efebb7fe700 1 -- 172.21.15.104:0/3341183676 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeac0106b0 con 0x7efec4158b40 2024-08-17T02:22:36.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.194+0000 7efec3fff700 1 -- 172.21.15.104:0/3341183676 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efec40b1330 con 0x7efec4158b40 2024-08-17T02:22:36.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.194+0000 7efebb7fe700 1 -- 172.21.15.104:0/3341183676 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac010a70 con 0x7efec4158b40 2024-08-17T02:22:36.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.194+0000 7efec3fff700 1 -- 172.21.15.104:0/3341183676 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efec40b18f0 con 0x7efec4158b40 2024-08-17T02:22:36.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.194+0000 7efebb7fe700 1 -- 172.21.15.104:0/3341183676 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7efeac012440 con 0x7efec4158b40 2024-08-17T02:22:36.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.198+0000 7efec3fff700 1 -- 172.21.15.104:0/3341183676 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efec40b1dd0 con 0x7efec4158b40 2024-08-17T02:22:36.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.198+0000 7efebb7fe700 1 --2- 172.21.15.104:0/3341183676 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7efea4060860 0x7efea4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:36.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.198+0000 7efebb7fe700 1 -- 172.21.15.104:0/3341183676 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efeac07c200 con 0x7efec4158b40 2024-08-17T02:22:36.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.198+0000 7efec2ffd700 1 --2- 172.21.15.104:0/3341183676 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7efea4060860 0x7efea4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:36.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.198+0000 7efec2ffd700 1 --2- 172.21.15.104:0/3341183676 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7efea4060860 0x7efea4062d10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efeb4007fd0 tx=0x7efeb4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:36.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.202+0000 7efebb7fe700 1 -- 172.21.15.104:0/3341183676 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7efeac04a480 con 0x7efec4158b40 2024-08-17T02:22:36.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.402+0000 7efec3fff700 1 -- 172.21.15.104:0/3341183676 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7efec40638f0 con 0x7efec4158b40 2024-08-17T02:22:36.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.402+0000 7efebb7fe700 1 -- 172.21.15.104:0/3341183676 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7efeac017070 con 0x7efec4158b40 2024-08-17T02:22:36.406 INFO:teuthology.orchestra.run.smithi104.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:22:36.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.406+0000 7efec3fff700 1 -- 172.21.15.104:0/3341183676 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7efea4060860 msgr2=0x7efea4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:36.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.406+0000 7efec3fff700 1 --2- 172.21.15.104:0/3341183676 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7efea4060860 0x7efea4062d10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efeb4007fd0 tx=0x7efeb4009040 comp rx=0 tx=0).stop 2024-08-17T02:22:36.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.406+0000 7efec3fff700 1 -- 172.21.15.104:0/3341183676 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efec4158b40 msgr2=0x7efec414f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:36.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.406+0000 7efec3fff700 1 --2- 172.21.15.104:0/3341183676 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efec4158b40 0x7efec414f900 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7efeac00c7c0 tx=0x7efeac007de0 comp rx=0 tx=0).stop 2024-08-17T02:22:36.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.406+0000 7efec3fff700 1 -- 172.21.15.104:0/3341183676 shutdown_connections 2024-08-17T02:22:36.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.406+0000 7efec3fff700 1 --2- 172.21.15.104:0/3341183676 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7efea4060860 0x7efea4062d10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:36.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.406+0000 7efec3fff700 1 --2- 172.21.15.104:0/3341183676 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efec4158f10 0x7efec414fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:36.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.406+0000 7efec3fff700 1 --2- 172.21.15.104:0/3341183676 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efec4158b40 0x7efec414f900 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:36.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.406+0000 7efec3fff700 1 --2- 172.21.15.104:0/3341183676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efec4067da0 0x7efec413af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:36.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.406+0000 7efec3fff700 1 -- 172.21.15.104:0/3341183676 >> 172.21.15.104:0/3341183676 conn(0x7efec40ccb70 msgr2=0x7efec40ac860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:36.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.406+0000 7efec3fff700 1 -- 172.21.15.104:0/3341183676 shutdown_connections 2024-08-17T02:22:36.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:36.406+0000 7efec3fff700 1 -- 172.21.15.104:0/3341183676 wait complete. 2024-08-17T02:22:36.420 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:22:36.420 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:22:36.420 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi104.front.sepia.ceph.com 2024-08-17T02:22:36.420 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-08-17T02:22:36.420 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-08-17T02:22:36.421 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:22:36.421 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:22:36.421 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:22:36.421 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-08-17T02:22:36.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:36.421 DEBUG:teuthology.orchestra.run.smithi104:> ip addr 2024-08-17T02:22:36.429 INFO:teuthology.orchestra.run.smithi104.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:22:36.429 INFO:teuthology.orchestra.run.smithi104.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:22:36.429 INFO:teuthology.orchestra.run.smithi104.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:22:36.429 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:22:36.430 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 ::1/128 scope host 2024-08-17T02:22:36.430 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:22:36.430 INFO:teuthology.orchestra.run.smithi104.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:22:36.430 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1c brd ff:ff:ff:ff:ff:ff 2024-08-17T02:22:36.430 INFO:teuthology.orchestra.run.smithi104.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:22:36.430 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1d brd ff:ff:ff:ff:ff:ff 2024-08-17T02:22:36.430 INFO:teuthology.orchestra.run.smithi104.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:22:36.430 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:88 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:22:36.430 INFO:teuthology.orchestra.run.smithi104.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:22:36.430 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:89 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:22:36.430 INFO:teuthology.orchestra.run.smithi104.stdout: inet 172.21.15.104/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-08-17T02:22:36.430 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft 42586sec preferred_lft 42586sec 2024-08-17T02:22:36.431 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::ec4:7aff:fe8f:ce89/64 scope link 2024-08-17T02:22:36.431 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:22:36.431 INFO:teuthology.orchestra.run.smithi104.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-17T02:22:36.431 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 02:42:50:27:da:d0 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:22:36.431 INFO:teuthology.orchestra.run.smithi104.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-17T02:22:36.431 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:22:36.431 INFO:teuthology.orchestra.run.smithi104.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:22:36.431 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether be:82:c8:2b:c8:f8 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:22:36.431 INFO:teuthology.orchestra.run.smithi104.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:22:36.431 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:22:36.431 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::35:b5ff:fe2c:9902/64 scope link 2024-08-17T02:22:36.431 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:22:36.431 INFO:teuthology.orchestra.run.smithi104.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:22:36.432 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether be:82:c8:2b:c8:f8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:22:36.432 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::bc82:c8ff:fe2b:c8f8/64 scope link 2024-08-17T02:22:36.432 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:22:36.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:36.432 DEBUG:teuthology.orchestra.run.smithi104:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:22:36.444 INFO:teuthology.orchestra.run.smithi104.stdout:1 2024-08-17T02:22:36.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:36.445 DEBUG:teuthology.orchestra.run.smithi104:> route 2024-08-17T02:22:36.495 INFO:teuthology.orchestra.run.smithi104.stdout:Kernel IP routing table 2024-08-17T02:22:36.495 INFO:teuthology.orchestra.run.smithi104.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:22:36.496 INFO:teuthology.orchestra.run.smithi104.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-08-17T02:22:36.496 INFO:teuthology.orchestra.run.smithi104.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:22:36.496 INFO:teuthology.orchestra.run.smithi104.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-17T02:22:36.496 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-08-17T02:22:36.496 INFO:teuthology.orchestra.run.smithi104.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-17T02:22:36.496 INFO:teuthology.orchestra.run.smithi104.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:22:36.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:36.496 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec bash -c ' 2024-08-17T02:22:36.496 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-08-17T02:22:36.496 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:22:36.497 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:22:36.497 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:22:36.497 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-08-17T02:22:36.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:36.536 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2024-08-17T02:22:36.543 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:22:36.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:36.544 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list-id 2024-08-17T02:22:36.593 INFO:teuthology.orchestra.run.smithi104.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-08-17T02:22:36.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:36.595 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec bash -c ' 2024-08-17T02:22:36.595 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-08-17T02:22:36.595 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:22:36.595 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-08-17T02:22:36.595 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-08-17T02:22:36.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:36.627 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-17T02:22:36.642 INFO:teuthology.orchestra.run.smithi104.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:22:36.642 INFO:teuthology.orchestra.run.smithi104.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:22:36.642 INFO:teuthology.orchestra.run.smithi104.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:22:36.642 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:22:36.643 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 ::1/128 scope host 2024-08-17T02:22:36.643 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:22:36.643 INFO:teuthology.orchestra.run.smithi104.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:22:36.643 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether ba:2b:19:b6:fc:8a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:22:36.643 INFO:teuthology.orchestra.run.smithi104.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:22:36.643 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:22:36.643 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::b82b:19ff:feb6:fc8a/64 scope link 2024-08-17T02:22:36.643 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:22:36.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:36.644 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-17T02:22:36.704 INFO:teuthology.orchestra.run.smithi104.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:22:36.704 INFO:teuthology.orchestra.run.smithi104.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:22:36.704 INFO:teuthology.orchestra.run.smithi104.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:22:36.704 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:22:36.704 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 ::1/128 scope host 2024-08-17T02:22:36.704 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:22:36.704 INFO:teuthology.orchestra.run.smithi104.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:22:36.704 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether ba:2b:19:b6:fc:8a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:22:36.704 INFO:teuthology.orchestra.run.smithi104.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:22:36.704 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:22:36.705 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::b82b:19ff:feb6:fc8a/64 scope link 2024-08-17T02:22:36.705 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:22:36.706 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-08-17T02:22:36.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:36.706 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec bash -c ' 2024-08-17T02:22:36.706 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-08-17T02:22:36.706 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-08-17T02:22:36.706 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-17T02:22:36.706 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-08-17T02:22:36.706 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-08-17T02:22:36.706 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-08-17T02:22:36.707 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-08-17T02:22:36.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:36.763 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec bash -c ' 2024-08-17T02:22:36.763 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-08-17T02:22:36.763 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set brx.1 up 2024-08-17T02:22:36.763 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set dev brx.1 master ceph-brx 2024-08-17T02:22:36.763 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-08-17T02:22:36.794 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-08-17T02:22:36.794 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:22:36.795 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-08-17T02:22:36.849 INFO:teuthology.orchestra.run.smithi104.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-08-17T02:22:36.850 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:22:36.850 DEBUG:teuthology.orchestra.run.smithi104:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-08-17T02:22:36.856 DEBUG:teuthology.orchestra.run.smithi104:> sudo modprobe fuse 2024-08-17T02:22:36.871 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:22:36.871 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:22:36.885 INFO:teuthology.orchestra.run.smithi104.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:22:36.885 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:22:36.886 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:22:36.886 DEBUG:teuthology.orchestra.run.smithi104:> ls /sys/fs/fuse/connections 2024-08-17T02:22:36.936 INFO:teuthology.orchestra.run.smithi104.stdout:52 2024-08-17T02:22:36.937 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [52] 2024-08-17T02:22:36.937 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-08-17T02:22:36.939 DEBUG:teuthology.orchestra.run.smithi104:> sudo modprobe fuse 2024-08-17T02:22:36.958 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:22:36.958 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:22:36.969 INFO:teuthology.orchestra.run.smithi104.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:22:36.970 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:22:36.971 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:22:36.971 DEBUG:teuthology.orchestra.run.smithi104:> ls /sys/fs/fuse/connections 2024-08-17T02:22:36.977 INFO:teuthology.orchestra.run.smithi104.stdout:52 2024-08-17T02:22:37.023 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi104.stderr:2024-08-17T02:22:37.022+0000 7f837e140380 -1 init, newargv = 0x5566e33611f0 newargc=15 2024-08-17T02:22:37.023 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi104.stderr:ceph-fuse[31493]: starting ceph client 2024-08-17T02:22:37.032 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi104.stderr:ceph-fuse[31493]: starting fuse 2024-08-17T02:22:38.079 DEBUG:teuthology.orchestra.run.smithi104:> sudo modprobe fuse 2024-08-17T02:22:38.095 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:22:38.096 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:22:38.108 INFO:teuthology.orchestra.run.smithi104.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:22:38.109 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:22:38.110 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:22:38.110 DEBUG:teuthology.orchestra.run.smithi104:> ls /sys/fs/fuse/connections 2024-08-17T02:22:38.116 INFO:teuthology.orchestra.run.smithi104.stdout:52 2024-08-17T02:22:38.116 INFO:teuthology.orchestra.run.smithi104.stdout:53 2024-08-17T02:22:38.116 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52, 53] 2024-08-17T02:22:38.116 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-08-17T02:22:38.116 DEBUG:teuthology.orchestra.run.smithi104:> import glob 2024-08-17T02:22:38.117 DEBUG:teuthology.orchestra.run.smithi104:> import re 2024-08-17T02:22:38.117 DEBUG:teuthology.orchestra.run.smithi104:> import os 2024-08-17T02:22:38.117 DEBUG:teuthology.orchestra.run.smithi104:> import subprocess 2024-08-17T02:22:38.117 DEBUG:teuthology.orchestra.run.smithi104:> 2024-08-17T02:22:38.117 DEBUG:teuthology.orchestra.run.smithi104:> def _find_admin_socket(client_name): 2024-08-17T02:22:38.117 DEBUG:teuthology.orchestra.run.smithi104:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-08-17T02:22:38.117 DEBUG:teuthology.orchestra.run.smithi104:> files = glob.glob(asok_path) 2024-08-17T02:22:38.117 DEBUG:teuthology.orchestra.run.smithi104:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-08-17T02:22:38.117 DEBUG:teuthology.orchestra.run.smithi104:> 2024-08-17T02:22:38.117 DEBUG:teuthology.orchestra.run.smithi104:> # Given a non-glob path, it better be there 2024-08-17T02:22:38.117 DEBUG:teuthology.orchestra.run.smithi104:> if "*" not in asok_path: 2024-08-17T02:22:38.117 DEBUG:teuthology.orchestra.run.smithi104:> assert(len(files) == 1) 2024-08-17T02:22:38.117 DEBUG:teuthology.orchestra.run.smithi104:> return files[0] 2024-08-17T02:22:38.117 DEBUG:teuthology.orchestra.run.smithi104:> 2024-08-17T02:22:38.117 DEBUG:teuthology.orchestra.run.smithi104:> for f in files: 2024-08-17T02:22:38.118 DEBUG:teuthology.orchestra.run.smithi104:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-17T02:22:38.118 DEBUG:teuthology.orchestra.run.smithi104:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-17T02:22:38.118 DEBUG:teuthology.orchestra.run.smithi104:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-17T02:22:38.118 DEBUG:teuthology.orchestra.run.smithi104:> contents = proc_f.read() 2024-08-17T02:22:38.118 DEBUG:teuthology.orchestra.run.smithi104:> if mountpoint in contents: 2024-08-17T02:22:38.118 DEBUG:teuthology.orchestra.run.smithi104:> return f 2024-08-17T02:22:38.118 DEBUG:teuthology.orchestra.run.smithi104:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-17T02:22:38.118 DEBUG:teuthology.orchestra.run.smithi104:> 2024-08-17T02:22:38.118 DEBUG:teuthology.orchestra.run.smithi104:> print(_find_admin_socket("client.2")) 2024-08-17T02:22:38.118 DEBUG:teuthology.orchestra.run.smithi104:> ' 2024-08-17T02:22:38.199 INFO:teuthology.orchestra.run.smithi104.stdout:/var/run/ceph/ceph-client.2.31493.asok 2024-08-17T02:22:38.385 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.31493.asok 2024-08-17T02:22:38.385 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:22:38.385 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.31493.asok status 2024-08-17T02:22:38.481 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-08-17T02:22:38.481 INFO:teuthology.orchestra.run.smithi104.stdout: "metadata": { 2024-08-17T02:22:38.482 INFO:teuthology.orchestra.run.smithi104.stdout: "ceph_sha1": "2577e8139c6b8786f9d6d6ea21b8da9244b9260e", 2024-08-17T02:22:38.482 INFO:teuthology.orchestra.run.smithi104.stdout: "ceph_version": "ceph version 17.2.7-1375-g2577e813 (2577e8139c6b8786f9d6d6ea21b8da9244b9260e) quincy (stable)", 2024-08-17T02:22:38.482 INFO:teuthology.orchestra.run.smithi104.stdout: "entity_id": "2", 2024-08-17T02:22:38.482 INFO:teuthology.orchestra.run.smithi104.stdout: "hostname": "smithi104", 2024-08-17T02:22:38.482 INFO:teuthology.orchestra.run.smithi104.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-08-17T02:22:38.482 INFO:teuthology.orchestra.run.smithi104.stdout: "pid": "31493", 2024-08-17T02:22:38.482 INFO:teuthology.orchestra.run.smithi104.stdout: "root": "/" 2024-08-17T02:22:38.482 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-08-17T02:22:38.482 INFO:teuthology.orchestra.run.smithi104.stdout: "dentry_count": 0, 2024-08-17T02:22:38.482 INFO:teuthology.orchestra.run.smithi104.stdout: "dentry_pinned_count": 0, 2024-08-17T02:22:38.482 INFO:teuthology.orchestra.run.smithi104.stdout: "id": 4668, 2024-08-17T02:22:38.482 INFO:teuthology.orchestra.run.smithi104.stdout: "inst": { 2024-08-17T02:22:38.482 INFO:teuthology.orchestra.run.smithi104.stdout: "name": { 2024-08-17T02:22:38.483 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "client", 2024-08-17T02:22:38.483 INFO:teuthology.orchestra.run.smithi104.stdout: "num": 4668 2024-08-17T02:22:38.483 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-08-17T02:22:38.483 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": { 2024-08-17T02:22:38.483 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-08-17T02:22:38.483 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "192.168.0.2:0", 2024-08-17T02:22:38.483 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3055055618 2024-08-17T02:22:38.483 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-08-17T02:22:38.483 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-08-17T02:22:38.483 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": { 2024-08-17T02:22:38.483 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-08-17T02:22:38.483 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "192.168.0.2:0", 2024-08-17T02:22:38.484 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3055055618 2024-08-17T02:22:38.484 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-08-17T02:22:38.484 INFO:teuthology.orchestra.run.smithi104.stdout: "inst_str": "client.4668 192.168.0.2:0/3055055618", 2024-08-17T02:22:38.484 INFO:teuthology.orchestra.run.smithi104.stdout: "addr_str": "192.168.0.2:0/3055055618", 2024-08-17T02:22:38.484 INFO:teuthology.orchestra.run.smithi104.stdout: "inode_count": 1, 2024-08-17T02:22:38.484 INFO:teuthology.orchestra.run.smithi104.stdout: "mds_epoch": 7, 2024-08-17T02:22:38.484 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_epoch": 23, 2024-08-17T02:22:38.484 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_epoch_barrier": 0, 2024-08-17T02:22:38.484 INFO:teuthology.orchestra.run.smithi104.stdout: "blocklisted": false, 2024-08-17T02:22:38.484 INFO:teuthology.orchestra.run.smithi104.stdout: "fs_name": "cephfs" 2024-08-17T02:22:38.484 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-08-17T02:22:38.491 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:22:38.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.590+0000 7f379767c700 1 Processor -- start 2024-08-17T02:22:38.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.590+0000 7f379767c700 1 -- start start 2024-08-17T02:22:38.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.590+0000 7f379767c700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f37900cc2e0 0x7f37900b3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:38.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.590+0000 7f379767c700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f37900cea40 0x7f37900ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:38.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.590+0000 7f379767c700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37900cf3e0 con 0x7f3790159810 2024-08-17T02:22:38.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.590+0000 7f379767c700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37900c5c60 con 0x7f37900cc2e0 2024-08-17T02:22:38.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.590+0000 7f379767c700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37900ce120 con 0x7f37900cea40 2024-08-17T02:22:38.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.590+0000 7f3794c17700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f37900cc2e0 0x7f37900b3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:38.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.590+0000 7f3794c17700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f37900cc2e0 0x7f37900b3270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53588/0 (socket says 172.21.15.104:53588) 2024-08-17T02:22:38.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.590+0000 7f3794c17700 1 -- 172.21.15.104:0/700006134 learned_addr learned my addr 172.21.15.104:0/700006134 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:38.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.590+0000 7f3795c19700 1 --2- 172.21.15.104:0/700006134 >> v2:172.21.15.117:3300/0 conn(0x7f37900cea40 0x7f37900ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:38.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.590+0000 7f3794c17700 1 -- 172.21.15.104:0/700006134 >> v2:172.21.15.117:3300/0 conn(0x7f37900cea40 msgr2=0x7f37900ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:38.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.590+0000 7f3794c17700 1 --2- 172.21.15.104:0/700006134 >> v2:172.21.15.117:3300/0 conn(0x7f37900cea40 0x7f37900ceea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:38.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.590+0000 7f3794c17700 1 -- 172.21.15.104:0/700006134 >> v1:172.21.15.117:6789/0 conn(0x7f3790159810 legacy=0x7f37900d0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:38.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.590+0000 7f3794c17700 1 -- 172.21.15.104:0/700006134 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37900ce390 con 0x7f37900cc2e0 2024-08-17T02:22:38.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.590+0000 7f3794c17700 1 --2- 172.21.15.104:0/700006134 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f37900cc2e0 0x7f37900b3270 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f379006a640 tx=0x7f3788009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8a22addbad276b1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:38.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.590+0000 7f378ffff700 1 -- 172.21.15.104:0/700006134 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3788009e70 con 0x7f37900cc2e0 2024-08-17T02:22:38.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.590+0000 7f378ffff700 1 -- 172.21.15.104:0/700006134 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f378800b860 con 0x7f37900cc2e0 2024-08-17T02:22:38.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.590+0000 7f378ffff700 1 -- 172.21.15.104:0/700006134 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378800bc00 con 0x7f37900cc2e0 2024-08-17T02:22:38.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.594+0000 7f379767c700 1 -- 172.21.15.104:0/700006134 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f37900cc2e0 msgr2=0x7f37900b3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:38.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.594+0000 7f379767c700 1 --2- 172.21.15.104:0/700006134 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f37900cc2e0 0x7f37900b3270 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f379006a640 tx=0x7f3788009250 comp rx=0 tx=0).stop 2024-08-17T02:22:38.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.594+0000 7f379767c700 1 -- 172.21.15.104:0/700006134 shutdown_connections 2024-08-17T02:22:38.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.594+0000 7f379767c700 1 --2- 172.21.15.104:0/700006134 >> v2:172.21.15.117:3300/0 conn(0x7f37900cea40 0x7f37900ceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:38.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.594+0000 7f379767c700 1 --2- 172.21.15.104:0/700006134 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f37900cc2e0 0x7f37900b3270 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:38.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.594+0000 7f379767c700 1 -- 172.21.15.104:0/700006134 >> 172.21.15.104:0/700006134 conn(0x7f3790067590 msgr2=0x7f37900d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:38.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.594+0000 7f379767c700 1 -- 172.21.15.104:0/700006134 shutdown_connections 2024-08-17T02:22:38.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.594+0000 7f379767c700 1 -- 172.21.15.104:0/700006134 wait complete. 2024-08-17T02:22:38.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.594+0000 7f379767c700 1 Processor -- start 2024-08-17T02:22:38.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.594+0000 7f379767c700 1 -- start start 2024-08-17T02:22:38.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.598+0000 7f379767c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f37900cc2e0 0x7f379015b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:38.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.598+0000 7f379767c700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37900cea40 0x7f3790149eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:38.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.598+0000 7f379767c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3790159810 0x7f3790157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:38.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.598+0000 7f379767c700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379009b750 con 0x7f37900cc2e0 2024-08-17T02:22:38.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.598+0000 7f379767c700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3790169fe0 con 0x7f3790159810 2024-08-17T02:22:38.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.598+0000 7f379767c700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37901693f0 con 0x7f37900cea40 2024-08-17T02:22:38.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.598+0000 7f3795418700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f37900cc2e0 0x7f379015b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:38.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.598+0000 7f3795418700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f37900cc2e0 0x7f379015b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53594/0 (socket says 172.21.15.104:53594) 2024-08-17T02:22:38.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.598+0000 7f3795418700 1 -- 172.21.15.104:0/3477037392 learned_addr learned my addr 172.21.15.104:0/3477037392 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:38.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.598+0000 7f3794c17700 1 --2- 172.21.15.104:0/3477037392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37900cea40 0x7f3790149eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:38.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.598+0000 7f3795c19700 1 --2- 172.21.15.104:0/3477037392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3790159810 0x7f3790157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:38.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.598+0000 7f3795418700 1 -- 172.21.15.104:0/3477037392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37900cea40 msgr2=0x7f3790149eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:38.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.598+0000 7f3795418700 1 --2- 172.21.15.104:0/3477037392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37900cea40 0x7f3790149eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:38.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.598+0000 7f3795418700 1 -- 172.21.15.104:0/3477037392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3790159810 msgr2=0x7f3790157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:38.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.598+0000 7f3795418700 1 --2- 172.21.15.104:0/3477037392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3790159810 0x7f3790157b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:38.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.598+0000 7f3795418700 1 -- 172.21.15.104:0/3477037392 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37880094f0 con 0x7f37900cc2e0 2024-08-17T02:22:38.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.598+0000 7f3795418700 1 --2- 172.21.15.104:0/3477037392 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f37900cc2e0 0x7f379015b2b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f377800c910 tx=0x7f3778001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:38.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.598+0000 7f378d7fa700 1 -- 172.21.15.104:0/3477037392 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3778006ba0 con 0x7f37900cc2e0 2024-08-17T02:22:38.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.598+0000 7f378d7fa700 1 -- 172.21.15.104:0/3477037392 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3778006d00 con 0x7f37900cc2e0 2024-08-17T02:22:38.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.598+0000 7f378d7fa700 1 -- 172.21.15.104:0/3477037392 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377800a9f0 con 0x7f37900cc2e0 2024-08-17T02:22:38.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.598+0000 7f379767c700 1 -- 172.21.15.104:0/3477037392 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37901696b0 con 0x7f37900cc2e0 2024-08-17T02:22:38.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.598+0000 7f379767c700 1 -- 172.21.15.104:0/3477037392 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3790169c70 con 0x7f37900cc2e0 2024-08-17T02:22:38.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.602+0000 7f379767c700 1 -- 172.21.15.104:0/3477037392 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37900645c0 con 0x7f37900cc2e0 2024-08-17T02:22:38.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.602+0000 7f378d7fa700 1 -- 172.21.15.104:0/3477037392 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f3778012420 con 0x7f37900cc2e0 2024-08-17T02:22:38.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.602+0000 7f378d7fa700 1 --2- 172.21.15.104:0/3477037392 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f37700608e0 0x7f3770062d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:38.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.602+0000 7f378d7fa700 1 -- 172.21.15.104:0/3477037392 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f377807c8e0 con 0x7f37900cc2e0 2024-08-17T02:22:38.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.602+0000 7f3794c17700 1 --2- 172.21.15.104:0/3477037392 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f37700608e0 0x7f3770062d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:38.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.602+0000 7f3794c17700 1 --2- 172.21.15.104:0/3477037392 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f37700608e0 0x7f3770062d90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f379006a640 tx=0x7f3788017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:38.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.610+0000 7f378d7fa700 1 -- 172.21.15.104:0/3477037392 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f377804cc90 con 0x7f37900cc2e0 2024-08-17T02:22:38.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.810+0000 7f379767c700 1 -- 172.21.15.104:0/3477037392 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f37900cf3b0 con 0x7f37900cc2e0 2024-08-17T02:22:38.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.810+0000 7f378d7fa700 1 -- 172.21.15.104:0/3477037392 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3778016070 con 0x7f37900cc2e0 2024-08-17T02:22:38.813 INFO:teuthology.orchestra.run.smithi104.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:22:38.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.814+0000 7f379767c700 1 -- 172.21.15.104:0/3477037392 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f37700608e0 msgr2=0x7f3770062d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:38.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.814+0000 7f379767c700 1 --2- 172.21.15.104:0/3477037392 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f37700608e0 0x7f3770062d90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f379006a640 tx=0x7f3788017000 comp rx=0 tx=0).stop 2024-08-17T02:22:38.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.814+0000 7f379767c700 1 -- 172.21.15.104:0/3477037392 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f37900cc2e0 msgr2=0x7f379015b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:38.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.814+0000 7f379767c700 1 --2- 172.21.15.104:0/3477037392 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f37900cc2e0 0x7f379015b2b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f377800c910 tx=0x7f3778001710 comp rx=0 tx=0).stop 2024-08-17T02:22:38.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.814+0000 7f379767c700 1 -- 172.21.15.104:0/3477037392 shutdown_connections 2024-08-17T02:22:38.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.814+0000 7f379767c700 1 --2- 172.21.15.104:0/3477037392 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f37700608e0 0x7f3770062d90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:38.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.814+0000 7f379767c700 1 --2- 172.21.15.104:0/3477037392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3790159810 0x7f3790157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:38.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.814+0000 7f379767c700 1 --2- 172.21.15.104:0/3477037392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37900cea40 0x7f3790149eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:38.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.814+0000 7f379767c700 1 --2- 172.21.15.104:0/3477037392 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f37900cc2e0 0x7f379015b2b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:38.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.814+0000 7f379767c700 1 -- 172.21.15.104:0/3477037392 >> 172.21.15.104:0/3477037392 conn(0x7f3790067590 msgr2=0x7f37900cb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:38.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.814+0000 7f379767c700 1 -- 172.21.15.104:0/3477037392 shutdown_connections 2024-08-17T02:22:38.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:38.814+0000 7f379767c700 1 -- 172.21.15.104:0/3477037392 wait complete. 2024-08-17T02:22:38.830 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:22:38.830 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:22:38.830 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2024-08-17T02:22:38.830 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-17T02:22:38.830 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-17T02:22:38.831 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:22:38.831 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:22:38.831 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:22:38.831 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:22:38.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:38.831 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2024-08-17T02:22:38.839 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:22:38.839 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:22:38.839 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:22:38.840 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:22:38.840 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2024-08-17T02:22:38.840 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:22:38.840 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:22:38.840 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2024-08-17T02:22:38.840 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:22:38.840 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2024-08-17T02:22:38.840 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:22:38.840 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:22:38.840 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:22:38.840 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:22:38.840 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-08-17T02:22:38.841 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 42584sec preferred_lft 42584sec 2024-08-17T02:22:38.841 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ec4:7aff:fe8f:4463/64 scope link 2024-08-17T02:22:38.841 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:22:38.841 INFO:teuthology.orchestra.run.smithi117.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-17T02:22:38.841 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 02:42:ac:19:64:9e brd ff:ff:ff:ff:ff:ff 2024-08-17T02:22:38.841 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-17T02:22:38.841 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:22:38.841 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-17T02:22:38.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:38.842 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2024-08-17T02:22:38.842 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-08-17T02:22:38.842 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link add name ceph-brx type bridge 2024-08-17T02:22:38.842 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip addr flush dev ceph-brx 2024-08-17T02:22:38.842 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set ceph-brx up 2024-08-17T02:22:38.842 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-17T02:22:38.842 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-08-17T02:22:38.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:38.887 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:22:38.946 INFO:teuthology.orchestra.run.smithi117.stdout:1 2024-08-17T02:22:38.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:38.946 DEBUG:teuthology.orchestra.run.smithi117:> route 2024-08-17T02:22:38.972 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2024-08-17T02:22:38.972 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:22:38.972 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-08-17T02:22:38.972 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:22:38.972 INFO:teuthology.orchestra.run.smithi117.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-17T02:22:38.972 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-08-17T02:22:38.972 INFO:teuthology.orchestra.run.smithi117.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-17T02:22:38.972 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:22:38.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:38.973 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2024-08-17T02:22:38.973 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-08-17T02:22:38.973 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:22:38.973 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:22:38.973 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:22:38.973 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-08-17T02:22:39.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:39.014 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2024-08-17T02:22:39.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:39.064 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list-id 2024-08-17T02:22:39.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:39.072 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2024-08-17T02:22:39.072 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-08-17T02:22:39.072 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:22:39.072 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-08-17T02:22:39.072 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-08-17T02:22:39.104 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-08-17T02:22:39.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:39.105 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2024-08-17T02:22:39.105 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-08-17T02:22:39.105 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-08-17T02:22:39.105 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-17T02:22:39.105 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-08-17T02:22:39.106 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-08-17T02:22:39.106 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-08-17T02:22:39.106 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-08-17T02:22:39.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:39.218 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2024-08-17T02:22:39.218 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-08-17T02:22:39.218 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.0 up 2024-08-17T02:22:39.218 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set dev brx.0 master ceph-brx 2024-08-17T02:22:39.218 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-08-17T02:22:39.245 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-08-17T02:22:39.245 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:22:39.245 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-17T02:22:39.296 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:22:39.297 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:22:39.297 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:22:39.304 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2024-08-17T02:22:39.318 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:22:39.319 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:22:39.376 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:22:39.377 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:22:39.378 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:22:39.378 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2024-08-17T02:22:39.382 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-17T02:22:39.382 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-08-17T02:22:39.385 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2024-08-17T02:22:39.400 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:22:39.400 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:22:39.414 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:22:39.415 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:22:39.415 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:22:39.415 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2024-08-17T02:22:39.466 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:2024-08-17T02:22:39.461+0000 7f5056ba2380 -1 init, newargv = 0x55ad239fb7d0 newargc=15 2024-08-17T02:22:39.467 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[29892]: starting ceph client 2024-08-17T02:22:39.476 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[29892]: starting fuse 2024-08-17T02:22:40.566 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2024-08-17T02:22:40.585 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:22:40.586 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:22:40.599 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:22:40.599 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:22:40.600 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:22:40.600 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2024-08-17T02:22:40.605 INFO:teuthology.orchestra.run.smithi117.stdout:52 2024-08-17T02:22:40.605 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-08-17T02:22:40.606 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-08-17T02:22:40.606 DEBUG:teuthology.orchestra.run.smithi117:> import glob 2024-08-17T02:22:40.606 DEBUG:teuthology.orchestra.run.smithi117:> import re 2024-08-17T02:22:40.606 DEBUG:teuthology.orchestra.run.smithi117:> import os 2024-08-17T02:22:40.606 DEBUG:teuthology.orchestra.run.smithi117:> import subprocess 2024-08-17T02:22:40.606 DEBUG:teuthology.orchestra.run.smithi117:> 2024-08-17T02:22:40.606 DEBUG:teuthology.orchestra.run.smithi117:> def _find_admin_socket(client_name): 2024-08-17T02:22:40.606 DEBUG:teuthology.orchestra.run.smithi117:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-08-17T02:22:40.606 DEBUG:teuthology.orchestra.run.smithi117:> files = glob.glob(asok_path) 2024-08-17T02:22:40.606 DEBUG:teuthology.orchestra.run.smithi117:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-08-17T02:22:40.606 DEBUG:teuthology.orchestra.run.smithi117:> 2024-08-17T02:22:40.606 DEBUG:teuthology.orchestra.run.smithi117:> # Given a non-glob path, it better be there 2024-08-17T02:22:40.607 DEBUG:teuthology.orchestra.run.smithi117:> if "*" not in asok_path: 2024-08-17T02:22:40.607 DEBUG:teuthology.orchestra.run.smithi117:> assert(len(files) == 1) 2024-08-17T02:22:40.607 DEBUG:teuthology.orchestra.run.smithi117:> return files[0] 2024-08-17T02:22:40.607 DEBUG:teuthology.orchestra.run.smithi117:> 2024-08-17T02:22:40.607 DEBUG:teuthology.orchestra.run.smithi117:> for f in files: 2024-08-17T02:22:40.607 DEBUG:teuthology.orchestra.run.smithi117:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-17T02:22:40.607 DEBUG:teuthology.orchestra.run.smithi117:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-17T02:22:40.607 DEBUG:teuthology.orchestra.run.smithi117:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-17T02:22:40.607 DEBUG:teuthology.orchestra.run.smithi117:> contents = proc_f.read() 2024-08-17T02:22:40.607 DEBUG:teuthology.orchestra.run.smithi117:> if mountpoint in contents: 2024-08-17T02:22:40.607 DEBUG:teuthology.orchestra.run.smithi117:> return f 2024-08-17T02:22:40.607 DEBUG:teuthology.orchestra.run.smithi117:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-17T02:22:40.607 DEBUG:teuthology.orchestra.run.smithi117:> 2024-08-17T02:22:40.607 DEBUG:teuthology.orchestra.run.smithi117:> print(_find_admin_socket("client.1")) 2024-08-17T02:22:40.607 DEBUG:teuthology.orchestra.run.smithi117:> ' 2024-08-17T02:22:40.732 INFO:teuthology.orchestra.run.smithi117.stdout:/var/run/ceph/ceph-client.1.29892.asok 2024-08-17T02:22:40.917 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.29892.asok 2024-08-17T02:22:40.917 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:22:40.918 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.29892.asok status 2024-08-17T02:22:41.010 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-08-17T02:22:41.010 INFO:teuthology.orchestra.run.smithi117.stdout: "metadata": { 2024-08-17T02:22:41.010 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_sha1": "2577e8139c6b8786f9d6d6ea21b8da9244b9260e", 2024-08-17T02:22:41.010 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_version": "ceph version 17.2.7-1375-g2577e813 (2577e8139c6b8786f9d6d6ea21b8da9244b9260e) quincy (stable)", 2024-08-17T02:22:41.010 INFO:teuthology.orchestra.run.smithi117.stdout: "entity_id": "1", 2024-08-17T02:22:41.010 INFO:teuthology.orchestra.run.smithi117.stdout: "hostname": "smithi117", 2024-08-17T02:22:41.010 INFO:teuthology.orchestra.run.smithi117.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-08-17T02:22:41.010 INFO:teuthology.orchestra.run.smithi117.stdout: "pid": "29892", 2024-08-17T02:22:41.011 INFO:teuthology.orchestra.run.smithi117.stdout: "root": "/" 2024-08-17T02:22:41.011 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-08-17T02:22:41.011 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_count": 0, 2024-08-17T02:22:41.011 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_pinned_count": 0, 2024-08-17T02:22:41.011 INFO:teuthology.orchestra.run.smithi117.stdout: "id": 4639, 2024-08-17T02:22:41.011 INFO:teuthology.orchestra.run.smithi117.stdout: "inst": { 2024-08-17T02:22:41.011 INFO:teuthology.orchestra.run.smithi117.stdout: "name": { 2024-08-17T02:22:41.011 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "client", 2024-08-17T02:22:41.011 INFO:teuthology.orchestra.run.smithi117.stdout: "num": 4639 2024-08-17T02:22:41.011 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-08-17T02:22:41.011 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2024-08-17T02:22:41.011 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2024-08-17T02:22:41.011 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2024-08-17T02:22:41.011 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 2219833127 2024-08-17T02:22:41.011 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-08-17T02:22:41.012 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-08-17T02:22:41.012 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2024-08-17T02:22:41.012 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2024-08-17T02:22:41.012 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2024-08-17T02:22:41.012 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 2219833127 2024-08-17T02:22:41.012 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-08-17T02:22:41.012 INFO:teuthology.orchestra.run.smithi117.stdout: "inst_str": "client.4639 192.168.0.1:0/2219833127", 2024-08-17T02:22:41.012 INFO:teuthology.orchestra.run.smithi117.stdout: "addr_str": "192.168.0.1:0/2219833127", 2024-08-17T02:22:41.012 INFO:teuthology.orchestra.run.smithi117.stdout: "inode_count": 1, 2024-08-17T02:22:41.012 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_epoch": 7, 2024-08-17T02:22:41.012 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch": 23, 2024-08-17T02:22:41.012 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch_barrier": 0, 2024-08-17T02:22:41.012 INFO:teuthology.orchestra.run.smithi117.stdout: "blocklisted": false, 2024-08-17T02:22:41.012 INFO:teuthology.orchestra.run.smithi117.stdout: "fs_name": "cephfs" 2024-08-17T02:22:41.012 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-08-17T02:22:41.019 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:22:41.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.130+0000 7f7964911700 1 Processor -- start 2024-08-17T02:22:41.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.130+0000 7f7964911700 1 -- start start 2024-08-17T02:22:41.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.134+0000 7f7964911700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7960159040 0x7f79600cf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:41.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.134+0000 7f7964911700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f79600d0010 0x7f79600d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:41.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.134+0000 7f7964911700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f796015cea0 0x7f796015d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:41.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.134+0000 7f7964911700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79600cf190 con 0x7f79600d0010 2024-08-17T02:22:41.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.134+0000 7f7964911700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79600d09a0 con 0x7f796015cea0 2024-08-17T02:22:41.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.134+0000 7f7964911700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79600ce5e0 con 0x7f7960159040 2024-08-17T02:22:41.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.134+0000 7f795e59c700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f79600d0010 0x7f79600d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:41.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.134+0000 7f795e59c700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f79600d0010 0x7f79600d0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53600/0 (socket says 172.21.15.104:53600) 2024-08-17T02:22:41.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.134+0000 7f795e59c700 1 -- 172.21.15.104:0/703024054 learned_addr learned my addr 172.21.15.104:0/703024054 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:41.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.134+0000 7f795ed9d700 1 --2- 172.21.15.104:0/703024054 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7960159040 0x7f79600cf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:41.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.134+0000 7f795f59e700 1 --2- 172.21.15.104:0/703024054 >> v2:172.21.15.117:3300/0 conn(0x7f796015cea0 0x7f796015d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:41.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.134+0000 7f795e59c700 1 -- 172.21.15.104:0/703024054 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7960159040 msgr2=0x7f79600cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:41.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.134+0000 7f795e59c700 1 --2- 172.21.15.104:0/703024054 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7960159040 0x7f79600cf620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:41.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.134+0000 7f795e59c700 1 -- 172.21.15.104:0/703024054 >> v2:172.21.15.117:3300/0 conn(0x7f796015cea0 msgr2=0x7f796015d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:41.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.134+0000 7f795e59c700 1 --2- 172.21.15.104:0/703024054 >> v2:172.21.15.117:3300/0 conn(0x7f796015cea0 0x7f796015d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:41.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.134+0000 7f795e59c700 1 -- 172.21.15.104:0/703024054 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79600ce860 con 0x7f79600d0010 2024-08-17T02:22:41.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.134+0000 7f795e59c700 1 --2- 172.21.15.104:0/703024054 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f79600d0010 0x7f79600d0460 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f79600b6130 tx=0x7f794c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f5f6fa127b7b415 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:41.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.134+0000 7f795dd9b700 1 -- 172.21.15.104:0/703024054 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c00b640 con 0x7f79600d0010 2024-08-17T02:22:41.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.134+0000 7f795dd9b700 1 -- 172.21.15.104:0/703024054 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794c00b7a0 con 0x7f79600d0010 2024-08-17T02:22:41.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.134+0000 7f795dd9b700 1 -- 172.21.15.104:0/703024054 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c00bb60 con 0x7f79600d0010 2024-08-17T02:22:41.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.134+0000 7f7964911700 1 -- 172.21.15.104:0/703024054 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f79600d0010 msgr2=0x7f79600d0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:41.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.134+0000 7f7964911700 1 --2- 172.21.15.104:0/703024054 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f79600d0010 0x7f79600d0460 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f79600b6130 tx=0x7f794c009250 comp rx=0 tx=0).stop 2024-08-17T02:22:41.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.134+0000 7f7964911700 1 -- 172.21.15.104:0/703024054 shutdown_connections 2024-08-17T02:22:41.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.134+0000 7f7964911700 1 --2- 172.21.15.104:0/703024054 >> v2:172.21.15.117:3300/0 conn(0x7f796015cea0 0x7f796015d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:41.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.134+0000 7f7964911700 1 --2- 172.21.15.104:0/703024054 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f79600d0010 0x7f79600d0460 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:41.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.134+0000 7f7964911700 1 --2- 172.21.15.104:0/703024054 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7960159040 0x7f79600cf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:41.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.134+0000 7f7964911700 1 -- 172.21.15.104:0/703024054 >> 172.21.15.104:0/703024054 conn(0x7f7960068250 msgr2=0x7f7960068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:41.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.134+0000 7f7964911700 1 -- 172.21.15.104:0/703024054 shutdown_connections 2024-08-17T02:22:41.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.134+0000 7f7964911700 1 -- 172.21.15.104:0/703024054 wait complete. 2024-08-17T02:22:41.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.138+0000 7f7964911700 1 Processor -- start 2024-08-17T02:22:41.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.138+0000 7f7964911700 1 -- start start 2024-08-17T02:22:41.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.142+0000 7f7964911700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f79600d0010 0x7f7960169360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:41.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.142+0000 7f7964911700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7960159040 0x7f796016a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:41.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.142+0000 7f7964911700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f796015cea0 0x7f7960157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:41.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.142+0000 7f7964911700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79600b0980 con 0x7f79600d0010 2024-08-17T02:22:41.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.142+0000 7f7964911700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79601698a0 con 0x7f7960159040 2024-08-17T02:22:41.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.142+0000 7f7964911700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79600afd70 con 0x7f796015cea0 2024-08-17T02:22:41.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.142+0000 7f795ed9d700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f79600d0010 0x7f7960169360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:41.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.142+0000 7f795ed9d700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f79600d0010 0x7f7960169360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53606/0 (socket says 172.21.15.104:53606) 2024-08-17T02:22:41.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.142+0000 7f795ed9d700 1 -- 172.21.15.104:0/339108272 learned_addr learned my addr 172.21.15.104:0/339108272 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:41.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.142+0000 7f795e59c700 1 --2- 172.21.15.104:0/339108272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7960159040 0x7f796016a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:41.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.142+0000 7f795f59e700 1 --2- 172.21.15.104:0/339108272 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f796015cea0 0x7f7960157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:41.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.142+0000 7f795ed9d700 1 -- 172.21.15.104:0/339108272 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f796015cea0 msgr2=0x7f7960157960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:41.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.142+0000 7f795ed9d700 1 --2- 172.21.15.104:0/339108272 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f796015cea0 0x7f7960157960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:41.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.142+0000 7f795ed9d700 1 -- 172.21.15.104:0/339108272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7960159040 msgr2=0x7f796016a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:41.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.142+0000 7f795ed9d700 1 --2- 172.21.15.104:0/339108272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7960159040 0x7f796016a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:41.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.142+0000 7f795ed9d700 1 -- 172.21.15.104:0/339108272 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794c0094f0 con 0x7f79600d0010 2024-08-17T02:22:41.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.142+0000 7f795ed9d700 1 --2- 172.21.15.104:0/339108272 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f79600d0010 0x7f7960169360 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f795000ec80 tx=0x7f79500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:41.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.142+0000 7f7956ffd700 1 -- 172.21.15.104:0/339108272 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795000c850 con 0x7f79600d0010 2024-08-17T02:22:41.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.142+0000 7f7956ffd700 1 -- 172.21.15.104:0/339108272 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f795000c9d0 con 0x7f79600d0010 2024-08-17T02:22:41.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.142+0000 7f7964911700 1 -- 172.21.15.104:0/339108272 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79600b0050 con 0x7f79600d0010 2024-08-17T02:22:41.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.142+0000 7f7956ffd700 1 -- 172.21.15.104:0/339108272 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795000cd90 con 0x7f79600d0010 2024-08-17T02:22:41.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.142+0000 7f7964911700 1 -- 172.21.15.104:0/339108272 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79600b0610 con 0x7f79600d0010 2024-08-17T02:22:41.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.142+0000 7f7964911700 1 -- 172.21.15.104:0/339108272 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79600643a0 con 0x7f79600d0010 2024-08-17T02:22:41.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.146+0000 7f7956ffd700 1 -- 172.21.15.104:0/339108272 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7950013680 con 0x7f79600d0010 2024-08-17T02:22:41.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.146+0000 7f7956ffd700 1 --2- 172.21.15.104:0/339108272 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7948060860 0x7f7948062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:41.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.146+0000 7f7956ffd700 1 -- 172.21.15.104:0/339108272 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f795007cef0 con 0x7f79600d0010 2024-08-17T02:22:41.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.146+0000 7f795e59c700 1 --2- 172.21.15.104:0/339108272 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7948060860 0x7f7948062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:41.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.146+0000 7f795e59c700 1 --2- 172.21.15.104:0/339108272 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7948060860 0x7f7948062d10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f79600b6130 tx=0x7f794c017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:41.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.150+0000 7f7956ffd700 1 -- 172.21.15.104:0/339108272 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f795004d2a0 con 0x7f79600d0010 2024-08-17T02:22:41.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.350+0000 7f7964911700 1 -- 172.21.15.104:0/339108272 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f79600b5e30 con 0x7f79600d0010 2024-08-17T02:22:41.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.350+0000 7f7956ffd700 1 -- 172.21.15.104:0/339108272 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f79500508c0 con 0x7f79600d0010 2024-08-17T02:22:41.354 INFO:teuthology.orchestra.run.smithi104.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:22:41.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.354+0000 7f7964911700 1 -- 172.21.15.104:0/339108272 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7948060860 msgr2=0x7f7948062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:41.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.354+0000 7f7964911700 1 --2- 172.21.15.104:0/339108272 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7948060860 0x7f7948062d10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f79600b6130 tx=0x7f794c017000 comp rx=0 tx=0).stop 2024-08-17T02:22:41.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.354+0000 7f7964911700 1 -- 172.21.15.104:0/339108272 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f79600d0010 msgr2=0x7f7960169360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:41.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.354+0000 7f7964911700 1 --2- 172.21.15.104:0/339108272 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f79600d0010 0x7f7960169360 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f795000ec80 tx=0x7f79500091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:41.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.354+0000 7f7964911700 1 -- 172.21.15.104:0/339108272 shutdown_connections 2024-08-17T02:22:41.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.354+0000 7f7964911700 1 --2- 172.21.15.104:0/339108272 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7948060860 0x7f7948062d10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:41.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.354+0000 7f7964911700 1 --2- 172.21.15.104:0/339108272 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f796015cea0 0x7f7960157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:41.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.354+0000 7f7964911700 1 --2- 172.21.15.104:0/339108272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7960159040 0x7f796016a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:41.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.354+0000 7f7964911700 1 --2- 172.21.15.104:0/339108272 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f79600d0010 0x7f7960169360 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:41.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.354+0000 7f7964911700 1 -- 172.21.15.104:0/339108272 >> 172.21.15.104:0/339108272 conn(0x7f7960068250 msgr2=0x7f79600aee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:41.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.354+0000 7f7964911700 1 -- 172.21.15.104:0/339108272 shutdown_connections 2024-08-17T02:22:41.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:41.354+0000 7f7964911700 1 -- 172.21.15.104:0/339108272 wait complete. 2024-08-17T02:22:41.368 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:22:41.368 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:22:41.368 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2024-08-17T02:22:41.368 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-08-17T02:22:41.368 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-08-17T02:22:41.368 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:22:41.368 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:22:41.368 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:22:41.368 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-08-17T02:22:41.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:41.369 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2024-08-17T02:22:41.377 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:22:41.377 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:22:41.377 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:22:41.377 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:22:41.377 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2024-08-17T02:22:41.377 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:22:41.377 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:22:41.377 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2024-08-17T02:22:41.377 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:22:41.378 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2024-08-17T02:22:41.378 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:22:41.378 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:22:41.378 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:22:41.378 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:22:41.378 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-08-17T02:22:41.378 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 42581sec preferred_lft 42581sec 2024-08-17T02:22:41.378 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ec4:7aff:fe8f:4463/64 scope link 2024-08-17T02:22:41.378 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:22:41.378 INFO:teuthology.orchestra.run.smithi117.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-17T02:22:41.378 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 02:42:ac:19:64:9e brd ff:ff:ff:ff:ff:ff 2024-08-17T02:22:41.378 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-17T02:22:41.379 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:22:41.379 INFO:teuthology.orchestra.run.smithi117.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:22:41.379 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether fa:89:18:75:99:18 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:22:41.379 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:22:41.379 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:22:41.379 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::7468:93ff:fe47:9753/64 scope link 2024-08-17T02:22:41.379 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:22:41.379 INFO:teuthology.orchestra.run.smithi117.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:22:41.379 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether fa:89:18:75:99:18 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:22:41.379 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::f889:18ff:fe75:9918/64 scope link 2024-08-17T02:22:41.379 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:22:41.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:41.380 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:22:41.435 INFO:teuthology.orchestra.run.smithi117.stdout:1 2024-08-17T02:22:41.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:41.437 DEBUG:teuthology.orchestra.run.smithi117:> route 2024-08-17T02:22:41.446 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2024-08-17T02:22:41.446 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:22:41.446 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-08-17T02:22:41.446 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:22:41.446 INFO:teuthology.orchestra.run.smithi117.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-17T02:22:41.446 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-08-17T02:22:41.446 INFO:teuthology.orchestra.run.smithi117.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-17T02:22:41.446 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:22:41.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:41.447 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2024-08-17T02:22:41.447 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-08-17T02:22:41.447 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:22:41.447 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:22:41.447 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:22:41.447 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-08-17T02:22:41.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:41.485 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2024-08-17T02:22:41.536 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:22:41.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:41.536 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list-id 2024-08-17T02:22:41.543 INFO:teuthology.orchestra.run.smithi117.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-08-17T02:22:41.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:41.544 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2024-08-17T02:22:41.544 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-08-17T02:22:41.544 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:22:41.544 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-08-17T02:22:41.544 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-08-17T02:22:41.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:41.574 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-17T02:22:41.635 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:22:41.685 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:22:41.686 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:22:41.686 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:22:41.686 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2024-08-17T02:22:41.686 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:22:41.686 INFO:teuthology.orchestra.run.smithi117.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:22:41.686 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 5a:08:f7:ba:f6:19 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:22:41.686 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:22:41.686 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:22:41.686 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::5808:f7ff:feba:f619/64 scope link 2024-08-17T02:22:41.686 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:22:41.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:41.688 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-17T02:22:41.705 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:22:41.705 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:22:41.705 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:22:41.706 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:22:41.706 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2024-08-17T02:22:41.706 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:22:41.706 INFO:teuthology.orchestra.run.smithi117.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:22:41.706 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 5a:08:f7:ba:f6:19 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:22:41.706 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:22:41.706 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:22:41.706 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::5808:f7ff:feba:f619/64 scope link 2024-08-17T02:22:41.706 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:22:41.707 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-08-17T02:22:41.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:41.707 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2024-08-17T02:22:41.708 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-08-17T02:22:41.708 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-08-17T02:22:41.708 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-17T02:22:41.708 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-08-17T02:22:41.708 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-08-17T02:22:41.708 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-08-17T02:22:41.708 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-08-17T02:22:41.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:41.766 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2024-08-17T02:22:41.766 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-08-17T02:22:41.766 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.1 up 2024-08-17T02:22:41.766 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set dev brx.1 master ceph-brx 2024-08-17T02:22:41.766 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-08-17T02:22:41.792 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-08-17T02:22:41.793 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:22:41.793 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-08-17T02:22:41.798 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-08-17T02:22:41.798 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:22:41.798 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-08-17T02:22:41.804 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2024-08-17T02:22:41.862 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:22:41.862 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:22:41.879 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:22:41.880 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:22:41.880 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:22:41.880 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2024-08-17T02:22:41.890 INFO:teuthology.orchestra.run.smithi117.stdout:52 2024-08-17T02:22:41.890 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [52] 2024-08-17T02:22:41.891 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-08-17T02:22:41.934 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2024-08-17T02:22:41.951 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:22:41.951 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:22:41.962 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:22:41.962 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:22:41.963 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:22:41.963 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2024-08-17T02:22:41.968 INFO:teuthology.orchestra.run.smithi117.stdout:52 2024-08-17T02:22:42.021 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi117.stderr:2024-08-17T02:22:42.017+0000 7f447c108380 -1 init, newargv = 0x564359828c10 newargc=15 2024-08-17T02:22:42.021 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi117.stderr:ceph-fuse[30007]: starting ceph client 2024-08-17T02:22:42.030 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi117.stderr:ceph-fuse[30007]: starting fuse 2024-08-17T02:22:43.069 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2024-08-17T02:22:43.086 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:22:43.086 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:22:43.103 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:22:43.104 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:22:43.104 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:22:43.104 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2024-08-17T02:22:43.159 INFO:teuthology.orchestra.run.smithi117.stdout:52 2024-08-17T02:22:43.159 INFO:teuthology.orchestra.run.smithi117.stdout:53 2024-08-17T02:22:43.159 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52, 53] 2024-08-17T02:22:43.160 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-08-17T02:22:43.160 DEBUG:teuthology.orchestra.run.smithi117:> import glob 2024-08-17T02:22:43.160 DEBUG:teuthology.orchestra.run.smithi117:> import re 2024-08-17T02:22:43.160 DEBUG:teuthology.orchestra.run.smithi117:> import os 2024-08-17T02:22:43.160 DEBUG:teuthology.orchestra.run.smithi117:> import subprocess 2024-08-17T02:22:43.160 DEBUG:teuthology.orchestra.run.smithi117:> 2024-08-17T02:22:43.160 DEBUG:teuthology.orchestra.run.smithi117:> def _find_admin_socket(client_name): 2024-08-17T02:22:43.160 DEBUG:teuthology.orchestra.run.smithi117:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-08-17T02:22:43.160 DEBUG:teuthology.orchestra.run.smithi117:> files = glob.glob(asok_path) 2024-08-17T02:22:43.160 DEBUG:teuthology.orchestra.run.smithi117:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-08-17T02:22:43.160 DEBUG:teuthology.orchestra.run.smithi117:> 2024-08-17T02:22:43.160 DEBUG:teuthology.orchestra.run.smithi117:> # Given a non-glob path, it better be there 2024-08-17T02:22:43.161 DEBUG:teuthology.orchestra.run.smithi117:> if "*" not in asok_path: 2024-08-17T02:22:43.161 DEBUG:teuthology.orchestra.run.smithi117:> assert(len(files) == 1) 2024-08-17T02:22:43.161 DEBUG:teuthology.orchestra.run.smithi117:> return files[0] 2024-08-17T02:22:43.161 DEBUG:teuthology.orchestra.run.smithi117:> 2024-08-17T02:22:43.161 DEBUG:teuthology.orchestra.run.smithi117:> for f in files: 2024-08-17T02:22:43.161 DEBUG:teuthology.orchestra.run.smithi117:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-17T02:22:43.161 DEBUG:teuthology.orchestra.run.smithi117:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-17T02:22:43.161 DEBUG:teuthology.orchestra.run.smithi117:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-17T02:22:43.161 DEBUG:teuthology.orchestra.run.smithi117:> contents = proc_f.read() 2024-08-17T02:22:43.161 DEBUG:teuthology.orchestra.run.smithi117:> if mountpoint in contents: 2024-08-17T02:22:43.161 DEBUG:teuthology.orchestra.run.smithi117:> return f 2024-08-17T02:22:43.161 DEBUG:teuthology.orchestra.run.smithi117:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-17T02:22:43.161 DEBUG:teuthology.orchestra.run.smithi117:> 2024-08-17T02:22:43.161 DEBUG:teuthology.orchestra.run.smithi117:> print(_find_admin_socket("client.3")) 2024-08-17T02:22:43.161 DEBUG:teuthology.orchestra.run.smithi117:> ' 2024-08-17T02:22:43.246 INFO:teuthology.orchestra.run.smithi117.stdout:/var/run/ceph/ceph-client.3.30007.asok 2024-08-17T02:22:43.429 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.30007.asok 2024-08-17T02:22:43.429 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:22:43.430 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.30007.asok status 2024-08-17T02:22:43.523 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-08-17T02:22:43.523 INFO:teuthology.orchestra.run.smithi117.stdout: "metadata": { 2024-08-17T02:22:43.523 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_sha1": "2577e8139c6b8786f9d6d6ea21b8da9244b9260e", 2024-08-17T02:22:43.523 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_version": "ceph version 17.2.7-1375-g2577e813 (2577e8139c6b8786f9d6d6ea21b8da9244b9260e) quincy (stable)", 2024-08-17T02:22:43.523 INFO:teuthology.orchestra.run.smithi117.stdout: "entity_id": "3", 2024-08-17T02:22:43.524 INFO:teuthology.orchestra.run.smithi117.stdout: "hostname": "smithi117", 2024-08-17T02:22:43.524 INFO:teuthology.orchestra.run.smithi117.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-08-17T02:22:43.524 INFO:teuthology.orchestra.run.smithi117.stdout: "pid": "30007", 2024-08-17T02:22:43.524 INFO:teuthology.orchestra.run.smithi117.stdout: "root": "/" 2024-08-17T02:22:43.524 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-08-17T02:22:43.524 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_count": 0, 2024-08-17T02:22:43.524 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_pinned_count": 0, 2024-08-17T02:22:43.524 INFO:teuthology.orchestra.run.smithi117.stdout: "id": 4651, 2024-08-17T02:22:43.524 INFO:teuthology.orchestra.run.smithi117.stdout: "inst": { 2024-08-17T02:22:43.524 INFO:teuthology.orchestra.run.smithi117.stdout: "name": { 2024-08-17T02:22:43.524 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "client", 2024-08-17T02:22:43.524 INFO:teuthology.orchestra.run.smithi117.stdout: "num": 4651 2024-08-17T02:22:43.524 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-08-17T02:22:43.525 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2024-08-17T02:22:43.525 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2024-08-17T02:22:43.525 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.2:0", 2024-08-17T02:22:43.525 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 3152327974 2024-08-17T02:22:43.525 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-08-17T02:22:43.525 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-08-17T02:22:43.525 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2024-08-17T02:22:43.525 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2024-08-17T02:22:43.525 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.2:0", 2024-08-17T02:22:43.525 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 3152327974 2024-08-17T02:22:43.525 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-08-17T02:22:43.525 INFO:teuthology.orchestra.run.smithi117.stdout: "inst_str": "client.4651 192.168.0.2:0/3152327974", 2024-08-17T02:22:43.525 INFO:teuthology.orchestra.run.smithi117.stdout: "addr_str": "192.168.0.2:0/3152327974", 2024-08-17T02:22:43.526 INFO:teuthology.orchestra.run.smithi117.stdout: "inode_count": 1, 2024-08-17T02:22:43.526 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_epoch": 7, 2024-08-17T02:22:43.526 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch": 23, 2024-08-17T02:22:43.526 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch_barrier": 0, 2024-08-17T02:22:43.526 INFO:teuthology.orchestra.run.smithi117.stdout: "blocklisted": false, 2024-08-17T02:22:43.526 INFO:teuthology.orchestra.run.smithi117.stdout: "fs_name": "cephfs" 2024-08-17T02:22:43.526 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-08-17T02:22:43.532 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:22:43.532 DEBUG:teuthology.orchestra.run.smithi104:> stat --file-system '--printf=%T 2024-08-17T02:22:43.532 DEBUG:teuthology.orchestra.run.smithi104:> ' -- /home/ubuntu/cephtest/mnt.0 2024-08-17T02:22:43.541 INFO:teuthology.orchestra.run.smithi104.stdout:fuseblk 2024-08-17T02:22:43.541 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-08-17T02:22:43.541 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:22:43.541 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:22:43.559 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:22:43.559 DEBUG:teuthology.orchestra.run.smithi104:> stat --file-system '--printf=%T 2024-08-17T02:22:43.560 DEBUG:teuthology.orchestra.run.smithi104:> ' -- /home/ubuntu/cephtest/mnt.2 2024-08-17T02:22:43.610 INFO:teuthology.orchestra.run.smithi104.stdout:fuseblk 2024-08-17T02:22:43.610 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-08-17T02:22:43.610 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:22:43.610 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-08-17T02:22:43.633 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:22:43.633 DEBUG:teuthology.orchestra.run.smithi117:> stat --file-system '--printf=%T 2024-08-17T02:22:43.633 DEBUG:teuthology.orchestra.run.smithi117:> ' -- /home/ubuntu/cephtest/mnt.1 2024-08-17T02:22:43.641 INFO:teuthology.orchestra.run.smithi117.stdout:fuseblk 2024-08-17T02:22:43.641 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-08-17T02:22:43.641 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:22:43.642 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:22:43.654 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:22:43.654 DEBUG:teuthology.orchestra.run.smithi117:> stat --file-system '--printf=%T 2024-08-17T02:22:43.654 DEBUG:teuthology.orchestra.run.smithi117:> ' -- /home/ubuntu/cephtest/mnt.3 2024-08-17T02:22:43.662 INFO:teuthology.orchestra.run.smithi117.stdout:fuseblk 2024-08-17T02:22:43.662 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-08-17T02:22:43.662 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:22:43.662 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-08-17T02:22:43.720 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-08-17T02:22:43.737 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:22:43.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.850+0000 7f75e78d3700 1 Processor -- start 2024-08-17T02:22:43.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.850+0000 7f75e78d3700 1 -- start start 2024-08-17T02:22:43.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.850+0000 7f75e78d3700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f75e00a9430 0x7f75e00b0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:43.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.850+0000 7f75e78d3700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75e00b0270 con 0x7f75e00af030 2024-08-17T02:22:43.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.850+0000 7f75e78d3700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75e00af660 con 0x7f75e015d540 2024-08-17T02:22:43.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.850+0000 7f75e78d3700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75e00af940 con 0x7f75e00a9430 2024-08-17T02:22:43.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.850+0000 7f75e4e6e700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f75e00af030 0x7f75e00a8d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:53962/0 (socket says 172.21.15.104:53962) 2024-08-17T02:22:43.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.850+0000 7f75e4e6e700 1 -- 172.21.15.104:0/1487923607 learned_addr learned my addr 172.21.15.104:0/1487923607 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:43.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.850+0000 7f75e5e70700 1 --2- 172.21.15.104:0/1487923607 >> v2:172.21.15.117:3300/0 conn(0x7f75e00a9430 0x7f75e00b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:43.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.850+0000 7f75d3fff700 1 -- 172.21.15.104:0/1487923607 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1227040929 0 0) 0x7f75e00b0270 con 0x7f75e00af030 2024-08-17T02:22:43.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.850+0000 7f75d3fff700 1 -- 172.21.15.104:0/1487923607 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75cc003570 con 0x7f75e00af030 2024-08-17T02:22:43.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.850+0000 7f75d3fff700 1 -- 172.21.15.104:0/1487923607 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 928303859 0 0) 0x7f75e00af660 con 0x7f75e015d540 2024-08-17T02:22:43.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.850+0000 7f75d3fff700 1 -- 172.21.15.104:0/1487923607 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75e00b0270 con 0x7f75e015d540 2024-08-17T02:22:43.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.850+0000 7f75d3fff700 1 -- 172.21.15.104:0/1487923607 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2168957762 0 0) 0x7f75cc003570 con 0x7f75e00af030 2024-08-17T02:22:43.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.850+0000 7f75e5e70700 1 -- 172.21.15.104:0/1487923607 >> v1:172.21.15.117:6789/0 conn(0x7f75e015d540 legacy=0x7f75e006e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:43.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.850+0000 7f75e5e70700 1 -- 172.21.15.104:0/1487923607 >> v1:172.21.15.104:6789/0 conn(0x7f75e00af030 legacy=0x7f75e00a8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:43.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.850+0000 7f75e5e70700 1 -- 172.21.15.104:0/1487923607 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e00afc20 con 0x7f75e00a9430 2024-08-17T02:22:43.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.850+0000 7f75e5e70700 1 --2- 172.21.15.104:0/1487923607 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75e00a9430 0x7f75e00b0700 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f75d40098e0 tx=0x7f75d40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ae05f9095c685a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:43.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.850+0000 7f75d3fff700 1 -- 172.21.15.104:0/1487923607 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d80017f0 con 0x7f75e00a9430 2024-08-17T02:22:43.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.850+0000 7f75d3fff700 1 -- 172.21.15.104:0/1487923607 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d4011420 con 0x7f75e00a9430 2024-08-17T02:22:43.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.850+0000 7f75d3fff700 1 -- 172.21.15.104:0/1487923607 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d40117a0 con 0x7f75e00a9430 2024-08-17T02:22:43.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.854+0000 7f75e78d3700 1 -- 172.21.15.104:0/1487923607 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75e00a9430 msgr2=0x7f75e00b0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:43.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.854+0000 7f75e78d3700 1 --2- 172.21.15.104:0/1487923607 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75e00a9430 0x7f75e00b0700 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f75d40098e0 tx=0x7f75d40091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:43.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.854+0000 7f75e78d3700 1 -- 172.21.15.104:0/1487923607 shutdown_connections 2024-08-17T02:22:43.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.854+0000 7f75e78d3700 1 --2- 172.21.15.104:0/1487923607 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75e00a9430 0x7f75e00b0700 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:43.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.854+0000 7f75e78d3700 1 -- 172.21.15.104:0/1487923607 >> 172.21.15.104:0/1487923607 conn(0x7f75e0066e00 msgr2=0x7f75e0067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:43.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.854+0000 7f75e78d3700 1 -- 172.21.15.104:0/1487923607 shutdown_connections 2024-08-17T02:22:43.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.854+0000 7f75e78d3700 1 -- 172.21.15.104:0/1487923607 wait complete. 2024-08-17T02:22:43.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.854+0000 7f75e78d3700 1 Processor -- start 2024-08-17T02:22:43.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.854+0000 7f75e78d3700 1 -- start start 2024-08-17T02:22:43.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.854+0000 7f75e78d3700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75e00a9430 0x7f75e0097400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:43.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.854+0000 7f75e78d3700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75e00af030 0x7f75e014bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:43.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.854+0000 7f75e78d3700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75e015d540 0x7f75e014c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:43.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.854+0000 7f75e78d3700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e014c6b0 con 0x7f75e015d540 2024-08-17T02:22:43.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.854+0000 7f75e78d3700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e0097940 con 0x7f75e00a9430 2024-08-17T02:22:43.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.854+0000 7f75e78d3700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e00c9700 con 0x7f75e00af030 2024-08-17T02:22:43.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.854+0000 7f75e5e70700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75e015d540 0x7f75e014c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:43.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.854+0000 7f75e5e70700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75e015d540 0x7f75e014c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53614/0 (socket says 172.21.15.104:53614) 2024-08-17T02:22:43.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.854+0000 7f75e5e70700 1 -- 172.21.15.104:0/4059509644 learned_addr learned my addr 172.21.15.104:0/4059509644 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:43.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.854+0000 7f75e566f700 1 --2- 172.21.15.104:0/4059509644 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75e00a9430 0x7f75e0097400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:43.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.854+0000 7f75e4e6e700 1 --2- 172.21.15.104:0/4059509644 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75e00af030 0x7f75e014bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:43.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.854+0000 7f75e5e70700 1 -- 172.21.15.104:0/4059509644 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75e00af030 msgr2=0x7f75e014bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:43.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.854+0000 7f75e5e70700 1 --2- 172.21.15.104:0/4059509644 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75e00af030 0x7f75e014bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:43.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.854+0000 7f75e5e70700 1 -- 172.21.15.104:0/4059509644 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75e00a9430 msgr2=0x7f75e0097400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:43.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.854+0000 7f75e5e70700 1 --2- 172.21.15.104:0/4059509644 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75e00a9430 0x7f75e0097400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:43.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.854+0000 7f75e5e70700 1 -- 172.21.15.104:0/4059509644 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d4009420 con 0x7f75e015d540 2024-08-17T02:22:43.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.858+0000 7f75e5e70700 1 --2- 172.21.15.104:0/4059509644 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75e015d540 0x7f75e014c170 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f75e006f870 tx=0x7f75d4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:43.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.858+0000 7f75d17fa700 1 -- 172.21.15.104:0/4059509644 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d401ccb0 con 0x7f75e015d540 2024-08-17T02:22:43.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.858+0000 7f75e78d3700 1 -- 172.21.15.104:0/4059509644 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75e00c99e0 con 0x7f75e015d540 2024-08-17T02:22:43.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.858+0000 7f75e78d3700 1 -- 172.21.15.104:0/4059509644 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75e00c9fa0 con 0x7f75e015d540 2024-08-17T02:22:43.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.858+0000 7f75d17fa700 1 -- 172.21.15.104:0/4059509644 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d401ce10 con 0x7f75e015d540 2024-08-17T02:22:43.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.858+0000 7f75d17fa700 1 -- 172.21.15.104:0/4059509644 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d401a660 con 0x7f75e015d540 2024-08-17T02:22:43.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.858+0000 7f75e78d3700 1 -- 172.21.15.104:0/4059509644 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75c00052b0 con 0x7f75e015d540 2024-08-17T02:22:43.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.858+0000 7f75d17fa700 1 -- 172.21.15.104:0/4059509644 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f75d401a7c0 con 0x7f75e015d540 2024-08-17T02:22:43.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.858+0000 7f75d17fa700 1 --2- 172.21.15.104:0/4059509644 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f75c4060860 0x7f75c4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:43.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.858+0000 7f75d17fa700 1 -- 172.21.15.104:0/4059509644 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f75d407e3b0 con 0x7f75e015d540 2024-08-17T02:22:43.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.858+0000 7f75e566f700 1 --2- 172.21.15.104:0/4059509644 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f75c4060860 0x7f75c4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:43.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.862+0000 7f75e566f700 1 --2- 172.21.15.104:0/4059509644 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f75c4060860 0x7f75c4062d10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f75dc007fd0 tx=0x7f75dc007d50 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:43.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:43.870+0000 7f75d17fa700 1 -- 172.21.15.104:0/4059509644 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f75d404e8b0 con 0x7f75e015d540 2024-08-17T02:22:44.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.038+0000 7f75e78d3700 1 -- 172.21.15.104:0/4059509644 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75c0005830 con 0x7f75e015d540 2024-08-17T02:22:44.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.038+0000 7f75d17fa700 1 -- 172.21.15.104:0/4059509644 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f75d4051ed0 con 0x7f75e015d540 2024-08-17T02:22:44.042 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:22:44.043 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":23,"fsid":"fd5f7fb8-d34b-49bb-89a8-62b7dad1bc25","created":"2024-08-17T02:21:57.891389+0000","modified":"2024-08-17T02:22:23.175831+0000","last_up_change":"2024-08-17T02:22:08.924546+0000","last_in_change":"2024-08-17T02:21:59.938028+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:22:10.143970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:22:20.082708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:22:20.521582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"606b9088-590e-4709-aa3a-b0f6e22972ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":24257},{"type":"v1","addr":"172.21.15.104:6809","nonce":24257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":24257},{"type":"v1","addr":"172.21.15.104:6811","nonce":24257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":24257},{"type":"v1","addr":"172.21.15.104:6815","nonce":24257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":24257},{"type":"v1","addr":"172.21.15.104:6813","nonce":24257}]},"public_addr":"172.21.15.104:6809/24257","cluster_addr":"172.21.15.104:6811/24257","heartbeat_back_addr":"172.21.15.104:6815/24257","heartbeat_front_addr":"172.21.15.104:6813/24257","state":["exists","up"]},{"osd":1,"uuid":"9bc6a909-0c2f-4889-afe7-4a47f89b0f64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":24256},{"type":"v1","addr":"172.21.15.104:6825","nonce":24256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":24256},{"type":"v1","addr":"172.21.15.104:6827","nonce":24256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":24256},{"type":"v1","addr":"172.21.15.104:6831","nonce":24256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":24256},{"type":"v1","addr":"172.21.15.104:6829","nonce":24256}]},"public_addr":"172.21.15.104:6825/24256","cluster_addr":"172.21.15.104:6827/24256","heartbeat_back_addr":"172.21.15.104:6831/24256","heartbeat_front_addr":"172.21.15.104:6829/24256","state":["exists","up"]},{"osd":2,"uuid":"23da31d5-aefb-4edb-b79d-fa05e1becef7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":24255},{"type":"v1","addr":"172.21.15.104:6817","nonce":24255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":24255},{"type":"v1","addr":"172.21.15.104:6819","nonce":24255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":24255},{"type":"v1","addr":"172.21.15.104:6823","nonce":24255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":24255},{"type":"v1","addr":"172.21.15.104:6821","nonce":24255}]},"public_addr":"172.21.15.104:6817/24255","cluster_addr":"172.21.15.104:6819/24255","heartbeat_back_addr":"172.21.15.104:6823/24255","heartbeat_front_addr":"172.21.15.104:6821/24255","state":["exists","up"]},{"osd":3,"uuid":"6e4a5ec2-b415-45ef-8381-61a59eb65224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":24254},{"type":"v1","addr":"172.21.15.104:6801","nonce":24254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":24254},{"type":"v1","addr":"172.21.15.104:6803","nonce":24254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":24254},{"type":"v1","addr":"172.21.15.104:6807","nonce":24254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":24254},{"type":"v1","addr":"172.21.15.104:6805","nonce":24254}]},"public_addr":"172.21.15.104:6801/24254","cluster_addr":"172.21.15.104:6803/24254","heartbeat_back_addr":"172.21.15.104:6807/24254","heartbeat_front_addr":"172.21.15.104:6805/24254","state":["exists","up"]},{"osd":4,"uuid":"8d5bea2d-9039-4013-8c99-2c046c5b8a17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":24421},{"type":"v1","addr":"172.21.15.117:6804","nonce":24421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":24421},{"type":"v1","addr":"172.21.15.117:6809","nonce":24421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":24421},{"type":"v1","addr":"172.21.15.117:6815","nonce":24421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":24421},{"type":"v1","addr":"172.21.15.117:6813","nonce":24421}]},"public_addr":"172.21.15.117:6804/24421","cluster_addr":"172.21.15.117:6809/24421","heartbeat_back_addr":"172.21.15.117:6815/24421","heartbeat_front_addr":"172.21.15.117:6813/24421","state":["exists","up"]},{"osd":5,"uuid":"de8b36fc-121c-4f05-8f5b-28f513d9f21f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":24422},{"type":"v1","addr":"172.21.15.117:6817","nonce":24422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":24422},{"type":"v1","addr":"172.21.15.117:6819","nonce":24422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":24422},{"type":"v1","addr":"172.21.15.117:6823","nonce":24422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":24422},{"type":"v1","addr":"172.21.15.117:6821","nonce":24422}]},"public_addr":"172.21.15.117:6817/24422","cluster_addr":"172.21.15.117:6819/24422","heartbeat_back_addr":"172.21.15.117:6823/24422","heartbeat_front_addr":"172.21.15.117:6821/24422","state":["exists","up"]},{"osd":6,"uuid":"6a87f09f-7bf7-4f7a-be87-530ac1ff8ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":24420},{"type":"v1","addr":"172.21.15.117:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6803","nonce":24420},{"type":"v1","addr":"172.21.15.117:6805","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":24420},{"type":"v1","addr":"172.21.15.117:6811","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":24420},{"type":"v1","addr":"172.21.15.117:6808","nonce":24420}]},"public_addr":"172.21.15.117:6801/24420","cluster_addr":"172.21.15.117:6805/24420","heartbeat_back_addr":"172.21.15.117:6811/24420","heartbeat_front_addr":"172.21.15.117:6808/24420","state":["exists","up"]},{"osd":7,"uuid":"e31d8041-1aa1-4b5d-83b3-0a373426dd9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":24423},{"type":"v1","addr":"172.21.15.117:6825","nonce":24423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":24423},{"type":"v1","addr":"172.21.15.117:6827","nonce":24423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":24423},{"type":"v1","addr":"172.21.15.117:6831","nonce":24423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":24423},{"type":"v1","addr":"172.21.15.117:6829","nonce":24423}]},"public_addr":"172.21.15.117:6825/24423","cluster_addr":"172.21.15.117:6827/24423","heartbeat_back_addr":"172.21.15.117:6831/24423","heartbeat_front_addr":"172.21.15.117:6829/24423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.220874+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.210039+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.434762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.247206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.184316+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.306325+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.035719+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.400303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:22:44.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.042+0000 7f75e78d3700 1 -- 172.21.15.104:0/4059509644 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f75c4060860 msgr2=0x7f75c4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:44.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.042+0000 7f75e78d3700 1 --2- 172.21.15.104:0/4059509644 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f75c4060860 0x7f75c4062d10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f75dc007fd0 tx=0x7f75dc007d50 comp rx=0 tx=0).stop 2024-08-17T02:22:44.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.042+0000 7f75e78d3700 1 -- 172.21.15.104:0/4059509644 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75e015d540 msgr2=0x7f75e014c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:44.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.042+0000 7f75e78d3700 1 --2- 172.21.15.104:0/4059509644 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75e015d540 0x7f75e014c170 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f75e006f870 tx=0x7f75d4016000 comp rx=0 tx=0).stop 2024-08-17T02:22:44.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.042+0000 7f75e78d3700 1 -- 172.21.15.104:0/4059509644 shutdown_connections 2024-08-17T02:22:44.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.042+0000 7f75e78d3700 1 --2- 172.21.15.104:0/4059509644 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f75c4060860 0x7f75c4062d10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:44.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.042+0000 7f75e78d3700 1 --2- 172.21.15.104:0/4059509644 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75e015d540 0x7f75e014c170 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:44.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.042+0000 7f75e78d3700 1 --2- 172.21.15.104:0/4059509644 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75e00af030 0x7f75e014bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:44.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.042+0000 7f75e78d3700 1 --2- 172.21.15.104:0/4059509644 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75e00a9430 0x7f75e0097400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:44.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.042+0000 7f75e78d3700 1 -- 172.21.15.104:0/4059509644 >> 172.21.15.104:0/4059509644 conn(0x7f75e0066e00 msgr2=0x7f75e006ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:44.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.042+0000 7f75e78d3700 1 -- 172.21.15.104:0/4059509644 shutdown_connections 2024-08-17T02:22:44.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.042+0000 7f75e78d3700 1 -- 172.21.15.104:0/4059509644 wait complete. 2024-08-17T02:22:44.062 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:22:10.143970+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:22:20.082708+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:22:20.521582+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:22:44.063 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:22:44.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.170+0000 7ffb769bf700 1 Processor -- start 2024-08-17T02:22:44.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.170+0000 7ffb769bf700 1 -- start start 2024-08-17T02:22:44.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.174+0000 7ffb769bf700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ffb7006e720 0x7ffb700aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:44.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.174+0000 7ffb769bf700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb700b0810 con 0x7ffb7013f680 2024-08-17T02:22:44.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.174+0000 7ffb769bf700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb700afc70 con 0x7ffb7013fa50 2024-08-17T02:22:44.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.174+0000 7ffb769bf700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb700af060 con 0x7ffb7006e720 2024-08-17T02:22:44.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.174+0000 7ffb759bd700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7ffb7013f680 0x7ffb700b0100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:53972/0 (socket says 172.21.15.104:53972) 2024-08-17T02:22:44.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.174+0000 7ffb759bd700 1 -- 172.21.15.104:0/1496167222 learned_addr learned my addr 172.21.15.104:0/1496167222 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:44.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.174+0000 7ffb761be700 1 --2- 172.21.15.104:0/1496167222 >> v2:172.21.15.117:3300/0 conn(0x7ffb7006e720 0x7ffb700aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:44.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.174+0000 7ffb749bb700 1 -- 172.21.15.104:0/1496167222 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2286188243 0 0) 0x7ffb700b0810 con 0x7ffb7013f680 2024-08-17T02:22:44.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.174+0000 7ffb749bb700 1 -- 172.21.15.104:0/1496167222 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb58003570 con 0x7ffb7013f680 2024-08-17T02:22:44.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.174+0000 7ffb761be700 1 -- 172.21.15.104:0/1496167222 >> v1:172.21.15.117:6789/0 conn(0x7ffb7013fa50 legacy=0x7ffb7006e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:44.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.174+0000 7ffb761be700 1 -- 172.21.15.104:0/1496167222 >> v1:172.21.15.104:6789/0 conn(0x7ffb7013f680 legacy=0x7ffb700b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:44.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.174+0000 7ffb761be700 1 -- 172.21.15.104:0/1496167222 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb700af340 con 0x7ffb7006e720 2024-08-17T02:22:44.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.174+0000 7ffb761be700 1 --2- 172.21.15.104:0/1496167222 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb7006e720 0x7ffb700aea80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ffb680098e0 tx=0x7ffb680091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60574bea85169c5a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:44.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.174+0000 7ffb749bb700 1 -- 172.21.15.104:0/1496167222 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6800b640 con 0x7ffb7006e720 2024-08-17T02:22:44.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.174+0000 7ffb749bb700 1 -- 172.21.15.104:0/1496167222 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6800b7a0 con 0x7ffb7006e720 2024-08-17T02:22:44.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.174+0000 7ffb749bb700 1 -- 172.21.15.104:0/1496167222 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6800bb20 con 0x7ffb7006e720 2024-08-17T02:22:44.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.174+0000 7ffb769bf700 1 -- 172.21.15.104:0/1496167222 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb7006e720 msgr2=0x7ffb700aea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:44.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.174+0000 7ffb769bf700 1 --2- 172.21.15.104:0/1496167222 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb7006e720 0x7ffb700aea80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ffb680098e0 tx=0x7ffb680091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:44.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.174+0000 7ffb769bf700 1 -- 172.21.15.104:0/1496167222 shutdown_connections 2024-08-17T02:22:44.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.174+0000 7ffb769bf700 1 --2- 172.21.15.104:0/1496167222 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb7006e720 0x7ffb700aea80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:44.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.174+0000 7ffb769bf700 1 -- 172.21.15.104:0/1496167222 >> 172.21.15.104:0/1496167222 conn(0x7ffb700678a0 msgr2=0x7ffb70067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:44.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.174+0000 7ffb769bf700 1 -- 172.21.15.104:0/1496167222 shutdown_connections 2024-08-17T02:22:44.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.174+0000 7ffb769bf700 1 -- 172.21.15.104:0/1496167222 wait complete. 2024-08-17T02:22:44.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.178+0000 7ffb769bf700 1 Processor -- start 2024-08-17T02:22:44.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.178+0000 7ffb769bf700 1 -- start start 2024-08-17T02:22:44.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.178+0000 7ffb769bf700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb7006e720 0x7ffb70154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:44.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.178+0000 7ffb769bf700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffb7013f680 0x7ffb70166f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:44.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.178+0000 7ffb769bf700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb7013fa50 0x7ffb70135230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:44.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.178+0000 7ffb769bf700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb70134da0 con 0x7ffb7013f680 2024-08-17T02:22:44.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.178+0000 7ffb769bf700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb70134190 con 0x7ffb7013fa50 2024-08-17T02:22:44.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.178+0000 7ffb769bf700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb70134470 con 0x7ffb7006e720 2024-08-17T02:22:44.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.178+0000 7ffb751bc700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffb7013f680 0x7ffb70166f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:44.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.178+0000 7ffb751bc700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffb7013f680 0x7ffb70166f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53622/0 (socket says 172.21.15.104:53622) 2024-08-17T02:22:44.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.178+0000 7ffb751bc700 1 -- 172.21.15.104:0/651387360 learned_addr learned my addr 172.21.15.104:0/651387360 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:44.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.178+0000 7ffb761be700 1 --2- 172.21.15.104:0/651387360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb7013fa50 0x7ffb70135230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:44.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.178+0000 7ffb759bd700 1 --2- 172.21.15.104:0/651387360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb7006e720 0x7ffb70154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:44.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.178+0000 7ffb751bc700 1 -- 172.21.15.104:0/651387360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb7006e720 msgr2=0x7ffb70154b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:44.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.178+0000 7ffb751bc700 1 --2- 172.21.15.104:0/651387360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb7006e720 0x7ffb70154b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:44.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.178+0000 7ffb751bc700 1 -- 172.21.15.104:0/651387360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb7013fa50 msgr2=0x7ffb70135230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:44.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.178+0000 7ffb751bc700 1 --2- 172.21.15.104:0/651387360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb7013fa50 0x7ffb70135230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:44.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.178+0000 7ffb751bc700 1 -- 172.21.15.104:0/651387360 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb68009420 con 0x7ffb7013f680 2024-08-17T02:22:44.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.178+0000 7ffb759bd700 1 --2- 172.21.15.104:0/651387360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb7006e720 0x7ffb70154b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:22:44.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.178+0000 7ffb751bc700 1 --2- 172.21.15.104:0/651387360 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffb7013f680 0x7ffb70166f20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c00cb40 tx=0x7ffb6c001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:44.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.178+0000 7ffb65ffb700 1 -- 172.21.15.104:0/651387360 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c00a7e0 con 0x7ffb7013f680 2024-08-17T02:22:44.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.178+0000 7ffb65ffb700 1 -- 172.21.15.104:0/651387360 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6c00a940 con 0x7ffb7013f680 2024-08-17T02:22:44.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.178+0000 7ffb769bf700 1 -- 172.21.15.104:0/651387360 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb70134750 con 0x7ffb7013f680 2024-08-17T02:22:44.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.178+0000 7ffb65ffb700 1 -- 172.21.15.104:0/651387360 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c00ad00 con 0x7ffb7013f680 2024-08-17T02:22:44.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.178+0000 7ffb769bf700 1 -- 172.21.15.104:0/651387360 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb70167460 con 0x7ffb7013f680 2024-08-17T02:22:44.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.182+0000 7ffb769bf700 1 -- 172.21.15.104:0/651387360 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb70064330 con 0x7ffb7013f680 2024-08-17T02:22:44.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.182+0000 7ffb65ffb700 1 -- 172.21.15.104:0/651387360 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ffb6c003030 con 0x7ffb7013f680 2024-08-17T02:22:44.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.182+0000 7ffb65ffb700 1 --2- 172.21.15.104:0/651387360 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ffb5c060860 0x7ffb5c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:44.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.182+0000 7ffb65ffb700 1 -- 172.21.15.104:0/651387360 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffb6c07cba0 con 0x7ffb7013f680 2024-08-17T02:22:44.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.182+0000 7ffb759bd700 1 --2- 172.21.15.104:0/651387360 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ffb5c060860 0x7ffb5c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:44.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.182+0000 7ffb759bd700 1 --2- 172.21.15.104:0/651387360 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ffb5c060860 0x7ffb5c062d10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ffb600058d0 tx=0x7ffb60009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:44.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.190+0000 7ffb65ffb700 1 -- 172.21.15.104:0/651387360 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ffb6c04cff0 con 0x7ffb7013f680 2024-08-17T02:22:44.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.354+0000 7ffb769bf700 1 -- 172.21.15.104:0/651387360 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffb701676e0 con 0x7ffb7013f680 2024-08-17T02:22:44.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.354+0000 7ffb65ffb700 1 -- 172.21.15.104:0/651387360 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffb6c00ae60 con 0x7ffb7013f680 2024-08-17T02:22:44.357 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-08-17T02:22:44.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.354+0000 7ffb769bf700 1 -- 172.21.15.104:0/651387360 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ffb5c060860 msgr2=0x7ffb5c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:44.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.354+0000 7ffb769bf700 1 --2- 172.21.15.104:0/651387360 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ffb5c060860 0x7ffb5c062d10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ffb600058d0 tx=0x7ffb60009040 comp rx=0 tx=0).stop 2024-08-17T02:22:44.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.354+0000 7ffb769bf700 1 -- 172.21.15.104:0/651387360 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffb7013f680 msgr2=0x7ffb70166f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:44.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.354+0000 7ffb769bf700 1 --2- 172.21.15.104:0/651387360 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffb7013f680 0x7ffb70166f20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c00cb40 tx=0x7ffb6c001770 comp rx=0 tx=0).stop 2024-08-17T02:22:44.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.354+0000 7ffb769bf700 1 -- 172.21.15.104:0/651387360 shutdown_connections 2024-08-17T02:22:44.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.354+0000 7ffb769bf700 1 --2- 172.21.15.104:0/651387360 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ffb5c060860 0x7ffb5c062d10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:44.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.354+0000 7ffb769bf700 1 --2- 172.21.15.104:0/651387360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb7013fa50 0x7ffb70135230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:44.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.354+0000 7ffb769bf700 1 --2- 172.21.15.104:0/651387360 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffb7013f680 0x7ffb70166f20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:44.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.354+0000 7ffb769bf700 1 --2- 172.21.15.104:0/651387360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb7006e720 0x7ffb70154b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:44.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.354+0000 7ffb769bf700 1 -- 172.21.15.104:0/651387360 >> 172.21.15.104:0/651387360 conn(0x7ffb700678a0 msgr2=0x7ffb7013dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:44.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.354+0000 7ffb769bf700 1 -- 172.21.15.104:0/651387360 shutdown_connections 2024-08-17T02:22:44.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.354+0000 7ffb769bf700 1 -- 172.21.15.104:0/651387360 wait complete. 2024-08-17T02:22:44.369 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:22:44.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.474+0000 7fed4714d700 1 Processor -- start 2024-08-17T02:22:44.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.474+0000 7fed4714d700 1 -- start start 2024-08-17T02:22:44.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.474+0000 7fed4714d700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fed40159300 0x7fed400b2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:44.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.474+0000 7fed4714d700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fed401596d0 0x7fed40066e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:44.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.474+0000 7fed4714d700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed400cba90 con 0x7fed4015dbc0 2024-08-17T02:22:44.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.474+0000 7fed4714d700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed400b2b60 con 0x7fed40159300 2024-08-17T02:22:44.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.474+0000 7fed4714d700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed400cb160 con 0x7fed401596d0 2024-08-17T02:22:44.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.478+0000 7fed456ea700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fed4015dbc0 0x7fed400afe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:53986/0 (socket says 172.21.15.104:53986) 2024-08-17T02:22:44.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.478+0000 7fed456ea700 1 -- 172.21.15.104:0/217542047 learned_addr learned my addr 172.21.15.104:0/217542047 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:44.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.478+0000 7fed44ee9700 1 --2- 172.21.15.104:0/217542047 >> v2:172.21.15.104:3300/0 conn(0x7fed40159300 0x7fed400b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:44.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.478+0000 7fed3ffff700 1 --2- 172.21.15.104:0/217542047 >> v2:172.21.15.117:3300/0 conn(0x7fed401596d0 0x7fed40066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:44.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.478+0000 7fed3f7fe700 1 -- 172.21.15.104:0/217542047 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 967832699 0 0) 0x7fed400cba90 con 0x7fed4015dbc0 2024-08-17T02:22:44.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.478+0000 7fed3f7fe700 1 -- 172.21.15.104:0/217542047 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed28003570 con 0x7fed4015dbc0 2024-08-17T02:22:44.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.478+0000 7fed44ee9700 1 -- 172.21.15.104:0/217542047 >> v2:172.21.15.117:3300/0 conn(0x7fed401596d0 msgr2=0x7fed40066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:44.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.478+0000 7fed44ee9700 1 --2- 172.21.15.104:0/217542047 >> v2:172.21.15.117:3300/0 conn(0x7fed401596d0 0x7fed40066e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:44.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.478+0000 7fed44ee9700 1 -- 172.21.15.104:0/217542047 >> v1:172.21.15.104:6789/0 conn(0x7fed4015dbc0 legacy=0x7fed400afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:44.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.478+0000 7fed44ee9700 1 -- 172.21.15.104:0/217542047 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed400cb440 con 0x7fed40159300 2024-08-17T02:22:44.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.478+0000 7fed44ee9700 1 --2- 172.21.15.104:0/217542047 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed40159300 0x7fed400b2230 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fed400b2d20 tx=0x7fed340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=851175d6665e3b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:44.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.478+0000 7fed3f7fe700 1 -- 172.21.15.104:0/217542047 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed34011630 con 0x7fed40159300 2024-08-17T02:22:44.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.478+0000 7fed3f7fe700 1 -- 172.21.15.104:0/217542047 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed340117b0 con 0x7fed40159300 2024-08-17T02:22:44.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.478+0000 7fed3f7fe700 1 -- 172.21.15.104:0/217542047 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed34011b70 con 0x7fed40159300 2024-08-17T02:22:44.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.478+0000 7fed4714d700 1 -- 172.21.15.104:0/217542047 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed40159300 msgr2=0x7fed400b2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:44.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.478+0000 7fed4714d700 1 --2- 172.21.15.104:0/217542047 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed40159300 0x7fed400b2230 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fed400b2d20 tx=0x7fed340091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:44.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.478+0000 7fed4714d700 1 -- 172.21.15.104:0/217542047 shutdown_connections 2024-08-17T02:22:44.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.478+0000 7fed4714d700 1 --2- 172.21.15.104:0/217542047 >> v2:172.21.15.117:3300/0 conn(0x7fed401596d0 0x7fed40066e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:44.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.478+0000 7fed4714d700 1 --2- 172.21.15.104:0/217542047 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed40159300 0x7fed400b2230 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:44.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.478+0000 7fed4714d700 1 -- 172.21.15.104:0/217542047 >> 172.21.15.104:0/217542047 conn(0x7fed400682c0 msgr2=0x7fed400686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:44.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.478+0000 7fed4714d700 1 -- 172.21.15.104:0/217542047 shutdown_connections 2024-08-17T02:22:44.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.478+0000 7fed4714d700 1 -- 172.21.15.104:0/217542047 wait complete. 2024-08-17T02:22:44.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.482+0000 7fed4714d700 1 Processor -- start 2024-08-17T02:22:44.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.482+0000 7fed4714d700 1 -- start start 2024-08-17T02:22:44.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.482+0000 7fed4714d700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed40159300 0x7fed4014c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:44.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.482+0000 7fed4714d700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed401596d0 0x7fed400c5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:44.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.482+0000 7fed4714d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed4015dbc0 0x7fed400c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:44.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.482+0000 7fed4714d700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed400c4e80 con 0x7fed401596d0 2024-08-17T02:22:44.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.482+0000 7fed4714d700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed400c6270 con 0x7fed4015dbc0 2024-08-17T02:22:44.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.482+0000 7fed4714d700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed400c4270 con 0x7fed40159300 2024-08-17T02:22:44.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.482+0000 7fed3ffff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed401596d0 0x7fed400c5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:44.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.482+0000 7fed3ffff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed401596d0 0x7fed400c5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53642/0 (socket says 172.21.15.104:53642) 2024-08-17T02:22:44.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.482+0000 7fed3ffff700 1 -- 172.21.15.104:0/2009889124 learned_addr learned my addr 172.21.15.104:0/2009889124 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:44.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.482+0000 7fed44ee9700 1 --2- 172.21.15.104:0/2009889124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed40159300 0x7fed4014c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:44.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.482+0000 7fed456ea700 1 --2- 172.21.15.104:0/2009889124 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed4015dbc0 0x7fed400c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:44.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.482+0000 7fed3ffff700 1 -- 172.21.15.104:0/2009889124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed40159300 msgr2=0x7fed4014c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:44.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.482+0000 7fed3ffff700 1 --2- 172.21.15.104:0/2009889124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed40159300 0x7fed4014c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:44.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.482+0000 7fed3ffff700 1 -- 172.21.15.104:0/2009889124 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed4015dbc0 msgr2=0x7fed400c8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:44.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.482+0000 7fed3ffff700 1 --2- 172.21.15.104:0/2009889124 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed4015dbc0 0x7fed400c8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:44.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.482+0000 7fed3ffff700 1 -- 172.21.15.104:0/2009889124 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed34009420 con 0x7fed401596d0 2024-08-17T02:22:44.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.482+0000 7fed44ee9700 1 --2- 172.21.15.104:0/2009889124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed40159300 0x7fed4014c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:22:44.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.482+0000 7fed3ffff700 1 --2- 172.21.15.104:0/2009889124 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed401596d0 0x7fed400c5d30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fed3000ec80 tx=0x7fed300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:44.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.482+0000 7fed3cff9700 1 -- 172.21.15.104:0/2009889124 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3000c9d0 con 0x7fed401596d0 2024-08-17T02:22:44.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.482+0000 7fed3cff9700 1 -- 172.21.15.104:0/2009889124 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed3000cb30 con 0x7fed401596d0 2024-08-17T02:22:44.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.482+0000 7fed3cff9700 1 -- 172.21.15.104:0/2009889124 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed30013470 con 0x7fed401596d0 2024-08-17T02:22:44.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.482+0000 7fed4714d700 1 -- 172.21.15.104:0/2009889124 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed400c4550 con 0x7fed401596d0 2024-08-17T02:22:44.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.482+0000 7fed4714d700 1 -- 172.21.15.104:0/2009889124 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed400c4b10 con 0x7fed401596d0 2024-08-17T02:22:44.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.486+0000 7fed4714d700 1 -- 172.21.15.104:0/2009889124 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed400c5030 con 0x7fed401596d0 2024-08-17T02:22:44.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.486+0000 7fed3cff9700 1 -- 172.21.15.104:0/2009889124 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fed30013820 con 0x7fed401596d0 2024-08-17T02:22:44.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.486+0000 7fed3cff9700 1 --2- 172.21.15.104:0/2009889124 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fed2c060860 0x7fed2c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:44.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.486+0000 7fed3cff9700 1 -- 172.21.15.104:0/2009889124 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fed3007cf90 con 0x7fed401596d0 2024-08-17T02:22:44.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.486+0000 7fed44ee9700 1 --2- 172.21.15.104:0/2009889124 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fed2c060860 0x7fed2c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:44.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.486+0000 7fed44ee9700 1 --2- 172.21.15.104:0/2009889124 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fed2c060860 0x7fed2c062d10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fed400b2d20 tx=0x7fed34017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:44.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.490+0000 7fed3cff9700 1 -- 172.21.15.104:0/2009889124 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fed300ad480 con 0x7fed401596d0 2024-08-17T02:22:44.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.654+0000 7fed4714d700 1 -- 172.21.15.104:0/2009889124 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fed400645c0 con 0x7fed401596d0 2024-08-17T02:22:44.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.654+0000 7fed3cff9700 1 -- 172.21.15.104:0/2009889124 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fed400c5030 con 0x7fed401596d0 2024-08-17T02:22:44.658 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 32 2024-08-17T02:22:44.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.658+0000 7fed4714d700 1 -- 172.21.15.104:0/2009889124 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fed2c060860 msgr2=0x7fed2c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:44.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.658+0000 7fed4714d700 1 --2- 172.21.15.104:0/2009889124 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fed2c060860 0x7fed2c062d10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fed400b2d20 tx=0x7fed34017000 comp rx=0 tx=0).stop 2024-08-17T02:22:44.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.658+0000 7fed4714d700 1 -- 172.21.15.104:0/2009889124 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed401596d0 msgr2=0x7fed400c5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:44.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.658+0000 7fed4714d700 1 --2- 172.21.15.104:0/2009889124 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed401596d0 0x7fed400c5d30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fed3000ec80 tx=0x7fed300091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:44.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.658+0000 7fed4714d700 1 -- 172.21.15.104:0/2009889124 shutdown_connections 2024-08-17T02:22:44.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.658+0000 7fed4714d700 1 --2- 172.21.15.104:0/2009889124 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fed2c060860 0x7fed2c062d10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:44.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.658+0000 7fed4714d700 1 --2- 172.21.15.104:0/2009889124 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed4015dbc0 0x7fed400c8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:44.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.658+0000 7fed4714d700 1 --2- 172.21.15.104:0/2009889124 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed401596d0 0x7fed400c5d30 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:44.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.658+0000 7fed4714d700 1 --2- 172.21.15.104:0/2009889124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed40159300 0x7fed4014c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:44.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.658+0000 7fed4714d700 1 -- 172.21.15.104:0/2009889124 >> 172.21.15.104:0/2009889124 conn(0x7fed400682c0 msgr2=0x7fed400b3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:44.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.658+0000 7fed4714d700 1 -- 172.21.15.104:0/2009889124 shutdown_connections 2024-08-17T02:22:44.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.658+0000 7fed4714d700 1 -- 172.21.15.104:0/2009889124 wait complete. 2024-08-17T02:22:44.677 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:22:44.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.790+0000 7ff86229d700 1 Processor -- start 2024-08-17T02:22:44.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.790+0000 7ff86229d700 1 -- start start 2024-08-17T02:22:44.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.790+0000 7ff86229d700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff85c067030 0x7ff85c067400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:44.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.790+0000 7ff86229d700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff85c0cfb00 0x7ff85c0cb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:44.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.790+0000 7ff86229d700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff85c0cb5c0 0x7ff85c158cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:44.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.790+0000 7ff86229d700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff85c0cf670 con 0x7ff85c0cb5c0 2024-08-17T02:22:44.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.790+0000 7ff86229d700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff85c0cea60 con 0x7ff85c0cfb00 2024-08-17T02:22:44.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.790+0000 7ff86229d700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff85c0ced40 con 0x7ff85c067030 2024-08-17T02:22:44.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.790+0000 7ff861a9c700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff85c0cb5c0 0x7ff85c158cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:44.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.790+0000 7ff861a9c700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff85c0cb5c0 0x7ff85c158cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53654/0 (socket says 172.21.15.104:53654) 2024-08-17T02:22:44.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.790+0000 7ff861a9c700 1 -- 172.21.15.104:0/2605281143 learned_addr learned my addr 172.21.15.104:0/2605281143 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:44.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.790+0000 7ff86129b700 1 --2- 172.21.15.104:0/2605281143 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff85c067030 0x7ff85c067400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:44.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.790+0000 7ff861a9c700 1 -- 172.21.15.104:0/2605281143 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff85c067030 msgr2=0x7ff85c067400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:44.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.790+0000 7ff860a9a700 1 --2- 172.21.15.104:0/2605281143 >> v2:172.21.15.117:3300/0 conn(0x7ff85c0cfb00 0x7ff85c0cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:44.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.790+0000 7ff861a9c700 1 --2- 172.21.15.104:0/2605281143 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff85c067030 0x7ff85c067400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:44.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.790+0000 7ff861a9c700 1 -- 172.21.15.104:0/2605281143 >> v2:172.21.15.117:3300/0 conn(0x7ff85c0cfb00 msgr2=0x7ff85c0cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:44.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.790+0000 7ff861a9c700 1 --2- 172.21.15.104:0/2605281143 >> v2:172.21.15.117:3300/0 conn(0x7ff85c0cfb00 0x7ff85c0cb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:44.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.790+0000 7ff861a9c700 1 -- 172.21.15.104:0/2605281143 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff85c0cf020 con 0x7ff85c0cb5c0 2024-08-17T02:22:44.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.790+0000 7ff860a9a700 1 --2- 172.21.15.104:0/2605281143 >> v2:172.21.15.117:3300/0 conn(0x7ff85c0cfb00 0x7ff85c0cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:22:44.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.790+0000 7ff86129b700 1 --2- 172.21.15.104:0/2605281143 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff85c067030 0x7ff85c067400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:22:44.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.790+0000 7ff861a9c700 1 --2- 172.21.15.104:0/2605281143 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff85c0cb5c0 0x7ff85c158cc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff85c069590 tx=0x7ff854009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f02f27928ee5305a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:44.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.790+0000 7ff853fff700 1 -- 172.21.15.104:0/2605281143 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85400e070 con 0x7ff85c0cb5c0 2024-08-17T02:22:44.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.790+0000 7ff853fff700 1 -- 172.21.15.104:0/2605281143 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff85400ba50 con 0x7ff85c0cb5c0 2024-08-17T02:22:44.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.790+0000 7ff853fff700 1 -- 172.21.15.104:0/2605281143 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8540092e0 con 0x7ff85c0cb5c0 2024-08-17T02:22:44.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.794+0000 7ff86229d700 1 -- 172.21.15.104:0/2605281143 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff85c0cb5c0 msgr2=0x7ff85c158cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:44.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.794+0000 7ff86229d700 1 --2- 172.21.15.104:0/2605281143 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff85c0cb5c0 0x7ff85c158cc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff85c069590 tx=0x7ff854009840 comp rx=0 tx=0).stop 2024-08-17T02:22:44.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.794+0000 7ff86229d700 1 -- 172.21.15.104:0/2605281143 shutdown_connections 2024-08-17T02:22:44.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.794+0000 7ff86229d700 1 --2- 172.21.15.104:0/2605281143 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff85c0cb5c0 0x7ff85c158cc0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:44.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.794+0000 7ff86229d700 1 --2- 172.21.15.104:0/2605281143 >> v2:172.21.15.117:3300/0 conn(0x7ff85c0cfb00 0x7ff85c0cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:44.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.794+0000 7ff86229d700 1 --2- 172.21.15.104:0/2605281143 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff85c067030 0x7ff85c067400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:44.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.794+0000 7ff86229d700 1 -- 172.21.15.104:0/2605281143 >> 172.21.15.104:0/2605281143 conn(0x7ff85c0d0b50 msgr2=0x7ff85c0ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:44.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.794+0000 7ff86229d700 1 -- 172.21.15.104:0/2605281143 shutdown_connections 2024-08-17T02:22:44.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.794+0000 7ff86229d700 1 -- 172.21.15.104:0/2605281143 wait complete. 2024-08-17T02:22:44.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.794+0000 7ff86229d700 1 Processor -- start 2024-08-17T02:22:44.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.794+0000 7ff86229d700 1 -- start start 2024-08-17T02:22:44.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.798+0000 7ff86229d700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff85c067030 0x7ff85c0b2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:44.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.798+0000 7ff86229d700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff85c0cb5c0 0x7ff85c147f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:44.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.798+0000 7ff86229d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff85c0cfb00 0x7ff85c15f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:44.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.798+0000 7ff86229d700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff85c0b4370 con 0x7ff85c067030 2024-08-17T02:22:44.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.798+0000 7ff86229d700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff85c0b3760 con 0x7ff85c0cfb00 2024-08-17T02:22:44.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.798+0000 7ff86229d700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff85c0b3a40 con 0x7ff85c0cb5c0 2024-08-17T02:22:44.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.798+0000 7ff86129b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff85c067030 0x7ff85c0b2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:44.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.798+0000 7ff86129b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff85c067030 0x7ff85c0b2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53670/0 (socket says 172.21.15.104:53670) 2024-08-17T02:22:44.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.798+0000 7ff86129b700 1 -- 172.21.15.104:0/3961351684 learned_addr learned my addr 172.21.15.104:0/3961351684 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:44.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.798+0000 7ff860a9a700 1 --2- 172.21.15.104:0/3961351684 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff85c0cb5c0 0x7ff85c147f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:44.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.798+0000 7ff861a9c700 1 --2- 172.21.15.104:0/3961351684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff85c0cfb00 0x7ff85c15f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:44.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.798+0000 7ff86129b700 1 -- 172.21.15.104:0/3961351684 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff85c0cb5c0 msgr2=0x7ff85c147f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:44.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.798+0000 7ff86129b700 1 --2- 172.21.15.104:0/3961351684 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff85c0cb5c0 0x7ff85c147f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:44.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.798+0000 7ff86129b700 1 -- 172.21.15.104:0/3961351684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff85c0cfb00 msgr2=0x7ff85c15f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:44.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.798+0000 7ff86129b700 1 --2- 172.21.15.104:0/3961351684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff85c0cfb00 0x7ff85c15f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:44.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.798+0000 7ff86129b700 1 -- 172.21.15.104:0/3961351684 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff854009ae0 con 0x7ff85c067030 2024-08-17T02:22:44.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.798+0000 7ff86129b700 1 --2- 172.21.15.104:0/3961351684 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff85c067030 0x7ff85c0b2f10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff85800c880 tx=0x7ff858008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:44.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.798+0000 7ff8517fa700 1 -- 172.21.15.104:0/3961351684 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff858011600 con 0x7ff85c067030 2024-08-17T02:22:44.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.798+0000 7ff8517fa700 1 -- 172.21.15.104:0/3961351684 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff858011760 con 0x7ff85c067030 2024-08-17T02:22:44.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.798+0000 7ff86229d700 1 -- 172.21.15.104:0/3961351684 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff85c0b3d20 con 0x7ff85c067030 2024-08-17T02:22:44.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.798+0000 7ff8517fa700 1 -- 172.21.15.104:0/3961351684 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff858011b20 con 0x7ff85c067030 2024-08-17T02:22:44.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.798+0000 7ff86229d700 1 -- 172.21.15.104:0/3961351684 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff85c0b3450 con 0x7ff85c067030 2024-08-17T02:22:44.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.798+0000 7ff86229d700 1 -- 172.21.15.104:0/3961351684 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff85c0638f0 con 0x7ff85c067030 2024-08-17T02:22:44.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.802+0000 7ff8517fa700 1 -- 172.21.15.104:0/3961351684 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff85801a450 con 0x7ff85c067030 2024-08-17T02:22:44.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.802+0000 7ff8517fa700 1 --2- 172.21.15.104:0/3961351684 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff840060890 0x7ff840062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:44.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.802+0000 7ff8517fa700 1 -- 172.21.15.104:0/3961351684 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff85807cdf0 con 0x7ff85c067030 2024-08-17T02:22:44.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.802+0000 7ff860a9a700 1 --2- 172.21.15.104:0/3961351684 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff840060890 0x7ff840062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:44.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.802+0000 7ff860a9a700 1 --2- 172.21.15.104:0/3961351684 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff840060890 0x7ff840062d40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff85c0b5ff0 tx=0x7ff84c006f90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:44.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.814+0000 7ff8517fa700 1 -- 172.21.15.104:0/3961351684 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff858050cd0 con 0x7ff85c067030 2024-08-17T02:22:44.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.978+0000 7ff86229d700 1 -- 172.21.15.104:0/3961351684 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff85c0b03f0 con 0x7ff85c067030 2024-08-17T02:22:44.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.978+0000 7ff8517fa700 1 -- 172.21.15.104:0/3961351684 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff858050860 con 0x7ff85c067030 2024-08-17T02:22:44.981 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 64 2024-08-17T02:22:44.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.982+0000 7ff86229d700 1 -- 172.21.15.104:0/3961351684 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff840060890 msgr2=0x7ff840062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:44.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.982+0000 7ff86229d700 1 --2- 172.21.15.104:0/3961351684 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff840060890 0x7ff840062d40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff85c0b5ff0 tx=0x7ff84c006f90 comp rx=0 tx=0).stop 2024-08-17T02:22:44.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.982+0000 7ff86229d700 1 -- 172.21.15.104:0/3961351684 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff85c067030 msgr2=0x7ff85c0b2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:44.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.982+0000 7ff86229d700 1 --2- 172.21.15.104:0/3961351684 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff85c067030 0x7ff85c0b2f10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff85800c880 tx=0x7ff858008040 comp rx=0 tx=0).stop 2024-08-17T02:22:44.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.982+0000 7ff86229d700 1 -- 172.21.15.104:0/3961351684 shutdown_connections 2024-08-17T02:22:44.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.982+0000 7ff86229d700 1 --2- 172.21.15.104:0/3961351684 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff840060890 0x7ff840062d40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:44.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.982+0000 7ff86229d700 1 --2- 172.21.15.104:0/3961351684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff85c0cfb00 0x7ff85c15f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:44.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.982+0000 7ff86229d700 1 --2- 172.21.15.104:0/3961351684 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff85c0cb5c0 0x7ff85c147f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:44.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.982+0000 7ff86229d700 1 --2- 172.21.15.104:0/3961351684 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff85c067030 0x7ff85c0b2f10 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:44.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.982+0000 7ff86229d700 1 -- 172.21.15.104:0/3961351684 >> 172.21.15.104:0/3961351684 conn(0x7ff85c0d0b50 msgr2=0x7ff85c0b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:44.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.982+0000 7ff86229d700 1 -- 172.21.15.104:0/3961351684 shutdown_connections 2024-08-17T02:22:44.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:44.982+0000 7ff86229d700 1 -- 172.21.15.104:0/3961351684 wait complete. 2024-08-17T02:22:44.995 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:22:45.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.098+0000 7f49296f6700 1 Processor -- start 2024-08-17T02:22:45.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.098+0000 7f49296f6700 1 -- start start 2024-08-17T02:22:45.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.098+0000 7f49296f6700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f4924154900 0x7f49240b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:45.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.098+0000 7f49296f6700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49240cb560 0x7f4924160ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:45.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.098+0000 7f49296f6700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49240b1730 con 0x7f49240b12d0 2024-08-17T02:22:45.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.098+0000 7f49296f6700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4924068790 con 0x7f4924154900 2024-08-17T02:22:45.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.098+0000 7f49296f6700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49241583f0 con 0x7f49240cb560 2024-08-17T02:22:45.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.098+0000 7f4923fff700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f4924154900 0x7f49240b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:45.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.102+0000 7f4928ef5700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49240cb560 0x7f4924160ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:45.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.102+0000 7f4923fff700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f4924154900 0x7f49240b0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53682/0 (socket says 172.21.15.104:53682) 2024-08-17T02:22:45.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.102+0000 7f49237fe700 1 --1- 172.21.15.104:0/4000676333 >> v1:172.21.15.117:6789/0 conn(0x7f49240b12d0 0x7f49240cae50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.104:42272/0 (socket says 172.21.15.104:42272) 2024-08-17T02:22:45.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.102+0000 7f4923fff700 1 -- 172.21.15.104:0/4000676333 learned_addr learned my addr 172.21.15.104:0/4000676333 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:45.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.102+0000 7f4928ef5700 1 -- 172.21.15.104:0/4000676333 >> v2:172.21.15.104:3300/0 conn(0x7f4924154900 msgr2=0x7f49240b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:45.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.102+0000 7f4928ef5700 1 --2- 172.21.15.104:0/4000676333 >> v2:172.21.15.104:3300/0 conn(0x7f4924154900 0x7f49240b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:45.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.102+0000 7f4928ef5700 1 -- 172.21.15.104:0/4000676333 >> v1:172.21.15.117:6789/0 conn(0x7f49240b12d0 legacy=0x7f49240cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:45.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.102+0000 7f4928ef5700 1 -- 172.21.15.104:0/4000676333 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49240cbaa0 con 0x7f49240cb560 2024-08-17T02:22:45.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.102+0000 7f4922ffd700 1 -- 172.21.15.104:0/4000676333 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2730935516 0 0) 0x7f490c001110 con 0x7f49240b12d0 2024-08-17T02:22:45.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.102+0000 7f4923fff700 1 --2- 172.21.15.104:0/4000676333 >> v2:172.21.15.104:3300/0 conn(0x7f4924154900 0x7f49240b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:22:45.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.102+0000 7f4928ef5700 1 --2- 172.21.15.104:0/4000676333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49240cb560 0x7f4924160ac0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f491c009e60 tx=0x7f491c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecb31a161222914a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:45.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.102+0000 7f4922ffd700 1 -- 172.21.15.104:0/4000676333 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c00e070 con 0x7f49240cb560 2024-08-17T02:22:45.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.102+0000 7f4922ffd700 1 -- 172.21.15.104:0/4000676333 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f491c00bb60 con 0x7f49240cb560 2024-08-17T02:22:45.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.102+0000 7f4922ffd700 1 -- 172.21.15.104:0/4000676333 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c012430 con 0x7f49240cb560 2024-08-17T02:22:45.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.102+0000 7f49296f6700 1 -- 172.21.15.104:0/4000676333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49240cb560 msgr2=0x7f4924160ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:45.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.102+0000 7f49296f6700 1 --2- 172.21.15.104:0/4000676333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49240cb560 0x7f4924160ac0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f491c009e60 tx=0x7f491c009780 comp rx=0 tx=0).stop 2024-08-17T02:22:45.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.102+0000 7f49296f6700 1 -- 172.21.15.104:0/4000676333 shutdown_connections 2024-08-17T02:22:45.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.102+0000 7f49296f6700 1 --2- 172.21.15.104:0/4000676333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49240cb560 0x7f4924160ac0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:45.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.102+0000 7f49296f6700 1 --2- 172.21.15.104:0/4000676333 >> v2:172.21.15.104:3300/0 conn(0x7f4924154900 0x7f49240b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:45.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.102+0000 7f49296f6700 1 -- 172.21.15.104:0/4000676333 >> 172.21.15.104:0/4000676333 conn(0x7f49240678d0 msgr2=0x7f4924067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:45.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.102+0000 7f49296f6700 1 -- 172.21.15.104:0/4000676333 shutdown_connections 2024-08-17T02:22:45.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.102+0000 7f49296f6700 1 -- 172.21.15.104:0/4000676333 wait complete. 2024-08-17T02:22:45.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.102+0000 7f49296f6700 1 Processor -- start 2024-08-17T02:22:45.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.106+0000 7f49296f6700 1 -- start start 2024-08-17T02:22:45.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.106+0000 7f49296f6700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49240b12d0 0x7f4924145ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:45.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.106+0000 7f49296f6700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f49240cb560 0x7f49241669d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:45.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.106+0000 7f49296f6700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4924154900 0x7f4924155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:45.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.106+0000 7f49296f6700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4924147180 con 0x7f49240cb560 2024-08-17T02:22:45.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.106+0000 7f49296f6700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4924146570 con 0x7f4924154900 2024-08-17T02:22:45.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.106+0000 7f49296f6700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4924146850 con 0x7f49240b12d0 2024-08-17T02:22:45.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.106+0000 7f49237fe700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f49240cb560 0x7f49241669d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:45.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.106+0000 7f49237fe700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f49240cb560 0x7f49241669d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53692/0 (socket says 172.21.15.104:53692) 2024-08-17T02:22:45.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.106+0000 7f49237fe700 1 -- 172.21.15.104:0/3279734046 learned_addr learned my addr 172.21.15.104:0/3279734046 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:45.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.106+0000 7f4928ef5700 1 --2- 172.21.15.104:0/3279734046 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4924154900 0x7f4924155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:45.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.106+0000 7f4923fff700 1 --2- 172.21.15.104:0/3279734046 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49240b12d0 0x7f4924145ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:45.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.106+0000 7f49237fe700 1 -- 172.21.15.104:0/3279734046 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49240b12d0 msgr2=0x7f4924145ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:45.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.106+0000 7f49237fe700 1 --2- 172.21.15.104:0/3279734046 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49240b12d0 0x7f4924145ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:45.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.106+0000 7f49237fe700 1 -- 172.21.15.104:0/3279734046 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4924154900 msgr2=0x7f4924155ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:45.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.106+0000 7f49237fe700 1 --2- 172.21.15.104:0/3279734046 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4924154900 0x7f4924155ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:45.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.106+0000 7f49237fe700 1 -- 172.21.15.104:0/3279734046 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49140094f0 con 0x7f49240cb560 2024-08-17T02:22:45.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.106+0000 7f49237fe700 1 --2- 172.21.15.104:0/3279734046 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f49240cb560 0x7f49241669d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f490c00c7e0 tx=0x7f490c007c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:45.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.106+0000 7f491bfff700 1 -- 172.21.15.104:0/3279734046 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490c007300 con 0x7f49240cb560 2024-08-17T02:22:45.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.106+0000 7f491bfff700 1 -- 172.21.15.104:0/3279734046 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f490c007460 con 0x7f49240cb560 2024-08-17T02:22:45.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.106+0000 7f49296f6700 1 -- 172.21.15.104:0/3279734046 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f491c009a20 con 0x7f49240cb560 2024-08-17T02:22:45.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.106+0000 7f491bfff700 1 -- 172.21.15.104:0/3279734046 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490c005860 con 0x7f49240cb560 2024-08-17T02:22:45.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.106+0000 7f49296f6700 1 -- 172.21.15.104:0/3279734046 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4924146e10 con 0x7f49240cb560 2024-08-17T02:22:45.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.110+0000 7f49296f6700 1 -- 172.21.15.104:0/3279734046 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4924147330 con 0x7f49240cb560 2024-08-17T02:22:45.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.110+0000 7f491bfff700 1 -- 172.21.15.104:0/3279734046 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f490c005c50 con 0x7f49240cb560 2024-08-17T02:22:45.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.110+0000 7f491bfff700 1 --2- 172.21.15.104:0/3279734046 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4908060860 0x7f4908062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:45.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.110+0000 7f491bfff700 1 -- 172.21.15.104:0/3279734046 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f490c07c540 con 0x7f49240cb560 2024-08-17T02:22:45.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.110+0000 7f4923fff700 1 --2- 172.21.15.104:0/3279734046 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4908060860 0x7f4908062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:45.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.110+0000 7f4923fff700 1 --2- 172.21.15.104:0/3279734046 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4908060860 0x7f4908062d10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4914006fd0 tx=0x7f4914008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:45.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.118+0000 7f491bfff700 1 -- 172.21.15.104:0/3279734046 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f4924147330 con 0x7f49240cb560 2024-08-17T02:22:45.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.286+0000 7f49296f6700 1 -- 172.21.15.104:0/3279734046 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49240b1730 con 0x7f49240cb560 2024-08-17T02:22:45.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.290+0000 7f491bfff700 1 -- 172.21.15.104:0/3279734046 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f49240b1730 con 0x7f49240cb560 2024-08-17T02:22:45.293 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:22:45.293 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":23,"fsid":"fd5f7fb8-d34b-49bb-89a8-62b7dad1bc25","created":"2024-08-17T02:21:57.891389+0000","modified":"2024-08-17T02:22:23.175831+0000","last_up_change":"2024-08-17T02:22:08.924546+0000","last_in_change":"2024-08-17T02:21:59.938028+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:22:10.143970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:22:20.082708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:22:20.521582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"606b9088-590e-4709-aa3a-b0f6e22972ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":24257},{"type":"v1","addr":"172.21.15.104:6809","nonce":24257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":24257},{"type":"v1","addr":"172.21.15.104:6811","nonce":24257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":24257},{"type":"v1","addr":"172.21.15.104:6815","nonce":24257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":24257},{"type":"v1","addr":"172.21.15.104:6813","nonce":24257}]},"public_addr":"172.21.15.104:6809/24257","cluster_addr":"172.21.15.104:6811/24257","heartbeat_back_addr":"172.21.15.104:6815/24257","heartbeat_front_addr":"172.21.15.104:6813/24257","state":["exists","up"]},{"osd":1,"uuid":"9bc6a909-0c2f-4889-afe7-4a47f89b0f64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":24256},{"type":"v1","addr":"172.21.15.104:6825","nonce":24256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":24256},{"type":"v1","addr":"172.21.15.104:6827","nonce":24256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":24256},{"type":"v1","addr":"172.21.15.104:6831","nonce":24256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":24256},{"type":"v1","addr":"172.21.15.104:6829","nonce":24256}]},"public_addr":"172.21.15.104:6825/24256","cluster_addr":"172.21.15.104:6827/24256","heartbeat_back_addr":"172.21.15.104:6831/24256","heartbeat_front_addr":"172.21.15.104:6829/24256","state":["exists","up"]},{"osd":2,"uuid":"23da31d5-aefb-4edb-b79d-fa05e1becef7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":24255},{"type":"v1","addr":"172.21.15.104:6817","nonce":24255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":24255},{"type":"v1","addr":"172.21.15.104:6819","nonce":24255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":24255},{"type":"v1","addr":"172.21.15.104:6823","nonce":24255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":24255},{"type":"v1","addr":"172.21.15.104:6821","nonce":24255}]},"public_addr":"172.21.15.104:6817/24255","cluster_addr":"172.21.15.104:6819/24255","heartbeat_back_addr":"172.21.15.104:6823/24255","heartbeat_front_addr":"172.21.15.104:6821/24255","state":["exists","up"]},{"osd":3,"uuid":"6e4a5ec2-b415-45ef-8381-61a59eb65224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":24254},{"type":"v1","addr":"172.21.15.104:6801","nonce":24254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":24254},{"type":"v1","addr":"172.21.15.104:6803","nonce":24254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":24254},{"type":"v1","addr":"172.21.15.104:6807","nonce":24254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":24254},{"type":"v1","addr":"172.21.15.104:6805","nonce":24254}]},"public_addr":"172.21.15.104:6801/24254","cluster_addr":"172.21.15.104:6803/24254","heartbeat_back_addr":"172.21.15.104:6807/24254","heartbeat_front_addr":"172.21.15.104:6805/24254","state":["exists","up"]},{"osd":4,"uuid":"8d5bea2d-9039-4013-8c99-2c046c5b8a17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":24421},{"type":"v1","addr":"172.21.15.117:6804","nonce":24421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":24421},{"type":"v1","addr":"172.21.15.117:6809","nonce":24421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":24421},{"type":"v1","addr":"172.21.15.117:6815","nonce":24421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":24421},{"type":"v1","addr":"172.21.15.117:6813","nonce":24421}]},"public_addr":"172.21.15.117:6804/24421","cluster_addr":"172.21.15.117:6809/24421","heartbeat_back_addr":"172.21.15.117:6815/24421","heartbeat_front_addr":"172.21.15.117:6813/24421","state":["exists","up"]},{"osd":5,"uuid":"de8b36fc-121c-4f05-8f5b-28f513d9f21f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":24422},{"type":"v1","addr":"172.21.15.117:6817","nonce":24422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":24422},{"type":"v1","addr":"172.21.15.117:6819","nonce":24422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":24422},{"type":"v1","addr":"172.21.15.117:6823","nonce":24422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":24422},{"type":"v1","addr":"172.21.15.117:6821","nonce":24422}]},"public_addr":"172.21.15.117:6817/24422","cluster_addr":"172.21.15.117:6819/24422","heartbeat_back_addr":"172.21.15.117:6823/24422","heartbeat_front_addr":"172.21.15.117:6821/24422","state":["exists","up"]},{"osd":6,"uuid":"6a87f09f-7bf7-4f7a-be87-530ac1ff8ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":24420},{"type":"v1","addr":"172.21.15.117:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6803","nonce":24420},{"type":"v1","addr":"172.21.15.117:6805","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":24420},{"type":"v1","addr":"172.21.15.117:6811","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":24420},{"type":"v1","addr":"172.21.15.117:6808","nonce":24420}]},"public_addr":"172.21.15.117:6801/24420","cluster_addr":"172.21.15.117:6805/24420","heartbeat_back_addr":"172.21.15.117:6811/24420","heartbeat_front_addr":"172.21.15.117:6808/24420","state":["exists","up"]},{"osd":7,"uuid":"e31d8041-1aa1-4b5d-83b3-0a373426dd9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":24423},{"type":"v1","addr":"172.21.15.117:6825","nonce":24423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":24423},{"type":"v1","addr":"172.21.15.117:6827","nonce":24423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":24423},{"type":"v1","addr":"172.21.15.117:6831","nonce":24423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":24423},{"type":"v1","addr":"172.21.15.117:6829","nonce":24423}]},"public_addr":"172.21.15.117:6825/24423","cluster_addr":"172.21.15.117:6827/24423","heartbeat_back_addr":"172.21.15.117:6831/24423","heartbeat_front_addr":"172.21.15.117:6829/24423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.220874+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.210039+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.434762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.247206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.184316+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.306325+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.035719+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.400303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:22:45.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.294+0000 7f49296f6700 1 -- 172.21.15.104:0/3279734046 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4908060860 msgr2=0x7f4908062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:45.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.294+0000 7f49296f6700 1 --2- 172.21.15.104:0/3279734046 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4908060860 0x7f4908062d10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4914006fd0 tx=0x7f4914008040 comp rx=0 tx=0).stop 2024-08-17T02:22:45.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.294+0000 7f49296f6700 1 -- 172.21.15.104:0/3279734046 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f49240cb560 msgr2=0x7f49241669d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:45.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.294+0000 7f49296f6700 1 --2- 172.21.15.104:0/3279734046 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f49240cb560 0x7f49241669d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f490c00c7e0 tx=0x7f490c007c50 comp rx=0 tx=0).stop 2024-08-17T02:22:45.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.294+0000 7f49296f6700 1 -- 172.21.15.104:0/3279734046 shutdown_connections 2024-08-17T02:22:45.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.294+0000 7f49296f6700 1 --2- 172.21.15.104:0/3279734046 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4908060860 0x7f4908062d10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:45.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.294+0000 7f49296f6700 1 --2- 172.21.15.104:0/3279734046 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4924154900 0x7f4924155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:45.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.294+0000 7f49296f6700 1 --2- 172.21.15.104:0/3279734046 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f49240cb560 0x7f49241669d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:45.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.294+0000 7f49296f6700 1 --2- 172.21.15.104:0/3279734046 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49240b12d0 0x7f4924145ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:45.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.294+0000 7f49296f6700 1 -- 172.21.15.104:0/3279734046 >> 172.21.15.104:0/3279734046 conn(0x7f49240678d0 msgr2=0x7f492406e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:45.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.294+0000 7f49296f6700 1 -- 172.21.15.104:0/3279734046 shutdown_connections 2024-08-17T02:22:45.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.294+0000 7f49296f6700 1 -- 172.21.15.104:0/3279734046 wait complete. 2024-08-17T02:22:45.312 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:22:10.143970+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:22:20.082708+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:22:20.521582+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:22:45.313 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:22:45.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.422+0000 7f33456f1700 1 Processor -- start 2024-08-17T02:22:45.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.422+0000 7f33456f1700 1 -- start start 2024-08-17T02:22:45.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.422+0000 7f33456f1700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f334006e470 0x7f33400aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:45.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.422+0000 7f33456f1700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3340140f70 con 0x7f33400b1600 2024-08-17T02:22:45.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.422+0000 7f33456f1700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3340141250 con 0x7f334006e840 2024-08-17T02:22:45.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.422+0000 7f33456f1700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33400b1a80 con 0x7f334006e470 2024-08-17T02:22:45.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.422+0000 7f3344ef0700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f33400b1600 0x7f3340141d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:53998/0 (socket says 172.21.15.104:53998) 2024-08-17T02:22:45.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.422+0000 7f3344ef0700 1 -- 172.21.15.104:0/4073162332 learned_addr learned my addr 172.21.15.104:0/4073162332 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:45.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.422+0000 7f333ffff700 1 --2- 172.21.15.104:0/4073162332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f334006e470 0x7f33400aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:45.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.422+0000 7f333effd700 1 -- 172.21.15.104:0/4073162332 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 460660133 0 0) 0x7f3340140f70 con 0x7f33400b1600 2024-08-17T02:22:45.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.422+0000 7f333effd700 1 -- 172.21.15.104:0/4073162332 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3328003570 con 0x7f33400b1600 2024-08-17T02:22:45.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.422+0000 7f333effd700 1 -- 172.21.15.104:0/4073162332 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2726318137 0 0) 0x7f3340141250 con 0x7f334006e840 2024-08-17T02:22:45.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.422+0000 7f333effd700 1 -- 172.21.15.104:0/4073162332 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3340140f70 con 0x7f334006e840 2024-08-17T02:22:45.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.422+0000 7f333effd700 1 -- 172.21.15.104:0/4073162332 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3773594493 0 0) 0x7f3328003570 con 0x7f33400b1600 2024-08-17T02:22:45.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.422+0000 7f333ffff700 1 -- 172.21.15.104:0/4073162332 >> v1:172.21.15.117:6789/0 conn(0x7f334006e840 legacy=0x7f33400b0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:45.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.422+0000 7f333ffff700 1 -- 172.21.15.104:0/4073162332 >> v1:172.21.15.104:6789/0 conn(0x7f33400b1600 legacy=0x7f3340141d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:45.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.422+0000 7f333ffff700 1 -- 172.21.15.104:0/4073162332 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3340141530 con 0x7f334006e470 2024-08-17T02:22:45.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.422+0000 7f333ffff700 1 --2- 172.21.15.104:0/4073162332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f334006e470 0x7f33400aea80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3330009e90 tx=0x7f3330009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc7e49611c10e939 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:45.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.422+0000 7f333effd700 1 -- 172.21.15.104:0/4073162332 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333000e070 con 0x7f334006e470 2024-08-17T02:22:45.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.422+0000 7f333effd700 1 -- 172.21.15.104:0/4073162332 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f333000b870 con 0x7f334006e470 2024-08-17T02:22:45.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.422+0000 7f333effd700 1 -- 172.21.15.104:0/4073162332 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3338001470 con 0x7f334006e470 2024-08-17T02:22:45.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.426+0000 7f33456f1700 1 -- 172.21.15.104:0/4073162332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f334006e470 msgr2=0x7f33400aea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:45.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.426+0000 7f33456f1700 1 --2- 172.21.15.104:0/4073162332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f334006e470 0x7f33400aea80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3330009e90 tx=0x7f3330009780 comp rx=0 tx=0).stop 2024-08-17T02:22:45.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.426+0000 7f33456f1700 1 -- 172.21.15.104:0/4073162332 shutdown_connections 2024-08-17T02:22:45.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.426+0000 7f33456f1700 1 --2- 172.21.15.104:0/4073162332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f334006e470 0x7f33400aea80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:45.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.426+0000 7f33456f1700 1 -- 172.21.15.104:0/4073162332 >> 172.21.15.104:0/4073162332 conn(0x7f33400678a0 msgr2=0x7f3340067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:45.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.426+0000 7f33456f1700 1 -- 172.21.15.104:0/4073162332 shutdown_connections 2024-08-17T02:22:45.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.426+0000 7f33456f1700 1 -- 172.21.15.104:0/4073162332 wait complete. 2024-08-17T02:22:45.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.426+0000 7f33456f1700 1 Processor -- start 2024-08-17T02:22:45.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.426+0000 7f33456f1700 1 -- start start 2024-08-17T02:22:45.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.430+0000 7f33456f1700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f334006e470 0x7f334013f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:45.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.430+0000 7f33456f1700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f334006e840 0x7f3340154110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:45.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.430+0000 7f33456f1700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33400b1600 0x7f3340161e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:45.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.430+0000 7f33456f1700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f334013f5f0 con 0x7f33400b1600 2024-08-17T02:22:45.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.430+0000 7f33456f1700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3340154ad0 con 0x7f334006e840 2024-08-17T02:22:45.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.430+0000 7f33456f1700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3340154db0 con 0x7f334006e470 2024-08-17T02:22:45.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.430+0000 7f3344ef0700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33400b1600 0x7f3340161e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:45.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.430+0000 7f3344ef0700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33400b1600 0x7f3340161e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53694/0 (socket says 172.21.15.104:53694) 2024-08-17T02:22:45.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.430+0000 7f3344ef0700 1 -- 172.21.15.104:0/335585193 learned_addr learned my addr 172.21.15.104:0/335585193 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:45.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.430+0000 7f333ffff700 1 --2- 172.21.15.104:0/335585193 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f334006e470 0x7f334013f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:45.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.430+0000 7f333f7fe700 1 --2- 172.21.15.104:0/335585193 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f334006e840 0x7f3340154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:45.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.430+0000 7f3344ef0700 1 -- 172.21.15.104:0/335585193 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f334006e470 msgr2=0x7f334013f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:45.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.430+0000 7f3344ef0700 1 --2- 172.21.15.104:0/335585193 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f334006e470 0x7f334013f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:45.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.430+0000 7f3344ef0700 1 -- 172.21.15.104:0/335585193 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f334006e840 msgr2=0x7f3340154110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:45.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.430+0000 7f3344ef0700 1 --2- 172.21.15.104:0/335585193 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f334006e840 0x7f3340154110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:45.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.430+0000 7f3344ef0700 1 -- 172.21.15.104:0/335585193 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3330009a20 con 0x7f33400b1600 2024-08-17T02:22:45.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.430+0000 7f333ffff700 1 --2- 172.21.15.104:0/335585193 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f334006e470 0x7f334013f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:22:45.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.430+0000 7f3344ef0700 1 --2- 172.21.15.104:0/335585193 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33400b1600 0x7f3340161e20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f333800cb70 tx=0x7f3338001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:45.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.430+0000 7f3327fff700 1 -- 172.21.15.104:0/335585193 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3338001d40 con 0x7f33400b1600 2024-08-17T02:22:45.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.430+0000 7f3327fff700 1 -- 172.21.15.104:0/335585193 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3338007360 con 0x7f33400b1600 2024-08-17T02:22:45.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.430+0000 7f33456f1700 1 -- 172.21.15.104:0/335585193 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3340155090 con 0x7f33400b1600 2024-08-17T02:22:45.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.430+0000 7f3327fff700 1 -- 172.21.15.104:0/335585193 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3338004830 con 0x7f33400b1600 2024-08-17T02:22:45.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.430+0000 7f33456f1700 1 -- 172.21.15.104:0/335585193 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3340155650 con 0x7f33400b1600 2024-08-17T02:22:45.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.430+0000 7f3327fff700 1 -- 172.21.15.104:0/335585193 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f3338004be0 con 0x7f33400b1600 2024-08-17T02:22:45.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.430+0000 7f33456f1700 1 -- 172.21.15.104:0/335585193 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3340155870 con 0x7f33400b1600 2024-08-17T02:22:45.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.430+0000 7f3327fff700 1 --2- 172.21.15.104:0/335585193 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f332c060860 0x7f332c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:45.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.430+0000 7f3327fff700 1 -- 172.21.15.104:0/335585193 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f333807c270 con 0x7f33400b1600 2024-08-17T02:22:45.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.434+0000 7f333ffff700 1 --2- 172.21.15.104:0/335585193 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f332c060860 0x7f332c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:45.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.434+0000 7f333ffff700 1 --2- 172.21.15.104:0/335585193 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f332c060860 0x7f332c062d10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f33300097c0 tx=0x7f3330017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:45.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.438+0000 7f3327fff700 1 -- 172.21.15.104:0/335585193 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f333804c6e0 con 0x7f33400b1600 2024-08-17T02:22:45.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.598+0000 7f33456f1700 1 -- 172.21.15.104:0/335585193 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f334013f730 con 0x7f33400b1600 2024-08-17T02:22:45.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.598+0000 7f3327fff700 1 -- 172.21.15.104:0/335585193 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f333804fd00 con 0x7f33400b1600 2024-08-17T02:22:45.602 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-08-17T02:22:45.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.602+0000 7f33456f1700 1 -- 172.21.15.104:0/335585193 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f332c060860 msgr2=0x7f332c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:45.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.602+0000 7f33456f1700 1 --2- 172.21.15.104:0/335585193 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f332c060860 0x7f332c062d10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f33300097c0 tx=0x7f3330017000 comp rx=0 tx=0).stop 2024-08-17T02:22:45.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.602+0000 7f33456f1700 1 -- 172.21.15.104:0/335585193 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33400b1600 msgr2=0x7f3340161e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:45.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.602+0000 7f33456f1700 1 --2- 172.21.15.104:0/335585193 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33400b1600 0x7f3340161e20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f333800cb70 tx=0x7f3338001ad0 comp rx=0 tx=0).stop 2024-08-17T02:22:45.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.602+0000 7f33456f1700 1 -- 172.21.15.104:0/335585193 shutdown_connections 2024-08-17T02:22:45.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.602+0000 7f33456f1700 1 --2- 172.21.15.104:0/335585193 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f332c060860 0x7f332c062d10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:45.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.602+0000 7f33456f1700 1 --2- 172.21.15.104:0/335585193 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33400b1600 0x7f3340161e20 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:45.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.602+0000 7f33456f1700 1 --2- 172.21.15.104:0/335585193 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f334006e840 0x7f3340154110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:45.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.602+0000 7f33456f1700 1 --2- 172.21.15.104:0/335585193 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f334006e470 0x7f334013f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:45.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.602+0000 7f33456f1700 1 -- 172.21.15.104:0/335585193 >> 172.21.15.104:0/335585193 conn(0x7f33400678a0 msgr2=0x7f334013fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:45.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.602+0000 7f33456f1700 1 -- 172.21.15.104:0/335585193 shutdown_connections 2024-08-17T02:22:45.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.602+0000 7f33456f1700 1 -- 172.21.15.104:0/335585193 wait complete. 2024-08-17T02:22:45.615 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:22:45.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.722+0000 7ff18359e700 1 Processor -- start 2024-08-17T02:22:45.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.722+0000 7ff18359e700 1 -- start start 2024-08-17T02:22:45.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.722+0000 7ff18359e700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff1841514d0 0x7ff18406ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:45.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.722+0000 7ff18359e700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff1841574f0 0x7ff184157990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:45.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.722+0000 7ff18359e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1840b0d90 0x7ff1840b1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:45.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.722+0000 7ff18359e700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1840b1750 con 0x7ff1841574f0 2024-08-17T02:22:45.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.722+0000 7ff18359e700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff18406e010 con 0x7ff1841514d0 2024-08-17T02:22:45.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.722+0000 7ff18359e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff18406efa0 con 0x7ff1840b0d90 2024-08-17T02:22:45.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.722+0000 7ff181d9b700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff1841574f0 0x7ff184157990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:45.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.722+0000 7ff181d9b700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff1841574f0 0x7ff184157990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53710/0 (socket says 172.21.15.104:53710) 2024-08-17T02:22:45.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.722+0000 7ff181d9b700 1 -- 172.21.15.104:0/5494753 learned_addr learned my addr 172.21.15.104:0/5494753 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:45.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.726+0000 7ff182d9d700 1 --2- 172.21.15.104:0/5494753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1840b0d90 0x7ff1840b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:45.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.726+0000 7ff18259c700 1 --2- 172.21.15.104:0/5494753 >> v2:172.21.15.117:3300/0 conn(0x7ff1841514d0 0x7ff18406ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:45.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.726+0000 7ff181d9b700 1 -- 172.21.15.104:0/5494753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1840b0d90 msgr2=0x7ff1840b1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:45.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.726+0000 7ff181d9b700 1 --2- 172.21.15.104:0/5494753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1840b0d90 0x7ff1840b1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:45.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.726+0000 7ff181d9b700 1 -- 172.21.15.104:0/5494753 >> v2:172.21.15.117:3300/0 conn(0x7ff1841514d0 msgr2=0x7ff18406ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:45.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.726+0000 7ff181d9b700 1 --2- 172.21.15.104:0/5494753 >> v2:172.21.15.117:3300/0 conn(0x7ff1841514d0 0x7ff18406ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:45.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.726+0000 7ff181d9b700 1 -- 172.21.15.104:0/5494753 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff184157fb0 con 0x7ff1841574f0 2024-08-17T02:22:45.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.726+0000 7ff18259c700 1 --2- 172.21.15.104:0/5494753 >> v2:172.21.15.117:3300/0 conn(0x7ff1841514d0 0x7ff18406ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:22:45.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.726+0000 7ff181d9b700 1 --2- 172.21.15.104:0/5494753 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff1841574f0 0x7ff184157990 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff18405f080 tx=0x7ff16c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54659a70e367d4d5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:45.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.726+0000 7ff18159a700 1 -- 172.21.15.104:0/5494753 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c00b860 con 0x7ff1841574f0 2024-08-17T02:22:45.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.726+0000 7ff18159a700 1 -- 172.21.15.104:0/5494753 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff16c00b9c0 con 0x7ff1841574f0 2024-08-17T02:22:45.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.726+0000 7ff18159a700 1 -- 172.21.15.104:0/5494753 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c00bd60 con 0x7ff1841574f0 2024-08-17T02:22:45.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.726+0000 7ff18359e700 1 -- 172.21.15.104:0/5494753 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff1841574f0 msgr2=0x7ff184157990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:45.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.726+0000 7ff18359e700 1 --2- 172.21.15.104:0/5494753 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff1841574f0 0x7ff184157990 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff18405f080 tx=0x7ff16c009250 comp rx=0 tx=0).stop 2024-08-17T02:22:45.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.726+0000 7ff18359e700 1 -- 172.21.15.104:0/5494753 shutdown_connections 2024-08-17T02:22:45.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.726+0000 7ff18359e700 1 --2- 172.21.15.104:0/5494753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1840b0d90 0x7ff1840b1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:45.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.726+0000 7ff18359e700 1 --2- 172.21.15.104:0/5494753 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff1841574f0 0x7ff184157990 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:45.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.726+0000 7ff18359e700 1 --2- 172.21.15.104:0/5494753 >> v2:172.21.15.117:3300/0 conn(0x7ff1841514d0 0x7ff18406ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:45.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.726+0000 7ff18359e700 1 -- 172.21.15.104:0/5494753 >> 172.21.15.104:0/5494753 conn(0x7ff1840678a0 msgr2=0x7ff184067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:45.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.726+0000 7ff18359e700 1 -- 172.21.15.104:0/5494753 shutdown_connections 2024-08-17T02:22:45.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.726+0000 7ff18359e700 1 -- 172.21.15.104:0/5494753 wait complete. 2024-08-17T02:22:45.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.726+0000 7ff18359e700 1 Processor -- start 2024-08-17T02:22:45.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.726+0000 7ff18359e700 1 -- start start 2024-08-17T02:22:45.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.730+0000 7ff18359e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1840b0d90 0x7ff1840a8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:45.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.730+0000 7ff18359e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff1841514d0 0x7ff18406a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:45.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.730+0000 7ff18359e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1841574f0 0x7ff18414e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:45.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.730+0000 7ff18359e700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1840a6200 con 0x7ff1841514d0 2024-08-17T02:22:45.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.730+0000 7ff18359e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1840a55f0 con 0x7ff1840b0d90 2024-08-17T02:22:45.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.730+0000 7ff18359e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1840a58d0 con 0x7ff1841574f0 2024-08-17T02:22:45.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.730+0000 7ff181d9b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff1841514d0 0x7ff18406a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:45.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.730+0000 7ff181d9b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff1841514d0 0x7ff18406a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53714/0 (socket says 172.21.15.104:53714) 2024-08-17T02:22:45.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.730+0000 7ff181d9b700 1 -- 172.21.15.104:0/69734411 learned_addr learned my addr 172.21.15.104:0/69734411 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:45.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.730+0000 7ff182d9d700 1 --2- 172.21.15.104:0/69734411 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1841574f0 0x7ff18414e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:45.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.730+0000 7ff18259c700 1 --2- 172.21.15.104:0/69734411 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1840b0d90 0x7ff1840a8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:45.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.730+0000 7ff181d9b700 1 -- 172.21.15.104:0/69734411 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1841574f0 msgr2=0x7ff18414e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:45.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.730+0000 7ff181d9b700 1 --2- 172.21.15.104:0/69734411 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1841574f0 0x7ff18414e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:45.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.730+0000 7ff181d9b700 1 -- 172.21.15.104:0/69734411 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1840b0d90 msgr2=0x7ff1840a8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:45.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.730+0000 7ff181d9b700 1 --2- 172.21.15.104:0/69734411 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1840b0d90 0x7ff1840a8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:45.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.730+0000 7ff181d9b700 1 -- 172.21.15.104:0/69734411 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff16c0094f0 con 0x7ff1841514d0 2024-08-17T02:22:45.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.730+0000 7ff181d9b700 1 --2- 172.21.15.104:0/69734411 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff1841514d0 0x7ff18406a180 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff16c0090b0 tx=0x7ff16c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:45.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.730+0000 7ff17a7fc700 1 -- 172.21.15.104:0/69734411 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c024440 con 0x7ff1841514d0 2024-08-17T02:22:45.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.730+0000 7ff17a7fc700 1 -- 172.21.15.104:0/69734411 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff16c0245e0 con 0x7ff1841514d0 2024-08-17T02:22:45.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.730+0000 7ff17a7fc700 1 -- 172.21.15.104:0/69734411 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c0249a0 con 0x7ff1841514d0 2024-08-17T02:22:45.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.730+0000 7ff18359e700 1 -- 172.21.15.104:0/69734411 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1840a5bb0 con 0x7ff1841514d0 2024-08-17T02:22:45.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.730+0000 7ff18359e700 1 -- 172.21.15.104:0/69734411 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1840a8ca0 con 0x7ff1841514d0 2024-08-17T02:22:45.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.730+0000 7ff18359e700 1 -- 172.21.15.104:0/69734411 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff184064330 con 0x7ff1841514d0 2024-08-17T02:22:45.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.734+0000 7ff17a7fc700 1 -- 172.21.15.104:0/69734411 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff16c01a420 con 0x7ff1841514d0 2024-08-17T02:22:45.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.734+0000 7ff17a7fc700 1 --2- 172.21.15.104:0/69734411 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff168060860 0x7ff168062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:45.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.734+0000 7ff17a7fc700 1 -- 172.21.15.104:0/69734411 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff16c07ed60 con 0x7ff1841514d0 2024-08-17T02:22:45.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.734+0000 7ff18259c700 1 --2- 172.21.15.104:0/69734411 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff168060860 0x7ff168062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:45.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.734+0000 7ff18259c700 1 --2- 172.21.15.104:0/69734411 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff168060860 0x7ff168062d10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff17c006f00 tx=0x7ff17c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:45.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.738+0000 7ff17a7fc700 1 -- 172.21.15.104:0/69734411 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff16c04f230 con 0x7ff1841514d0 2024-08-17T02:22:45.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.902+0000 7ff18359e700 1 -- 172.21.15.104:0/69734411 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff184157ad0 con 0x7ff1841514d0 2024-08-17T02:22:45.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.902+0000 7ff17a7fc700 1 -- 172.21.15.104:0/69734411 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff16c052850 con 0x7ff1841514d0 2024-08-17T02:22:45.905 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 32 2024-08-17T02:22:45.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.902+0000 7ff18359e700 1 -- 172.21.15.104:0/69734411 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff168060860 msgr2=0x7ff168062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:45.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.902+0000 7ff18359e700 1 --2- 172.21.15.104:0/69734411 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff168060860 0x7ff168062d10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff17c006f00 tx=0x7ff17c008040 comp rx=0 tx=0).stop 2024-08-17T02:22:45.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.902+0000 7ff18359e700 1 -- 172.21.15.104:0/69734411 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff1841514d0 msgr2=0x7ff18406a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:45.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.902+0000 7ff18359e700 1 --2- 172.21.15.104:0/69734411 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff1841514d0 0x7ff18406a180 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff16c0090b0 tx=0x7ff16c017000 comp rx=0 tx=0).stop 2024-08-17T02:22:45.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.906+0000 7ff18359e700 1 -- 172.21.15.104:0/69734411 shutdown_connections 2024-08-17T02:22:45.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.906+0000 7ff18359e700 1 --2- 172.21.15.104:0/69734411 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff168060860 0x7ff168062d10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:45.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.906+0000 7ff18359e700 1 --2- 172.21.15.104:0/69734411 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1841574f0 0x7ff18414e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:45.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.906+0000 7ff18359e700 1 --2- 172.21.15.104:0/69734411 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff1841514d0 0x7ff18406a180 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:45.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.906+0000 7ff18359e700 1 --2- 172.21.15.104:0/69734411 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1840b0d90 0x7ff1840a8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:45.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.906+0000 7ff18359e700 1 -- 172.21.15.104:0/69734411 >> 172.21.15.104:0/69734411 conn(0x7ff1840678a0 msgr2=0x7ff1840c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:45.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.906+0000 7ff18359e700 1 -- 172.21.15.104:0/69734411 shutdown_connections 2024-08-17T02:22:45.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:45.906+0000 7ff18359e700 1 -- 172.21.15.104:0/69734411 wait complete. 2024-08-17T02:22:45.919 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:22:46.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.030+0000 7ff4cf59e700 1 Processor -- start 2024-08-17T02:22:46.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.030+0000 7ff4cf59e700 1 -- start start 2024-08-17T02:22:46.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.030+0000 7ff4cf59e700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff4d006eea0 0x7ff4d00b1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:46.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.030+0000 7ff4cf59e700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff4d0152bd0 0x7ff4d0152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:46.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.030+0000 7ff4cf59e700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4d00ace30 con 0x7ff4d006ead0 2024-08-17T02:22:46.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.030+0000 7ff4cf59e700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4d0156dd0 con 0x7ff4d006eea0 2024-08-17T02:22:46.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.030+0000 7ff4cf59e700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4d0156450 con 0x7ff4d0152bd0 2024-08-17T02:22:46.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.030+0000 7ff4cdd9b700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff4d006eea0 0x7ff4d00b1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:46.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.030+0000 7ff4cdd9b700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff4d006eea0 0x7ff4d00b1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53722/0 (socket says 172.21.15.104:53722) 2024-08-17T02:22:46.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.030+0000 7ff4cdd9b700 1 -- 172.21.15.104:0/4264127816 learned_addr learned my addr 172.21.15.104:0/4264127816 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:46.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.030+0000 7ff4ced9d700 1 --2- 172.21.15.104:0/4264127816 >> v2:172.21.15.117:3300/0 conn(0x7ff4d0152bd0 0x7ff4d0152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:46.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.030+0000 7ff4cdd9b700 1 -- 172.21.15.104:0/4264127816 >> v2:172.21.15.117:3300/0 conn(0x7ff4d0152bd0 msgr2=0x7ff4d0152ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:46.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.030+0000 7ff4cdd9b700 1 --2- 172.21.15.104:0/4264127816 >> v2:172.21.15.117:3300/0 conn(0x7ff4d0152bd0 0x7ff4d0152ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:46.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.030+0000 7ff4cdd9b700 1 -- 172.21.15.104:0/4264127816 >> v1:172.21.15.117:6789/0 conn(0x7ff4d006ead0 legacy=0x7ff4d0155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:46.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.030+0000 7ff4cdd9b700 1 -- 172.21.15.104:0/4264127816 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d0156730 con 0x7ff4d006eea0 2024-08-17T02:22:46.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.030+0000 7ff4cdd9b700 1 --2- 172.21.15.104:0/4264127816 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff4d006eea0 0x7ff4d00b1830 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff4d005f0e0 tx=0x7ff4b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd2136c84aa590b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:46.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.030+0000 7ff4cd59a700 1 -- 172.21.15.104:0/4264127816 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b800b820 con 0x7ff4d006eea0 2024-08-17T02:22:46.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.030+0000 7ff4cd59a700 1 -- 172.21.15.104:0/4264127816 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b800b980 con 0x7ff4d006eea0 2024-08-17T02:22:46.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.030+0000 7ff4cd59a700 1 -- 172.21.15.104:0/4264127816 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b800bd20 con 0x7ff4d006eea0 2024-08-17T02:22:46.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.034+0000 7ff4cf59e700 1 -- 172.21.15.104:0/4264127816 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff4d006eea0 msgr2=0x7ff4d00b1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:46.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.034+0000 7ff4cf59e700 1 --2- 172.21.15.104:0/4264127816 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff4d006eea0 0x7ff4d00b1830 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff4d005f0e0 tx=0x7ff4b8009250 comp rx=0 tx=0).stop 2024-08-17T02:22:46.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.034+0000 7ff4cf59e700 1 -- 172.21.15.104:0/4264127816 shutdown_connections 2024-08-17T02:22:46.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.034+0000 7ff4cf59e700 1 --2- 172.21.15.104:0/4264127816 >> v2:172.21.15.117:3300/0 conn(0x7ff4d0152bd0 0x7ff4d0152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:46.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.034+0000 7ff4cf59e700 1 --2- 172.21.15.104:0/4264127816 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff4d006eea0 0x7ff4d00b1830 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:46.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.034+0000 7ff4cf59e700 1 -- 172.21.15.104:0/4264127816 >> 172.21.15.104:0/4264127816 conn(0x7ff4d00678a0 msgr2=0x7ff4d0067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:46.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.034+0000 7ff4cf59e700 1 -- 172.21.15.104:0/4264127816 shutdown_connections 2024-08-17T02:22:46.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.034+0000 7ff4cf59e700 1 -- 172.21.15.104:0/4264127816 wait complete. 2024-08-17T02:22:46.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.034+0000 7ff4cf59e700 1 Processor -- start 2024-08-17T02:22:46.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.034+0000 7ff4cf59e700 1 -- start start 2024-08-17T02:22:46.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.034+0000 7ff4cf59e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4d006ead0 0x7ff4d014e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:46.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.034+0000 7ff4cf59e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff4d006eea0 0x7ff4d00aadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:46.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.034+0000 7ff4cf59e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4d0152bd0 0x7ff4d014a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:46.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.034+0000 7ff4cf59e700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d00ab310 con 0x7ff4d006eea0 2024-08-17T02:22:46.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.034+0000 7ff4cf59e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d00ab520 con 0x7ff4d0152bd0 2024-08-17T02:22:46.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.034+0000 7ff4cf59e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d00ab800 con 0x7ff4d006ead0 2024-08-17T02:22:46.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.034+0000 7ff4cdd9b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff4d006eea0 0x7ff4d00aadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:46.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.034+0000 7ff4cdd9b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff4d006eea0 0x7ff4d00aadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53730/0 (socket says 172.21.15.104:53730) 2024-08-17T02:22:46.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.034+0000 7ff4cdd9b700 1 -- 172.21.15.104:0/2672845731 learned_addr learned my addr 172.21.15.104:0/2672845731 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:46.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.038+0000 7ff4ce59c700 1 --2- 172.21.15.104:0/2672845731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4d006ead0 0x7ff4d014e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:46.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.038+0000 7ff4ced9d700 1 --2- 172.21.15.104:0/2672845731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4d0152bd0 0x7ff4d014a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:46.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.038+0000 7ff4cdd9b700 1 -- 172.21.15.104:0/2672845731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4d006ead0 msgr2=0x7ff4d014e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:46.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.038+0000 7ff4cdd9b700 1 --2- 172.21.15.104:0/2672845731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4d006ead0 0x7ff4d014e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:46.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.038+0000 7ff4cdd9b700 1 -- 172.21.15.104:0/2672845731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4d0152bd0 msgr2=0x7ff4d014a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:46.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.038+0000 7ff4cdd9b700 1 --2- 172.21.15.104:0/2672845731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4d0152bd0 0x7ff4d014a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:46.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.038+0000 7ff4cdd9b700 1 -- 172.21.15.104:0/2672845731 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b80094f0 con 0x7ff4d006eea0 2024-08-17T02:22:46.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.038+0000 7ff4cdd9b700 1 --2- 172.21.15.104:0/2672845731 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff4d006eea0 0x7ff4d00aadd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8009290 tx=0x7ff4b8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:46.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.038+0000 7ff4c67fc700 1 -- 172.21.15.104:0/2672845731 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b8011e20 con 0x7ff4d006eea0 2024-08-17T02:22:46.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.038+0000 7ff4c67fc700 1 -- 172.21.15.104:0/2672845731 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b801b680 con 0x7ff4d006eea0 2024-08-17T02:22:46.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.038+0000 7ff4cf59e700 1 -- 172.21.15.104:0/2672845731 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4d00abae0 con 0x7ff4d006eea0 2024-08-17T02:22:46.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.038+0000 7ff4c67fc700 1 -- 172.21.15.104:0/2672845731 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b801ba40 con 0x7ff4d006eea0 2024-08-17T02:22:46.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.038+0000 7ff4cf59e700 1 -- 172.21.15.104:0/2672845731 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4d014ccc0 con 0x7ff4d006eea0 2024-08-17T02:22:46.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.038+0000 7ff4cf59e700 1 -- 172.21.15.104:0/2672845731 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4d014ceb0 con 0x7ff4d006eea0 2024-08-17T02:22:46.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.038+0000 7ff4c67fc700 1 -- 172.21.15.104:0/2672845731 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff4b801c450 con 0x7ff4d006eea0 2024-08-17T02:22:46.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.042+0000 7ff4c67fc700 1 --2- 172.21.15.104:0/2672845731 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff4b4060890 0x7ff4b4062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:46.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.042+0000 7ff4c67fc700 1 -- 172.21.15.104:0/2672845731 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff4b807e830 con 0x7ff4d006eea0 2024-08-17T02:22:46.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.042+0000 7ff4ce59c700 1 --2- 172.21.15.104:0/2672845731 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff4b4060890 0x7ff4b4062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:46.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.042+0000 7ff4ce59c700 1 --2- 172.21.15.104:0/2672845731 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff4b4060890 0x7ff4b4062d40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0006fd0 tx=0x7ff4c0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:46.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.046+0000 7ff4c67fc700 1 -- 172.21.15.104:0/2672845731 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff4b804ec80 con 0x7ff4d006eea0 2024-08-17T02:22:46.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.214+0000 7ff4cf59e700 1 -- 172.21.15.104:0/2672845731 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff4d0064330 con 0x7ff4d006eea0 2024-08-17T02:22:46.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.214+0000 7ff4c67fc700 1 -- 172.21.15.104:0/2672845731 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff4b802a070 con 0x7ff4d006eea0 2024-08-17T02:22:46.217 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 64 2024-08-17T02:22:46.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.214+0000 7ff4cf59e700 1 -- 172.21.15.104:0/2672845731 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff4b4060890 msgr2=0x7ff4b4062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:46.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.214+0000 7ff4cf59e700 1 --2- 172.21.15.104:0/2672845731 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff4b4060890 0x7ff4b4062d40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0006fd0 tx=0x7ff4c0008040 comp rx=0 tx=0).stop 2024-08-17T02:22:46.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.214+0000 7ff4cf59e700 1 -- 172.21.15.104:0/2672845731 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff4d006eea0 msgr2=0x7ff4d00aadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:46.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.214+0000 7ff4cf59e700 1 --2- 172.21.15.104:0/2672845731 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff4d006eea0 0x7ff4d00aadd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8009290 tx=0x7ff4b8016000 comp rx=0 tx=0).stop 2024-08-17T02:22:46.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.218+0000 7ff4cf59e700 1 -- 172.21.15.104:0/2672845731 shutdown_connections 2024-08-17T02:22:46.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.218+0000 7ff4cf59e700 1 --2- 172.21.15.104:0/2672845731 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff4b4060890 0x7ff4b4062d40 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:46.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.218+0000 7ff4cf59e700 1 --2- 172.21.15.104:0/2672845731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4d0152bd0 0x7ff4d014a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:46.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.218+0000 7ff4cf59e700 1 --2- 172.21.15.104:0/2672845731 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff4d006eea0 0x7ff4d00aadd0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:46.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.218+0000 7ff4cf59e700 1 --2- 172.21.15.104:0/2672845731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4d006ead0 0x7ff4d014e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:46.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.218+0000 7ff4cf59e700 1 -- 172.21.15.104:0/2672845731 >> 172.21.15.104:0/2672845731 conn(0x7ff4d00678a0 msgr2=0x7ff4d0063060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:46.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.218+0000 7ff4cf59e700 1 -- 172.21.15.104:0/2672845731 shutdown_connections 2024-08-17T02:22:46.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.218+0000 7ff4cf59e700 1 -- 172.21.15.104:0/2672845731 wait complete. 2024-08-17T02:22:46.230 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:22:46.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.326+0000 7f31db30e700 1 Processor -- start 2024-08-17T02:22:46.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.326+0000 7f31db30e700 1 -- start start 2024-08-17T02:22:46.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.326+0000 7f31db30e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31d4159040 0x7f31d40cf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:46.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.326+0000 7f31db30e700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d40cf190 con 0x7f31d415d5b0 2024-08-17T02:22:46.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.330+0000 7f31db30e700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d40ce5e0 con 0x7f31d40d0010 2024-08-17T02:22:46.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.330+0000 7f31db30e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d40ce860 con 0x7f31d4159040 2024-08-17T02:22:46.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.330+0000 7f31dab0d700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f31d415d5b0 0x7f31d415aa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:54006/0 (socket says 172.21.15.104:54006) 2024-08-17T02:22:46.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.330+0000 7f31dab0d700 1 -- 172.21.15.104:0/1500148173 learned_addr learned my addr 172.21.15.104:0/1500148173 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:46.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.330+0000 7f31da30c700 1 --2- 172.21.15.104:0/1500148173 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31d4159040 0x7f31d40cf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:46.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.330+0000 7f31d930a700 1 -- 172.21.15.104:0/1500148173 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3821996936 0 0) 0x7f31d40cf190 con 0x7f31d415d5b0 2024-08-17T02:22:46.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.330+0000 7f31d930a700 1 -- 172.21.15.104:0/1500148173 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31c0003570 con 0x7f31d415d5b0 2024-08-17T02:22:46.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.330+0000 7f31d930a700 1 -- 172.21.15.104:0/1500148173 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2628442456 0 0) 0x7f31c0003570 con 0x7f31d415d5b0 2024-08-17T02:22:46.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.330+0000 7f31d930a700 1 -- 172.21.15.104:0/1500148173 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31d4159040 msgr2=0x7f31d40cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:46.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.330+0000 7f31d930a700 1 --2- 172.21.15.104:0/1500148173 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31d4159040 0x7f31d40cf620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:46.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.330+0000 7f31d930a700 1 -- 172.21.15.104:0/1500148173 >> v1:172.21.15.117:6789/0 conn(0x7f31d40d0010 legacy=0x7f31d415cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:46.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.330+0000 7f31d930a700 1 -- 172.21.15.104:0/1500148173 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d40ceb40 con 0x7f31d415d5b0 2024-08-17T02:22:46.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.330+0000 7f31d930a700 1 -- 172.21.15.104:0/1500148173 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1279957748 0 0) 0x7f31cc0017f0 con 0x7f31d415d5b0 2024-08-17T02:22:46.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.330+0000 7f31d930a700 1 -- 172.21.15.104:0/1500148173 >> v1:172.21.15.104:6789/0 conn(0x7f31d415d5b0 legacy=0x7f31d415aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:46.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.330+0000 7f31d930a700 1 --2- 172.21.15.104:0/1500148173 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31c0003a90 0x7f31c0003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:46.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.330+0000 7f31d930a700 1 --2- 172.21.15.104:0/1500148173 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31d4159040 0x7f31c0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:46.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.330+0000 7f31d930a700 1 --2- 172.21.15.104:0/1500148173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31c0004d50 0x7f31c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:46.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.330+0000 7f31d930a700 1 -- 172.21.15.104:0/1500148173 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d40ce860 con 0x7f31c0003a90 2024-08-17T02:22:46.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.330+0000 7f31d930a700 1 -- 172.21.15.104:0/1500148173 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c000bb10 con 0x7f31c0004d50 2024-08-17T02:22:46.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.330+0000 7f31d930a700 1 -- 172.21.15.104:0/1500148173 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c000bcd0 con 0x7f31d4159040 2024-08-17T02:22:46.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.330+0000 7f31da30c700 1 --2- 172.21.15.104:0/1500148173 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31c0003a90 0x7f31c0003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:46.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.330+0000 7f31d9b0b700 1 --2- 172.21.15.104:0/1500148173 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31d4159040 0x7f31c0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:46.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.330+0000 7f31dab0d700 1 --2- 172.21.15.104:0/1500148173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31c0004d50 0x7f31c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:46.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.330+0000 7f31da30c700 1 -- 172.21.15.104:0/1500148173 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31d4159040 msgr2=0x7f31c0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:46.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.330+0000 7f31da30c700 1 --2- 172.21.15.104:0/1500148173 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31d4159040 0x7f31c0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:46.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.330+0000 7f31da30c700 1 -- 172.21.15.104:0/1500148173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31c0004d50 msgr2=0x7f31c00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:46.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.330+0000 7f31da30c700 1 --2- 172.21.15.104:0/1500148173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31c0004d50 0x7f31c00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:46.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.330+0000 7f31da30c700 1 -- 172.21.15.104:0/1500148173 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c0003570 con 0x7f31c0003a90 2024-08-17T02:22:46.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.330+0000 7f31da30c700 1 --2- 172.21.15.104:0/1500148173 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31c0003a90 0x7f31c0003e60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f31d0009c00 tx=0x7f31d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bd5520834a67b59 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:46.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.330+0000 7f31d930a700 1 -- 172.21.15.104:0/1500148173 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d000e710 con 0x7f31c0003a90 2024-08-17T02:22:46.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.330+0000 7f31d930a700 1 -- 172.21.15.104:0/1500148173 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d000e870 con 0x7f31c0003a90 2024-08-17T02:22:46.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.330+0000 7f31d930a700 1 -- 172.21.15.104:0/1500148173 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d000ec30 con 0x7f31c0003a90 2024-08-17T02:22:46.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.330+0000 7f31db30e700 1 -- 172.21.15.104:0/1500148173 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31c0003a90 msgr2=0x7f31c0003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:46.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.330+0000 7f31db30e700 1 --2- 172.21.15.104:0/1500148173 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31c0003a90 0x7f31c0003e60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f31d0009c00 tx=0x7f31d00091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:46.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.330+0000 7f31dab0d700 1 -- 172.21.15.104:0/1500148173 reap_dead start 2024-08-17T02:22:46.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.330+0000 7f31db30e700 1 -- 172.21.15.104:0/1500148173 shutdown_connections 2024-08-17T02:22:46.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.330+0000 7f31db30e700 1 -- 172.21.15.104:0/1500148173 >> 172.21.15.104:0/1500148173 conn(0x7f31d4068250 msgr2=0x7f31d4068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:46.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.330+0000 7f31db30e700 1 -- 172.21.15.104:0/1500148173 shutdown_connections 2024-08-17T02:22:46.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.330+0000 7f31db30e700 1 -- 172.21.15.104:0/1500148173 wait complete. 2024-08-17T02:22:46.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.334+0000 7f31db30e700 1 Processor -- start 2024-08-17T02:22:46.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.334+0000 7f31db30e700 1 -- start start 2024-08-17T02:22:46.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.338+0000 7f31db30e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31c0003a90 0x7f31d41696a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:46.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.338+0000 7f31db30e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31d40ae2e0 0x7f31d4154e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:46.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.338+0000 7f31db30e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31d4155340 0x7f31d4151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:46.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.338+0000 7f31db30e700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d4169cd0 con 0x7f31d40ae2e0 2024-08-17T02:22:46.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.338+0000 7f31db30e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d4169fb0 con 0x7f31d4155340 2024-08-17T02:22:46.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.338+0000 7f31db30e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d416a290 con 0x7f31c0003a90 2024-08-17T02:22:46.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.338+0000 7f31d9b0b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31d40ae2e0 0x7f31d4154e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:46.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.338+0000 7f31d9b0b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31d40ae2e0 0x7f31d4154e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53748/0 (socket says 172.21.15.104:53748) 2024-08-17T02:22:46.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.338+0000 7f31d9b0b700 1 -- 172.21.15.104:0/94279316 learned_addr learned my addr 172.21.15.104:0/94279316 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:46.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.338+0000 7f31dab0d700 1 --2- 172.21.15.104:0/94279316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31d4155340 0x7f31d4151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:46.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.338+0000 7f31da30c700 1 --2- 172.21.15.104:0/94279316 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31c0003a90 0x7f31d41696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:46.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.338+0000 7f31d9b0b700 1 -- 172.21.15.104:0/94279316 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31c0003a90 msgr2=0x7f31d41696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:46.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.338+0000 7f31d9b0b700 1 --2- 172.21.15.104:0/94279316 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31c0003a90 0x7f31d41696a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:46.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.338+0000 7f31d9b0b700 1 -- 172.21.15.104:0/94279316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31d4155340 msgr2=0x7f31d4151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:46.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.338+0000 7f31d9b0b700 1 --2- 172.21.15.104:0/94279316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31d4155340 0x7f31d4151840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:46.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.338+0000 7f31d9b0b700 1 -- 172.21.15.104:0/94279316 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d416a570 con 0x7f31d40ae2e0 2024-08-17T02:22:46.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.338+0000 7f31d9b0b700 1 --2- 172.21.15.104:0/94279316 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31d40ae2e0 0x7f31d4154e00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f31c4002b90 tx=0x7f31c4007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:46.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.338+0000 7f31ca7fc700 1 -- 172.21.15.104:0/94279316 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c400f8d0 con 0x7f31d40ae2e0 2024-08-17T02:22:46.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.338+0000 7f31ca7fc700 1 -- 172.21.15.104:0/94279316 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c400fa50 con 0x7f31d40ae2e0 2024-08-17T02:22:46.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.338+0000 7f31ca7fc700 1 -- 172.21.15.104:0/94279316 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c400fe10 con 0x7f31d40ae2e0 2024-08-17T02:22:46.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.338+0000 7f31db30e700 1 -- 172.21.15.104:0/94279316 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31d40b06d0 con 0x7f31d40ae2e0 2024-08-17T02:22:46.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.338+0000 7f31db30e700 1 -- 172.21.15.104:0/94279316 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31d4151d80 con 0x7f31d40ae2e0 2024-08-17T02:22:46.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.338+0000 7f31db30e700 1 -- 172.21.15.104:0/94279316 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31d40643a0 con 0x7f31d40ae2e0 2024-08-17T02:22:46.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.342+0000 7f31ca7fc700 1 -- 172.21.15.104:0/94279316 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f31c4013600 con 0x7f31d40ae2e0 2024-08-17T02:22:46.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.342+0000 7f31ca7fc700 1 --2- 172.21.15.104:0/94279316 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f31b8060860 0x7f31b8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:46.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.342+0000 7f31ca7fc700 1 -- 172.21.15.104:0/94279316 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f31c407d190 con 0x7f31d40ae2e0 2024-08-17T02:22:46.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.342+0000 7f31da30c700 1 --2- 172.21.15.104:0/94279316 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f31b8060860 0x7f31b8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:46.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.342+0000 7f31da30c700 1 --2- 172.21.15.104:0/94279316 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f31b8060860 0x7f31b8062d10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f31d00091e0 tx=0x7f31d001a000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:46.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.350+0000 7f31ca7fc700 1 -- 172.21.15.104:0/94279316 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f31c404d5e0 con 0x7f31d40ae2e0 2024-08-17T02:22:46.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.518+0000 7f31db30e700 1 -- 172.21.15.104:0/94279316 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31d415cc30 con 0x7f31d40ae2e0 2024-08-17T02:22:46.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.518+0000 7f31ca7fc700 1 -- 172.21.15.104:0/94279316 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f31c4050c00 con 0x7f31d40ae2e0 2024-08-17T02:22:46.521 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:22:46.521 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":23,"fsid":"fd5f7fb8-d34b-49bb-89a8-62b7dad1bc25","created":"2024-08-17T02:21:57.891389+0000","modified":"2024-08-17T02:22:23.175831+0000","last_up_change":"2024-08-17T02:22:08.924546+0000","last_in_change":"2024-08-17T02:21:59.938028+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:22:10.143970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:22:20.082708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:22:20.521582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"606b9088-590e-4709-aa3a-b0f6e22972ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":24257},{"type":"v1","addr":"172.21.15.104:6809","nonce":24257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":24257},{"type":"v1","addr":"172.21.15.104:6811","nonce":24257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":24257},{"type":"v1","addr":"172.21.15.104:6815","nonce":24257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":24257},{"type":"v1","addr":"172.21.15.104:6813","nonce":24257}]},"public_addr":"172.21.15.104:6809/24257","cluster_addr":"172.21.15.104:6811/24257","heartbeat_back_addr":"172.21.15.104:6815/24257","heartbeat_front_addr":"172.21.15.104:6813/24257","state":["exists","up"]},{"osd":1,"uuid":"9bc6a909-0c2f-4889-afe7-4a47f89b0f64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":24256},{"type":"v1","addr":"172.21.15.104:6825","nonce":24256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":24256},{"type":"v1","addr":"172.21.15.104:6827","nonce":24256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":24256},{"type":"v1","addr":"172.21.15.104:6831","nonce":24256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":24256},{"type":"v1","addr":"172.21.15.104:6829","nonce":24256}]},"public_addr":"172.21.15.104:6825/24256","cluster_addr":"172.21.15.104:6827/24256","heartbeat_back_addr":"172.21.15.104:6831/24256","heartbeat_front_addr":"172.21.15.104:6829/24256","state":["exists","up"]},{"osd":2,"uuid":"23da31d5-aefb-4edb-b79d-fa05e1becef7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":24255},{"type":"v1","addr":"172.21.15.104:6817","nonce":24255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":24255},{"type":"v1","addr":"172.21.15.104:6819","nonce":24255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":24255},{"type":"v1","addr":"172.21.15.104:6823","nonce":24255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":24255},{"type":"v1","addr":"172.21.15.104:6821","nonce":24255}]},"public_addr":"172.21.15.104:6817/24255","cluster_addr":"172.21.15.104:6819/24255","heartbeat_back_addr":"172.21.15.104:6823/24255","heartbeat_front_addr":"172.21.15.104:6821/24255","state":["exists","up"]},{"osd":3,"uuid":"6e4a5ec2-b415-45ef-8381-61a59eb65224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":24254},{"type":"v1","addr":"172.21.15.104:6801","nonce":24254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":24254},{"type":"v1","addr":"172.21.15.104:6803","nonce":24254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":24254},{"type":"v1","addr":"172.21.15.104:6807","nonce":24254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":24254},{"type":"v1","addr":"172.21.15.104:6805","nonce":24254}]},"public_addr":"172.21.15.104:6801/24254","cluster_addr":"172.21.15.104:6803/24254","heartbeat_back_addr":"172.21.15.104:6807/24254","heartbeat_front_addr":"172.21.15.104:6805/24254","state":["exists","up"]},{"osd":4,"uuid":"8d5bea2d-9039-4013-8c99-2c046c5b8a17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":24421},{"type":"v1","addr":"172.21.15.117:6804","nonce":24421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":24421},{"type":"v1","addr":"172.21.15.117:6809","nonce":24421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":24421},{"type":"v1","addr":"172.21.15.117:6815","nonce":24421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":24421},{"type":"v1","addr":"172.21.15.117:6813","nonce":24421}]},"public_addr":"172.21.15.117:6804/24421","cluster_addr":"172.21.15.117:6809/24421","heartbeat_back_addr":"172.21.15.117:6815/24421","heartbeat_front_addr":"172.21.15.117:6813/24421","state":["exists","up"]},{"osd":5,"uuid":"de8b36fc-121c-4f05-8f5b-28f513d9f21f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":24422},{"type":"v1","addr":"172.21.15.117:6817","nonce":24422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":24422},{"type":"v1","addr":"172.21.15.117:6819","nonce":24422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":24422},{"type":"v1","addr":"172.21.15.117:6823","nonce":24422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":24422},{"type":"v1","addr":"172.21.15.117:6821","nonce":24422}]},"public_addr":"172.21.15.117:6817/24422","cluster_addr":"172.21.15.117:6819/24422","heartbeat_back_addr":"172.21.15.117:6823/24422","heartbeat_front_addr":"172.21.15.117:6821/24422","state":["exists","up"]},{"osd":6,"uuid":"6a87f09f-7bf7-4f7a-be87-530ac1ff8ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":24420},{"type":"v1","addr":"172.21.15.117:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6803","nonce":24420},{"type":"v1","addr":"172.21.15.117:6805","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":24420},{"type":"v1","addr":"172.21.15.117:6811","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":24420},{"type":"v1","addr":"172.21.15.117:6808","nonce":24420}]},"public_addr":"172.21.15.117:6801/24420","cluster_addr":"172.21.15.117:6805/24420","heartbeat_back_addr":"172.21.15.117:6811/24420","heartbeat_front_addr":"172.21.15.117:6808/24420","state":["exists","up"]},{"osd":7,"uuid":"e31d8041-1aa1-4b5d-83b3-0a373426dd9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":24423},{"type":"v1","addr":"172.21.15.117:6825","nonce":24423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":24423},{"type":"v1","addr":"172.21.15.117:6827","nonce":24423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":24423},{"type":"v1","addr":"172.21.15.117:6831","nonce":24423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":24423},{"type":"v1","addr":"172.21.15.117:6829","nonce":24423}]},"public_addr":"172.21.15.117:6825/24423","cluster_addr":"172.21.15.117:6827/24423","heartbeat_back_addr":"172.21.15.117:6831/24423","heartbeat_front_addr":"172.21.15.117:6829/24423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.220874+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.210039+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.434762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.247206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.184316+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.306325+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.035719+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.400303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:22:46.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.522+0000 7f31db30e700 1 -- 172.21.15.104:0/94279316 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f31b8060860 msgr2=0x7f31b8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:46.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.522+0000 7f31db30e700 1 --2- 172.21.15.104:0/94279316 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f31b8060860 0x7f31b8062d10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f31d00091e0 tx=0x7f31d001a000 comp rx=0 tx=0).stop 2024-08-17T02:22:46.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.522+0000 7f31db30e700 1 -- 172.21.15.104:0/94279316 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31d40ae2e0 msgr2=0x7f31d4154e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:46.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.522+0000 7f31db30e700 1 --2- 172.21.15.104:0/94279316 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31d40ae2e0 0x7f31d4154e00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f31c4002b90 tx=0x7f31c4007d10 comp rx=0 tx=0).stop 2024-08-17T02:22:46.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.522+0000 7f31db30e700 1 -- 172.21.15.104:0/94279316 shutdown_connections 2024-08-17T02:22:46.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.522+0000 7f31db30e700 1 --2- 172.21.15.104:0/94279316 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f31b8060860 0x7f31b8062d10 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:46.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.522+0000 7f31db30e700 1 --2- 172.21.15.104:0/94279316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31d4155340 0x7f31d4151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:46.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.522+0000 7f31db30e700 1 --2- 172.21.15.104:0/94279316 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31d40ae2e0 0x7f31d4154e00 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:46.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.522+0000 7f31db30e700 1 --2- 172.21.15.104:0/94279316 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31c0003a90 0x7f31d41696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:46.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.522+0000 7f31db30e700 1 -- 172.21.15.104:0/94279316 >> 172.21.15.104:0/94279316 conn(0x7f31d4068250 msgr2=0x7f31d4152a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:46.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.522+0000 7f31db30e700 1 -- 172.21.15.104:0/94279316 shutdown_connections 2024-08-17T02:22:46.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.522+0000 7f31db30e700 1 -- 172.21.15.104:0/94279316 wait complete. 2024-08-17T02:22:46.535 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:22:10.143970+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:22:20.082708+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:22:20.521582+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:22:46.536 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:22:46.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.642+0000 7f3093fff700 1 Processor -- start 2024-08-17T02:22:46.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.642+0000 7f3093fff700 1 -- start start 2024-08-17T02:22:46.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.646+0000 7f3093fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3094067030 0x7f3094067400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:46.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.646+0000 7f3093fff700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30940cf670 con 0x7f3094158cc0 2024-08-17T02:22:46.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.646+0000 7f3093fff700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30940cea60 con 0x7f30940cfb00 2024-08-17T02:22:46.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.646+0000 7f3093fff700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30940ced40 con 0x7f3094067030 2024-08-17T02:22:46.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.646+0000 7f30937fe700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f3094158cc0 0x7f30941590f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:54022/0 (socket says 172.21.15.104:54022) 2024-08-17T02:22:46.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.646+0000 7f30937fe700 1 -- 172.21.15.104:0/3044387421 learned_addr learned my addr 172.21.15.104:0/3044387421 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:46.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.646+0000 7f3092ffd700 1 --2- 172.21.15.104:0/3044387421 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3094067030 0x7f3094067400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:46.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.646+0000 7f3091ffb700 1 -- 172.21.15.104:0/3044387421 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 956324313 0 0) 0x7f30940cf670 con 0x7f3094158cc0 2024-08-17T02:22:46.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.646+0000 7f3091ffb700 1 -- 172.21.15.104:0/3044387421 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f307c003570 con 0x7f3094158cc0 2024-08-17T02:22:46.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.646+0000 7f3091ffb700 1 -- 172.21.15.104:0/3044387421 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 454704502 0 0) 0x7f30940cea60 con 0x7f30940cfb00 2024-08-17T02:22:46.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.646+0000 7f3091ffb700 1 -- 172.21.15.104:0/3044387421 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30940cf670 con 0x7f30940cfb00 2024-08-17T02:22:46.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.646+0000 7f3092ffd700 1 -- 172.21.15.104:0/3044387421 >> v1:172.21.15.117:6789/0 conn(0x7f30940cfb00 legacy=0x7f30940cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:46.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.646+0000 7f3092ffd700 1 -- 172.21.15.104:0/3044387421 >> v1:172.21.15.104:6789/0 conn(0x7f3094158cc0 legacy=0x7f30941590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:46.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.646+0000 7f3092ffd700 1 -- 172.21.15.104:0/3044387421 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30940cf020 con 0x7f3094067030 2024-08-17T02:22:46.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.646+0000 7f3092ffd700 1 --2- 172.21.15.104:0/3044387421 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3094067030 0x7f3094067400 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3088009910 tx=0x7f30880091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e13acae130d38134 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:46.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.646+0000 7f3091ffb700 1 -- 172.21.15.104:0/3044387421 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3088011630 con 0x7f3094067030 2024-08-17T02:22:46.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.646+0000 7f3091ffb700 1 -- 172.21.15.104:0/3044387421 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3088011790 con 0x7f3094067030 2024-08-17T02:22:46.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.646+0000 7f3091ffb700 1 -- 172.21.15.104:0/3044387421 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3088011b30 con 0x7f3094067030 2024-08-17T02:22:46.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.646+0000 7f3093fff700 1 -- 172.21.15.104:0/3044387421 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3094067030 msgr2=0x7f3094067400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:46.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.646+0000 7f3093fff700 1 --2- 172.21.15.104:0/3044387421 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3094067030 0x7f3094067400 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3088009910 tx=0x7f30880091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:46.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.646+0000 7f3093fff700 1 -- 172.21.15.104:0/3044387421 shutdown_connections 2024-08-17T02:22:46.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.646+0000 7f3093fff700 1 --2- 172.21.15.104:0/3044387421 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3094067030 0x7f3094067400 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:46.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.646+0000 7f3093fff700 1 -- 172.21.15.104:0/3044387421 >> 172.21.15.104:0/3044387421 conn(0x7f30940d0b50 msgr2=0x7f30940ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:46.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.646+0000 7f3093fff700 1 -- 172.21.15.104:0/3044387421 shutdown_connections 2024-08-17T02:22:46.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.646+0000 7f3093fff700 1 -- 172.21.15.104:0/3044387421 wait complete. 2024-08-17T02:22:46.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.650+0000 7f3093fff700 1 Processor -- start 2024-08-17T02:22:46.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.650+0000 7f3093fff700 1 -- start start 2024-08-17T02:22:46.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.650+0000 7f3093fff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3094067030 0x7f309415b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:46.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.650+0000 7f3093fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30940cfb00 0x7f3094145b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:46.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.650+0000 7f3093fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3094158cc0 0x7f30940b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:46.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.650+0000 7f3093fff700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30940b2ff0 con 0x7f3094067030 2024-08-17T02:22:46.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.650+0000 7f3093fff700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3094146060 con 0x7f3094158cc0 2024-08-17T02:22:46.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.650+0000 7f3093fff700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3094169d60 con 0x7f30940cfb00 2024-08-17T02:22:46.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.650+0000 7f3092ffd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3094067030 0x7f309415b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:46.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.650+0000 7f3092ffd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3094067030 0x7f309415b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53762/0 (socket says 172.21.15.104:53762) 2024-08-17T02:22:46.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.650+0000 7f3092ffd700 1 -- 172.21.15.104:0/3955609069 learned_addr learned my addr 172.21.15.104:0/3955609069 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:46.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.650+0000 7f30937fe700 1 --2- 172.21.15.104:0/3955609069 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3094158cc0 0x7f30940b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:46.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.650+0000 7f30927fc700 1 --2- 172.21.15.104:0/3955609069 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30940cfb00 0x7f3094145b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:46.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.654+0000 7f3092ffd700 1 -- 172.21.15.104:0/3955609069 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30940cfb00 msgr2=0x7f3094145b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:46.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.654+0000 7f3092ffd700 1 --2- 172.21.15.104:0/3955609069 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30940cfb00 0x7f3094145b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:46.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.654+0000 7f3092ffd700 1 -- 172.21.15.104:0/3955609069 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3094158cc0 msgr2=0x7f30940b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:46.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.654+0000 7f3092ffd700 1 --2- 172.21.15.104:0/3955609069 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3094158cc0 0x7f30940b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:46.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.654+0000 7f3092ffd700 1 -- 172.21.15.104:0/3955609069 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3088009420 con 0x7f3094067030 2024-08-17T02:22:46.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.654+0000 7f30927fc700 1 --2- 172.21.15.104:0/3955609069 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30940cfb00 0x7f3094145b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:22:46.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.654+0000 7f3092ffd700 1 --2- 172.21.15.104:0/3955609069 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3094067030 0x7f309415b010 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3094069520 tx=0x7f3088017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:46.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.654+0000 7f307affd700 1 -- 172.21.15.104:0/3955609069 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3088011b10 con 0x7f3094067030 2024-08-17T02:22:46.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.654+0000 7f307affd700 1 -- 172.21.15.104:0/3955609069 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3088000c90 con 0x7f3094067030 2024-08-17T02:22:46.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.654+0000 7f3093fff700 1 -- 172.21.15.104:0/3955609069 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f309416a040 con 0x7f3094067030 2024-08-17T02:22:46.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.654+0000 7f307affd700 1 -- 172.21.15.104:0/3955609069 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3088025620 con 0x7f3094067030 2024-08-17T02:22:46.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.654+0000 7f3093fff700 1 -- 172.21.15.104:0/3955609069 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f309416a600 con 0x7f3094067030 2024-08-17T02:22:46.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.654+0000 7f3093fff700 1 -- 172.21.15.104:0/3955609069 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30940b3160 con 0x7f3094067030 2024-08-17T02:22:46.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.658+0000 7f307affd700 1 -- 172.21.15.104:0/3955609069 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f3088025a10 con 0x7f3094067030 2024-08-17T02:22:46.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.658+0000 7f307affd700 1 --2- 172.21.15.104:0/3955609069 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3080060860 0x7f3080062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:46.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.658+0000 7f307affd700 1 -- 172.21.15.104:0/3955609069 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f308807e2a0 con 0x7f3094067030 2024-08-17T02:22:46.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.658+0000 7f30927fc700 1 --2- 172.21.15.104:0/3955609069 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3080060860 0x7f3080062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:46.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.658+0000 7f30927fc700 1 --2- 172.21.15.104:0/3955609069 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3080060860 0x7f3080062d10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3094067650 tx=0x7f3084007d30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:46.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.662+0000 7f307affd700 1 -- 172.21.15.104:0/3955609069 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f308804e6f0 con 0x7f3094067030 2024-08-17T02:22:46.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.826+0000 7f3093fff700 1 -- 172.21.15.104:0/3955609069 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f30940638f0 con 0x7f3094067030 2024-08-17T02:22:46.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.826+0000 7f307affd700 1 -- 172.21.15.104:0/3955609069 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3088051d10 con 0x7f3094067030 2024-08-17T02:22:46.828 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-08-17T02:22:46.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.826+0000 7f3093fff700 1 -- 172.21.15.104:0/3955609069 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3080060860 msgr2=0x7f3080062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:46.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.826+0000 7f3093fff700 1 --2- 172.21.15.104:0/3955609069 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3080060860 0x7f3080062d10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3094067650 tx=0x7f3084007d30 comp rx=0 tx=0).stop 2024-08-17T02:22:46.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.826+0000 7f3093fff700 1 -- 172.21.15.104:0/3955609069 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3094067030 msgr2=0x7f309415b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:46.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.826+0000 7f3093fff700 1 --2- 172.21.15.104:0/3955609069 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3094067030 0x7f309415b010 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3094069520 tx=0x7f3088017000 comp rx=0 tx=0).stop 2024-08-17T02:22:46.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.826+0000 7f3093fff700 1 -- 172.21.15.104:0/3955609069 shutdown_connections 2024-08-17T02:22:46.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.826+0000 7f3093fff700 1 --2- 172.21.15.104:0/3955609069 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3080060860 0x7f3080062d10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:46.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.826+0000 7f3093fff700 1 --2- 172.21.15.104:0/3955609069 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3094158cc0 0x7f30940b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:46.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.826+0000 7f3093fff700 1 --2- 172.21.15.104:0/3955609069 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30940cfb00 0x7f3094145b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:46.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.826+0000 7f3093fff700 1 --2- 172.21.15.104:0/3955609069 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3094067030 0x7f309415b010 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:46.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.826+0000 7f3093fff700 1 -- 172.21.15.104:0/3955609069 >> 172.21.15.104:0/3955609069 conn(0x7f30940d0b50 msgr2=0x7f30940c6720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:46.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.826+0000 7f3093fff700 1 -- 172.21.15.104:0/3955609069 shutdown_connections 2024-08-17T02:22:46.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.826+0000 7f3093fff700 1 -- 172.21.15.104:0/3955609069 wait complete. 2024-08-17T02:22:46.842 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:22:46.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.954+0000 7f6bb62aa700 1 Processor -- start 2024-08-17T02:22:46.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.954+0000 7f6bb62aa700 1 -- start start 2024-08-17T02:22:46.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.954+0000 7f6bb62aa700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6bb00cd5a0 0x7f6bb00ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:46.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.954+0000 7f6bb62aa700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bb00c6520 0x7f6bb00cf020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:46.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.954+0000 7f6bb62aa700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bb00cca00 con 0x7f6bb015cb60 2024-08-17T02:22:46.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.954+0000 7f6bb62aa700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bb00b2e80 con 0x7f6bb00cd5a0 2024-08-17T02:22:46.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.954+0000 7f6bb62aa700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb015cf30 con 0x7f6bb00c6520 2024-08-17T02:22:46.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.954+0000 7f6baf7fe700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6bb00cd5a0 0x7f6bb00ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:46.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.954+0000 7f6baf7fe700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6bb00cd5a0 0x7f6bb00ceae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44998/0 (socket says 172.21.15.104:44998) 2024-08-17T02:22:46.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.954+0000 7f6baf7fe700 1 -- 172.21.15.104:0/1422831671 learned_addr learned my addr 172.21.15.104:0/1422831671 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:46.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.954+0000 7f6bb4847700 1 --2- 172.21.15.104:0/1422831671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bb00c6520 0x7f6bb00cf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:46.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.958+0000 7f6baf7fe700 1 -- 172.21.15.104:0/1422831671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bb00c6520 msgr2=0x7f6bb00cf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:46.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.958+0000 7f6baf7fe700 1 --2- 172.21.15.104:0/1422831671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bb00c6520 0x7f6bb00cf020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:46.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.958+0000 7f6baf7fe700 1 -- 172.21.15.104:0/1422831671 >> v1:172.21.15.117:6789/0 conn(0x7f6bb015cb60 legacy=0x7f6bb00cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:46.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.958+0000 7f6baf7fe700 1 -- 172.21.15.104:0/1422831671 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb00cbb50 con 0x7f6bb00cd5a0 2024-08-17T02:22:46.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.958+0000 7f6baf7fe700 1 --2- 172.21.15.104:0/1422831671 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6bb00cd5a0 0x7f6bb00ceae0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6ba00099b0 tx=0x7f6ba0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b53018e07ca4d970 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:46.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.958+0000 7f6baeffd700 1 -- 172.21.15.104:0/1422831671 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba0009ea0 con 0x7f6bb00cd5a0 2024-08-17T02:22:46.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.958+0000 7f6baeffd700 1 -- 172.21.15.104:0/1422831671 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba000b860 con 0x7f6bb00cd5a0 2024-08-17T02:22:46.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.958+0000 7f6baeffd700 1 -- 172.21.15.104:0/1422831671 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba000bc00 con 0x7f6bb00cd5a0 2024-08-17T02:22:46.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.958+0000 7f6bb62aa700 1 -- 172.21.15.104:0/1422831671 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6bb00cd5a0 msgr2=0x7f6bb00ceae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:46.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.958+0000 7f6bb62aa700 1 --2- 172.21.15.104:0/1422831671 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6bb00cd5a0 0x7f6bb00ceae0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6ba00099b0 tx=0x7f6ba0009250 comp rx=0 tx=0).stop 2024-08-17T02:22:46.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.958+0000 7f6bb62aa700 1 -- 172.21.15.104:0/1422831671 shutdown_connections 2024-08-17T02:22:46.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.958+0000 7f6bb62aa700 1 --2- 172.21.15.104:0/1422831671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bb00c6520 0x7f6bb00cf020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:46.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.958+0000 7f6bb62aa700 1 --2- 172.21.15.104:0/1422831671 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6bb00cd5a0 0x7f6bb00ceae0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:46.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.958+0000 7f6bb62aa700 1 -- 172.21.15.104:0/1422831671 >> 172.21.15.104:0/1422831671 conn(0x7f6bb00996d0 msgr2=0x7f6bb00675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:46.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.958+0000 7f6bb62aa700 1 -- 172.21.15.104:0/1422831671 shutdown_connections 2024-08-17T02:22:46.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.958+0000 7f6bb62aa700 1 -- 172.21.15.104:0/1422831671 wait complete. 2024-08-17T02:22:46.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.962+0000 7f6bb62aa700 1 Processor -- start 2024-08-17T02:22:46.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.962+0000 7f6bb62aa700 1 -- start start 2024-08-17T02:22:46.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.962+0000 7f6bb62aa700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6bb00c6520 0x7f6bb015e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:46.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.962+0000 7f6bb62aa700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bb00cd5a0 0x7f6bb009d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:46.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.962+0000 7f6bb62aa700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bb015cb60 0x7f6bb0148130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:46.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.962+0000 7f6bb62aa700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb009e190 con 0x7f6bb00c6520 2024-08-17T02:22:46.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.962+0000 7f6bb62aa700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb009def0 con 0x7f6bb015cb60 2024-08-17T02:22:46.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.962+0000 7f6bb62aa700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb009a170 con 0x7f6bb00cd5a0 2024-08-17T02:22:46.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.962+0000 7f6baffff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6bb00c6520 0x7f6bb015e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:46.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.962+0000 7f6baffff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6bb00c6520 0x7f6bb015e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45002/0 (socket says 172.21.15.104:45002) 2024-08-17T02:22:46.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.962+0000 7f6baffff700 1 -- 172.21.15.104:0/1420819393 learned_addr learned my addr 172.21.15.104:0/1420819393 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:46.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.962+0000 7f6baf7fe700 1 --2- 172.21.15.104:0/1420819393 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bb00cd5a0 0x7f6bb009d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:46.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.962+0000 7f6bb4847700 1 --2- 172.21.15.104:0/1420819393 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bb015cb60 0x7f6bb0148130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:46.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.962+0000 7f6baffff700 1 -- 172.21.15.104:0/1420819393 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bb00cd5a0 msgr2=0x7f6bb009d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:46.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.962+0000 7f6baffff700 1 --2- 172.21.15.104:0/1420819393 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bb00cd5a0 0x7f6bb009d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:46.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.962+0000 7f6baffff700 1 -- 172.21.15.104:0/1420819393 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bb015cb60 msgr2=0x7f6bb0148130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:46.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.962+0000 7f6baffff700 1 --2- 172.21.15.104:0/1420819393 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bb015cb60 0x7f6bb0148130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:46.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.962+0000 7f6baffff700 1 -- 172.21.15.104:0/1420819393 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba00094f0 con 0x7f6bb00c6520 2024-08-17T02:22:46.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.962+0000 7f6baf7fe700 1 --2- 172.21.15.104:0/1420819393 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bb00cd5a0 0x7f6bb009d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:22:46.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.962+0000 7f6baffff700 1 --2- 172.21.15.104:0/1420819393 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6bb00c6520 0x7f6bb015e000 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6ba400c4e0 tx=0x7f6ba400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:46.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.962+0000 7f6b97fff700 1 -- 172.21.15.104:0/1420819393 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba4011590 con 0x7f6bb00c6520 2024-08-17T02:22:46.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.966+0000 7f6b97fff700 1 -- 172.21.15.104:0/1420819393 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba4011710 con 0x7f6bb00c6520 2024-08-17T02:22:46.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.966+0000 7f6bb62aa700 1 -- 172.21.15.104:0/1420819393 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb009a450 con 0x7f6bb00c6520 2024-08-17T02:22:46.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.966+0000 7f6b97fff700 1 -- 172.21.15.104:0/1420819393 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba4011ad0 con 0x7f6bb00c6520 2024-08-17T02:22:46.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.966+0000 7f6bb62aa700 1 -- 172.21.15.104:0/1420819393 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb009aa10 con 0x7f6bb00c6520 2024-08-17T02:22:46.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.966+0000 7f6bb62aa700 1 -- 172.21.15.104:0/1420819393 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bb00645c0 con 0x7f6bb00c6520 2024-08-17T02:22:46.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.966+0000 7f6b97fff700 1 -- 172.21.15.104:0/1420819393 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6ba401b3b0 con 0x7f6bb00c6520 2024-08-17T02:22:46.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.966+0000 7f6b97fff700 1 --2- 172.21.15.104:0/1420819393 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f6b9c060860 0x7f6b9c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:46.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.966+0000 7f6b97fff700 1 -- 172.21.15.104:0/1420819393 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6ba407bfc0 con 0x7f6bb00c6520 2024-08-17T02:22:46.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.970+0000 7f6baf7fe700 1 --2- 172.21.15.104:0/1420819393 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f6b9c060860 0x7f6b9c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:46.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.970+0000 7f6baf7fe700 1 --2- 172.21.15.104:0/1420819393 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f6b9c060860 0x7f6b9c062d10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6ba00099b0 tx=0x7f6ba0017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:46.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:46.974+0000 7f6b97fff700 1 -- 172.21.15.104:0/1420819393 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f6ba404c370 con 0x7f6bb00c6520 2024-08-17T02:22:47.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.142+0000 7f6bb62aa700 1 -- 172.21.15.104:0/1420819393 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6bb0071590 con 0x7f6bb00c6520 2024-08-17T02:22:47.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.142+0000 7f6b97fff700 1 -- 172.21.15.104:0/1420819393 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6ba4017020 con 0x7f6bb00c6520 2024-08-17T02:22:47.144 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 32 2024-08-17T02:22:47.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.142+0000 7f6bb62aa700 1 -- 172.21.15.104:0/1420819393 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f6b9c060860 msgr2=0x7f6b9c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:47.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.142+0000 7f6bb62aa700 1 --2- 172.21.15.104:0/1420819393 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f6b9c060860 0x7f6b9c062d10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6ba00099b0 tx=0x7f6ba0017000 comp rx=0 tx=0).stop 2024-08-17T02:22:47.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.142+0000 7f6bb62aa700 1 -- 172.21.15.104:0/1420819393 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6bb00c6520 msgr2=0x7f6bb015e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:47.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.142+0000 7f6bb62aa700 1 --2- 172.21.15.104:0/1420819393 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6bb00c6520 0x7f6bb015e000 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6ba400c4e0 tx=0x7f6ba400c7f0 comp rx=0 tx=0).stop 2024-08-17T02:22:47.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.142+0000 7f6bb62aa700 1 -- 172.21.15.104:0/1420819393 shutdown_connections 2024-08-17T02:22:47.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.142+0000 7f6bb62aa700 1 --2- 172.21.15.104:0/1420819393 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f6b9c060860 0x7f6b9c062d10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:47.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.142+0000 7f6bb62aa700 1 --2- 172.21.15.104:0/1420819393 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bb015cb60 0x7f6bb0148130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:47.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.142+0000 7f6bb62aa700 1 --2- 172.21.15.104:0/1420819393 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bb00cd5a0 0x7f6bb009d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:47.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.142+0000 7f6bb62aa700 1 --2- 172.21.15.104:0/1420819393 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6bb00c6520 0x7f6bb015e000 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:47.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.142+0000 7f6bb62aa700 1 -- 172.21.15.104:0/1420819393 >> 172.21.15.104:0/1420819393 conn(0x7f6bb00996d0 msgr2=0x7f6bb0068560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:47.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.142+0000 7f6bb62aa700 1 -- 172.21.15.104:0/1420819393 shutdown_connections 2024-08-17T02:22:47.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.142+0000 7f6bb62aa700 1 -- 172.21.15.104:0/1420819393 wait complete. 2024-08-17T02:22:47.158 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:22:47.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.270+0000 7f047ce0d700 1 Processor -- start 2024-08-17T02:22:47.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.270+0000 7f047ce0d700 1 -- start start 2024-08-17T02:22:47.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.270+0000 7f047ce0d700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f04780cbc30 0x7f04780ca2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:47.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.270+0000 7f047ce0d700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f04780ad6e0 0x7f04780c4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:47.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.270+0000 7f047ce0d700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04780c8cd0 con 0x7f04780adb60 2024-08-17T02:22:47.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.270+0000 7f047ce0d700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04780c89f0 con 0x7f04780ad6e0 2024-08-17T02:22:47.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.270+0000 7f047ce0d700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04780c3940 con 0x7f04780cbc30 2024-08-17T02:22:47.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.270+0000 7f0476d9d700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f04780adb60 0x7f04780cc000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:59416/0 (socket says 172.21.15.104:59416) 2024-08-17T02:22:47.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.270+0000 7f0476d9d700 1 -- 172.21.15.104:0/3189541695 learned_addr learned my addr 172.21.15.104:0/3189541695 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:47.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.270+0000 7f0475d9b700 1 --2- 172.21.15.104:0/3189541695 >> v2:172.21.15.104:3300/0 conn(0x7f04780ad6e0 0x7f04780c4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:47.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.270+0000 7f047659c700 1 --2- 172.21.15.104:0/3189541695 >> v2:172.21.15.117:3300/0 conn(0x7f04780cbc30 0x7f04780ca2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:47.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.270+0000 7f047559a700 1 -- 172.21.15.104:0/3189541695 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3978407686 0 0) 0x7f04780c8cd0 con 0x7f04780adb60 2024-08-17T02:22:47.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.270+0000 7f047559a700 1 -- 172.21.15.104:0/3189541695 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0460003570 con 0x7f04780adb60 2024-08-17T02:22:47.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.270+0000 7f0475d9b700 1 -- 172.21.15.104:0/3189541695 >> v2:172.21.15.117:3300/0 conn(0x7f04780cbc30 msgr2=0x7f04780ca2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:47.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.270+0000 7f0475d9b700 1 --2- 172.21.15.104:0/3189541695 >> v2:172.21.15.117:3300/0 conn(0x7f04780cbc30 0x7f04780ca2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:47.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.274+0000 7f0475d9b700 1 -- 172.21.15.104:0/3189541695 >> v1:172.21.15.104:6789/0 conn(0x7f04780adb60 legacy=0x7f04780cc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:47.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.274+0000 7f0475d9b700 1 -- 172.21.15.104:0/3189541695 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04780c3c20 con 0x7f04780ad6e0 2024-08-17T02:22:47.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.274+0000 7f0475d9b700 1 --2- 172.21.15.104:0/3189541695 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04780ad6e0 0x7f04780c4420 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f047806f1c0 tx=0x7f04680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=459800b4664d9e03 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:47.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.274+0000 7f047559a700 1 -- 172.21.15.104:0/3189541695 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0468011630 con 0x7f04780ad6e0 2024-08-17T02:22:47.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.274+0000 7f047559a700 1 -- 172.21.15.104:0/3189541695 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04680117b0 con 0x7f04780ad6e0 2024-08-17T02:22:47.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.274+0000 7f047559a700 1 -- 172.21.15.104:0/3189541695 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0468011b70 con 0x7f04780ad6e0 2024-08-17T02:22:47.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.274+0000 7f047ce0d700 1 -- 172.21.15.104:0/3189541695 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04780ad6e0 msgr2=0x7f04780c4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:47.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.274+0000 7f047ce0d700 1 --2- 172.21.15.104:0/3189541695 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04780ad6e0 0x7f04780c4420 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f047806f1c0 tx=0x7f04680091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:47.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.274+0000 7f047ce0d700 1 -- 172.21.15.104:0/3189541695 shutdown_connections 2024-08-17T02:22:47.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.274+0000 7f047ce0d700 1 --2- 172.21.15.104:0/3189541695 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04780ad6e0 0x7f04780c4420 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:47.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.274+0000 7f047ce0d700 1 --2- 172.21.15.104:0/3189541695 >> v2:172.21.15.117:3300/0 conn(0x7f04780cbc30 0x7f04780ca2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:47.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.274+0000 7f047ce0d700 1 -- 172.21.15.104:0/3189541695 >> 172.21.15.104:0/3189541695 conn(0x7f04780caad0 msgr2=0x7f04780caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:47.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.274+0000 7f047ce0d700 1 -- 172.21.15.104:0/3189541695 shutdown_connections 2024-08-17T02:22:47.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.274+0000 7f047ce0d700 1 -- 172.21.15.104:0/3189541695 wait complete. 2024-08-17T02:22:47.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.274+0000 7f047ce0d700 1 Processor -- start 2024-08-17T02:22:47.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.274+0000 7f047ce0d700 1 -- start start 2024-08-17T02:22:47.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.278+0000 7f047ce0d700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04780ad6e0 0x7f04780b37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:47.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.278+0000 7f047ce0d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04780adb60 0x7f04780b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:47.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.278+0000 7f047ce0d700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04780cbc30 0x7f04780aee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:47.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.278+0000 7f047ce0d700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04780688d0 con 0x7f04780ad6e0 2024-08-17T02:22:47.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.278+0000 7f047ce0d700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04780b3ce0 con 0x7f04780adb60 2024-08-17T02:22:47.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.278+0000 7f047ce0d700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f047816d110 con 0x7f04780cbc30 2024-08-17T02:22:47.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.278+0000 7f047659c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04780ad6e0 0x7f04780b37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:47.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.278+0000 7f047659c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04780ad6e0 0x7f04780b37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45034/0 (socket says 172.21.15.104:45034) 2024-08-17T02:22:47.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.278+0000 7f047659c700 1 -- 172.21.15.104:0/3851101450 learned_addr learned my addr 172.21.15.104:0/3851101450 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:47.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.278+0000 7f0475d9b700 1 --2- 172.21.15.104:0/3851101450 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04780adb60 0x7f04780b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:47.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.278+0000 7f0476d9d700 1 --2- 172.21.15.104:0/3851101450 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04780cbc30 0x7f04780aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:47.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.278+0000 7f047659c700 1 -- 172.21.15.104:0/3851101450 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04780cbc30 msgr2=0x7f04780aee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:47.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.278+0000 7f047659c700 1 --2- 172.21.15.104:0/3851101450 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04780cbc30 0x7f04780aee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:47.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.278+0000 7f047659c700 1 -- 172.21.15.104:0/3851101450 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04780adb60 msgr2=0x7f04780b12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:47.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.278+0000 7f047659c700 1 --2- 172.21.15.104:0/3851101450 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04780adb60 0x7f04780b12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:47.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.278+0000 7f047659c700 1 -- 172.21.15.104:0/3851101450 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0468009420 con 0x7f04780ad6e0 2024-08-17T02:22:47.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.278+0000 7f0475d9b700 1 --2- 172.21.15.104:0/3851101450 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04780adb60 0x7f04780b12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:22:47.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.278+0000 7f0476d9d700 1 --2- 172.21.15.104:0/3851101450 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04780cbc30 0x7f04780aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:22:47.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.278+0000 7f047659c700 1 --2- 172.21.15.104:0/3851101450 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04780ad6e0 0x7f04780b37a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f046c00e930 tx=0x7f046c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:47.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.278+0000 7f04667fc700 1 -- 172.21.15.104:0/3851101450 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046c00eed0 con 0x7f04780ad6e0 2024-08-17T02:22:47.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.278+0000 7f04667fc700 1 -- 172.21.15.104:0/3851101450 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f046c00c7f0 con 0x7f04780ad6e0 2024-08-17T02:22:47.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.278+0000 7f047ce0d700 1 -- 172.21.15.104:0/3851101450 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f047816d3f0 con 0x7f04780ad6e0 2024-08-17T02:22:47.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.278+0000 7f04667fc700 1 -- 172.21.15.104:0/3851101450 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046c00cb90 con 0x7f04780ad6e0 2024-08-17T02:22:47.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.278+0000 7f047ce0d700 1 -- 172.21.15.104:0/3851101450 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04780b1020 con 0x7f04780ad6e0 2024-08-17T02:22:47.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.278+0000 7f047ce0d700 1 -- 172.21.15.104:0/3851101450 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04780645c0 con 0x7f04780ad6e0 2024-08-17T02:22:47.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.282+0000 7f04667fc700 1 -- 172.21.15.104:0/3851101450 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f046c013470 con 0x7f04780ad6e0 2024-08-17T02:22:47.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.282+0000 7f04667fc700 1 --2- 172.21.15.104:0/3851101450 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f0458060860 0x7f0458062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:47.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.282+0000 7f04667fc700 1 -- 172.21.15.104:0/3851101450 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f046c07cd30 con 0x7f04780ad6e0 2024-08-17T02:22:47.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.282+0000 7f0475d9b700 1 --2- 172.21.15.104:0/3851101450 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f0458060860 0x7f0458062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:47.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.282+0000 7f0475d9b700 1 --2- 172.21.15.104:0/3851101450 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f0458060860 0x7f0458062d10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f047806f1c0 tx=0x7f0468017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:47.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.290+0000 7f04667fc700 1 -- 172.21.15.104:0/3851101450 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f046c04d180 con 0x7f04780ad6e0 2024-08-17T02:22:47.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.450+0000 7f047ce0d700 1 -- 172.21.15.104:0/3851101450 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f047813e350 con 0x7f04780ad6e0 2024-08-17T02:22:47.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.450+0000 7f04667fc700 1 -- 172.21.15.104:0/3851101450 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f046c0507a0 con 0x7f04780ad6e0 2024-08-17T02:22:47.454 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 64 2024-08-17T02:22:47.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.454+0000 7f047ce0d700 1 -- 172.21.15.104:0/3851101450 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f0458060860 msgr2=0x7f0458062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:47.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.454+0000 7f047ce0d700 1 --2- 172.21.15.104:0/3851101450 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f0458060860 0x7f0458062d10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f047806f1c0 tx=0x7f0468017000 comp rx=0 tx=0).stop 2024-08-17T02:22:47.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.454+0000 7f047ce0d700 1 -- 172.21.15.104:0/3851101450 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04780ad6e0 msgr2=0x7f04780b37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:47.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.454+0000 7f047ce0d700 1 --2- 172.21.15.104:0/3851101450 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04780ad6e0 0x7f04780b37a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f046c00e930 tx=0x7f046c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:47.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.454+0000 7f047ce0d700 1 -- 172.21.15.104:0/3851101450 shutdown_connections 2024-08-17T02:22:47.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.454+0000 7f047ce0d700 1 --2- 172.21.15.104:0/3851101450 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f0458060860 0x7f0458062d10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:47.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.454+0000 7f047ce0d700 1 --2- 172.21.15.104:0/3851101450 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04780cbc30 0x7f04780aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:47.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.454+0000 7f047ce0d700 1 --2- 172.21.15.104:0/3851101450 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04780adb60 0x7f04780b12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:47.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.454+0000 7f047ce0d700 1 --2- 172.21.15.104:0/3851101450 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04780ad6e0 0x7f04780b37a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:47.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.454+0000 7f047ce0d700 1 -- 172.21.15.104:0/3851101450 >> 172.21.15.104:0/3851101450 conn(0x7f04780caad0 msgr2=0x7f04780c4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:47.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.454+0000 7f047ce0d700 1 -- 172.21.15.104:0/3851101450 shutdown_connections 2024-08-17T02:22:47.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.454+0000 7f047ce0d700 1 -- 172.21.15.104:0/3851101450 wait complete. 2024-08-17T02:22:47.468 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:22:47.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.574+0000 7f9c816e0700 1 Processor -- start 2024-08-17T02:22:47.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.574+0000 7f9c816e0700 1 -- start start 2024-08-17T02:22:47.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.574+0000 7f9c816e0700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c7c0b0d20 0x7f9c7c06df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:47.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.574+0000 7f9c816e0700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f9c7c06e450 0x7f9c7c0b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:47.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.574+0000 7f9c816e0700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c7c141a00 con 0x7f9c7c0b1630 2024-08-17T02:22:47.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.574+0000 7f9c816e0700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c7c06e8a0 con 0x7f9c7c06e450 2024-08-17T02:22:47.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.574+0000 7f9c816e0700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c140b10 con 0x7f9c7c0b0d20 2024-08-17T02:22:47.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.574+0000 7f9c7b7fe700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f9c7c06e450 0x7f9c7c0b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:47.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.574+0000 7f9c7b7fe700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f9c7c06e450 0x7f9c7c0b10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45048/0 (socket says 172.21.15.104:45048) 2024-08-17T02:22:47.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.574+0000 7f9c7b7fe700 1 -- 172.21.15.104:0/711676801 learned_addr learned my addr 172.21.15.104:0/711676801 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:47.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.574+0000 7f9c7bfff700 1 --2- 172.21.15.104:0/711676801 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c7c0b0d20 0x7f9c7c06df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:47.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.578+0000 7f9c7b7fe700 1 -- 172.21.15.104:0/711676801 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c7c0b0d20 msgr2=0x7f9c7c06df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:47.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.578+0000 7f9c7b7fe700 1 --2- 172.21.15.104:0/711676801 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c7c0b0d20 0x7f9c7c06df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:47.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.578+0000 7f9c7b7fe700 1 -- 172.21.15.104:0/711676801 >> v1:172.21.15.104:6789/0 conn(0x7f9c7c0b1630 legacy=0x7f9c7c1610f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:47.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.578+0000 7f9c7affd700 1 -- 172.21.15.104:0/711676801 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3813610838 0 0) 0x7f9c7c141a00 con 0x7f9c7c0b1630 2024-08-17T02:22:47.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.578+0000 7f9c7b7fe700 1 -- 172.21.15.104:0/711676801 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c7c140df0 con 0x7f9c7c06e450 2024-08-17T02:22:47.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.578+0000 7f9c7b7fe700 1 --2- 172.21.15.104:0/711676801 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c7c06e450 0x7f9c7c0b10f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9c64009f20 tx=0x7f9c64009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ce84a2b591a6470 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:47.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.578+0000 7f9c7affd700 1 -- 172.21.15.104:0/711676801 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6400e070 con 0x7f9c7c06e450 2024-08-17T02:22:47.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.578+0000 7f9c7affd700 1 -- 172.21.15.104:0/711676801 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c6400ba80 con 0x7f9c7c06e450 2024-08-17T02:22:47.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.578+0000 7f9c7affd700 1 -- 172.21.15.104:0/711676801 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c640092e0 con 0x7f9c7c06e450 2024-08-17T02:22:47.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.578+0000 7f9c816e0700 1 -- 172.21.15.104:0/711676801 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c7c06e450 msgr2=0x7f9c7c0b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:47.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.578+0000 7f9c816e0700 1 --2- 172.21.15.104:0/711676801 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c7c06e450 0x7f9c7c0b10f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9c64009f20 tx=0x7f9c64009840 comp rx=0 tx=0).stop 2024-08-17T02:22:47.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.578+0000 7f9c816e0700 1 -- 172.21.15.104:0/711676801 shutdown_connections 2024-08-17T02:22:47.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.578+0000 7f9c816e0700 1 --2- 172.21.15.104:0/711676801 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c7c06e450 0x7f9c7c0b10f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:47.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.578+0000 7f9c816e0700 1 --2- 172.21.15.104:0/711676801 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c7c0b0d20 0x7f9c7c06df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:47.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.578+0000 7f9c816e0700 1 -- 172.21.15.104:0/711676801 >> 172.21.15.104:0/711676801 conn(0x7f9c7c0678d0 msgr2=0x7f9c7c067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:47.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.578+0000 7f9c816e0700 1 -- 172.21.15.104:0/711676801 shutdown_connections 2024-08-17T02:22:47.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.578+0000 7f9c816e0700 1 -- 172.21.15.104:0/711676801 wait complete. 2024-08-17T02:22:47.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.578+0000 7f9c816e0700 1 Processor -- start 2024-08-17T02:22:47.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.578+0000 7f9c816e0700 1 -- start start 2024-08-17T02:22:47.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.578+0000 7f9c816e0700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c7c06e450 0x7f9c7c16d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:47.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.582+0000 7f9c816e0700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c7c0b0d20 0x7f9c7c0a96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:47.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.582+0000 7f9c816e0700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c7c0b1630 0x7f9c7c0a9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:47.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.582+0000 7f9c816e0700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c16ecd0 con 0x7f9c7c0b1630 2024-08-17T02:22:47.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.582+0000 7f9c816e0700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c16fb30 con 0x7f9c7c0b0d20 2024-08-17T02:22:47.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.582+0000 7f9c816e0700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c16ef20 con 0x7f9c7c06e450 2024-08-17T02:22:47.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.582+0000 7f9c80edf700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c7c0b1630 0x7f9c7c0a9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:47.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.582+0000 7f9c80edf700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c7c0b1630 0x7f9c7c0a9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45064/0 (socket says 172.21.15.104:45064) 2024-08-17T02:22:47.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.582+0000 7f9c80edf700 1 -- 172.21.15.104:0/4213969215 learned_addr learned my addr 172.21.15.104:0/4213969215 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:47.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.582+0000 7f9c7b7fe700 1 --2- 172.21.15.104:0/4213969215 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c7c0b0d20 0x7f9c7c0a96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:47.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.582+0000 7f9c7bfff700 1 --2- 172.21.15.104:0/4213969215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c7c06e450 0x7f9c7c16d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:47.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.582+0000 7f9c80edf700 1 -- 172.21.15.104:0/4213969215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c7c06e450 msgr2=0x7f9c7c16d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:47.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.582+0000 7f9c80edf700 1 --2- 172.21.15.104:0/4213969215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c7c06e450 0x7f9c7c16d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:47.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.582+0000 7f9c80edf700 1 -- 172.21.15.104:0/4213969215 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c7c0b0d20 msgr2=0x7f9c7c0a96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:47.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.582+0000 7f9c80edf700 1 --2- 172.21.15.104:0/4213969215 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c7c0b0d20 0x7f9c7c0a96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:47.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.582+0000 7f9c80edf700 1 -- 172.21.15.104:0/4213969215 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c64009ae0 con 0x7f9c7c0b1630 2024-08-17T02:22:47.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.582+0000 7f9c80edf700 1 --2- 172.21.15.104:0/4213969215 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c7c0b1630 0x7f9c7c0a9c20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c00c600 tx=0x7f9c6c007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:47.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.582+0000 7f9c73fff700 1 -- 172.21.15.104:0/4213969215 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c011590 con 0x7f9c7c0b1630 2024-08-17T02:22:47.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.582+0000 7f9c73fff700 1 -- 172.21.15.104:0/4213969215 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c6c0116f0 con 0x7f9c7c0b1630 2024-08-17T02:22:47.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.582+0000 7f9c816e0700 1 -- 172.21.15.104:0/4213969215 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c7c16f200 con 0x7f9c7c0b1630 2024-08-17T02:22:47.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.582+0000 7f9c73fff700 1 -- 172.21.15.104:0/4213969215 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c011ab0 con 0x7f9c7c0b1630 2024-08-17T02:22:47.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.582+0000 7f9c816e0700 1 -- 172.21.15.104:0/4213969215 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c7c16f7c0 con 0x7f9c7c0b1630 2024-08-17T02:22:47.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.582+0000 7f9c816e0700 1 -- 172.21.15.104:0/4213969215 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c7c16fcc0 con 0x7f9c7c0b1630 2024-08-17T02:22:47.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.582+0000 7f9c73fff700 1 -- 172.21.15.104:0/4213969215 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9c6c01b3b0 con 0x7f9c7c0b1630 2024-08-17T02:22:47.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.582+0000 7f9c73fff700 1 --2- 172.21.15.104:0/4213969215 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f9c60060890 0x7f9c60062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:47.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.586+0000 7f9c73fff700 1 -- 172.21.15.104:0/4213969215 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9c6c07c030 con 0x7f9c7c0b1630 2024-08-17T02:22:47.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.586+0000 7f9c7bfff700 1 --2- 172.21.15.104:0/4213969215 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f9c60060890 0x7f9c60062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:47.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.586+0000 7f9c7bfff700 1 --2- 172.21.15.104:0/4213969215 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f9c60060890 0x7f9c60062d40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9c74006fd0 tx=0x7f9c74008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:47.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.594+0000 7f9c73fff700 1 -- 172.21.15.104:0/4213969215 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f9c6c04c480 con 0x7f9c7c0b1630 2024-08-17T02:22:47.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.758+0000 7f9c816e0700 1 -- 172.21.15.104:0/4213969215 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c7c0643a0 con 0x7f9c7c0b1630 2024-08-17T02:22:47.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.758+0000 7f9c73fff700 1 -- 172.21.15.104:0/4213969215 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f9c6c017090 con 0x7f9c7c0b1630 2024-08-17T02:22:47.763 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:22:47.763 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":23,"fsid":"fd5f7fb8-d34b-49bb-89a8-62b7dad1bc25","created":"2024-08-17T02:21:57.891389+0000","modified":"2024-08-17T02:22:23.175831+0000","last_up_change":"2024-08-17T02:22:08.924546+0000","last_in_change":"2024-08-17T02:21:59.938028+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:22:10.143970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:22:20.082708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:22:20.521582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"606b9088-590e-4709-aa3a-b0f6e22972ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":24257},{"type":"v1","addr":"172.21.15.104:6809","nonce":24257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":24257},{"type":"v1","addr":"172.21.15.104:6811","nonce":24257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":24257},{"type":"v1","addr":"172.21.15.104:6815","nonce":24257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":24257},{"type":"v1","addr":"172.21.15.104:6813","nonce":24257}]},"public_addr":"172.21.15.104:6809/24257","cluster_addr":"172.21.15.104:6811/24257","heartbeat_back_addr":"172.21.15.104:6815/24257","heartbeat_front_addr":"172.21.15.104:6813/24257","state":["exists","up"]},{"osd":1,"uuid":"9bc6a909-0c2f-4889-afe7-4a47f89b0f64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":24256},{"type":"v1","addr":"172.21.15.104:6825","nonce":24256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":24256},{"type":"v1","addr":"172.21.15.104:6827","nonce":24256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":24256},{"type":"v1","addr":"172.21.15.104:6831","nonce":24256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":24256},{"type":"v1","addr":"172.21.15.104:6829","nonce":24256}]},"public_addr":"172.21.15.104:6825/24256","cluster_addr":"172.21.15.104:6827/24256","heartbeat_back_addr":"172.21.15.104:6831/24256","heartbeat_front_addr":"172.21.15.104:6829/24256","state":["exists","up"]},{"osd":2,"uuid":"23da31d5-aefb-4edb-b79d-fa05e1becef7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":24255},{"type":"v1","addr":"172.21.15.104:6817","nonce":24255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":24255},{"type":"v1","addr":"172.21.15.104:6819","nonce":24255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":24255},{"type":"v1","addr":"172.21.15.104:6823","nonce":24255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":24255},{"type":"v1","addr":"172.21.15.104:6821","nonce":24255}]},"public_addr":"172.21.15.104:6817/24255","cluster_addr":"172.21.15.104:6819/24255","heartbeat_back_addr":"172.21.15.104:6823/24255","heartbeat_front_addr":"172.21.15.104:6821/24255","state":["exists","up"]},{"osd":3,"uuid":"6e4a5ec2-b415-45ef-8381-61a59eb65224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":24254},{"type":"v1","addr":"172.21.15.104:6801","nonce":24254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":24254},{"type":"v1","addr":"172.21.15.104:6803","nonce":24254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":24254},{"type":"v1","addr":"172.21.15.104:6807","nonce":24254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":24254},{"type":"v1","addr":"172.21.15.104:6805","nonce":24254}]},"public_addr":"172.21.15.104:6801/24254","cluster_addr":"172.21.15.104:6803/24254","heartbeat_back_addr":"172.21.15.104:6807/24254","heartbeat_front_addr":"172.21.15.104:6805/24254","state":["exists","up"]},{"osd":4,"uuid":"8d5bea2d-9039-4013-8c99-2c046c5b8a17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":24421},{"type":"v1","addr":"172.21.15.117:6804","nonce":24421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":24421},{"type":"v1","addr":"172.21.15.117:6809","nonce":24421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":24421},{"type":"v1","addr":"172.21.15.117:6815","nonce":24421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":24421},{"type":"v1","addr":"172.21.15.117:6813","nonce":24421}]},"public_addr":"172.21.15.117:6804/24421","cluster_addr":"172.21.15.117:6809/24421","heartbeat_back_addr":"172.21.15.117:6815/24421","heartbeat_front_addr":"172.21.15.117:6813/24421","state":["exists","up"]},{"osd":5,"uuid":"de8b36fc-121c-4f05-8f5b-28f513d9f21f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":24422},{"type":"v1","addr":"172.21.15.117:6817","nonce":24422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":24422},{"type":"v1","addr":"172.21.15.117:6819","nonce":24422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":24422},{"type":"v1","addr":"172.21.15.117:6823","nonce":24422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":24422},{"type":"v1","addr":"172.21.15.117:6821","nonce":24422}]},"public_addr":"172.21.15.117:6817/24422","cluster_addr":"172.21.15.117:6819/24422","heartbeat_back_addr":"172.21.15.117:6823/24422","heartbeat_front_addr":"172.21.15.117:6821/24422","state":["exists","up"]},{"osd":6,"uuid":"6a87f09f-7bf7-4f7a-be87-530ac1ff8ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":24420},{"type":"v1","addr":"172.21.15.117:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6803","nonce":24420},{"type":"v1","addr":"172.21.15.117:6805","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":24420},{"type":"v1","addr":"172.21.15.117:6811","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":24420},{"type":"v1","addr":"172.21.15.117:6808","nonce":24420}]},"public_addr":"172.21.15.117:6801/24420","cluster_addr":"172.21.15.117:6805/24420","heartbeat_back_addr":"172.21.15.117:6811/24420","heartbeat_front_addr":"172.21.15.117:6808/24420","state":["exists","up"]},{"osd":7,"uuid":"e31d8041-1aa1-4b5d-83b3-0a373426dd9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":24423},{"type":"v1","addr":"172.21.15.117:6825","nonce":24423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":24423},{"type":"v1","addr":"172.21.15.117:6827","nonce":24423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":24423},{"type":"v1","addr":"172.21.15.117:6831","nonce":24423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":24423},{"type":"v1","addr":"172.21.15.117:6829","nonce":24423}]},"public_addr":"172.21.15.117:6825/24423","cluster_addr":"172.21.15.117:6827/24423","heartbeat_back_addr":"172.21.15.117:6831/24423","heartbeat_front_addr":"172.21.15.117:6829/24423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.220874+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.210039+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.434762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.247206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.184316+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.306325+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.035719+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.400303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:22:47.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.762+0000 7f9c816e0700 1 -- 172.21.15.104:0/4213969215 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f9c60060890 msgr2=0x7f9c60062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:47.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.762+0000 7f9c816e0700 1 --2- 172.21.15.104:0/4213969215 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f9c60060890 0x7f9c60062d40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9c74006fd0 tx=0x7f9c74008040 comp rx=0 tx=0).stop 2024-08-17T02:22:47.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.762+0000 7f9c816e0700 1 -- 172.21.15.104:0/4213969215 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c7c0b1630 msgr2=0x7f9c7c0a9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:47.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.762+0000 7f9c816e0700 1 --2- 172.21.15.104:0/4213969215 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c7c0b1630 0x7f9c7c0a9c20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c00c600 tx=0x7f9c6c007d70 comp rx=0 tx=0).stop 2024-08-17T02:22:47.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.762+0000 7f9c816e0700 1 -- 172.21.15.104:0/4213969215 shutdown_connections 2024-08-17T02:22:47.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.762+0000 7f9c816e0700 1 --2- 172.21.15.104:0/4213969215 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f9c60060890 0x7f9c60062d40 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:47.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.762+0000 7f9c816e0700 1 --2- 172.21.15.104:0/4213969215 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c7c0b1630 0x7f9c7c0a9c20 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:47.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.762+0000 7f9c816e0700 1 --2- 172.21.15.104:0/4213969215 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c7c0b0d20 0x7f9c7c0a96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:47.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.762+0000 7f9c816e0700 1 --2- 172.21.15.104:0/4213969215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c7c06e450 0x7f9c7c16d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:47.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.762+0000 7f9c816e0700 1 -- 172.21.15.104:0/4213969215 >> 172.21.15.104:0/4213969215 conn(0x7f9c7c0678d0 msgr2=0x7f9c7c06a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:47.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.762+0000 7f9c816e0700 1 -- 172.21.15.104:0/4213969215 shutdown_connections 2024-08-17T02:22:47.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.762+0000 7f9c816e0700 1 -- 172.21.15.104:0/4213969215 wait complete. 2024-08-17T02:22:47.777 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:22:10.143970+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:22:20.082708+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:22:20.521582+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:22:47.777 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:22:47.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.886+0000 7fc92d059700 1 Processor -- start 2024-08-17T02:22:47.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.886+0000 7fc92d059700 1 -- start start 2024-08-17T02:22:47.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.890+0000 7fc92d059700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fc928161f20 0x7fc928164300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:47.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.890+0000 7fc92d059700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9280cc350 con 0x7fc9280cbcc0 2024-08-17T02:22:47.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.890+0000 7fc92d059700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9280cc630 con 0x7fc9280b0390 2024-08-17T02:22:47.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.890+0000 7fc92d059700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9280ca760 con 0x7fc928161f20 2024-08-17T02:22:47.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.890+0000 7fc92c858700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fc928161f20 0x7fc928164300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:47.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.890+0000 7fc92c858700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fc928161f20 0x7fc928164300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45080/0 (socket says 172.21.15.104:45080) 2024-08-17T02:22:47.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.890+0000 7fc92c858700 1 -- 172.21.15.104:0/1275137769 learned_addr learned my addr 172.21.15.104:0/1275137769 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:47.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.890+0000 7fc9277fe700 1 --1- 172.21.15.104:0/1275137769 >> v1:172.21.15.104:6789/0 conn(0x7fc9280cbcc0 0x7fc92815d4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:59426/0 (socket says 172.21.15.104:59426) 2024-08-17T02:22:47.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.890+0000 7fc92c858700 1 -- 172.21.15.104:0/1275137769 >> v1:172.21.15.117:6789/0 conn(0x7fc9280b0390 legacy=0x7fc92815cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:47.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.890+0000 7fc92c858700 1 -- 172.21.15.104:0/1275137769 >> v1:172.21.15.104:6789/0 conn(0x7fc9280cbcc0 legacy=0x7fc92815d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:47.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.890+0000 7fc92c858700 1 -- 172.21.15.104:0/1275137769 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9280cc910 con 0x7fc928161f20 2024-08-17T02:22:47.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.890+0000 7fc926ffd700 1 -- 172.21.15.104:0/1275137769 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3121996355 0 0) 0x7fc9280cc350 con 0x7fc9280cbcc0 2024-08-17T02:22:47.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.890+0000 7fc92c858700 1 --2- 172.21.15.104:0/1275137769 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc928161f20 0x7fc928164300 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc920009f20 tx=0x7fc920009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43375656bf2e840c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:47.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.890+0000 7fc926ffd700 1 -- 172.21.15.104:0/1275137769 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92000e070 con 0x7fc928161f20 2024-08-17T02:22:47.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.890+0000 7fc926ffd700 1 -- 172.21.15.104:0/1275137769 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92000ba80 con 0x7fc928161f20 2024-08-17T02:22:47.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.890+0000 7fc926ffd700 1 -- 172.21.15.104:0/1275137769 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9200092e0 con 0x7fc928161f20 2024-08-17T02:22:47.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.890+0000 7fc92d059700 1 -- 172.21.15.104:0/1275137769 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc928161f20 msgr2=0x7fc928164300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:47.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.890+0000 7fc92d059700 1 --2- 172.21.15.104:0/1275137769 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc928161f20 0x7fc928164300 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc920009f20 tx=0x7fc920009840 comp rx=0 tx=0).stop 2024-08-17T02:22:47.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.890+0000 7fc92d059700 1 -- 172.21.15.104:0/1275137769 shutdown_connections 2024-08-17T02:22:47.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.890+0000 7fc92d059700 1 --2- 172.21.15.104:0/1275137769 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc928161f20 0x7fc928164300 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:47.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.890+0000 7fc92d059700 1 -- 172.21.15.104:0/1275137769 >> 172.21.15.104:0/1275137769 conn(0x7fc9280cdee0 msgr2=0x7fc9280ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:47.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.890+0000 7fc92d059700 1 -- 172.21.15.104:0/1275137769 shutdown_connections 2024-08-17T02:22:47.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.890+0000 7fc92d059700 1 -- 172.21.15.104:0/1275137769 wait complete. 2024-08-17T02:22:47.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.894+0000 7fc92d059700 1 Processor -- start 2024-08-17T02:22:47.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.894+0000 7fc92d059700 1 -- start start 2024-08-17T02:22:47.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.898+0000 7fc92d059700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9280b0390 0x7fc928068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:47.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.898+0000 7fc92d059700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9280cbcc0 0x7fc928148ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:47.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.898+0000 7fc92d059700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc928161f20 0x7fc92814b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:47.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.898+0000 7fc92d059700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc928069c40 con 0x7fc9280cbcc0 2024-08-17T02:22:47.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.898+0000 7fc92d059700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc928069960 con 0x7fc9280b0390 2024-08-17T02:22:47.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.898+0000 7fc92d059700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc928156a60 con 0x7fc928161f20 2024-08-17T02:22:47.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.898+0000 7fc9277fe700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9280cbcc0 0x7fc928148ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:47.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.898+0000 7fc9277fe700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9280cbcc0 0x7fc928148ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45084/0 (socket says 172.21.15.104:45084) 2024-08-17T02:22:47.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.898+0000 7fc9277fe700 1 -- 172.21.15.104:0/2694380988 learned_addr learned my addr 172.21.15.104:0/2694380988 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:47.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.898+0000 7fc92c858700 1 --2- 172.21.15.104:0/2694380988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc928161f20 0x7fc92814b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:47.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.898+0000 7fc927fff700 1 --2- 172.21.15.104:0/2694380988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9280b0390 0x7fc928068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:47.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.898+0000 7fc9277fe700 1 -- 172.21.15.104:0/2694380988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc928161f20 msgr2=0x7fc92814b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:47.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.898+0000 7fc9277fe700 1 --2- 172.21.15.104:0/2694380988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc928161f20 0x7fc92814b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:47.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.898+0000 7fc9277fe700 1 -- 172.21.15.104:0/2694380988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9280b0390 msgr2=0x7fc928068c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:47.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.898+0000 7fc9277fe700 1 --2- 172.21.15.104:0/2694380988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9280b0390 0x7fc928068c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:47.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.898+0000 7fc9277fe700 1 -- 172.21.15.104:0/2694380988 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc920009ae0 con 0x7fc9280cbcc0 2024-08-17T02:22:47.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.898+0000 7fc9277fe700 1 --2- 172.21.15.104:0/2694380988 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9280cbcc0 0x7fc928148ff0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc91000c810 tx=0x7fc910007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:47.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.898+0000 7fc91ffff700 1 -- 172.21.15.104:0/2694380988 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc910005b40 con 0x7fc9280cbcc0 2024-08-17T02:22:47.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.898+0000 7fc91ffff700 1 -- 172.21.15.104:0/2694380988 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc910005ca0 con 0x7fc9280cbcc0 2024-08-17T02:22:47.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.898+0000 7fc92d059700 1 -- 172.21.15.104:0/2694380988 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc928156d40 con 0x7fc9280cbcc0 2024-08-17T02:22:47.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.898+0000 7fc91ffff700 1 -- 172.21.15.104:0/2694380988 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc910007320 con 0x7fc9280cbcc0 2024-08-17T02:22:47.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.898+0000 7fc92d059700 1 -- 172.21.15.104:0/2694380988 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc928149530 con 0x7fc9280cbcc0 2024-08-17T02:22:47.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.898+0000 7fc92d059700 1 -- 172.21.15.104:0/2694380988 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9281568c0 con 0x7fc9280cbcc0 2024-08-17T02:22:47.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.902+0000 7fc91ffff700 1 -- 172.21.15.104:0/2694380988 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fc91001b3b0 con 0x7fc9280cbcc0 2024-08-17T02:22:47.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.902+0000 7fc91ffff700 1 --2- 172.21.15.104:0/2694380988 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fc908060860 0x7fc908062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:47.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.902+0000 7fc91ffff700 1 -- 172.21.15.104:0/2694380988 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc91007c050 con 0x7fc9280cbcc0 2024-08-17T02:22:47.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.902+0000 7fc927fff700 1 --2- 172.21.15.104:0/2694380988 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fc908060860 0x7fc908062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:47.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.902+0000 7fc927fff700 1 --2- 172.21.15.104:0/2694380988 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fc908060860 0x7fc908062d10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc918003a80 tx=0x7fc918007ec0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:47.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:47.910+0000 7fc91ffff700 1 -- 172.21.15.104:0/2694380988 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fc9281568c0 con 0x7fc9280cbcc0 2024-08-17T02:22:48.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.070+0000 7fc92d059700 1 -- 172.21.15.104:0/2694380988 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc9281568c0 con 0x7fc9280cbcc0 2024-08-17T02:22:48.075 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.074+0000 7fc91ffff700 1 -- 172.21.15.104:0/2694380988 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc910017020 con 0x7fc9280cbcc0 2024-08-17T02:22:48.075 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-08-17T02:22:48.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.074+0000 7fc92d059700 1 -- 172.21.15.104:0/2694380988 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fc908060860 msgr2=0x7fc908062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:48.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.074+0000 7fc92d059700 1 --2- 172.21.15.104:0/2694380988 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fc908060860 0x7fc908062d10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc918003a80 tx=0x7fc918007ec0 comp rx=0 tx=0).stop 2024-08-17T02:22:48.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.074+0000 7fc92d059700 1 -- 172.21.15.104:0/2694380988 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9280cbcc0 msgr2=0x7fc928148ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:48.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.074+0000 7fc92d059700 1 --2- 172.21.15.104:0/2694380988 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9280cbcc0 0x7fc928148ff0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc91000c810 tx=0x7fc910007d90 comp rx=0 tx=0).stop 2024-08-17T02:22:48.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.074+0000 7fc92d059700 1 -- 172.21.15.104:0/2694380988 shutdown_connections 2024-08-17T02:22:48.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.074+0000 7fc92d059700 1 --2- 172.21.15.104:0/2694380988 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fc908060860 0x7fc908062d10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:48.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.074+0000 7fc92d059700 1 --2- 172.21.15.104:0/2694380988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc928161f20 0x7fc92814b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:48.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.074+0000 7fc92d059700 1 --2- 172.21.15.104:0/2694380988 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9280cbcc0 0x7fc928148ff0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:48.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.074+0000 7fc92d059700 1 --2- 172.21.15.104:0/2694380988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9280b0390 0x7fc928068c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:48.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.074+0000 7fc92d059700 1 -- 172.21.15.104:0/2694380988 >> 172.21.15.104:0/2694380988 conn(0x7fc9280cdee0 msgr2=0x7fc9280cb130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:48.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.074+0000 7fc92d059700 1 -- 172.21.15.104:0/2694380988 shutdown_connections 2024-08-17T02:22:48.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.074+0000 7fc92d059700 1 -- 172.21.15.104:0/2694380988 wait complete. 2024-08-17T02:22:48.089 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:22:48.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.202+0000 7f9dd359e700 1 Processor -- start 2024-08-17T02:22:48.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.202+0000 7f9dd359e700 1 -- start start 2024-08-17T02:22:48.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.202+0000 7f9dd359e700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9dd41505b0 0x7f9dd40686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:48.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.202+0000 7f9dd359e700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dd4157160 con 0x7f9dd4068be0 2024-08-17T02:22:48.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.202+0000 7f9dd359e700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dd4069020 con 0x7f9dd41501e0 2024-08-17T02:22:48.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.202+0000 7f9dd359e700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dd4156550 con 0x7f9dd41505b0 2024-08-17T02:22:48.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.202+0000 7f9dd2d9d700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f9dd4068be0 0x7f9dd40af5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:59436/0 (socket says 172.21.15.104:59436) 2024-08-17T02:22:48.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.202+0000 7f9dd2d9d700 1 -- 172.21.15.104:0/3577789683 learned_addr learned my addr 172.21.15.104:0/3577789683 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:48.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.202+0000 7f9dd1d9b700 1 --2- 172.21.15.104:0/3577789683 >> v2:172.21.15.117:3300/0 conn(0x7f9dd41505b0 0x7f9dd40686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:48.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.202+0000 7f9dd159a700 1 -- 172.21.15.104:0/3577789683 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2032155224 0 0) 0x7f9dd4157160 con 0x7f9dd4068be0 2024-08-17T02:22:48.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.202+0000 7f9dd159a700 1 -- 172.21.15.104:0/3577789683 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9dbc003570 con 0x7f9dd4068be0 2024-08-17T02:22:48.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.206+0000 7f9dd159a700 1 -- 172.21.15.104:0/3577789683 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2331263029 0 0) 0x7f9dbc003570 con 0x7f9dd4068be0 2024-08-17T02:22:48.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.206+0000 7f9dd159a700 1 -- 172.21.15.104:0/3577789683 >> v2:172.21.15.117:3300/0 conn(0x7f9dd41505b0 msgr2=0x7f9dd40686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:48.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.206+0000 7f9dd159a700 1 --2- 172.21.15.104:0/3577789683 >> v2:172.21.15.117:3300/0 conn(0x7f9dd41505b0 0x7f9dd40686a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:48.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.206+0000 7f9dd159a700 1 -- 172.21.15.104:0/3577789683 >> v1:172.21.15.117:6789/0 conn(0x7f9dd41501e0 legacy=0x7f9dd40ab7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:48.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.206+0000 7f9dd159a700 1 -- 172.21.15.104:0/3577789683 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd4156830 con 0x7f9dd4068be0 2024-08-17T02:22:48.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.206+0000 7f9dd159a700 1 -- 172.21.15.104:0/3577789683 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1279957748 0 0) 0x7f9dcc0017f0 con 0x7f9dd4068be0 2024-08-17T02:22:48.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.206+0000 7f9dd159a700 1 -- 172.21.15.104:0/3577789683 >> v1:172.21.15.104:6789/0 conn(0x7f9dd4068be0 legacy=0x7f9dd40af5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:48.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.206+0000 7f9dd159a700 1 --2- 172.21.15.104:0/3577789683 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9dbc003a60 0x7f9dbc003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:48.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.206+0000 7f9dd159a700 1 --2- 172.21.15.104:0/3577789683 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9dbc004810 0x7f9dbc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:48.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.206+0000 7f9dd159a700 1 --2- 172.21.15.104:0/3577789683 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9dbc0051c0 0x7f9dbc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:48.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.206+0000 7f9dd159a700 1 -- 172.21.15.104:0/3577789683 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd4156550 con 0x7f9dbc0051c0 2024-08-17T02:22:48.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.206+0000 7f9dd159a700 1 -- 172.21.15.104:0/3577789683 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dbc00c0e0 con 0x7f9dbc003a60 2024-08-17T02:22:48.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.206+0000 7f9dd159a700 1 -- 172.21.15.104:0/3577789683 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dbc00c2a0 con 0x7f9dbc004810 2024-08-17T02:22:48.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.206+0000 7f9dd2d9d700 1 --2- 172.21.15.104:0/3577789683 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9dbc0051c0 0x7f9dbc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:48.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.206+0000 7f9dd1d9b700 1 --2- 172.21.15.104:0/3577789683 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9dbc004810 0x7f9dbc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:48.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.206+0000 7f9dd259c700 1 --2- 172.21.15.104:0/3577789683 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9dbc003a60 0x7f9dbc003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:48.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.206+0000 7f9dd2d9d700 1 -- 172.21.15.104:0/3577789683 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9dbc004810 msgr2=0x7f9dbc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:48.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.206+0000 7f9dd2d9d700 1 --2- 172.21.15.104:0/3577789683 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9dbc004810 0x7f9dbc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:48.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.206+0000 7f9dd2d9d700 1 -- 172.21.15.104:0/3577789683 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9dbc003a60 msgr2=0x7f9dbc003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:48.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.206+0000 7f9dd2d9d700 1 --2- 172.21.15.104:0/3577789683 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9dbc003a60 0x7f9dbc003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:48.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.206+0000 7f9dd2d9d700 1 -- 172.21.15.104:0/3577789683 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dbc003570 con 0x7f9dbc0051c0 2024-08-17T02:22:48.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.206+0000 7f9dd2d9d700 1 -- 172.21.15.104:0/3577789683 reap_dead start 2024-08-17T02:22:48.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.206+0000 7f9dd2d9d700 1 --2- 172.21.15.104:0/3577789683 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9dbc0051c0 0x7f9dbc00ba60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc00a950 tx=0x7f9dcc0021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4cbe9757b6b52b2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:48.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.206+0000 7f9dd159a700 1 -- 172.21.15.104:0/3577789683 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc0070d0 con 0x7f9dbc0051c0 2024-08-17T02:22:48.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.206+0000 7f9dd159a700 1 -- 172.21.15.104:0/3577789683 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dcc007270 con 0x7f9dbc0051c0 2024-08-17T02:22:48.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.206+0000 7f9dd159a700 1 -- 172.21.15.104:0/3577789683 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc007630 con 0x7f9dbc0051c0 2024-08-17T02:22:48.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.206+0000 7f9dd359e700 1 -- 172.21.15.104:0/3577789683 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9dbc0051c0 msgr2=0x7f9dbc00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:48.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.206+0000 7f9dd359e700 1 --2- 172.21.15.104:0/3577789683 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9dbc0051c0 0x7f9dbc00ba60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc00a950 tx=0x7f9dcc0021f0 comp rx=0 tx=0).stop 2024-08-17T02:22:48.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.206+0000 7f9dd359e700 1 -- 172.21.15.104:0/3577789683 shutdown_connections 2024-08-17T02:22:48.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.206+0000 7f9dd359e700 1 --2- 172.21.15.104:0/3577789683 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9dbc0051c0 0x7f9dbc00ba60 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:48.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.206+0000 7f9dd359e700 1 -- 172.21.15.104:0/3577789683 >> 172.21.15.104:0/3577789683 conn(0x7f9dd406e310 msgr2=0x7f9dd406b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:48.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.206+0000 7f9dd359e700 1 -- 172.21.15.104:0/3577789683 shutdown_connections 2024-08-17T02:22:48.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.206+0000 7f9dd359e700 1 -- 172.21.15.104:0/3577789683 wait complete. 2024-08-17T02:22:48.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.210+0000 7f9dd359e700 1 Processor -- start 2024-08-17T02:22:48.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.210+0000 7f9dd359e700 1 -- start start 2024-08-17T02:22:48.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.210+0000 7f9dd359e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9dbc0051c0 0x7f9dd4153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:48.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.210+0000 7f9dd359e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9dd406a8a0 0x7f9dd406ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:48.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.210+0000 7f9dd359e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9dd4164580 0x7f9dd4164a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:48.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.210+0000 7f9dd359e700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd4146d00 con 0x7f9dd406a8a0 2024-08-17T02:22:48.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.210+0000 7f9dd359e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd4153750 con 0x7f9dd4164580 2024-08-17T02:22:48.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.210+0000 7f9dd359e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd406b250 con 0x7f9dbc0051c0 2024-08-17T02:22:48.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.210+0000 7f9dd1d9b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9dd406a8a0 0x7f9dd406ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:48.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.210+0000 7f9dd1d9b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9dd406a8a0 0x7f9dd406ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45098/0 (socket says 172.21.15.104:45098) 2024-08-17T02:22:48.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.210+0000 7f9dd1d9b700 1 -- 172.21.15.104:0/2699531330 learned_addr learned my addr 172.21.15.104:0/2699531330 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:48.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.210+0000 7f9dd259c700 1 --2- 172.21.15.104:0/2699531330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9dbc0051c0 0x7f9dd4153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:48.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.210+0000 7f9dd2d9d700 1 --2- 172.21.15.104:0/2699531330 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9dd4164580 0x7f9dd4164a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:48.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.210+0000 7f9dd1d9b700 1 -- 172.21.15.104:0/2699531330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9dbc0051c0 msgr2=0x7f9dd4153210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:48.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.210+0000 7f9dd1d9b700 1 --2- 172.21.15.104:0/2699531330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9dbc0051c0 0x7f9dd4153210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:48.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.210+0000 7f9dd1d9b700 1 -- 172.21.15.104:0/2699531330 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9dd4164580 msgr2=0x7f9dd4164a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:48.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.210+0000 7f9dd1d9b700 1 --2- 172.21.15.104:0/2699531330 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9dd4164580 0x7f9dd4164a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:48.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.210+0000 7f9dd1d9b700 1 -- 172.21.15.104:0/2699531330 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd4165e00 con 0x7f9dd406a8a0 2024-08-17T02:22:48.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.210+0000 7f9dd259c700 1 --2- 172.21.15.104:0/2699531330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9dbc0051c0 0x7f9dd4153210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:22:48.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.210+0000 7f9dd1d9b700 1 --2- 172.21.15.104:0/2699531330 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9dd406a8a0 0x7f9dd406ad10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9dc8011b10 tx=0x7f9dc80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:48.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.210+0000 7f9dc27fc700 1 -- 172.21.15.104:0/2699531330 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc800f990 con 0x7f9dd406a8a0 2024-08-17T02:22:48.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.210+0000 7f9dc27fc700 1 -- 172.21.15.104:0/2699531330 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc800faf0 con 0x7f9dd406a8a0 2024-08-17T02:22:48.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.210+0000 7f9dc27fc700 1 -- 172.21.15.104:0/2699531330 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc800fe70 con 0x7f9dd406a8a0 2024-08-17T02:22:48.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.210+0000 7f9dd359e700 1 -- 172.21.15.104:0/2699531330 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dd4164f60 con 0x7f9dd406a8a0 2024-08-17T02:22:48.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.214+0000 7f9dd359e700 1 -- 172.21.15.104:0/2699531330 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dd41651d0 con 0x7f9dd406a8a0 2024-08-17T02:22:48.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.214+0000 7f9dd359e700 1 -- 172.21.15.104:0/2699531330 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dd4165f90 con 0x7f9dd406a8a0 2024-08-17T02:22:48.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.214+0000 7f9dc27fc700 1 -- 172.21.15.104:0/2699531330 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9dc8014650 con 0x7f9dd406a8a0 2024-08-17T02:22:48.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.214+0000 7f9dc27fc700 1 --2- 172.21.15.104:0/2699531330 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f9db4060890 0x7f9db4062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:48.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.214+0000 7f9dc27fc700 1 -- 172.21.15.104:0/2699531330 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9dc8018030 con 0x7f9dd406a8a0 2024-08-17T02:22:48.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.214+0000 7f9dd259c700 1 --2- 172.21.15.104:0/2699531330 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f9db4060890 0x7f9db4062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:48.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.214+0000 7f9dd259c700 1 --2- 172.21.15.104:0/2699531330 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f9db4060890 0x7f9db4062d40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4003c50 tx=0x7f9dc4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:48.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.222+0000 7f9dc27fc700 1 -- 172.21.15.104:0/2699531330 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f9dc8051410 con 0x7f9dd406a8a0 2024-08-17T02:22:48.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.382+0000 7f9dd359e700 1 -- 172.21.15.104:0/2699531330 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9dd40638f0 con 0x7f9dd406a8a0 2024-08-17T02:22:48.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.382+0000 7f9dc27fc700 1 -- 172.21.15.104:0/2699531330 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9dc8050fa0 con 0x7f9dd406a8a0 2024-08-17T02:22:48.387 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 32 2024-08-17T02:22:48.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.386+0000 7f9dd359e700 1 -- 172.21.15.104:0/2699531330 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f9db4060890 msgr2=0x7f9db4062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:48.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.386+0000 7f9dd359e700 1 --2- 172.21.15.104:0/2699531330 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f9db4060890 0x7f9db4062d40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4003c50 tx=0x7f9dc4009040 comp rx=0 tx=0).stop 2024-08-17T02:22:48.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.386+0000 7f9dd359e700 1 -- 172.21.15.104:0/2699531330 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9dd406a8a0 msgr2=0x7f9dd406ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:48.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.386+0000 7f9dd359e700 1 --2- 172.21.15.104:0/2699531330 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9dd406a8a0 0x7f9dd406ad10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9dc8011b10 tx=0x7f9dc80091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:48.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.386+0000 7f9dd359e700 1 -- 172.21.15.104:0/2699531330 shutdown_connections 2024-08-17T02:22:48.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.386+0000 7f9dd359e700 1 --2- 172.21.15.104:0/2699531330 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f9db4060890 0x7f9db4062d40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:48.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.386+0000 7f9dd359e700 1 --2- 172.21.15.104:0/2699531330 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9dd4164580 0x7f9dd4164a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:48.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.386+0000 7f9dd359e700 1 --2- 172.21.15.104:0/2699531330 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9dd406a8a0 0x7f9dd406ad10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:48.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.386+0000 7f9dd359e700 1 --2- 172.21.15.104:0/2699531330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9dbc0051c0 0x7f9dd4153210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:48.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.386+0000 7f9dd359e700 1 -- 172.21.15.104:0/2699531330 >> 172.21.15.104:0/2699531330 conn(0x7f9dd406e310 msgr2=0x7f9dd414f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:48.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.386+0000 7f9dd359e700 1 -- 172.21.15.104:0/2699531330 shutdown_connections 2024-08-17T02:22:48.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.386+0000 7f9dd359e700 1 -- 172.21.15.104:0/2699531330 wait complete. 2024-08-17T02:22:48.401 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:22:48.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.506+0000 7ff81f0c3700 1 Processor -- start 2024-08-17T02:22:48.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.506+0000 7ff81f0c3700 1 -- start start 2024-08-17T02:22:48.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.506+0000 7ff81f0c3700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff818067510 0x7ff8180ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:48.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.506+0000 7ff81f0c3700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff818159480 0x7ff8180cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:48.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.506+0000 7ff81f0c3700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8180ce210 con 0x7ff8181590b0 2024-08-17T02:22:48.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.506+0000 7ff81f0c3700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8180cba00 con 0x7ff818067510 2024-08-17T02:22:48.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.506+0000 7ff81f0c3700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8180cdc90 con 0x7ff818159480 2024-08-17T02:22:48.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.506+0000 7ff81e0c1700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7ff8181590b0 0x7ff818066e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:59442/0 (socket says 172.21.15.104:59442) 2024-08-17T02:22:48.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.506+0000 7ff81e0c1700 1 -- 172.21.15.104:0/2920329168 learned_addr learned my addr 172.21.15.104:0/2920329168 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:48.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.506+0000 7ff81e8c2700 1 --2- 172.21.15.104:0/2920329168 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff818159480 0x7ff8180cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:48.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.506+0000 7ff81d8c0700 1 --2- 172.21.15.104:0/2920329168 >> v2:172.21.15.117:3300/0 conn(0x7ff818067510 0x7ff8180ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:48.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.506+0000 7ff81d0bf700 1 -- 172.21.15.104:0/2920329168 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 97139094 0 0) 0x7ff8180ce210 con 0x7ff8181590b0 2024-08-17T02:22:48.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.506+0000 7ff81d0bf700 1 -- 172.21.15.104:0/2920329168 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff804003570 con 0x7ff8181590b0 2024-08-17T02:22:48.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.510+0000 7ff81d0bf700 1 -- 172.21.15.104:0/2920329168 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1617617525 0 0) 0x7ff804003570 con 0x7ff8181590b0 2024-08-17T02:22:48.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.510+0000 7ff81e8c2700 1 -- 172.21.15.104:0/2920329168 >> v2:172.21.15.117:3300/0 conn(0x7ff818067510 msgr2=0x7ff8180ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:48.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.510+0000 7ff81e8c2700 1 --2- 172.21.15.104:0/2920329168 >> v2:172.21.15.117:3300/0 conn(0x7ff818067510 0x7ff8180ce6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:48.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.510+0000 7ff81e8c2700 1 -- 172.21.15.104:0/2920329168 >> v1:172.21.15.104:6789/0 conn(0x7ff8181590b0 legacy=0x7ff818066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:48.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.510+0000 7ff81e8c2700 1 -- 172.21.15.104:0/2920329168 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8180cb440 con 0x7ff818159480 2024-08-17T02:22:48.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.510+0000 7ff81d8c0700 1 --2- 172.21.15.104:0/2920329168 >> v2:172.21.15.117:3300/0 conn(0x7ff818067510 0x7ff8180ce6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:22:48.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.510+0000 7ff81e8c2700 1 --2- 172.21.15.104:0/2920329168 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff818159480 0x7ff8180cebe0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff810009e60 tx=0x7ff810009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f16f00bd97941aa server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:48.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.510+0000 7ff81d0bf700 1 -- 172.21.15.104:0/2920329168 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81000e070 con 0x7ff818159480 2024-08-17T02:22:48.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.510+0000 7ff81d0bf700 1 -- 172.21.15.104:0/2920329168 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff81000b7a0 con 0x7ff818159480 2024-08-17T02:22:48.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.510+0000 7ff81d0bf700 1 -- 172.21.15.104:0/2920329168 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff808001470 con 0x7ff818159480 2024-08-17T02:22:48.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.510+0000 7ff81f0c3700 1 -- 172.21.15.104:0/2920329168 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff818159480 msgr2=0x7ff8180cebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:48.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.510+0000 7ff81f0c3700 1 --2- 172.21.15.104:0/2920329168 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff818159480 0x7ff8180cebe0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff810009e60 tx=0x7ff810009780 comp rx=0 tx=0).stop 2024-08-17T02:22:48.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.510+0000 7ff81f0c3700 1 -- 172.21.15.104:0/2920329168 shutdown_connections 2024-08-17T02:22:48.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.510+0000 7ff81f0c3700 1 --2- 172.21.15.104:0/2920329168 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff818159480 0x7ff8180cebe0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:48.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.510+0000 7ff81f0c3700 1 --2- 172.21.15.104:0/2920329168 >> v2:172.21.15.117:3300/0 conn(0x7ff818067510 0x7ff8180ce6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:48.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.510+0000 7ff81f0c3700 1 -- 172.21.15.104:0/2920329168 >> 172.21.15.104:0/2920329168 conn(0x7ff8180d0b90 msgr2=0x7ff8180ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:48.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.510+0000 7ff81f0c3700 1 -- 172.21.15.104:0/2920329168 shutdown_connections 2024-08-17T02:22:48.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.510+0000 7ff81f0c3700 1 -- 172.21.15.104:0/2920329168 wait complete. 2024-08-17T02:22:48.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.510+0000 7ff81f0c3700 1 Processor -- start 2024-08-17T02:22:48.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.514+0000 7ff81f0c3700 1 -- start start 2024-08-17T02:22:48.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.514+0000 7ff81f0c3700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff818067510 0x7ff8180c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:48.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.514+0000 7ff81f0c3700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8181590b0 0x7ff8180b07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:48.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.514+0000 7ff81f0c3700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff818159480 0x7ff818152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:48.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.514+0000 7ff81f0c3700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8180c8a40 con 0x7ff8181590b0 2024-08-17T02:22:48.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.514+0000 7ff81f0c3700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8180c8d20 con 0x7ff818159480 2024-08-17T02:22:48.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.514+0000 7ff81f0c3700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8180c9000 con 0x7ff818067510 2024-08-17T02:22:48.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.514+0000 7ff81d8c0700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8181590b0 0x7ff8180b07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:48.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.514+0000 7ff81d8c0700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8181590b0 0x7ff8180b07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45110/0 (socket says 172.21.15.104:45110) 2024-08-17T02:22:48.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.514+0000 7ff81d8c0700 1 -- 172.21.15.104:0/743330205 learned_addr learned my addr 172.21.15.104:0/743330205 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:48.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.514+0000 7ff81e8c2700 1 --2- 172.21.15.104:0/743330205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff818159480 0x7ff818152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:48.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.514+0000 7ff81e0c1700 1 --2- 172.21.15.104:0/743330205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff818067510 0x7ff8180c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:48.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.514+0000 7ff81d8c0700 1 -- 172.21.15.104:0/743330205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff818067510 msgr2=0x7ff8180c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:48.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.514+0000 7ff81d8c0700 1 --2- 172.21.15.104:0/743330205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff818067510 0x7ff8180c8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:48.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.514+0000 7ff81d8c0700 1 -- 172.21.15.104:0/743330205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff818159480 msgr2=0x7ff818152230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:48.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.514+0000 7ff81d8c0700 1 --2- 172.21.15.104:0/743330205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff818159480 0x7ff818152230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:48.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.514+0000 7ff81d8c0700 1 -- 172.21.15.104:0/743330205 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff814009420 con 0x7ff8181590b0 2024-08-17T02:22:48.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.514+0000 7ff81d8c0700 1 --2- 172.21.15.104:0/743330205 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8181590b0 0x7ff8180b07c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff81400ec80 tx=0x7ff8140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:48.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.514+0000 7ff80e7fc700 1 -- 172.21.15.104:0/743330205 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81400c920 con 0x7ff8181590b0 2024-08-17T02:22:48.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.514+0000 7ff80e7fc700 1 -- 172.21.15.104:0/743330205 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff81400ca80 con 0x7ff8181590b0 2024-08-17T02:22:48.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.514+0000 7ff80e7fc700 1 -- 172.21.15.104:0/743330205 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81400ce00 con 0x7ff8181590b0 2024-08-17T02:22:48.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.514+0000 7ff81f0c3700 1 -- 172.21.15.104:0/743330205 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff810009a20 con 0x7ff8181590b0 2024-08-17T02:22:48.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.514+0000 7ff81f0c3700 1 -- 172.21.15.104:0/743330205 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff818151d10 con 0x7ff8181590b0 2024-08-17T02:22:48.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.518+0000 7ff81f0c3700 1 -- 172.21.15.104:0/743330205 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff818064330 con 0x7ff8181590b0 2024-08-17T02:22:48.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.518+0000 7ff80e7fc700 1 -- 172.21.15.104:0/743330205 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff814013680 con 0x7ff8181590b0 2024-08-17T02:22:48.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.518+0000 7ff80e7fc700 1 --2- 172.21.15.104:0/743330205 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff7fc060860 0x7ff7fc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:48.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.518+0000 7ff80e7fc700 1 -- 172.21.15.104:0/743330205 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff81407cfd0 con 0x7ff8181590b0 2024-08-17T02:22:48.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.518+0000 7ff81e0c1700 1 --2- 172.21.15.104:0/743330205 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff7fc060860 0x7ff7fc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:48.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.522+0000 7ff81e0c1700 1 --2- 172.21.15.104:0/743330205 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff7fc060860 0x7ff7fc062d10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff808004e60 tx=0x7ff808001a10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:48.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.526+0000 7ff80e7fc700 1 -- 172.21.15.104:0/743330205 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff81404d420 con 0x7ff8181590b0 2024-08-17T02:22:48.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.682+0000 7ff81f0c3700 1 -- 172.21.15.104:0/743330205 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff818070cf0 con 0x7ff8181590b0 2024-08-17T02:22:48.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.686+0000 7ff80e7fc700 1 -- 172.21.15.104:0/743330205 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff814050a40 con 0x7ff8181590b0 2024-08-17T02:22:48.687 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 64 2024-08-17T02:22:48.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.686+0000 7ff81f0c3700 1 -- 172.21.15.104:0/743330205 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff7fc060860 msgr2=0x7ff7fc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:48.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.686+0000 7ff81f0c3700 1 --2- 172.21.15.104:0/743330205 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff7fc060860 0x7ff7fc062d10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff808004e60 tx=0x7ff808001a10 comp rx=0 tx=0).stop 2024-08-17T02:22:48.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.686+0000 7ff81f0c3700 1 -- 172.21.15.104:0/743330205 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8181590b0 msgr2=0x7ff8180b07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:48.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.686+0000 7ff81f0c3700 1 --2- 172.21.15.104:0/743330205 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8181590b0 0x7ff8180b07c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff81400ec80 tx=0x7ff8140091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:48.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.686+0000 7ff81f0c3700 1 -- 172.21.15.104:0/743330205 shutdown_connections 2024-08-17T02:22:48.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.686+0000 7ff81f0c3700 1 --2- 172.21.15.104:0/743330205 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff7fc060860 0x7ff7fc062d10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:48.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.686+0000 7ff81f0c3700 1 --2- 172.21.15.104:0/743330205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff818159480 0x7ff818152230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:48.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.686+0000 7ff81f0c3700 1 --2- 172.21.15.104:0/743330205 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8181590b0 0x7ff8180b07c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:48.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.686+0000 7ff81f0c3700 1 --2- 172.21.15.104:0/743330205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff818067510 0x7ff8180c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:48.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.686+0000 7ff81f0c3700 1 -- 172.21.15.104:0/743330205 >> 172.21.15.104:0/743330205 conn(0x7ff8180d0b90 msgr2=0x7ff8180b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:48.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.686+0000 7ff81f0c3700 1 -- 172.21.15.104:0/743330205 shutdown_connections 2024-08-17T02:22:48.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.686+0000 7ff81f0c3700 1 -- 172.21.15.104:0/743330205 wait complete. 2024-08-17T02:22:48.771 INFO:tasks.cephfs_test_runner:Starting test: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) That the volume can be created and then cleans up 2024-08-17T02:22:48.771 INFO:tasks.cephfs_test_runner:test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:22:48.771 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:22:48.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.878+0000 7fb96617b700 1 Processor -- start 2024-08-17T02:22:48.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.878+0000 7fb96617b700 1 -- start start 2024-08-17T02:22:48.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.878+0000 7fb96617b700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb960158f10 0x7fb960069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:48.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.878+0000 7fb96617b700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9600ce0c0 con 0x7fb960069d40 2024-08-17T02:22:48.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.878+0000 7fb96617b700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb96015a360 con 0x7fb9601599f0 2024-08-17T02:22:48.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.878+0000 7fb96617b700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb96015a920 con 0x7fb960158f10 2024-08-17T02:22:48.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.878+0000 7fb965179700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb960158f10 0x7fb960069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:48.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.878+0000 7fb964978700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fb960069d40 0x7fb9601592e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:59456/0 (socket says 172.21.15.104:59456) 2024-08-17T02:22:48.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.878+0000 7fb964978700 1 -- 172.21.15.104:0/170713580 learned_addr learned my addr 172.21.15.104:0/170713580 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:48.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.878+0000 7fb965179700 1 -- 172.21.15.104:0/170713580 >> v1:172.21.15.117:6789/0 conn(0x7fb9601599f0 legacy=0x7fb9600ce550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:48.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.878+0000 7fb965179700 1 -- 172.21.15.104:0/170713580 >> v1:172.21.15.104:6789/0 conn(0x7fb960069d40 legacy=0x7fb9601592e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:48.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.878+0000 7fb965179700 1 -- 172.21.15.104:0/170713580 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb96015a640 con 0x7fb960158f10 2024-08-17T02:22:48.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.878+0000 7fb965179700 1 --2- 172.21.15.104:0/170713580 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb960158f10 0x7fb960069800 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb95c009e60 tx=0x7fb95c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2d4fdcb8f73338a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:48.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.878+0000 7fb957fff700 1 -- 172.21.15.104:0/170713580 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c00e070 con 0x7fb960158f10 2024-08-17T02:22:48.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.878+0000 7fb957fff700 1 -- 172.21.15.104:0/170713580 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95c00bc30 con 0x7fb960158f10 2024-08-17T02:22:48.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.878+0000 7fb957fff700 1 -- 172.21.15.104:0/170713580 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c012430 con 0x7fb960158f10 2024-08-17T02:22:48.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.878+0000 7fb96617b700 1 -- 172.21.15.104:0/170713580 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb960158f10 msgr2=0x7fb960069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:48.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.878+0000 7fb96617b700 1 --2- 172.21.15.104:0/170713580 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb960158f10 0x7fb960069800 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb95c009e60 tx=0x7fb95c009780 comp rx=0 tx=0).stop 2024-08-17T02:22:48.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.878+0000 7fb96617b700 1 -- 172.21.15.104:0/170713580 shutdown_connections 2024-08-17T02:22:48.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.878+0000 7fb96617b700 1 --2- 172.21.15.104:0/170713580 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb960158f10 0x7fb960069800 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:48.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.878+0000 7fb96617b700 1 -- 172.21.15.104:0/170713580 >> 172.21.15.104:0/170713580 conn(0x7fb9600678d0 msgr2=0x7fb9600ccac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:48.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.878+0000 7fb96617b700 1 -- 172.21.15.104:0/170713580 shutdown_connections 2024-08-17T02:22:48.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.878+0000 7fb96617b700 1 -- 172.21.15.104:0/170713580 wait complete. 2024-08-17T02:22:48.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.882+0000 7fb96617b700 1 Processor -- start 2024-08-17T02:22:48.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.882+0000 7fb96617b700 1 -- start start 2024-08-17T02:22:48.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.882+0000 7fb96617b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb960069d40 0x7fb9601503c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:48.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.882+0000 7fb96617b700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb960158f10 0x7fb96014c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:48.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.882+0000 7fb96617b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb9601599f0 0x7fb9600b0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:48.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.882+0000 7fb96617b700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9600b3d50 con 0x7fb9601599f0 2024-08-17T02:22:48.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.882+0000 7fb96617b700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb960150900 con 0x7fb960069d40 2024-08-17T02:22:48.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.882+0000 7fb96617b700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9600b3140 con 0x7fb960158f10 2024-08-17T02:22:48.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.882+0000 7fb96597a700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb9601599f0 0x7fb9600b0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:48.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.882+0000 7fb96597a700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb9601599f0 0x7fb9600b0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45122/0 (socket says 172.21.15.104:45122) 2024-08-17T02:22:48.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.882+0000 7fb96597a700 1 -- 172.21.15.104:0/2234441866 learned_addr learned my addr 172.21.15.104:0/2234441866 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:48.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.882+0000 7fb965179700 1 --2- 172.21.15.104:0/2234441866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb960069d40 0x7fb9601503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:48.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.882+0000 7fb964978700 1 --2- 172.21.15.104:0/2234441866 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb960158f10 0x7fb96014c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:48.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.882+0000 7fb96597a700 1 -- 172.21.15.104:0/2234441866 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb960158f10 msgr2=0x7fb96014c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:48.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.882+0000 7fb96597a700 1 --2- 172.21.15.104:0/2234441866 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb960158f10 0x7fb96014c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:48.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.882+0000 7fb96597a700 1 -- 172.21.15.104:0/2234441866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb960069d40 msgr2=0x7fb9601503c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:48.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.882+0000 7fb96597a700 1 --2- 172.21.15.104:0/2234441866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb960069d40 0x7fb9601503c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:48.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.882+0000 7fb96597a700 1 -- 172.21.15.104:0/2234441866 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb95c009a20 con 0x7fb9601599f0 2024-08-17T02:22:48.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.882+0000 7fb96597a700 1 --2- 172.21.15.104:0/2234441866 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb9601599f0 0x7fb9600b0e00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb95800c4c0 tx=0x7fb958007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:48.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.882+0000 7fb9557fa700 1 -- 172.21.15.104:0/2234441866 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb958011590 con 0x7fb9601599f0 2024-08-17T02:22:48.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.882+0000 7fb9557fa700 1 -- 172.21.15.104:0/2234441866 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9580116f0 con 0x7fb9601599f0 2024-08-17T02:22:48.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.882+0000 7fb96617b700 1 -- 172.21.15.104:0/2234441866 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9600b3420 con 0x7fb9601599f0 2024-08-17T02:22:48.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.882+0000 7fb9557fa700 1 -- 172.21.15.104:0/2234441866 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb958011ab0 con 0x7fb9601599f0 2024-08-17T02:22:48.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.882+0000 7fb96617b700 1 -- 172.21.15.104:0/2234441866 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9600b39e0 con 0x7fb9601599f0 2024-08-17T02:22:48.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.886+0000 7fb96617b700 1 -- 172.21.15.104:0/2234441866 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9600b3f90 con 0x7fb9601599f0 2024-08-17T02:22:48.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.886+0000 7fb9557fa700 1 -- 172.21.15.104:0/2234441866 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb95801b3b0 con 0x7fb9601599f0 2024-08-17T02:22:48.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.886+0000 7fb9557fa700 1 --2- 172.21.15.104:0/2234441866 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb94c060860 0x7fb94c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:48.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.886+0000 7fb9557fa700 1 -- 172.21.15.104:0/2234441866 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb95807bfe0 con 0x7fb9601599f0 2024-08-17T02:22:48.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.886+0000 7fb965179700 1 --2- 172.21.15.104:0/2234441866 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb94c060860 0x7fb94c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:48.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.886+0000 7fb965179700 1 --2- 172.21.15.104:0/2234441866 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb94c060860 0x7fb94c062d10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb95c009e60 tx=0x7fb95c019000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:48.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:48.894+0000 7fb9557fa700 1 -- 172.21.15.104:0/2234441866 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb9600b3f90 con 0x7fb9601599f0 2024-08-17T02:22:49.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.058+0000 7fb96617b700 1 -- 172.21.15.104:0/2234441866 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9600b3f90 con 0x7fb9601599f0 2024-08-17T02:22:49.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.058+0000 7fb9557fa700 1 -- 172.21.15.104:0/2234441866 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fb9600b3f90 con 0x7fb9601599f0 2024-08-17T02:22:49.063 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:22:49.063 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":23,"fsid":"fd5f7fb8-d34b-49bb-89a8-62b7dad1bc25","created":"2024-08-17T02:21:57.891389+0000","modified":"2024-08-17T02:22:23.175831+0000","last_up_change":"2024-08-17T02:22:08.924546+0000","last_in_change":"2024-08-17T02:21:59.938028+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:22:10.143970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:22:20.082708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:22:20.521582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"606b9088-590e-4709-aa3a-b0f6e22972ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":24257},{"type":"v1","addr":"172.21.15.104:6809","nonce":24257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":24257},{"type":"v1","addr":"172.21.15.104:6811","nonce":24257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":24257},{"type":"v1","addr":"172.21.15.104:6815","nonce":24257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":24257},{"type":"v1","addr":"172.21.15.104:6813","nonce":24257}]},"public_addr":"172.21.15.104:6809/24257","cluster_addr":"172.21.15.104:6811/24257","heartbeat_back_addr":"172.21.15.104:6815/24257","heartbeat_front_addr":"172.21.15.104:6813/24257","state":["exists","up"]},{"osd":1,"uuid":"9bc6a909-0c2f-4889-afe7-4a47f89b0f64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":24256},{"type":"v1","addr":"172.21.15.104:6825","nonce":24256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":24256},{"type":"v1","addr":"172.21.15.104:6827","nonce":24256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":24256},{"type":"v1","addr":"172.21.15.104:6831","nonce":24256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":24256},{"type":"v1","addr":"172.21.15.104:6829","nonce":24256}]},"public_addr":"172.21.15.104:6825/24256","cluster_addr":"172.21.15.104:6827/24256","heartbeat_back_addr":"172.21.15.104:6831/24256","heartbeat_front_addr":"172.21.15.104:6829/24256","state":["exists","up"]},{"osd":2,"uuid":"23da31d5-aefb-4edb-b79d-fa05e1becef7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":24255},{"type":"v1","addr":"172.21.15.104:6817","nonce":24255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":24255},{"type":"v1","addr":"172.21.15.104:6819","nonce":24255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":24255},{"type":"v1","addr":"172.21.15.104:6823","nonce":24255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":24255},{"type":"v1","addr":"172.21.15.104:6821","nonce":24255}]},"public_addr":"172.21.15.104:6817/24255","cluster_addr":"172.21.15.104:6819/24255","heartbeat_back_addr":"172.21.15.104:6823/24255","heartbeat_front_addr":"172.21.15.104:6821/24255","state":["exists","up"]},{"osd":3,"uuid":"6e4a5ec2-b415-45ef-8381-61a59eb65224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":24254},{"type":"v1","addr":"172.21.15.104:6801","nonce":24254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":24254},{"type":"v1","addr":"172.21.15.104:6803","nonce":24254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":24254},{"type":"v1","addr":"172.21.15.104:6807","nonce":24254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":24254},{"type":"v1","addr":"172.21.15.104:6805","nonce":24254}]},"public_addr":"172.21.15.104:6801/24254","cluster_addr":"172.21.15.104:6803/24254","heartbeat_back_addr":"172.21.15.104:6807/24254","heartbeat_front_addr":"172.21.15.104:6805/24254","state":["exists","up"]},{"osd":4,"uuid":"8d5bea2d-9039-4013-8c99-2c046c5b8a17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":24421},{"type":"v1","addr":"172.21.15.117:6804","nonce":24421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":24421},{"type":"v1","addr":"172.21.15.117:6809","nonce":24421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":24421},{"type":"v1","addr":"172.21.15.117:6815","nonce":24421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":24421},{"type":"v1","addr":"172.21.15.117:6813","nonce":24421}]},"public_addr":"172.21.15.117:6804/24421","cluster_addr":"172.21.15.117:6809/24421","heartbeat_back_addr":"172.21.15.117:6815/24421","heartbeat_front_addr":"172.21.15.117:6813/24421","state":["exists","up"]},{"osd":5,"uuid":"de8b36fc-121c-4f05-8f5b-28f513d9f21f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":24422},{"type":"v1","addr":"172.21.15.117:6817","nonce":24422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":24422},{"type":"v1","addr":"172.21.15.117:6819","nonce":24422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":24422},{"type":"v1","addr":"172.21.15.117:6823","nonce":24422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":24422},{"type":"v1","addr":"172.21.15.117:6821","nonce":24422}]},"public_addr":"172.21.15.117:6817/24422","cluster_addr":"172.21.15.117:6819/24422","heartbeat_back_addr":"172.21.15.117:6823/24422","heartbeat_front_addr":"172.21.15.117:6821/24422","state":["exists","up"]},{"osd":6,"uuid":"6a87f09f-7bf7-4f7a-be87-530ac1ff8ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":24420},{"type":"v1","addr":"172.21.15.117:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6803","nonce":24420},{"type":"v1","addr":"172.21.15.117:6805","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":24420},{"type":"v1","addr":"172.21.15.117:6811","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":24420},{"type":"v1","addr":"172.21.15.117:6808","nonce":24420}]},"public_addr":"172.21.15.117:6801/24420","cluster_addr":"172.21.15.117:6805/24420","heartbeat_back_addr":"172.21.15.117:6811/24420","heartbeat_front_addr":"172.21.15.117:6808/24420","state":["exists","up"]},{"osd":7,"uuid":"e31d8041-1aa1-4b5d-83b3-0a373426dd9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":24423},{"type":"v1","addr":"172.21.15.117:6825","nonce":24423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":24423},{"type":"v1","addr":"172.21.15.117:6827","nonce":24423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":24423},{"type":"v1","addr":"172.21.15.117:6831","nonce":24423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":24423},{"type":"v1","addr":"172.21.15.117:6829","nonce":24423}]},"public_addr":"172.21.15.117:6825/24423","cluster_addr":"172.21.15.117:6827/24423","heartbeat_back_addr":"172.21.15.117:6831/24423","heartbeat_front_addr":"172.21.15.117:6829/24423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.220874+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.210039+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.434762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.247206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.184316+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.306325+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.035719+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.400303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:22:49.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.062+0000 7fb96617b700 1 -- 172.21.15.104:0/2234441866 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb94c060860 msgr2=0x7fb94c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:49.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.062+0000 7fb96617b700 1 --2- 172.21.15.104:0/2234441866 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb94c060860 0x7fb94c062d10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb95c009e60 tx=0x7fb95c019000 comp rx=0 tx=0).stop 2024-08-17T02:22:49.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.062+0000 7fb96617b700 1 -- 172.21.15.104:0/2234441866 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb9601599f0 msgr2=0x7fb9600b0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:49.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.062+0000 7fb96617b700 1 --2- 172.21.15.104:0/2234441866 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb9601599f0 0x7fb9600b0e00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb95800c4c0 tx=0x7fb958007f00 comp rx=0 tx=0).stop 2024-08-17T02:22:49.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.062+0000 7fb96617b700 1 -- 172.21.15.104:0/2234441866 shutdown_connections 2024-08-17T02:22:49.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.062+0000 7fb96617b700 1 --2- 172.21.15.104:0/2234441866 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb94c060860 0x7fb94c062d10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:49.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.062+0000 7fb96617b700 1 --2- 172.21.15.104:0/2234441866 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb9601599f0 0x7fb9600b0e00 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:49.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.062+0000 7fb96617b700 1 --2- 172.21.15.104:0/2234441866 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb960158f10 0x7fb96014c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:49.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.062+0000 7fb96617b700 1 --2- 172.21.15.104:0/2234441866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb960069d40 0x7fb9601503c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:49.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.062+0000 7fb96617b700 1 -- 172.21.15.104:0/2234441866 >> 172.21.15.104:0/2234441866 conn(0x7fb9600678d0 msgr2=0x7fb9600ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:49.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.062+0000 7fb96617b700 1 -- 172.21.15.104:0/2234441866 shutdown_connections 2024-08-17T02:22:49.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.062+0000 7fb96617b700 1 -- 172.21.15.104:0/2234441866 wait complete. 2024-08-17T02:22:49.081 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:22:10.143970+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:22:20.082708+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:22:20.521582+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:22:49.081 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:22:49.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.194+0000 7f72d0d51700 1 Processor -- start 2024-08-17T02:22:49.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.194+0000 7f72d0d51700 1 -- start start 2024-08-17T02:22:49.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.194+0000 7f72d0d51700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f72cc15fd10 0x7f72cc0b0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:49.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.194+0000 7f72d0d51700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72cc15df40 con 0x7f72cc067a30 2024-08-17T02:22:49.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.194+0000 7f72d0d51700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72cc15e220 con 0x7f72cc067660 2024-08-17T02:22:49.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.194+0000 7f72d0d51700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72cc15e500 con 0x7f72cc15fd10 2024-08-17T02:22:49.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.194+0000 7f72c9d9b700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f72cc067a30 0x7f72cc15d0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:59460/0 (socket says 172.21.15.104:59460) 2024-08-17T02:22:49.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.194+0000 7f72c9d9b700 1 -- 172.21.15.104:0/402055455 learned_addr learned my addr 172.21.15.104:0/402055455 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:49.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.194+0000 7f72cad9d700 1 --2- 172.21.15.104:0/402055455 >> v2:172.21.15.117:3300/0 conn(0x7f72cc15fd10 0x7f72cc0b0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:49.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.194+0000 7f72c959a700 1 -- 172.21.15.104:0/402055455 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 856068872 0 0) 0x7f72cc15df40 con 0x7f72cc067a30 2024-08-17T02:22:49.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.194+0000 7f72c959a700 1 -- 172.21.15.104:0/402055455 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72b8003570 con 0x7f72cc067a30 2024-08-17T02:22:49.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.194+0000 7f72c959a700 1 -- 172.21.15.104:0/402055455 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3390919606 0 0) 0x7f72cc15e220 con 0x7f72cc067660 2024-08-17T02:22:49.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.194+0000 7f72c959a700 1 -- 172.21.15.104:0/402055455 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72cc15df40 con 0x7f72cc067660 2024-08-17T02:22:49.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.194+0000 7f72c959a700 1 -- 172.21.15.104:0/402055455 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1500065017 0 0) 0x7f72b8003570 con 0x7f72cc067a30 2024-08-17T02:22:49.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.194+0000 7f72c959a700 1 -- 172.21.15.104:0/402055455 >> v2:172.21.15.117:3300/0 conn(0x7f72cc15fd10 msgr2=0x7f72cc0b0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:49.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.194+0000 7f72c959a700 1 --2- 172.21.15.104:0/402055455 >> v2:172.21.15.117:3300/0 conn(0x7f72cc15fd10 0x7f72cc0b0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:49.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.194+0000 7f72c959a700 1 -- 172.21.15.104:0/402055455 >> v1:172.21.15.117:6789/0 conn(0x7f72cc067660 legacy=0x7f72cc0b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:49.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.194+0000 7f72c959a700 1 -- 172.21.15.104:0/402055455 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72cc15e7e0 con 0x7f72cc067a30 2024-08-17T02:22:49.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.194+0000 7f72c959a700 1 -- 172.21.15.104:0/402055455 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1279957748 0 0) 0x7f72b4001470 con 0x7f72cc067a30 2024-08-17T02:22:49.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.194+0000 7f72c959a700 1 -- 172.21.15.104:0/402055455 >> v1:172.21.15.104:6789/0 conn(0x7f72cc067a30 legacy=0x7f72cc15d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:49.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.194+0000 7f72c959a700 1 --2- 172.21.15.104:0/402055455 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72b8003c40 0x7f72b8004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:49.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.194+0000 7f72c959a700 1 --2- 172.21.15.104:0/402055455 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72b8004810 0x7f72b8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:49.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.194+0000 7f72c959a700 1 --2- 172.21.15.104:0/402055455 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72b8005210 0x7f72b800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:49.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.194+0000 7f72c959a700 1 -- 172.21.15.104:0/402055455 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc15e500 con 0x7f72b8003c40 2024-08-17T02:22:49.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.194+0000 7f72c959a700 1 -- 172.21.15.104:0/402055455 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b800c130 con 0x7f72b8004810 2024-08-17T02:22:49.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.194+0000 7f72c959a700 1 -- 172.21.15.104:0/402055455 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b800c2c0 con 0x7f72b8005210 2024-08-17T02:22:49.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.194+0000 7f72ca59c700 1 --2- 172.21.15.104:0/402055455 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72b8003c40 0x7f72b8004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:49.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.194+0000 7f72c9d9b700 1 --2- 172.21.15.104:0/402055455 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72b8004810 0x7f72b8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:49.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.194+0000 7f72ca59c700 1 -- 172.21.15.104:0/402055455 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72b8005210 msgr2=0x7f72b800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:49.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.194+0000 7f72ca59c700 1 --2- 172.21.15.104:0/402055455 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72b8005210 0x7f72b800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:49.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.194+0000 7f72ca59c700 1 -- 172.21.15.104:0/402055455 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72b8004810 msgr2=0x7f72b8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:49.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.194+0000 7f72ca59c700 1 --2- 172.21.15.104:0/402055455 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72b8004810 0x7f72b8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:49.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.194+0000 7f72ca59c700 1 -- 172.21.15.104:0/402055455 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b8003570 con 0x7f72b8003c40 2024-08-17T02:22:49.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.194+0000 7f72c9d9b700 1 --2- 172.21.15.104:0/402055455 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72b8004810 0x7f72b8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:22:49.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.194+0000 7f72cad9d700 1 -- 172.21.15.104:0/402055455 reap_dead start 2024-08-17T02:22:49.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.194+0000 7f72ca59c700 1 --2- 172.21.15.104:0/402055455 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72b8003c40 0x7f72b8004030 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f72bc001a40 tx=0x7f72bc007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=896215aee7752a0d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:49.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.198+0000 7f72c959a700 1 -- 172.21.15.104:0/402055455 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc00c590 con 0x7f72b8003c40 2024-08-17T02:22:49.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.198+0000 7f72c959a700 1 -- 172.21.15.104:0/402055455 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72bc00c6f0 con 0x7f72b8003c40 2024-08-17T02:22:49.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.198+0000 7f72c959a700 1 -- 172.21.15.104:0/402055455 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc00cab0 con 0x7f72b8003c40 2024-08-17T02:22:49.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.198+0000 7f72d0d51700 1 -- 172.21.15.104:0/402055455 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72b8003c40 msgr2=0x7f72b8004030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:49.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.198+0000 7f72d0d51700 1 --2- 172.21.15.104:0/402055455 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72b8003c40 0x7f72b8004030 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f72bc001a40 tx=0x7f72bc007d30 comp rx=0 tx=0).stop 2024-08-17T02:22:49.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.198+0000 7f72d0d51700 1 -- 172.21.15.104:0/402055455 shutdown_connections 2024-08-17T02:22:49.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.198+0000 7f72d0d51700 1 --2- 172.21.15.104:0/402055455 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72b8003c40 0x7f72b8004030 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:49.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.198+0000 7f72d0d51700 1 -- 172.21.15.104:0/402055455 >> 172.21.15.104:0/402055455 conn(0x7f72cc0687a0 msgr2=0x7f72cc06c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:49.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.198+0000 7f72d0d51700 1 -- 172.21.15.104:0/402055455 shutdown_connections 2024-08-17T02:22:49.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.198+0000 7f72d0d51700 1 -- 172.21.15.104:0/402055455 wait complete. 2024-08-17T02:22:49.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.198+0000 7f72d0d51700 1 Processor -- start 2024-08-17T02:22:49.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.198+0000 7f72d0d51700 1 -- start start 2024-08-17T02:22:49.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.202+0000 7f72d0d51700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72b8003c40 0x7f72cc151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:49.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.202+0000 7f72d0d51700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72cc161190 0x7f72cc15c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:49.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.202+0000 7f72d0d51700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72cc15c8b0 0x7f72cc14b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:49.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.202+0000 7f72d0d51700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc16dd40 con 0x7f72cc161190 2024-08-17T02:22:49.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.202+0000 7f72d0d51700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc16ecf0 con 0x7f72b8003c40 2024-08-17T02:22:49.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.202+0000 7f72d0d51700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc16df30 con 0x7f72cc15c8b0 2024-08-17T02:22:49.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.202+0000 7f72c9d9b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72cc161190 0x7f72cc15c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:49.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.202+0000 7f72c9d9b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72cc161190 0x7f72cc15c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45134/0 (socket says 172.21.15.104:45134) 2024-08-17T02:22:49.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.202+0000 7f72c9d9b700 1 -- 172.21.15.104:0/1103968703 learned_addr learned my addr 172.21.15.104:0/1103968703 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:49.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.202+0000 7f72ca59c700 1 --2- 172.21.15.104:0/1103968703 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72b8003c40 0x7f72cc151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:49.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.202+0000 7f72cad9d700 1 --2- 172.21.15.104:0/1103968703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72cc15c8b0 0x7f72cc14b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:49.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.202+0000 7f72c9d9b700 1 -- 172.21.15.104:0/1103968703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72cc15c8b0 msgr2=0x7f72cc14b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:49.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.202+0000 7f72c9d9b700 1 --2- 172.21.15.104:0/1103968703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72cc15c8b0 0x7f72cc14b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:49.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.202+0000 7f72c9d9b700 1 -- 172.21.15.104:0/1103968703 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72b8003c40 msgr2=0x7f72cc151180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:49.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.202+0000 7f72c9d9b700 1 --2- 172.21.15.104:0/1103968703 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72b8003c40 0x7f72cc151180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:49.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.202+0000 7f72c9d9b700 1 -- 172.21.15.104:0/1103968703 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72cc16e210 con 0x7f72cc161190 2024-08-17T02:22:49.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.202+0000 7f72c9d9b700 1 --2- 172.21.15.104:0/1103968703 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72cc161190 0x7f72cc15c370 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f72b400dbb0 tx=0x7f72b4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:49.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.202+0000 7f72c27fc700 1 -- 172.21.15.104:0/1103968703 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b4001d10 con 0x7f72cc161190 2024-08-17T02:22:49.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.202+0000 7f72c27fc700 1 -- 172.21.15.104:0/1103968703 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b4007360 con 0x7f72cc161190 2024-08-17T02:22:49.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.202+0000 7f72d0d51700 1 -- 172.21.15.104:0/1103968703 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72cc16e4f0 con 0x7f72cc161190 2024-08-17T02:22:49.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.202+0000 7f72c27fc700 1 -- 172.21.15.104:0/1103968703 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b4007700 con 0x7f72cc161190 2024-08-17T02:22:49.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.202+0000 7f72d0d51700 1 -- 172.21.15.104:0/1103968703 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72cc161600 con 0x7f72cc161190 2024-08-17T02:22:49.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.206+0000 7f72d0d51700 1 -- 172.21.15.104:0/1103968703 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72cc16e970 con 0x7f72cc161190 2024-08-17T02:22:49.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.206+0000 7f72c27fc700 1 -- 172.21.15.104:0/1103968703 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f72b4004a40 con 0x7f72cc161190 2024-08-17T02:22:49.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.206+0000 7f72c27fc700 1 --2- 172.21.15.104:0/1103968703 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f72ac060860 0x7f72ac062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:49.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.206+0000 7f72c27fc700 1 -- 172.21.15.104:0/1103968703 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f72b407c550 con 0x7f72cc161190 2024-08-17T02:22:49.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.206+0000 7f72ca59c700 1 --2- 172.21.15.104:0/1103968703 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f72ac060860 0x7f72ac062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:49.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.206+0000 7f72ca59c700 1 --2- 172.21.15.104:0/1103968703 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f72ac060860 0x7f72ac062d10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f72cc15ea40 tx=0x7f72bc015000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:49.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.214+0000 7f72c27fc700 1 -- 172.21.15.104:0/1103968703 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f72b404caf0 con 0x7f72cc161190 2024-08-17T02:22:49.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.374+0000 7f72d0d51700 1 -- 172.21.15.104:0/1103968703 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f72cc0645c0 con 0x7f72cc161190 2024-08-17T02:22:49.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.374+0000 7f72c27fc700 1 -- 172.21.15.104:0/1103968703 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f72b4050110 con 0x7f72cc161190 2024-08-17T02:22:49.376 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-08-17T02:22:49.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.374+0000 7f72d0d51700 1 -- 172.21.15.104:0/1103968703 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f72ac060860 msgr2=0x7f72ac062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:49.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.374+0000 7f72d0d51700 1 --2- 172.21.15.104:0/1103968703 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f72ac060860 0x7f72ac062d10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f72cc15ea40 tx=0x7f72bc015000 comp rx=0 tx=0).stop 2024-08-17T02:22:49.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.374+0000 7f72d0d51700 1 -- 172.21.15.104:0/1103968703 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72cc161190 msgr2=0x7f72cc15c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:49.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.374+0000 7f72d0d51700 1 --2- 172.21.15.104:0/1103968703 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72cc161190 0x7f72cc15c370 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f72b400dbb0 tx=0x7f72b4009040 comp rx=0 tx=0).stop 2024-08-17T02:22:49.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.378+0000 7f72d0d51700 1 -- 172.21.15.104:0/1103968703 shutdown_connections 2024-08-17T02:22:49.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.378+0000 7f72d0d51700 1 --2- 172.21.15.104:0/1103968703 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f72ac060860 0x7f72ac062d10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:49.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.378+0000 7f72d0d51700 1 --2- 172.21.15.104:0/1103968703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72cc15c8b0 0x7f72cc14b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:49.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.378+0000 7f72d0d51700 1 --2- 172.21.15.104:0/1103968703 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72cc161190 0x7f72cc15c370 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:49.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.378+0000 7f72d0d51700 1 --2- 172.21.15.104:0/1103968703 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72b8003c40 0x7f72cc151180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:49.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.378+0000 7f72d0d51700 1 -- 172.21.15.104:0/1103968703 >> 172.21.15.104:0/1103968703 conn(0x7f72cc0687a0 msgr2=0x7f72cc06c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:49.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.378+0000 7f72d0d51700 1 -- 172.21.15.104:0/1103968703 shutdown_connections 2024-08-17T02:22:49.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.378+0000 7f72d0d51700 1 -- 172.21.15.104:0/1103968703 wait complete. 2024-08-17T02:22:49.391 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:22:49.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.498+0000 7f7ee3fff700 1 Processor -- start 2024-08-17T02:22:49.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.498+0000 7f7ee3fff700 1 -- start start 2024-08-17T02:22:49.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.498+0000 7f7ee3fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ee4068db0 0x7f7ee41570c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:49.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.498+0000 7f7ee3fff700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7ee40ae2d0 0x7f7ee40ae740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:49.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.498+0000 7f7ee3fff700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ee40b23d0 con 0x7f7ee4156cf0 2024-08-17T02:22:49.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.498+0000 7f7ee3fff700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ee40cc020 con 0x7f7ee40ae2d0 2024-08-17T02:22:49.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.498+0000 7f7ee3fff700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee40b1850 con 0x7f7ee4068db0 2024-08-17T02:22:49.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.498+0000 7f7ee27fc700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ee4068db0 0x7f7ee41570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:49.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.498+0000 7f7ee27fc700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ee4068db0 0x7f7ee41570c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.104:55028/0 (socket says 172.21.15.104:55028) 2024-08-17T02:22:49.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.502+0000 7f7ee27fc700 1 -- 172.21.15.104:0/2287547413 learned_addr learned my addr 172.21.15.104:0/2287547413 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:49.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.498+0000 7f7ee37fe700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7ee40ae2d0 0x7f7ee40ae740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:49.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.498+0000 7f7ee2ffd700 1 --1- 172.21.15.104:0/2287547413 >> v1:172.21.15.117:6789/0 conn(0x7f7ee4156cf0 0x7f7ee40686a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.104:36810/0 (socket says 172.21.15.104:36810) 2024-08-17T02:22:49.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.502+0000 7f7ee1ffb700 1 -- 172.21.15.104:0/2287547413 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3873585704 0 0) 0x7f7ee40b23d0 con 0x7f7ee4156cf0 2024-08-17T02:22:49.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.502+0000 7f7ee1ffb700 1 -- 172.21.15.104:0/2287547413 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ecc003570 con 0x7f7ee4156cf0 2024-08-17T02:22:49.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.502+0000 7f7ee27fc700 1 -- 172.21.15.104:0/2287547413 >> v2:172.21.15.117:3300/0 conn(0x7f7ee40ae2d0 msgr2=0x7f7ee40ae740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:49.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.502+0000 7f7ee27fc700 1 --2- 172.21.15.104:0/2287547413 >> v2:172.21.15.117:3300/0 conn(0x7f7ee40ae2d0 0x7f7ee40ae740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:49.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.502+0000 7f7ee27fc700 1 -- 172.21.15.104:0/2287547413 >> v1:172.21.15.117:6789/0 conn(0x7f7ee4156cf0 legacy=0x7f7ee40686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:49.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.502+0000 7f7ee27fc700 1 -- 172.21.15.104:0/2287547413 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee40aec80 con 0x7f7ee4068db0 2024-08-17T02:22:49.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.502+0000 7f7ee27fc700 1 --2- 172.21.15.104:0/2287547413 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ee4068db0 0x7f7ee41570c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7ed80099b0 tx=0x7f7ed8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5edfa74fdf45b50a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:49.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.502+0000 7f7ee1ffb700 1 -- 172.21.15.104:0/2287547413 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed800b680 con 0x7f7ee4068db0 2024-08-17T02:22:49.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.502+0000 7f7ee1ffb700 1 -- 172.21.15.104:0/2287547413 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed800b7e0 con 0x7f7ee4068db0 2024-08-17T02:22:49.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.502+0000 7f7ee1ffb700 1 -- 172.21.15.104:0/2287547413 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed800bb80 con 0x7f7ee4068db0 2024-08-17T02:22:49.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.502+0000 7f7ee3fff700 1 -- 172.21.15.104:0/2287547413 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ee4068db0 msgr2=0x7f7ee41570c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:49.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.502+0000 7f7ee3fff700 1 --2- 172.21.15.104:0/2287547413 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ee4068db0 0x7f7ee41570c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7ed80099b0 tx=0x7f7ed8009250 comp rx=0 tx=0).stop 2024-08-17T02:22:49.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.502+0000 7f7ee3fff700 1 -- 172.21.15.104:0/2287547413 shutdown_connections 2024-08-17T02:22:49.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.502+0000 7f7ee3fff700 1 --2- 172.21.15.104:0/2287547413 >> v2:172.21.15.117:3300/0 conn(0x7f7ee40ae2d0 0x7f7ee40ae740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:49.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.502+0000 7f7ee3fff700 1 --2- 172.21.15.104:0/2287547413 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ee4068db0 0x7f7ee41570c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:49.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.502+0000 7f7ee3fff700 1 -- 172.21.15.104:0/2287547413 >> 172.21.15.104:0/2287547413 conn(0x7f7ee406e350 msgr2=0x7f7ee406b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:49.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.502+0000 7f7ee3fff700 1 -- 172.21.15.104:0/2287547413 shutdown_connections 2024-08-17T02:22:49.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.502+0000 7f7ee3fff700 1 -- 172.21.15.104:0/2287547413 wait complete. 2024-08-17T02:22:49.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.502+0000 7f7ee3fff700 1 Processor -- start 2024-08-17T02:22:49.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.502+0000 7f7ee3fff700 1 -- start start 2024-08-17T02:22:49.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.506+0000 7f7ee3fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ee4068db0 0x7f7ee414ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:49.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.506+0000 7f7ee3fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ee40ae2d0 0x7f7ee4151f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:49.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.506+0000 7f7ee3fff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ee4156cf0 0x7f7ee41524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:49.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.506+0000 7f7ee3fff700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee4167200 con 0x7f7ee4156cf0 2024-08-17T02:22:49.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.506+0000 7f7ee3fff700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee415c3f0 con 0x7f7ee40ae2d0 2024-08-17T02:22:49.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.506+0000 7f7ee3fff700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee414f4c0 con 0x7f7ee4068db0 2024-08-17T02:22:49.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.506+0000 7f7ee2ffd700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ee4068db0 0x7f7ee414ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:49.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.506+0000 7f7ee2ffd700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ee4068db0 0x7f7ee414ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.104:55032/0 (socket says 172.21.15.104:55032) 2024-08-17T02:22:49.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.506+0000 7f7ee2ffd700 1 -- 172.21.15.104:0/1507962832 learned_addr learned my addr 172.21.15.104:0/1507962832 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:49.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.506+0000 7f7ee27fc700 1 --2- 172.21.15.104:0/1507962832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ee40ae2d0 0x7f7ee4151f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:49.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.506+0000 7f7ee37fe700 1 --2- 172.21.15.104:0/1507962832 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ee4156cf0 0x7f7ee41524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:49.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.506+0000 7f7ee2ffd700 1 -- 172.21.15.104:0/1507962832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ee40ae2d0 msgr2=0x7f7ee4151f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:49.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.506+0000 7f7ee2ffd700 1 --2- 172.21.15.104:0/1507962832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ee40ae2d0 0x7f7ee4151f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:49.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.506+0000 7f7ee2ffd700 1 -- 172.21.15.104:0/1507962832 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ee4156cf0 msgr2=0x7f7ee41524d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:49.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.506+0000 7f7ee2ffd700 1 --2- 172.21.15.104:0/1507962832 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ee4156cf0 0x7f7ee41524d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:49.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.506+0000 7f7ee2ffd700 1 -- 172.21.15.104:0/1507962832 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed80094f0 con 0x7f7ee4068db0 2024-08-17T02:22:49.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.506+0000 7f7ee2ffd700 1 --2- 172.21.15.104:0/1507962832 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ee4068db0 0x7f7ee414ef80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7ed400cdb0 tx=0x7f7ed4001bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:49.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.506+0000 7f7ecaffd700 1 -- 172.21.15.104:0/1507962832 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed4005df0 con 0x7f7ee4068db0 2024-08-17T02:22:49.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.506+0000 7f7ecaffd700 1 -- 172.21.15.104:0/1507962832 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed400a8b0 con 0x7f7ee4068db0 2024-08-17T02:22:49.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.506+0000 7f7ee3fff700 1 -- 172.21.15.104:0/1507962832 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ee4156440 con 0x7f7ee4068db0 2024-08-17T02:22:49.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.506+0000 7f7ecaffd700 1 -- 172.21.15.104:0/1507962832 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed400ac70 con 0x7f7ee4068db0 2024-08-17T02:22:49.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.506+0000 7f7ee3fff700 1 -- 172.21.15.104:0/1507962832 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ee415c080 con 0x7f7ee4068db0 2024-08-17T02:22:49.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.510+0000 7f7ee3fff700 1 -- 172.21.15.104:0/1507962832 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ee40638f0 con 0x7f7ee4068db0 2024-08-17T02:22:49.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.510+0000 7f7ecaffd700 1 -- 172.21.15.104:0/1507962832 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7ed4007300 con 0x7f7ee4068db0 2024-08-17T02:22:49.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.510+0000 7f7ecaffd700 1 --2- 172.21.15.104:0/1507962832 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7ed0060860 0x7f7ed0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:49.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.510+0000 7f7ecaffd700 1 -- 172.21.15.104:0/1507962832 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7ed407cd80 con 0x7f7ee4068db0 2024-08-17T02:22:49.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.510+0000 7f7ee27fc700 1 --2- 172.21.15.104:0/1507962832 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7ed0060860 0x7f7ed0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:49.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.514+0000 7f7ee27fc700 1 --2- 172.21.15.104:0/1507962832 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7ed0060860 0x7f7ed0062d10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7ed80099b0 tx=0x7f7ed8017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:49.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.522+0000 7f7ecaffd700 1 -- 172.21.15.104:0/1507962832 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f7ed404d1b0 con 0x7f7ee4068db0 2024-08-17T02:22:49.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.686+0000 7f7ee3fff700 1 -- 172.21.15.104:0/1507962832 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7ee415a880 con 0x7f7ee4068db0 2024-08-17T02:22:49.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.686+0000 7f7ecaffd700 1 -- 172.21.15.104:0/1507962832 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7ed4001d10 con 0x7f7ee4068db0 2024-08-17T02:22:49.690 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 32 2024-08-17T02:22:49.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.690+0000 7f7ee3fff700 1 -- 172.21.15.104:0/1507962832 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7ed0060860 msgr2=0x7f7ed0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:49.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.690+0000 7f7ee3fff700 1 --2- 172.21.15.104:0/1507962832 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7ed0060860 0x7f7ed0062d10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7ed80099b0 tx=0x7f7ed8017000 comp rx=0 tx=0).stop 2024-08-17T02:22:49.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.690+0000 7f7ee3fff700 1 -- 172.21.15.104:0/1507962832 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ee4068db0 msgr2=0x7f7ee414ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:49.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.690+0000 7f7ee3fff700 1 --2- 172.21.15.104:0/1507962832 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ee4068db0 0x7f7ee414ef80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7ed400cdb0 tx=0x7f7ed4001bd0 comp rx=0 tx=0).stop 2024-08-17T02:22:49.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.690+0000 7f7ee3fff700 1 -- 172.21.15.104:0/1507962832 shutdown_connections 2024-08-17T02:22:49.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.690+0000 7f7ee3fff700 1 --2- 172.21.15.104:0/1507962832 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7ed0060860 0x7f7ed0062d10 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:49.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.690+0000 7f7ee3fff700 1 --2- 172.21.15.104:0/1507962832 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ee4156cf0 0x7f7ee41524d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:49.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.690+0000 7f7ee3fff700 1 --2- 172.21.15.104:0/1507962832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ee40ae2d0 0x7f7ee4151f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:49.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.690+0000 7f7ee3fff700 1 --2- 172.21.15.104:0/1507962832 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ee4068db0 0x7f7ee414ef80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:49.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.690+0000 7f7ee3fff700 1 -- 172.21.15.104:0/1507962832 >> 172.21.15.104:0/1507962832 conn(0x7f7ee406e350 msgr2=0x7f7ee40ace80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:49.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.690+0000 7f7ee3fff700 1 -- 172.21.15.104:0/1507962832 shutdown_connections 2024-08-17T02:22:49.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.690+0000 7f7ee3fff700 1 -- 172.21.15.104:0/1507962832 wait complete. 2024-08-17T02:22:49.709 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:22:49.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.822+0000 7f8eb278e700 1 Processor -- start 2024-08-17T02:22:49.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.822+0000 7f8eb278e700 1 -- start start 2024-08-17T02:22:49.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.822+0000 7f8eb278e700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8eac140910 0x7f8eac0c8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:49.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.822+0000 7f8eb278e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8eac0cbab0 0x7f8eac0cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:49.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.822+0000 7f8eb278e700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eac0c3e30 con 0x7f8eac0c2c80 2024-08-17T02:22:49.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.822+0000 7f8eb278e700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eac0cc470 con 0x7f8eac140910 2024-08-17T02:22:49.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.822+0000 7f8eb278e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac0c4110 con 0x7f8eac0cbab0 2024-08-17T02:22:49.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.822+0000 7f8eb0f8b700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8eac0cbab0 0x7f8eac0cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:49.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.822+0000 7f8eb178c700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8eac140910 0x7f8eac0c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:49.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.822+0000 7f8eb0f8b700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8eac0cbab0 0x7f8eac0cbf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.104:55048/0 (socket says 172.21.15.104:55048) 2024-08-17T02:22:49.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.822+0000 7f8eb0f8b700 1 -- 172.21.15.104:0/4185950293 learned_addr learned my addr 172.21.15.104:0/4185950293 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:49.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.822+0000 7f8eb1f8d700 1 --1- 172.21.15.104:0/4185950293 >> v1:172.21.15.117:6789/0 conn(0x7f8eac0c2c80 0x7f8eac0c3080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.104:36826/0 (socket says 172.21.15.104:36826) 2024-08-17T02:22:49.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.826+0000 7f8eb0f8b700 1 -- 172.21.15.104:0/4185950293 >> v2:172.21.15.117:3300/0 conn(0x7f8eac140910 msgr2=0x7f8eac0c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:49.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.826+0000 7f8eb0f8b700 1 --2- 172.21.15.104:0/4185950293 >> v2:172.21.15.117:3300/0 conn(0x7f8eac140910 0x7f8eac0c8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:49.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.826+0000 7f8eb0f8b700 1 -- 172.21.15.104:0/4185950293 >> v1:172.21.15.117:6789/0 conn(0x7f8eac0c2c80 legacy=0x7f8eac0c3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:49.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.826+0000 7f8eb0f8b700 1 -- 172.21.15.104:0/4185950293 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eac0c43f0 con 0x7f8eac0cbab0 2024-08-17T02:22:49.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.826+0000 7f8eb0f8b700 1 --2- 172.21.15.104:0/4185950293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8eac0cbab0 0x7f8eac0cbf30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8ea80099b0 tx=0x7f8ea8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5378f2ce0536f5c4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:49.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.826+0000 7f8ea3fff700 1 -- 172.21.15.104:0/4185950293 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea8009ea0 con 0x7f8eac0cbab0 2024-08-17T02:22:49.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.826+0000 7f8ea3fff700 1 -- 172.21.15.104:0/4185950293 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea800b860 con 0x7f8eac0cbab0 2024-08-17T02:22:49.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.826+0000 7f8ea3fff700 1 -- 172.21.15.104:0/4185950293 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea800bc00 con 0x7f8eac0cbab0 2024-08-17T02:22:49.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.826+0000 7f8eb278e700 1 -- 172.21.15.104:0/4185950293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8eac0cbab0 msgr2=0x7f8eac0cbf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:49.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.826+0000 7f8eb278e700 1 --2- 172.21.15.104:0/4185950293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8eac0cbab0 0x7f8eac0cbf30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8ea80099b0 tx=0x7f8ea8009250 comp rx=0 tx=0).stop 2024-08-17T02:22:49.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.826+0000 7f8eb278e700 1 -- 172.21.15.104:0/4185950293 shutdown_connections 2024-08-17T02:22:49.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.826+0000 7f8eb278e700 1 --2- 172.21.15.104:0/4185950293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8eac0cbab0 0x7f8eac0cbf30 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:49.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.826+0000 7f8eb278e700 1 --2- 172.21.15.104:0/4185950293 >> v2:172.21.15.117:3300/0 conn(0x7f8eac140910 0x7f8eac0c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:49.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.826+0000 7f8eb278e700 1 -- 172.21.15.104:0/4185950293 >> 172.21.15.104:0/4185950293 conn(0x7f8eac0cdee0 msgr2=0x7f8eac0ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:49.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.826+0000 7f8eb278e700 1 -- 172.21.15.104:0/4185950293 shutdown_connections 2024-08-17T02:22:49.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.826+0000 7f8eb278e700 1 -- 172.21.15.104:0/4185950293 wait complete. 2024-08-17T02:22:49.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.830+0000 7f8eb278e700 1 Processor -- start 2024-08-17T02:22:49.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.830+0000 7f8eb278e700 1 -- start start 2024-08-17T02:22:49.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.830+0000 7f8eb278e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8eac0c2c80 0x7f8eac167b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:49.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.830+0000 7f8eb278e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8eac0cbab0 0x7f8eac13f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:49.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.830+0000 7f8eb278e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8eac140910 0x7f8eac1682e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:49.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.830+0000 7f8eb278e700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac0c7e20 con 0x7f8eac0c2c80 2024-08-17T02:22:49.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.830+0000 7f8eb278e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac1680a0 con 0x7f8eac0cbab0 2024-08-17T02:22:49.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.830+0000 7f8eb278e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac15b860 con 0x7f8eac140910 2024-08-17T02:22:49.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.830+0000 7f8eb178c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8eac0c2c80 0x7f8eac167b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:49.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.830+0000 7f8eb0f8b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8eac0cbab0 0x7f8eac13f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:49.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.830+0000 7f8eb1f8d700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8eac140910 0x7f8eac1682e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:49.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.830+0000 7f8eb178c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8eac0c2c80 0x7f8eac167b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45152/0 (socket says 172.21.15.104:45152) 2024-08-17T02:22:49.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.830+0000 7f8eb178c700 1 -- 172.21.15.104:0/1744266655 learned_addr learned my addr 172.21.15.104:0/1744266655 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:49.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.830+0000 7f8eb178c700 1 -- 172.21.15.104:0/1744266655 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8eac140910 msgr2=0x7f8eac1682e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:49.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.830+0000 7f8eb178c700 1 --2- 172.21.15.104:0/1744266655 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8eac140910 0x7f8eac1682e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:49.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.830+0000 7f8eb178c700 1 -- 172.21.15.104:0/1744266655 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8eac0cbab0 msgr2=0x7f8eac13f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:49.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.830+0000 7f8eb178c700 1 --2- 172.21.15.104:0/1744266655 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8eac0cbab0 0x7f8eac13f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:49.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.830+0000 7f8eb178c700 1 -- 172.21.15.104:0/1744266655 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea80094f0 con 0x7f8eac0c2c80 2024-08-17T02:22:49.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.830+0000 7f8eb1f8d700 1 --2- 172.21.15.104:0/1744266655 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8eac140910 0x7f8eac1682e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:22:49.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.830+0000 7f8eb0f8b700 1 --2- 172.21.15.104:0/1744266655 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8eac0cbab0 0x7f8eac13f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:22:49.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.830+0000 7f8eb178c700 1 --2- 172.21.15.104:0/1744266655 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8eac0c2c80 0x7f8eac167b60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c00e960 tx=0x7f8e9c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:49.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.830+0000 7f8ea17fa700 1 -- 172.21.15.104:0/1744266655 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c013680 con 0x7f8eac0c2c80 2024-08-17T02:22:49.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.830+0000 7f8ea17fa700 1 -- 172.21.15.104:0/1744266655 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9c0137e0 con 0x7f8eac0c2c80 2024-08-17T02:22:49.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.830+0000 7f8eb278e700 1 -- 172.21.15.104:0/1744266655 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eac15ac50 con 0x7f8eac0c2c80 2024-08-17T02:22:49.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.834+0000 7f8ea17fa700 1 -- 172.21.15.104:0/1744266655 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c013b80 con 0x7f8eac0c2c80 2024-08-17T02:22:49.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.834+0000 7f8eb278e700 1 -- 172.21.15.104:0/1744266655 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eac15b210 con 0x7f8eac0c2c80 2024-08-17T02:22:49.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.834+0000 7f8eb278e700 1 -- 172.21.15.104:0/1744266655 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eac0638f0 con 0x7f8eac0c2c80 2024-08-17T02:22:49.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.834+0000 7f8ea17fa700 1 -- 172.21.15.104:0/1744266655 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8e9c0123d0 con 0x7f8eac0c2c80 2024-08-17T02:22:49.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.834+0000 7f8ea17fa700 1 --2- 172.21.15.104:0/1744266655 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8e90060890 0x7f8e90062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:49.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.834+0000 7f8ea17fa700 1 -- 172.21.15.104:0/1744266655 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8e9c07cbb0 con 0x7f8eac0c2c80 2024-08-17T02:22:49.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.838+0000 7f8eb0f8b700 1 --2- 172.21.15.104:0/1744266655 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8e90060890 0x7f8e90062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:49.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.838+0000 7f8eb0f8b700 1 --2- 172.21.15.104:0/1744266655 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8e90060890 0x7f8e90062d40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8ea80099b0 tx=0x7f8ea8017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:49.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:49.842+0000 7f8ea17fa700 1 -- 172.21.15.104:0/1744266655 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f8e9c04d000 con 0x7f8eac0c2c80 2024-08-17T02:22:49.912 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:22:49.915 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:22:50.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.006+0000 7f8eb278e700 1 -- 172.21.15.104:0/1744266655 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8eac0cc230 con 0x7f8eac0c2c80 2024-08-17T02:22:50.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.006+0000 7f8ea17fa700 1 -- 172.21.15.104:0/1744266655 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8e9c050620 con 0x7f8eac0c2c80 2024-08-17T02:22:50.010 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 64 2024-08-17T02:22:50.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.010+0000 7f8eb278e700 1 -- 172.21.15.104:0/1744266655 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8e90060890 msgr2=0x7f8e90062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:50.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.010+0000 7f8eb278e700 1 --2- 172.21.15.104:0/1744266655 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8e90060890 0x7f8e90062d40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8ea80099b0 tx=0x7f8ea8017000 comp rx=0 tx=0).stop 2024-08-17T02:22:50.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.010+0000 7f8eb278e700 1 -- 172.21.15.104:0/1744266655 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8eac0c2c80 msgr2=0x7f8eac167b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:50.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.010+0000 7f8eb278e700 1 --2- 172.21.15.104:0/1744266655 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8eac0c2c80 0x7f8eac167b60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c00e960 tx=0x7f8e9c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:50.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.010+0000 7f8eb278e700 1 -- 172.21.15.104:0/1744266655 shutdown_connections 2024-08-17T02:22:50.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.010+0000 7f8eb278e700 1 --2- 172.21.15.104:0/1744266655 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8e90060890 0x7f8e90062d40 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:50.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.010+0000 7f8eb278e700 1 --2- 172.21.15.104:0/1744266655 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8eac140910 0x7f8eac1682e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:50.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.010+0000 7f8eb278e700 1 --2- 172.21.15.104:0/1744266655 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8eac0cbab0 0x7f8eac13f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:50.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.010+0000 7f8eb278e700 1 --2- 172.21.15.104:0/1744266655 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8eac0c2c80 0x7f8eac167b60 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:50.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.010+0000 7f8eb278e700 1 -- 172.21.15.104:0/1744266655 >> 172.21.15.104:0/1744266655 conn(0x7f8eac0cdee0 msgr2=0x7f8eac0b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:50.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.010+0000 7f8eb278e700 1 -- 172.21.15.104:0/1744266655 shutdown_connections 2024-08-17T02:22:50.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.010+0000 7f8eb278e700 1 -- 172.21.15.104:0/1744266655 wait complete. 2024-08-17T02:22:50.028 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2024-08-17T02:22:50.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.130+0000 7f671a781700 1 Processor -- start 2024-08-17T02:22:50.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.130+0000 7f671a781700 1 -- start start 2024-08-17T02:22:50.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.130+0000 7f671a781700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f67140ae9e0 0x7f67140686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:50.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.130+0000 7f671a781700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f671415ab20 con 0x7f6714068be0 2024-08-17T02:22:50.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.130+0000 7f671a781700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6714069030 con 0x7f67140abe80 2024-08-17T02:22:50.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.130+0000 7f671a781700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f671415a8b0 con 0x7f67140ae9e0 2024-08-17T02:22:50.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.130+0000 7f6719f80700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f6714068be0 0x7f67140b14f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:59472/0 (socket says 172.21.15.104:59472) 2024-08-17T02:22:50.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.130+0000 7f6719f80700 1 -- 172.21.15.104:0/1296168797 learned_addr learned my addr 172.21.15.104:0/1296168797 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:50.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.130+0000 7f6718f7e700 1 --2- 172.21.15.104:0/1296168797 >> v2:172.21.15.117:3300/0 conn(0x7f67140ae9e0 0x7f67140686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:50.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.130+0000 7f670bfff700 1 -- 172.21.15.104:0/1296168797 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3689661027 0 0) 0x7f671415ab20 con 0x7f6714068be0 2024-08-17T02:22:50.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.130+0000 7f670bfff700 1 -- 172.21.15.104:0/1296168797 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6700003570 con 0x7f6714068be0 2024-08-17T02:22:50.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.130+0000 7f670bfff700 1 -- 172.21.15.104:0/1296168797 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1550029555 0 0) 0x7f6714069030 con 0x7f67140abe80 2024-08-17T02:22:50.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.130+0000 7f670bfff700 1 -- 172.21.15.104:0/1296168797 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f671415ab20 con 0x7f67140abe80 2024-08-17T02:22:50.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.130+0000 7f670bfff700 1 -- 172.21.15.104:0/1296168797 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3609886792 0 0) 0x7f6700003570 con 0x7f6714068be0 2024-08-17T02:22:50.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.130+0000 7f6718f7e700 1 -- 172.21.15.104:0/1296168797 >> v1:172.21.15.117:6789/0 conn(0x7f67140abe80 legacy=0x7f6714159700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:50.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.130+0000 7f6718f7e700 1 -- 172.21.15.104:0/1296168797 >> v1:172.21.15.104:6789/0 conn(0x7f6714068be0 legacy=0x7f67140b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:50.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.130+0000 7f6718f7e700 1 -- 172.21.15.104:0/1296168797 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6714159ec0 con 0x7f67140ae9e0 2024-08-17T02:22:50.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.130+0000 7f6718f7e700 1 --2- 172.21.15.104:0/1296168797 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67140ae9e0 0x7f67140686a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f67040098e0 tx=0x7f67040091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3b74ebda04a7066 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:50.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.130+0000 7f670bfff700 1 -- 172.21.15.104:0/1296168797 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6710001470 con 0x7f67140ae9e0 2024-08-17T02:22:50.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.130+0000 7f670bfff700 1 -- 172.21.15.104:0/1296168797 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6704011420 con 0x7f67140ae9e0 2024-08-17T02:22:50.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.130+0000 7f670bfff700 1 -- 172.21.15.104:0/1296168797 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67040117a0 con 0x7f67140ae9e0 2024-08-17T02:22:50.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.134+0000 7f671a781700 1 -- 172.21.15.104:0/1296168797 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67140ae9e0 msgr2=0x7f67140686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:50.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.134+0000 7f671a781700 1 --2- 172.21.15.104:0/1296168797 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67140ae9e0 0x7f67140686a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f67040098e0 tx=0x7f67040091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:50.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.134+0000 7f671a781700 1 -- 172.21.15.104:0/1296168797 shutdown_connections 2024-08-17T02:22:50.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.134+0000 7f671a781700 1 --2- 172.21.15.104:0/1296168797 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67140ae9e0 0x7f67140686a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:50.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.134+0000 7f671a781700 1 -- 172.21.15.104:0/1296168797 >> 172.21.15.104:0/1296168797 conn(0x7f671406d870 msgr2=0x7f671406dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:50.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.134+0000 7f671a781700 1 -- 172.21.15.104:0/1296168797 shutdown_connections 2024-08-17T02:22:50.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.134+0000 7f671a781700 1 -- 172.21.15.104:0/1296168797 wait complete. 2024-08-17T02:22:50.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.134+0000 7f671a781700 1 Processor -- start 2024-08-17T02:22:50.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.134+0000 7f671a781700 1 -- start start 2024-08-17T02:22:50.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.134+0000 7f671a781700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6714068be0 0x7f671416d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:50.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.134+0000 7f671a781700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67140abe80 0x7f6714144f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:50.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.138+0000 7f671a781700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67140ae9e0 0x7f67140ac570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:50.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.138+0000 7f671a781700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67140aee80 con 0x7f67140abe80 2024-08-17T02:22:50.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.138+0000 7f671a781700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6714155e70 con 0x7f6714068be0 2024-08-17T02:22:50.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.138+0000 7f671a781700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6714156cd0 con 0x7f67140ae9e0 2024-08-17T02:22:50.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.138+0000 7f6718f7e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67140abe80 0x7f6714144f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:50.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.138+0000 7f6718f7e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67140abe80 0x7f6714144f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45162/0 (socket says 172.21.15.104:45162) 2024-08-17T02:22:50.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.138+0000 7f6718f7e700 1 -- 172.21.15.104:0/4220069452 learned_addr learned my addr 172.21.15.104:0/4220069452 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:50.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.138+0000 7f671977f700 1 --2- 172.21.15.104:0/4220069452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6714068be0 0x7f671416d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:50.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.138+0000 7f6719f80700 1 --2- 172.21.15.104:0/4220069452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67140ae9e0 0x7f67140ac570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:50.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.138+0000 7f6718f7e700 1 -- 172.21.15.104:0/4220069452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67140ae9e0 msgr2=0x7f67140ac570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:50.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.138+0000 7f6718f7e700 1 --2- 172.21.15.104:0/4220069452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67140ae9e0 0x7f67140ac570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:50.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.138+0000 7f6718f7e700 1 -- 172.21.15.104:0/4220069452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6714068be0 msgr2=0x7f671416d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:50.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.138+0000 7f6718f7e700 1 --2- 172.21.15.104:0/4220069452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6714068be0 0x7f671416d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:50.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.138+0000 7f6718f7e700 1 -- 172.21.15.104:0/4220069452 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6704009420 con 0x7f67140abe80 2024-08-17T02:22:50.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.138+0000 7f6718f7e700 1 --2- 172.21.15.104:0/4220069452 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67140abe80 0x7f6714144f40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f671406f0d0 tx=0x7f6704016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:50.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.138+0000 7f67097fa700 1 -- 172.21.15.104:0/4220069452 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670401cb30 con 0x7f67140abe80 2024-08-17T02:22:50.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.138+0000 7f67097fa700 1 -- 172.21.15.104:0/4220069452 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670401ccd0 con 0x7f67140abe80 2024-08-17T02:22:50.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.138+0000 7f67097fa700 1 -- 172.21.15.104:0/4220069452 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6704019640 con 0x7f67140abe80 2024-08-17T02:22:50.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.138+0000 7f671a781700 1 -- 172.21.15.104:0/4220069452 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f671416ddc0 con 0x7f67140abe80 2024-08-17T02:22:50.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.138+0000 7f671a781700 1 -- 172.21.15.104:0/4220069452 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67141563a0 con 0x7f67140abe80 2024-08-17T02:22:50.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.138+0000 7f671a781700 1 -- 172.21.15.104:0/4220069452 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67140638f0 con 0x7f67140abe80 2024-08-17T02:22:50.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.138+0000 7f67097fa700 1 -- 172.21.15.104:0/4220069452 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f67040199f0 con 0x7f67140abe80 2024-08-17T02:22:50.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.138+0000 7f67097fa700 1 --2- 172.21.15.104:0/4220069452 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f66f8060860 0x7f66f8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:50.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.142+0000 7f67097fa700 1 -- 172.21.15.104:0/4220069452 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f670407dbb0 con 0x7f67140abe80 2024-08-17T02:22:50.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.142+0000 7f671977f700 1 --2- 172.21.15.104:0/4220069452 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f66f8060860 0x7f66f8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:50.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.142+0000 7f671977f700 1 --2- 172.21.15.104:0/4220069452 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f66f8060860 0x7f66f8062d10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f670c004140 tx=0x7f670c007f90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:50.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.146+0000 7f67097fa700 1 -- 172.21.15.104:0/4220069452 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f670404e000 con 0x7f67140abe80 2024-08-17T02:22:50.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:50.366+0000 7f671a781700 1 -- 172.21.15.104:0/4220069452 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7f6714156e10 con 0x7f67140abe80 2024-08-17T02:22:51.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.326+0000 7f67097fa700 1 -- 172.21.15.104:0/4220069452 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v50) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6704051620 con 0x7f67140abe80 2024-08-17T02:22:51.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.330+0000 7f671a781700 1 -- 172.21.15.104:0/4220069452 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f66f8060860 msgr2=0x7f66f8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:51.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.330+0000 7f671a781700 1 --2- 172.21.15.104:0/4220069452 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f66f8060860 0x7f66f8062d10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f670c004140 tx=0x7f670c007f90 comp rx=0 tx=0).stop 2024-08-17T02:22:51.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.330+0000 7f671a781700 1 -- 172.21.15.104:0/4220069452 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67140abe80 msgr2=0x7f6714144f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:51.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.330+0000 7f671a781700 1 --2- 172.21.15.104:0/4220069452 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67140abe80 0x7f6714144f40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f671406f0d0 tx=0x7f6704016000 comp rx=0 tx=0).stop 2024-08-17T02:22:51.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.330+0000 7f671a781700 1 -- 172.21.15.104:0/4220069452 shutdown_connections 2024-08-17T02:22:51.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.330+0000 7f671a781700 1 --2- 172.21.15.104:0/4220069452 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f66f8060860 0x7f66f8062d10 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:51.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.330+0000 7f671a781700 1 --2- 172.21.15.104:0/4220069452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67140ae9e0 0x7f67140ac570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:51.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.330+0000 7f671a781700 1 --2- 172.21.15.104:0/4220069452 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67140abe80 0x7f6714144f40 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:51.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.330+0000 7f671a781700 1 --2- 172.21.15.104:0/4220069452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6714068be0 0x7f671416d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:51.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.330+0000 7f671a781700 1 -- 172.21.15.104:0/4220069452 >> 172.21.15.104:0/4220069452 conn(0x7f671406d870 msgr2=0x7f6714153080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:51.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.330+0000 7f671a781700 1 -- 172.21.15.104:0/4220069452 shutdown_connections 2024-08-17T02:22:51.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.330+0000 7f671a781700 1 -- 172.21.15.104:0/4220069452 wait complete. 2024-08-17T02:22:51.348 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-17T02:22:51.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.458+0000 7f4dcc4e3700 1 Processor -- start 2024-08-17T02:22:51.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.458+0000 7f4dcc4e3700 1 -- start start 2024-08-17T02:22:51.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.462+0000 7f4dcc4e3700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f4dc41596d0 0x7f4dc4066e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:51.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.462+0000 7f4dcc4e3700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dc40cba90 con 0x7f4dc4159300 2024-08-17T02:22:51.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.462+0000 7f4dcc4e3700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dc40cb160 con 0x7f4dc415dbc0 2024-08-17T02:22:51.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.462+0000 7f4dcc4e3700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc40b2b60 con 0x7f4dc41596d0 2024-08-17T02:22:51.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.462+0000 7f4dc9a7e700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f4dc41596d0 0x7f4dc4066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:51.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.462+0000 7f4dc9a7e700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f4dc41596d0 0x7f4dc4066e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45170/0 (socket says 172.21.15.104:45170) 2024-08-17T02:22:51.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.462+0000 7f4dca27f700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f4dc4159300 0x7f4dc40b2230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:59476/0 (socket says 172.21.15.104:59476) 2024-08-17T02:22:51.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.462+0000 7f4dc9a7e700 1 -- 172.21.15.104:0/512651504 learned_addr learned my addr 172.21.15.104:0/512651504 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:51.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.462+0000 7f4dc9a7e700 1 -- 172.21.15.104:0/512651504 >> v1:172.21.15.117:6789/0 conn(0x7f4dc415dbc0 legacy=0x7f4dc40cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:51.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.462+0000 7f4dc9a7e700 1 -- 172.21.15.104:0/512651504 >> v1:172.21.15.104:6789/0 conn(0x7f4dc4159300 legacy=0x7f4dc40b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:51.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.462+0000 7f4dc9a7e700 1 -- 172.21.15.104:0/512651504 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc40cb440 con 0x7f4dc41596d0 2024-08-17T02:22:51.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.462+0000 7f4dc9a7e700 1 --2- 172.21.15.104:0/512651504 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4dc41596d0 0x7f4dc4066e00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4dc00099b0 tx=0x7f4dc0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3833525f01fd2968 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:51.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.462+0000 7f4dc927d700 1 -- 172.21.15.104:0/512651504 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc000b860 con 0x7f4dc41596d0 2024-08-17T02:22:51.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.462+0000 7f4dc927d700 1 -- 172.21.15.104:0/512651504 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc000b9c0 con 0x7f4dc41596d0 2024-08-17T02:22:51.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.462+0000 7f4dc927d700 1 -- 172.21.15.104:0/512651504 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc000bd60 con 0x7f4dc41596d0 2024-08-17T02:22:51.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.462+0000 7f4dcc4e3700 1 -- 172.21.15.104:0/512651504 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4dc41596d0 msgr2=0x7f4dc4066e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:51.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.462+0000 7f4dcc4e3700 1 --2- 172.21.15.104:0/512651504 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4dc41596d0 0x7f4dc4066e00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4dc00099b0 tx=0x7f4dc0009250 comp rx=0 tx=0).stop 2024-08-17T02:22:51.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.462+0000 7f4dcc4e3700 1 -- 172.21.15.104:0/512651504 shutdown_connections 2024-08-17T02:22:51.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.462+0000 7f4dcc4e3700 1 --2- 172.21.15.104:0/512651504 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4dc41596d0 0x7f4dc4066e00 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:51.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.462+0000 7f4dcc4e3700 1 -- 172.21.15.104:0/512651504 >> 172.21.15.104:0/512651504 conn(0x7f4dc40682c0 msgr2=0x7f4dc40686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:51.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.462+0000 7f4dcc4e3700 1 -- 172.21.15.104:0/512651504 shutdown_connections 2024-08-17T02:22:51.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.462+0000 7f4dcc4e3700 1 -- 172.21.15.104:0/512651504 wait complete. 2024-08-17T02:22:51.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.466+0000 7f4dcc4e3700 1 Processor -- start 2024-08-17T02:22:51.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.466+0000 7f4dcc4e3700 1 -- start start 2024-08-17T02:22:51.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.466+0000 7f4dcc4e3700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4dc4159300 0x7f4dc40c4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:51.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.466+0000 7f4dcc4e3700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4dc41596d0 0x7f4dc41506f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:51.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.466+0000 7f4dcc4e3700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4dc415dbc0 0x7f4dc416d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:51.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.466+0000 7f4dcc4e3700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc4151220 con 0x7f4dc41596d0 2024-08-17T02:22:51.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.466+0000 7f4dcc4e3700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc40c51c0 con 0x7f4dc415dbc0 2024-08-17T02:22:51.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.466+0000 7f4dcc4e3700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc4150f40 con 0x7f4dc4159300 2024-08-17T02:22:51.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.466+0000 7f4dc9a7e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4dc41596d0 0x7f4dc41506f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:51.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.466+0000 7f4dc9a7e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4dc41596d0 0x7f4dc41506f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45180/0 (socket says 172.21.15.104:45180) 2024-08-17T02:22:51.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.466+0000 7f4dc9a7e700 1 -- 172.21.15.104:0/2358115380 learned_addr learned my addr 172.21.15.104:0/2358115380 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:51.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.466+0000 7f4dca27f700 1 --2- 172.21.15.104:0/2358115380 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4dc4159300 0x7f4dc40c4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:51.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.466+0000 7f4dcaa80700 1 --2- 172.21.15.104:0/2358115380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4dc415dbc0 0x7f4dc416d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:51.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.466+0000 7f4dc9a7e700 1 -- 172.21.15.104:0/2358115380 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4dc4159300 msgr2=0x7f4dc40c4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:51.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.466+0000 7f4dc9a7e700 1 --2- 172.21.15.104:0/2358115380 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4dc4159300 0x7f4dc40c4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:51.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.466+0000 7f4dc9a7e700 1 -- 172.21.15.104:0/2358115380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4dc415dbc0 msgr2=0x7f4dc416d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:51.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.466+0000 7f4dc9a7e700 1 --2- 172.21.15.104:0/2358115380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4dc415dbc0 0x7f4dc416d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:51.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.466+0000 7f4dc9a7e700 1 -- 172.21.15.104:0/2358115380 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc00094f0 con 0x7f4dc41596d0 2024-08-17T02:22:51.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.466+0000 7f4dc9a7e700 1 --2- 172.21.15.104:0/2358115380 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4dc41596d0 0x7f4dc41506f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4dc40cde20 tx=0x7f4dc0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:51.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.466+0000 7f4dba7fc700 1 -- 172.21.15.104:0/2358115380 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc0024440 con 0x7f4dc41596d0 2024-08-17T02:22:51.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.466+0000 7f4dcc4e3700 1 -- 172.21.15.104:0/2358115380 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dc414dfc0 con 0x7f4dc41596d0 2024-08-17T02:22:51.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.466+0000 7f4dba7fc700 1 -- 172.21.15.104:0/2358115380 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc00245a0 con 0x7f4dc41596d0 2024-08-17T02:22:51.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.466+0000 7f4dba7fc700 1 -- 172.21.15.104:0/2358115380 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc0024940 con 0x7f4dc41596d0 2024-08-17T02:22:51.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.466+0000 7f4dcc4e3700 1 -- 172.21.15.104:0/2358115380 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc414e580 con 0x7f4dc41596d0 2024-08-17T02:22:51.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.470+0000 7f4dcc4e3700 1 -- 172.21.15.104:0/2358115380 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc414e7a0 con 0x7f4dc41596d0 2024-08-17T02:22:51.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.470+0000 7f4dba7fc700 1 -- 172.21.15.104:0/2358115380 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f4dc001a420 con 0x7f4dc41596d0 2024-08-17T02:22:51.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.470+0000 7f4dba7fc700 1 --2- 172.21.15.104:0/2358115380 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4da8060890 0x7f4da8062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:51.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.470+0000 7f4dba7fc700 1 -- 172.21.15.104:0/2358115380 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4dc007ea10 con 0x7f4dc41596d0 2024-08-17T02:22:51.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.470+0000 7f4dca27f700 1 --2- 172.21.15.104:0/2358115380 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4da8060890 0x7f4da8062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:51.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.474+0000 7f4dca27f700 1 --2- 172.21.15.104:0/2358115380 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4da8060890 0x7f4da8062d40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4db4004fd0 tx=0x7f4db4007eb0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:51.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.478+0000 7f4dba7fc700 1 -- 172.21.15.104:0/2358115380 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f4dc004ef10 con 0x7f4dc41596d0 2024-08-17T02:22:51.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.630+0000 7f4dcc4e3700 1 -- 172.21.15.104:0/2358115380 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f4dc40645c0 con 0x7f4dc41596d0 2024-08-17T02:22:51.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.638+0000 7f4dba7fc700 1 -- 172.21.15.104:0/2358115380 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4dc00150c0 con 0x7f4dc41596d0 2024-08-17T02:22:51.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.642+0000 7f4dcc4e3700 1 -- 172.21.15.104:0/2358115380 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4da8060890 msgr2=0x7f4da8062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:51.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.642+0000 7f4dcc4e3700 1 --2- 172.21.15.104:0/2358115380 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4da8060890 0x7f4da8062d40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4db4004fd0 tx=0x7f4db4007eb0 comp rx=0 tx=0).stop 2024-08-17T02:22:51.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.642+0000 7f4dcc4e3700 1 -- 172.21.15.104:0/2358115380 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4dc41596d0 msgr2=0x7f4dc41506f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:51.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.642+0000 7f4dcc4e3700 1 --2- 172.21.15.104:0/2358115380 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4dc41596d0 0x7f4dc41506f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4dc40cde20 tx=0x7f4dc0017000 comp rx=0 tx=0).stop 2024-08-17T02:22:51.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.642+0000 7f4dcc4e3700 1 -- 172.21.15.104:0/2358115380 shutdown_connections 2024-08-17T02:22:51.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.642+0000 7f4dcc4e3700 1 --2- 172.21.15.104:0/2358115380 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4da8060890 0x7f4da8062d40 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:51.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.642+0000 7f4dcc4e3700 1 --2- 172.21.15.104:0/2358115380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4dc415dbc0 0x7f4dc416d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:51.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.642+0000 7f4dcc4e3700 1 --2- 172.21.15.104:0/2358115380 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4dc41596d0 0x7f4dc41506f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:51.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.642+0000 7f4dcc4e3700 1 --2- 172.21.15.104:0/2358115380 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4dc4159300 0x7f4dc40c4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:51.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.642+0000 7f4dcc4e3700 1 -- 172.21.15.104:0/2358115380 >> 172.21.15.104:0/2358115380 conn(0x7f4dc40682c0 msgr2=0x7f4dc40cf740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:51.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.642+0000 7f4dcc4e3700 1 -- 172.21.15.104:0/2358115380 shutdown_connections 2024-08-17T02:22:51.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:51.642+0000 7f4dcc4e3700 1 -- 172.21.15.104:0/2358115380 wait complete. 2024-08-17T02:22:51.656 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-17T02:22:51.657 DEBUG:teuthology.orchestra.run.smithi104:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:22:51.670 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:22:51.692 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-17T02:22:51.692 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi104.front.sepia.ceph.com... 2024-08-17T02:22:51.692 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:22:51.693 DEBUG:teuthology.orchestra.run.smithi104:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-08-17T02:22:51.719 INFO:teuthology.orchestra.run:waiting for 900 2024-08-17T02:22:51.719 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi104.front.sepia.ceph.com 2024-08-17T02:22:51.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:51.720 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-17T02:22:51.780 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi117.front.sepia.ceph.com... 2024-08-17T02:22:51.780 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:22:51.780 DEBUG:teuthology.orchestra.run.smithi117:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-08-17T02:22:51.809 INFO:teuthology.orchestra.run:waiting for 900 2024-08-17T02:22:51.809 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2024-08-17T02:22:51.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:51.810 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-08-17T02:22:51.843 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi104.front.sepia.ceph.com... 2024-08-17T02:22:51.843 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:22:51.843 DEBUG:teuthology.orchestra.run.smithi104:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-08-17T02:22:51.859 INFO:teuthology.orchestra.run:waiting for 900 2024-08-17T02:22:51.859 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi104.front.sepia.ceph.com 2024-08-17T02:22:51.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:51.859 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-08-17T02:22:51.865 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi117.front.sepia.ceph.com... 2024-08-17T02:22:51.865 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:22:51.865 DEBUG:teuthology.orchestra.run.smithi117:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-08-17T02:22:51.881 INFO:teuthology.orchestra.run:waiting for 900 2024-08-17T02:22:51.882 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2024-08-17T02:22:51.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:22:51.883 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-08-17T02:22:51.932 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-08-17T02:22:51.932 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:22:52.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.042+0000 7f5df0bcd700 1 Processor -- start 2024-08-17T02:22:52.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.042+0000 7f5df0bcd700 1 -- start start 2024-08-17T02:22:52.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.042+0000 7f5df0bcd700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f5dec155d20 0x7f5dec0b0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:52.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.042+0000 7f5df0bcd700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5dec06df10 0x7f5dec06e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:52.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.042+0000 7f5df0bcd700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dec06e8b0 con 0x7f5dec0ad7c0 2024-08-17T02:22:52.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.042+0000 7f5df0bcd700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dec0adc10 con 0x7f5dec155d20 2024-08-17T02:22:52.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.042+0000 7f5df0bcd700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec0af2b0 con 0x7f5dec06df10 2024-08-17T02:22:52.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.042+0000 7f5deaffd700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f5dec0ad7c0 0x7f5dec0aea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:59480/0 (socket says 172.21.15.104:59480) 2024-08-17T02:22:52.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.042+0000 7f5deaffd700 1 -- 172.21.15.104:0/2270211348 learned_addr learned my addr 172.21.15.104:0/2270211348 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:52.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.042+0000 7f5deb7fe700 1 --2- 172.21.15.104:0/2270211348 >> v2:172.21.15.104:3300/0 conn(0x7f5dec155d20 0x7f5dec0b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:52.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.042+0000 7f5debfff700 1 --2- 172.21.15.104:0/2270211348 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5dec06df10 0x7f5dec06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:52.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.042+0000 7f5dea7fc700 1 -- 172.21.15.104:0/2270211348 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3777030529 0 0) 0x7f5dd4001110 con 0x7f5dec0ad7c0 2024-08-17T02:22:52.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.042+0000 7f5dea7fc700 1 -- 172.21.15.104:0/2270211348 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dcc003570 con 0x7f5dec0ad7c0 2024-08-17T02:22:52.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.042+0000 7f5deb7fe700 1 -- 172.21.15.104:0/2270211348 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5dec06df10 msgr2=0x7f5dec06e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:52.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.042+0000 7f5deb7fe700 1 --2- 172.21.15.104:0/2270211348 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5dec06df10 0x7f5dec06e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:52.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.042+0000 7f5deb7fe700 1 -- 172.21.15.104:0/2270211348 >> v1:172.21.15.104:6789/0 conn(0x7f5dec0ad7c0 legacy=0x7f5dec0aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:52.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.042+0000 7f5dea7fc700 1 -- 172.21.15.104:0/2270211348 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 714515561 0 0) 0x7f5dcc003570 con 0x7f5dec0ad7c0 2024-08-17T02:22:52.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.042+0000 7f5deb7fe700 1 -- 172.21.15.104:0/2270211348 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dec0af590 con 0x7f5dec155d20 2024-08-17T02:22:52.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.046+0000 7f5deb7fe700 1 --2- 172.21.15.104:0/2270211348 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dec155d20 0x7f5dec0b0350 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc0098e0 tx=0x7f5ddc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dd76493b8bcea2c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:52.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.046+0000 7f5dea7fc700 1 -- 172.21.15.104:0/2270211348 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd4001600 con 0x7f5dec155d20 2024-08-17T02:22:52.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.046+0000 7f5dea7fc700 1 -- 172.21.15.104:0/2270211348 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ddc011420 con 0x7f5dec155d20 2024-08-17T02:22:52.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.046+0000 7f5dea7fc700 1 -- 172.21.15.104:0/2270211348 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc0117c0 con 0x7f5dec155d20 2024-08-17T02:22:52.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.046+0000 7f5df0bcd700 1 -- 172.21.15.104:0/2270211348 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dec155d20 msgr2=0x7f5dec0b0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:52.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.046+0000 7f5df0bcd700 1 --2- 172.21.15.104:0/2270211348 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dec155d20 0x7f5dec0b0350 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc0098e0 tx=0x7f5ddc0091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:52.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.046+0000 7f5df0bcd700 1 -- 172.21.15.104:0/2270211348 shutdown_connections 2024-08-17T02:22:52.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.046+0000 7f5df0bcd700 1 --2- 172.21.15.104:0/2270211348 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5dec06df10 0x7f5dec06e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:52.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.046+0000 7f5df0bcd700 1 --2- 172.21.15.104:0/2270211348 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dec155d20 0x7f5dec0b0350 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:52.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.046+0000 7f5df0bcd700 1 -- 172.21.15.104:0/2270211348 >> 172.21.15.104:0/2270211348 conn(0x7f5dec0678d0 msgr2=0x7f5dec067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:52.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.046+0000 7f5df0bcd700 1 -- 172.21.15.104:0/2270211348 shutdown_connections 2024-08-17T02:22:52.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.046+0000 7f5df0bcd700 1 -- 172.21.15.104:0/2270211348 wait complete. 2024-08-17T02:22:52.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.050+0000 7f5df0bcd700 1 Processor -- start 2024-08-17T02:22:52.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.050+0000 7f5df0bcd700 1 -- start start 2024-08-17T02:22:52.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.050+0000 7f5df0bcd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dec06df10 0x7f5dec169730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:52.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.050+0000 7f5df0bcd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5dec0ad7c0 0x7f5dec16d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:52.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.050+0000 7f5df0bcd700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5dec155d20 0x7f5dec151660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:52.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.050+0000 7f5df0bcd700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec157910 con 0x7f5dec06df10 2024-08-17T02:22:52.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.050+0000 7f5df0bcd700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec169c70 con 0x7f5dec0ad7c0 2024-08-17T02:22:52.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.050+0000 7f5df0bcd700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec16dc30 con 0x7f5dec155d20 2024-08-17T02:22:52.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.050+0000 7f5deb7fe700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dec06df10 0x7f5dec169730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:52.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.050+0000 7f5deb7fe700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dec06df10 0x7f5dec169730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45200/0 (socket says 172.21.15.104:45200) 2024-08-17T02:22:52.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.050+0000 7f5deb7fe700 1 -- 172.21.15.104:0/4152818014 learned_addr learned my addr 172.21.15.104:0/4152818014 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:52.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.050+0000 7f5debfff700 1 --2- 172.21.15.104:0/4152818014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5dec155d20 0x7f5dec151660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:52.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.050+0000 7f5deaffd700 1 --2- 172.21.15.104:0/4152818014 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5dec0ad7c0 0x7f5dec16d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:52.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.050+0000 7f5deb7fe700 1 -- 172.21.15.104:0/4152818014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5dec155d20 msgr2=0x7f5dec151660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:52.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.050+0000 7f5deb7fe700 1 --2- 172.21.15.104:0/4152818014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5dec155d20 0x7f5dec151660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:52.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.050+0000 7f5deb7fe700 1 -- 172.21.15.104:0/4152818014 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5dec0ad7c0 msgr2=0x7f5dec16d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:52.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.050+0000 7f5deb7fe700 1 --2- 172.21.15.104:0/4152818014 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5dec0ad7c0 0x7f5dec16d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:52.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.050+0000 7f5deb7fe700 1 -- 172.21.15.104:0/4152818014 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ddc009420 con 0x7f5dec06df10 2024-08-17T02:22:52.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.050+0000 7f5deaffd700 1 --2- 172.21.15.104:0/4152818014 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5dec0ad7c0 0x7f5dec16d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:22:52.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.050+0000 7f5deb7fe700 1 --2- 172.21.15.104:0/4152818014 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dec06df10 0x7f5dec169730 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc0030c0 tx=0x7f5ddc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:52.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.050+0000 7f5de37fe700 1 -- 172.21.15.104:0/4152818014 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc01cc90 con 0x7f5dec06df10 2024-08-17T02:22:52.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.050+0000 7f5de37fe700 1 -- 172.21.15.104:0/4152818014 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ddc01cdf0 con 0x7f5dec06df10 2024-08-17T02:22:52.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.050+0000 7f5df0bcd700 1 -- 172.21.15.104:0/4152818014 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dec146340 con 0x7f5dec06df10 2024-08-17T02:22:52.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.050+0000 7f5de37fe700 1 -- 172.21.15.104:0/4152818014 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc01a6a0 con 0x7f5dec06df10 2024-08-17T02:22:52.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.050+0000 7f5df0bcd700 1 -- 172.21.15.104:0/4152818014 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dec144bc0 con 0x7f5dec06df10 2024-08-17T02:22:52.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.054+0000 7f5df0bcd700 1 -- 172.21.15.104:0/4152818014 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dec0643a0 con 0x7f5dec06df10 2024-08-17T02:22:52.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.054+0000 7f5de37fe700 1 -- 172.21.15.104:0/4152818014 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f5ddc01aad0 con 0x7f5dec06df10 2024-08-17T02:22:52.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.054+0000 7f5de37fe700 1 --2- 172.21.15.104:0/4152818014 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f5dd0060890 0x7f5dd0062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:52.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.054+0000 7f5de37fe700 1 -- 172.21.15.104:0/4152818014 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5ddc07e440 con 0x7f5dec06df10 2024-08-17T02:22:52.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.054+0000 7f5deaffd700 1 --2- 172.21.15.104:0/4152818014 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f5dd0060890 0x7f5dd0062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:52.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.054+0000 7f5deaffd700 1 --2- 172.21.15.104:0/4152818014 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f5dd0060890 0x7f5dd0062d40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5dec14c700 tx=0x7f5dd4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:52.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.058+0000 7f5de37fe700 1 -- 172.21.15.104:0/4152818014 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f5ddc04e890 con 0x7f5dec06df10 2024-08-17T02:22:52.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.246+0000 7f5df0bcd700 1 -- 172.21.15.104:0/4152818014 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5dec1465a0 con 0x7f5dec06df10 2024-08-17T02:22:52.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.246+0000 7f5de37fe700 1 -- 172.21.15.104:0/4152818014 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4603 (secure 0 0 0) 0x7f5ddc051eb0 con 0x7f5dec06df10 2024-08-17T02:22:52.249 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:22:52.249 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/1242386459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":1242386459},{"type":"v1","addr":"172.21.15.104:6835","nonce":1242386459}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/2581980475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2581980475},{"type":"v1","addr":"172.21.15.104:6833","nonce":2581980475}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1039240942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1039240942},{"type":"v1","addr":"172.21.15.117:6835","nonce":1039240942}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:22:21.527207+0000","modified":"2024-08-17T02:22:25.187188+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/4197149840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":4197149840},{"type":"v1","addr":"172.21.15.117:6837","nonce":4197149840}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:22:52.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.246+0000 7f5df0bcd700 1 -- 172.21.15.104:0/4152818014 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f5dd0060890 msgr2=0x7f5dd0062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:52.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.246+0000 7f5df0bcd700 1 --2- 172.21.15.104:0/4152818014 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f5dd0060890 0x7f5dd0062d40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5dec14c700 tx=0x7f5dd4009040 comp rx=0 tx=0).stop 2024-08-17T02:22:52.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.246+0000 7f5df0bcd700 1 -- 172.21.15.104:0/4152818014 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dec06df10 msgr2=0x7f5dec169730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:52.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.246+0000 7f5df0bcd700 1 --2- 172.21.15.104:0/4152818014 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dec06df10 0x7f5dec169730 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc0030c0 tx=0x7f5ddc016000 comp rx=0 tx=0).stop 2024-08-17T02:22:52.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.246+0000 7f5df0bcd700 1 -- 172.21.15.104:0/4152818014 shutdown_connections 2024-08-17T02:22:52.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.246+0000 7f5df0bcd700 1 --2- 172.21.15.104:0/4152818014 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f5dd0060890 0x7f5dd0062d40 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:52.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.246+0000 7f5df0bcd700 1 --2- 172.21.15.104:0/4152818014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5dec155d20 0x7f5dec151660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:52.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.246+0000 7f5df0bcd700 1 --2- 172.21.15.104:0/4152818014 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5dec0ad7c0 0x7f5dec16d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:52.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.246+0000 7f5df0bcd700 1 --2- 172.21.15.104:0/4152818014 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dec06df10 0x7f5dec169730 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:52.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.246+0000 7f5df0bcd700 1 -- 172.21.15.104:0/4152818014 >> 172.21.15.104:0/4152818014 conn(0x7f5dec0678d0 msgr2=0x7f5dec143a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:52.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.246+0000 7f5df0bcd700 1 -- 172.21.15.104:0/4152818014 shutdown_connections 2024-08-17T02:22:52.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.246+0000 7f5df0bcd700 1 -- 172.21.15.104:0/4152818014 wait complete. 2024-08-17T02:22:52.252 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 7 2024-08-17T02:22:52.265 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:22:52.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.366+0000 7ffa36d28700 1 Processor -- start 2024-08-17T02:22:52.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.366+0000 7ffa36d28700 1 -- start start 2024-08-17T02:22:52.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.366+0000 7ffa36d28700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa30156220 0x7ffa30160f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:52.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.366+0000 7ffa36d28700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa300afc10 con 0x7ffa30155e50 2024-08-17T02:22:52.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.370+0000 7ffa36d28700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa300b10b0 con 0x7ffa300aa5f0 2024-08-17T02:22:52.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.370+0000 7ffa36d28700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa300aed20 con 0x7ffa30156220 2024-08-17T02:22:52.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.370+0000 7ffa34ac4700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7ffa30155e50 0x7ffa300a9ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:59494/0 (socket says 172.21.15.104:59494) 2024-08-17T02:22:52.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.370+0000 7ffa34ac4700 1 -- 172.21.15.104:0/744245576 learned_addr learned my addr 172.21.15.104:0/744245576 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:52.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.370+0000 7ffa352c5700 1 --2- 172.21.15.104:0/744245576 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa30156220 0x7ffa30160f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:52.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.370+0000 7ffa2f7fe700 1 -- 172.21.15.104:0/744245576 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 285706589 0 0) 0x7ffa300afc10 con 0x7ffa30155e50 2024-08-17T02:22:52.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.370+0000 7ffa2f7fe700 1 -- 172.21.15.104:0/744245576 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa18003570 con 0x7ffa30155e50 2024-08-17T02:22:52.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.370+0000 7ffa2f7fe700 1 -- 172.21.15.104:0/744245576 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3906615672 0 0) 0x7ffa300b10b0 con 0x7ffa300aa5f0 2024-08-17T02:22:52.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.370+0000 7ffa2f7fe700 1 -- 172.21.15.104:0/744245576 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa300afc10 con 0x7ffa300aa5f0 2024-08-17T02:22:52.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.370+0000 7ffa352c5700 1 -- 172.21.15.104:0/744245576 >> v1:172.21.15.117:6789/0 conn(0x7ffa300aa5f0 legacy=0x7ffa3006ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:52.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.370+0000 7ffa352c5700 1 -- 172.21.15.104:0/744245576 >> v1:172.21.15.104:6789/0 conn(0x7ffa30155e50 legacy=0x7ffa300a9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:52.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.370+0000 7ffa352c5700 1 -- 172.21.15.104:0/744245576 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa300af000 con 0x7ffa30156220 2024-08-17T02:22:52.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.370+0000 7ffa352c5700 1 --2- 172.21.15.104:0/744245576 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa30156220 0x7ffa30160f50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ffa28009f10 tx=0x7ffa28009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc8265ec77dcee8a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:52.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.370+0000 7ffa2f7fe700 1 -- 172.21.15.104:0/744245576 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2800dd90 con 0x7ffa30156220 2024-08-17T02:22:52.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.370+0000 7ffa2f7fe700 1 -- 172.21.15.104:0/744245576 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa28011460 con 0x7ffa30156220 2024-08-17T02:22:52.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.370+0000 7ffa2f7fe700 1 -- 172.21.15.104:0/744245576 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa280117e0 con 0x7ffa30156220 2024-08-17T02:22:52.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.370+0000 7ffa36d28700 1 -- 172.21.15.104:0/744245576 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa30156220 msgr2=0x7ffa30160f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:52.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.370+0000 7ffa36d28700 1 --2- 172.21.15.104:0/744245576 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa30156220 0x7ffa30160f50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ffa28009f10 tx=0x7ffa28009780 comp rx=0 tx=0).stop 2024-08-17T02:22:52.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.370+0000 7ffa36d28700 1 -- 172.21.15.104:0/744245576 shutdown_connections 2024-08-17T02:22:52.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.370+0000 7ffa36d28700 1 --2- 172.21.15.104:0/744245576 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa30156220 0x7ffa30160f50 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:52.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.370+0000 7ffa36d28700 1 -- 172.21.15.104:0/744245576 >> 172.21.15.104:0/744245576 conn(0x7ffa30066e00 msgr2=0x7ffa30067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:52.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.370+0000 7ffa36d28700 1 -- 172.21.15.104:0/744245576 shutdown_connections 2024-08-17T02:22:52.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.370+0000 7ffa36d28700 1 -- 172.21.15.104:0/744245576 wait complete. 2024-08-17T02:22:52.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.374+0000 7ffa36d28700 1 Processor -- start 2024-08-17T02:22:52.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.374+0000 7ffa36d28700 1 -- start start 2024-08-17T02:22:52.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.374+0000 7ffa36d28700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa300aa5f0 0x7ffa30150d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:52.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.374+0000 7ffa36d28700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffa30155e50 0x7ffa30099410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:52.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.374+0000 7ffa36d28700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa30156220 0x7ffa3013d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:52.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.374+0000 7ffa36d28700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa300c92f0 con 0x7ffa30155e50 2024-08-17T02:22:52.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.374+0000 7ffa36d28700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa300c8a30 con 0x7ffa300aa5f0 2024-08-17T02:22:52.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.374+0000 7ffa36d28700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa30099950 con 0x7ffa30156220 2024-08-17T02:22:52.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.374+0000 7ffa2ffff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffa30155e50 0x7ffa30099410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:52.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.374+0000 7ffa2ffff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffa30155e50 0x7ffa30099410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45216/0 (socket says 172.21.15.104:45216) 2024-08-17T02:22:52.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.374+0000 7ffa2ffff700 1 -- 172.21.15.104:0/1432873211 learned_addr learned my addr 172.21.15.104:0/1432873211 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:52.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.374+0000 7ffa34ac4700 1 --2- 172.21.15.104:0/1432873211 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa300aa5f0 0x7ffa30150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:52.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.374+0000 7ffa352c5700 1 --2- 172.21.15.104:0/1432873211 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa30156220 0x7ffa3013d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:52.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.374+0000 7ffa2ffff700 1 -- 172.21.15.104:0/1432873211 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa30156220 msgr2=0x7ffa3013d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:52.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.374+0000 7ffa2ffff700 1 --2- 172.21.15.104:0/1432873211 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa30156220 0x7ffa3013d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:52.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.374+0000 7ffa2ffff700 1 -- 172.21.15.104:0/1432873211 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa300aa5f0 msgr2=0x7ffa30150d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:52.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.374+0000 7ffa2ffff700 1 --2- 172.21.15.104:0/1432873211 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa300aa5f0 0x7ffa30150d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:52.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.374+0000 7ffa2ffff700 1 -- 172.21.15.104:0/1432873211 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa28009a20 con 0x7ffa30155e50 2024-08-17T02:22:52.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.374+0000 7ffa352c5700 1 --2- 172.21.15.104:0/1432873211 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa30156220 0x7ffa3013d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:22:52.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.374+0000 7ffa2ffff700 1 --2- 172.21.15.104:0/1432873211 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffa30155e50 0x7ffa30099410 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ffa2400c5c0 tx=0x7ffa24007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:52.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.374+0000 7ffa2cff9700 1 -- 172.21.15.104:0/1432873211 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa24010510 con 0x7ffa30155e50 2024-08-17T02:22:52.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.374+0000 7ffa2cff9700 1 -- 172.21.15.104:0/1432873211 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa240106b0 con 0x7ffa30155e50 2024-08-17T02:22:52.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.374+0000 7ffa36d28700 1 -- 172.21.15.104:0/1432873211 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa300c8ca0 con 0x7ffa30155e50 2024-08-17T02:22:52.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.374+0000 7ffa2cff9700 1 -- 172.21.15.104:0/1432873211 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa24010a70 con 0x7ffa30155e50 2024-08-17T02:22:52.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.374+0000 7ffa36d28700 1 -- 172.21.15.104:0/1432873211 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa30099c20 con 0x7ffa30155e50 2024-08-17T02:22:52.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.378+0000 7ffa36d28700 1 -- 172.21.15.104:0/1432873211 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa300c9460 con 0x7ffa30155e50 2024-08-17T02:22:52.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.378+0000 7ffa2cff9700 1 -- 172.21.15.104:0/1432873211 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ffa24012440 con 0x7ffa30155e50 2024-08-17T02:22:52.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.378+0000 7ffa2cff9700 1 --2- 172.21.15.104:0/1432873211 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ffa1c060890 0x7ffa1c062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:52.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.378+0000 7ffa2cff9700 1 -- 172.21.15.104:0/1432873211 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffa2407c1b0 con 0x7ffa30155e50 2024-08-17T02:22:52.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.378+0000 7ffa34ac4700 1 --2- 172.21.15.104:0/1432873211 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ffa1c060890 0x7ffa1c062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:52.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.378+0000 7ffa34ac4700 1 --2- 172.21.15.104:0/1432873211 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ffa1c060890 0x7ffa1c062d40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ffa20007fd0 tx=0x7ffa20009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:52.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.386+0000 7ffa2cff9700 1 -- 172.21.15.104:0/1432873211 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ffa2404a480 con 0x7ffa30155e50 2024-08-17T02:22:52.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.534+0000 7ffa36d28700 1 -- 172.21.15.104:0/1432873211 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa300645c0 con 0x7ffa30155e50 2024-08-17T02:22:52.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.538+0000 7ffa2cff9700 1 -- 172.21.15.104:0/1432873211 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+15398 (secure 0 0 0) 0x7ffa24017090 con 0x7ffa30155e50 2024-08-17T02:22:52.540 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:22:52.540 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":23,"fsid":"fd5f7fb8-d34b-49bb-89a8-62b7dad1bc25","created":"2024-08-17T02:21:57.891389+0000","modified":"2024-08-17T02:22:23.175831+0000","last_up_change":"2024-08-17T02:22:08.924546+0000","last_in_change":"2024-08-17T02:21:59.938028+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:22:10.143970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:22:20.082708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:22:20.521582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"606b9088-590e-4709-aa3a-b0f6e22972ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":24257},{"type":"v1","addr":"172.21.15.104:6809","nonce":24257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":24257},{"type":"v1","addr":"172.21.15.104:6811","nonce":24257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":24257},{"type":"v1","addr":"172.21.15.104:6815","nonce":24257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":24257},{"type":"v1","addr":"172.21.15.104:6813","nonce":24257}]},"public_addr":"172.21.15.104:6809/24257","cluster_addr":"172.21.15.104:6811/24257","heartbeat_back_addr":"172.21.15.104:6815/24257","heartbeat_front_addr":"172.21.15.104:6813/24257","state":["exists","up"]},{"osd":1,"uuid":"9bc6a909-0c2f-4889-afe7-4a47f89b0f64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":24256},{"type":"v1","addr":"172.21.15.104:6825","nonce":24256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":24256},{"type":"v1","addr":"172.21.15.104:6827","nonce":24256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":24256},{"type":"v1","addr":"172.21.15.104:6831","nonce":24256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":24256},{"type":"v1","addr":"172.21.15.104:6829","nonce":24256}]},"public_addr":"172.21.15.104:6825/24256","cluster_addr":"172.21.15.104:6827/24256","heartbeat_back_addr":"172.21.15.104:6831/24256","heartbeat_front_addr":"172.21.15.104:6829/24256","state":["exists","up"]},{"osd":2,"uuid":"23da31d5-aefb-4edb-b79d-fa05e1becef7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":24255},{"type":"v1","addr":"172.21.15.104:6817","nonce":24255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":24255},{"type":"v1","addr":"172.21.15.104:6819","nonce":24255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":24255},{"type":"v1","addr":"172.21.15.104:6823","nonce":24255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":24255},{"type":"v1","addr":"172.21.15.104:6821","nonce":24255}]},"public_addr":"172.21.15.104:6817/24255","cluster_addr":"172.21.15.104:6819/24255","heartbeat_back_addr":"172.21.15.104:6823/24255","heartbeat_front_addr":"172.21.15.104:6821/24255","state":["exists","up"]},{"osd":3,"uuid":"6e4a5ec2-b415-45ef-8381-61a59eb65224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":24254},{"type":"v1","addr":"172.21.15.104:6801","nonce":24254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":24254},{"type":"v1","addr":"172.21.15.104:6803","nonce":24254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":24254},{"type":"v1","addr":"172.21.15.104:6807","nonce":24254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":24254},{"type":"v1","addr":"172.21.15.104:6805","nonce":24254}]},"public_addr":"172.21.15.104:6801/24254","cluster_addr":"172.21.15.104:6803/24254","heartbeat_back_addr":"172.21.15.104:6807/24254","heartbeat_front_addr":"172.21.15.104:6805/24254","state":["exists","up"]},{"osd":4,"uuid":"8d5bea2d-9039-4013-8c99-2c046c5b8a17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":24421},{"type":"v1","addr":"172.21.15.117:6804","nonce":24421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":24421},{"type":"v1","addr":"172.21.15.117:6809","nonce":24421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":24421},{"type":"v1","addr":"172.21.15.117:6815","nonce":24421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":24421},{"type":"v1","addr":"172.21.15.117:6813","nonce":24421}]},"public_addr":"172.21.15.117:6804/24421","cluster_addr":"172.21.15.117:6809/24421","heartbeat_back_addr":"172.21.15.117:6815/24421","heartbeat_front_addr":"172.21.15.117:6813/24421","state":["exists","up"]},{"osd":5,"uuid":"de8b36fc-121c-4f05-8f5b-28f513d9f21f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":24422},{"type":"v1","addr":"172.21.15.117:6817","nonce":24422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":24422},{"type":"v1","addr":"172.21.15.117:6819","nonce":24422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":24422},{"type":"v1","addr":"172.21.15.117:6823","nonce":24422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":24422},{"type":"v1","addr":"172.21.15.117:6821","nonce":24422}]},"public_addr":"172.21.15.117:6817/24422","cluster_addr":"172.21.15.117:6819/24422","heartbeat_back_addr":"172.21.15.117:6823/24422","heartbeat_front_addr":"172.21.15.117:6821/24422","state":["exists","up"]},{"osd":6,"uuid":"6a87f09f-7bf7-4f7a-be87-530ac1ff8ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":24420},{"type":"v1","addr":"172.21.15.117:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6803","nonce":24420},{"type":"v1","addr":"172.21.15.117:6805","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":24420},{"type":"v1","addr":"172.21.15.117:6811","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":24420},{"type":"v1","addr":"172.21.15.117:6808","nonce":24420}]},"public_addr":"172.21.15.117:6801/24420","cluster_addr":"172.21.15.117:6805/24420","heartbeat_back_addr":"172.21.15.117:6811/24420","heartbeat_front_addr":"172.21.15.117:6808/24420","state":["exists","up"]},{"osd":7,"uuid":"e31d8041-1aa1-4b5d-83b3-0a373426dd9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":24423},{"type":"v1","addr":"172.21.15.117:6825","nonce":24423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":24423},{"type":"v1","addr":"172.21.15.117:6827","nonce":24423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":24423},{"type":"v1","addr":"172.21.15.117:6831","nonce":24423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":24423},{"type":"v1","addr":"172.21.15.117:6829","nonce":24423}]},"public_addr":"172.21.15.117:6825/24423","cluster_addr":"172.21.15.117:6827/24423","heartbeat_back_addr":"172.21.15.117:6831/24423","heartbeat_front_addr":"172.21.15.117:6829/24423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.220874+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.210039+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.434762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.247206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.184316+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.306325+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.035719+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.400303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:22:52.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.538+0000 7ffa36d28700 1 -- 172.21.15.104:0/1432873211 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ffa1c060890 msgr2=0x7ffa1c062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:52.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.538+0000 7ffa36d28700 1 --2- 172.21.15.104:0/1432873211 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ffa1c060890 0x7ffa1c062d40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ffa20007fd0 tx=0x7ffa20009040 comp rx=0 tx=0).stop 2024-08-17T02:22:52.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.538+0000 7ffa36d28700 1 -- 172.21.15.104:0/1432873211 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffa30155e50 msgr2=0x7ffa30099410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:52.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.538+0000 7ffa36d28700 1 --2- 172.21.15.104:0/1432873211 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffa30155e50 0x7ffa30099410 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ffa2400c5c0 tx=0x7ffa24007de0 comp rx=0 tx=0).stop 2024-08-17T02:22:52.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.538+0000 7ffa36d28700 1 -- 172.21.15.104:0/1432873211 shutdown_connections 2024-08-17T02:22:52.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.538+0000 7ffa36d28700 1 --2- 172.21.15.104:0/1432873211 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ffa1c060890 0x7ffa1c062d40 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:52.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.538+0000 7ffa36d28700 1 --2- 172.21.15.104:0/1432873211 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa30156220 0x7ffa3013d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:52.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.538+0000 7ffa36d28700 1 --2- 172.21.15.104:0/1432873211 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffa30155e50 0x7ffa30099410 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:52.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.538+0000 7ffa36d28700 1 --2- 172.21.15.104:0/1432873211 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa300aa5f0 0x7ffa30150d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:52.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.538+0000 7ffa36d28700 1 -- 172.21.15.104:0/1432873211 >> 172.21.15.104:0/1432873211 conn(0x7ffa30066e00 msgr2=0x7ffa300add70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:52.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.538+0000 7ffa36d28700 1 -- 172.21.15.104:0/1432873211 shutdown_connections 2024-08-17T02:22:52.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.538+0000 7ffa36d28700 1 -- 172.21.15.104:0/1432873211 wait complete. 2024-08-17T02:22:52.553 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:22:10.143970+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:22:20.082708+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:22:20.521582+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:22:52.554 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:22:52.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.662+0000 7f8508dfa700 1 Processor -- start 2024-08-17T02:22:52.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.662+0000 7f8508dfa700 1 -- start start 2024-08-17T02:22:52.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.662+0000 7f8508dfa700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f85041590b0 0x7f8504066e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:52.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.662+0000 7f8508dfa700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85040cd2b0 0x7f8504067340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:52.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.662+0000 7f8508dfa700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85040ce210 con 0x7f8504159480 2024-08-17T02:22:52.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.662+0000 7f8508dfa700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85040cba00 con 0x7f85041590b0 2024-08-17T02:22:52.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.662+0000 7f8508dfa700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85040cdc90 con 0x7f85040cd2b0 2024-08-17T02:22:52.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.662+0000 7f8502ffd700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f8504159480 0x7f850415ce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:59498/0 (socket says 172.21.15.104:59498) 2024-08-17T02:22:52.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.662+0000 7f8502ffd700 1 -- 172.21.15.104:0/630322775 learned_addr learned my addr 172.21.15.104:0/630322775 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:52.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.662+0000 7f85037fe700 1 --2- 172.21.15.104:0/630322775 >> v2:172.21.15.104:3300/0 conn(0x7f85041590b0 0x7f8504066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:52.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.662+0000 7f8503fff700 1 --2- 172.21.15.104:0/630322775 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85040cd2b0 0x7f8504067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:52.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.662+0000 7f85027fc700 1 -- 172.21.15.104:0/630322775 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4003438357 0 0) 0x7f85040ce210 con 0x7f8504159480 2024-08-17T02:22:52.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.662+0000 7f85027fc700 1 -- 172.21.15.104:0/630322775 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84ec003570 con 0x7f8504159480 2024-08-17T02:22:52.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.662+0000 7f85037fe700 1 -- 172.21.15.104:0/630322775 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85040cd2b0 msgr2=0x7f8504067340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:52.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.662+0000 7f85037fe700 1 --2- 172.21.15.104:0/630322775 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85040cd2b0 0x7f8504067340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:52.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.662+0000 7f85037fe700 1 -- 172.21.15.104:0/630322775 >> v1:172.21.15.104:6789/0 conn(0x7f8504159480 legacy=0x7f850415ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:52.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.662+0000 7f85037fe700 1 -- 172.21.15.104:0/630322775 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85040cb440 con 0x7f85041590b0 2024-08-17T02:22:52.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.662+0000 7f85037fe700 1 --2- 172.21.15.104:0/630322775 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85041590b0 0x7f8504066e00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f84f4009e60 tx=0x7f84f4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fa78a20221e5a15 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:52.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.666+0000 7f85027fc700 1 -- 172.21.15.104:0/630322775 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f400e070 con 0x7f85041590b0 2024-08-17T02:22:52.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.666+0000 7f85027fc700 1 -- 172.21.15.104:0/630322775 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f400bb60 con 0x7f85041590b0 2024-08-17T02:22:52.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.666+0000 7f85027fc700 1 -- 172.21.15.104:0/630322775 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f4012430 con 0x7f85041590b0 2024-08-17T02:22:52.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.666+0000 7f8508dfa700 1 -- 172.21.15.104:0/630322775 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85041590b0 msgr2=0x7f8504066e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:52.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.666+0000 7f8508dfa700 1 --2- 172.21.15.104:0/630322775 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85041590b0 0x7f8504066e00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f84f4009e60 tx=0x7f84f4009780 comp rx=0 tx=0).stop 2024-08-17T02:22:52.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.666+0000 7f8508dfa700 1 -- 172.21.15.104:0/630322775 shutdown_connections 2024-08-17T02:22:52.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.666+0000 7f8508dfa700 1 --2- 172.21.15.104:0/630322775 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85040cd2b0 0x7f8504067340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:52.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.666+0000 7f8508dfa700 1 --2- 172.21.15.104:0/630322775 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85041590b0 0x7f8504066e00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:52.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.666+0000 7f8508dfa700 1 -- 172.21.15.104:0/630322775 >> 172.21.15.104:0/630322775 conn(0x7f85040d0b90 msgr2=0x7f85040ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:52.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.666+0000 7f8508dfa700 1 -- 172.21.15.104:0/630322775 shutdown_connections 2024-08-17T02:22:52.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.666+0000 7f8508dfa700 1 -- 172.21.15.104:0/630322775 wait complete. 2024-08-17T02:22:52.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.666+0000 7f8508dfa700 1 Processor -- start 2024-08-17T02:22:52.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.666+0000 7f8508dfa700 1 -- start start 2024-08-17T02:22:52.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.670+0000 7f8508dfa700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85040cd2b0 0x7f8504142460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:52.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.670+0000 7f8508dfa700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85041590b0 0x7f850415ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:52.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.670+0000 7f8508dfa700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8504159480 0x7f850415bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:52.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.670+0000 7f8508dfa700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f850415c500 con 0x7f85040cd2b0 2024-08-17T02:22:52.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.670+0000 7f8508dfa700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f850415b1f0 con 0x7f8504159480 2024-08-17T02:22:52.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.670+0000 7f8508dfa700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f850415a5e0 con 0x7f85041590b0 2024-08-17T02:22:52.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.670+0000 7f85037fe700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85040cd2b0 0x7f8504142460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:52.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.670+0000 7f85037fe700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85040cd2b0 0x7f8504142460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45242/0 (socket says 172.21.15.104:45242) 2024-08-17T02:22:52.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.670+0000 7f85037fe700 1 -- 172.21.15.104:0/2267701932 learned_addr learned my addr 172.21.15.104:0/2267701932 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:52.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.670+0000 7f8502ffd700 1 --2- 172.21.15.104:0/2267701932 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85041590b0 0x7f850415ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:52.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.670+0000 7f8503fff700 1 --2- 172.21.15.104:0/2267701932 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8504159480 0x7f850415bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:52.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.670+0000 7f85037fe700 1 -- 172.21.15.104:0/2267701932 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85041590b0 msgr2=0x7f850415ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:52.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.670+0000 7f85037fe700 1 --2- 172.21.15.104:0/2267701932 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85041590b0 0x7f850415ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:52.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.670+0000 7f85037fe700 1 -- 172.21.15.104:0/2267701932 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8504159480 msgr2=0x7f850415bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:52.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.670+0000 7f85037fe700 1 --2- 172.21.15.104:0/2267701932 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8504159480 0x7f850415bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:52.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.670+0000 7f85037fe700 1 -- 172.21.15.104:0/2267701932 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f4009a20 con 0x7f85040cd2b0 2024-08-17T02:22:52.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.670+0000 7f8502ffd700 1 --2- 172.21.15.104:0/2267701932 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85041590b0 0x7f850415ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:22:52.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.670+0000 7f85037fe700 1 --2- 172.21.15.104:0/2267701932 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85040cd2b0 0x7f8504142460 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f84f4012560 tx=0x7f84f4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:52.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.670+0000 7f84eb7fe700 1 -- 172.21.15.104:0/2267701932 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f4012c40 con 0x7f85040cd2b0 2024-08-17T02:22:52.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.670+0000 7f84eb7fe700 1 -- 172.21.15.104:0/2267701932 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f4012da0 con 0x7f85040cd2b0 2024-08-17T02:22:52.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.670+0000 7f8508dfa700 1 -- 172.21.15.104:0/2267701932 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f850415a8c0 con 0x7f85040cd2b0 2024-08-17T02:22:52.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.670+0000 7f84eb7fe700 1 -- 172.21.15.104:0/2267701932 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f40276c0 con 0x7f85040cd2b0 2024-08-17T02:22:52.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.670+0000 7f8508dfa700 1 -- 172.21.15.104:0/2267701932 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f850415ae80 con 0x7f85040cd2b0 2024-08-17T02:22:52.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.670+0000 7f8508dfa700 1 -- 172.21.15.104:0/2267701932 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8504064330 con 0x7f85040cd2b0 2024-08-17T02:22:52.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.674+0000 7f84eb7fe700 1 -- 172.21.15.104:0/2267701932 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f84f4024070 con 0x7f85040cd2b0 2024-08-17T02:22:52.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.674+0000 7f84eb7fe700 1 --2- 172.21.15.104:0/2267701932 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f84f0060860 0x7f84f0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:52.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.674+0000 7f84eb7fe700 1 -- 172.21.15.104:0/2267701932 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f84f407f1b0 con 0x7f85040cd2b0 2024-08-17T02:22:52.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.674+0000 7f8502ffd700 1 --2- 172.21.15.104:0/2267701932 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f84f0060860 0x7f84f0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:52.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.674+0000 7f8502ffd700 1 --2- 172.21.15.104:0/2267701932 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f84f0060860 0x7f84f0062d10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f85040cf8b0 tx=0x7f84f8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:52.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.682+0000 7f84eb7fe700 1 -- 172.21.15.104:0/2267701932 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f84f404f600 con 0x7f85040cd2b0 2024-08-17T02:22:52.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.846+0000 7f8508dfa700 1 -- 172.21.15.104:0/2267701932 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f85040b0590 con 0x7f85040cd2b0 2024-08-17T02:22:52.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.846+0000 7f84eb7fe700 1 -- 172.21.15.104:0/2267701932 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f84f4052c20 con 0x7f85040cd2b0 2024-08-17T02:22:52.848 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-08-17T02:22:52.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.846+0000 7f8508dfa700 1 -- 172.21.15.104:0/2267701932 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f84f0060860 msgr2=0x7f84f0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:52.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.846+0000 7f8508dfa700 1 --2- 172.21.15.104:0/2267701932 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f84f0060860 0x7f84f0062d10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f85040cf8b0 tx=0x7f84f8009040 comp rx=0 tx=0).stop 2024-08-17T02:22:52.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.846+0000 7f8508dfa700 1 -- 172.21.15.104:0/2267701932 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85040cd2b0 msgr2=0x7f8504142460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:52.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.846+0000 7f8508dfa700 1 --2- 172.21.15.104:0/2267701932 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85040cd2b0 0x7f8504142460 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f84f4012560 tx=0x7f84f4019000 comp rx=0 tx=0).stop 2024-08-17T02:22:52.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.850+0000 7f8508dfa700 1 -- 172.21.15.104:0/2267701932 shutdown_connections 2024-08-17T02:22:52.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.850+0000 7f8508dfa700 1 --2- 172.21.15.104:0/2267701932 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f84f0060860 0x7f84f0062d10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:52.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.850+0000 7f8508dfa700 1 --2- 172.21.15.104:0/2267701932 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8504159480 0x7f850415bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:52.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.850+0000 7f8508dfa700 1 --2- 172.21.15.104:0/2267701932 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85041590b0 0x7f850415ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:52.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.850+0000 7f8508dfa700 1 --2- 172.21.15.104:0/2267701932 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85040cd2b0 0x7f8504142460 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:52.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.850+0000 7f8508dfa700 1 -- 172.21.15.104:0/2267701932 >> 172.21.15.104:0/2267701932 conn(0x7f85040d0b90 msgr2=0x7f85040b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:52.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.850+0000 7f8508dfa700 1 -- 172.21.15.104:0/2267701932 shutdown_connections 2024-08-17T02:22:52.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.850+0000 7f8508dfa700 1 -- 172.21.15.104:0/2267701932 wait complete. 2024-08-17T02:22:52.863 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:22:52.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.970+0000 7f282b59e700 1 Processor -- start 2024-08-17T02:22:52.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.970+0000 7f282b59e700 1 -- start start 2024-08-17T02:22:52.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.970+0000 7f282b59e700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f282c15d2f0 0x7f282c0ac7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:52.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.970+0000 7f282b59e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f282c15d6c0 0x7f282c0aeab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:52.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.970+0000 7f282b59e700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f282c0c8140 con 0x7f282c0acd30 2024-08-17T02:22:52.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.970+0000 7f282b59e700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f282c0b2d80 con 0x7f282c15d2f0 2024-08-17T02:22:52.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.970+0000 7f282b59e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f282c0c7530 con 0x7f282c15d6c0 2024-08-17T02:22:52.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.970+0000 7f282a59c700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f282c15d2f0 0x7f282c0ac7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:52.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.970+0000 7f282a59c700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f282c15d2f0 0x7f282c0ac7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45254/0 (socket says 172.21.15.104:45254) 2024-08-17T02:22:52.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.970+0000 7f282a59c700 1 -- 172.21.15.104:0/2800699905 learned_addr learned my addr 172.21.15.104:0/2800699905 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:52.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.970+0000 7f282ad9d700 1 --2- 172.21.15.104:0/2800699905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f282c15d6c0 0x7f282c0aeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:52.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.970+0000 7f282a59c700 1 -- 172.21.15.104:0/2800699905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f282c15d6c0 msgr2=0x7f282c0aeab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:52.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.970+0000 7f282a59c700 1 --2- 172.21.15.104:0/2800699905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f282c15d6c0 0x7f282c0aeab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:52.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.974+0000 7f282a59c700 1 -- 172.21.15.104:0/2800699905 >> v1:172.21.15.117:6789/0 conn(0x7f282c0acd30 legacy=0x7f282c0b19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:52.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.974+0000 7f282a59c700 1 -- 172.21.15.104:0/2800699905 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f282c0c7810 con 0x7f282c15d2f0 2024-08-17T02:22:52.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.974+0000 7f282a59c700 1 --2- 172.21.15.104:0/2800699905 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f282c15d2f0 0x7f282c0ac7f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f281c0099b0 tx=0x7f281c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ccfced4aaeb34f7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:52.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.974+0000 7f282959a700 1 -- 172.21.15.104:0/2800699905 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c00b860 con 0x7f282c15d2f0 2024-08-17T02:22:52.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.974+0000 7f282959a700 1 -- 172.21.15.104:0/2800699905 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281c00b9c0 con 0x7f282c15d2f0 2024-08-17T02:22:52.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.974+0000 7f282959a700 1 -- 172.21.15.104:0/2800699905 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c00bd60 con 0x7f282c15d2f0 2024-08-17T02:22:52.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.974+0000 7f282b59e700 1 -- 172.21.15.104:0/2800699905 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f282c15d2f0 msgr2=0x7f282c0ac7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:52.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.974+0000 7f282b59e700 1 --2- 172.21.15.104:0/2800699905 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f282c15d2f0 0x7f282c0ac7f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f281c0099b0 tx=0x7f281c009250 comp rx=0 tx=0).stop 2024-08-17T02:22:52.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.974+0000 7f282b59e700 1 -- 172.21.15.104:0/2800699905 shutdown_connections 2024-08-17T02:22:52.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.974+0000 7f282b59e700 1 --2- 172.21.15.104:0/2800699905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f282c15d6c0 0x7f282c0aeab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:52.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.974+0000 7f282b59e700 1 --2- 172.21.15.104:0/2800699905 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f282c15d2f0 0x7f282c0ac7f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:52.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.974+0000 7f282b59e700 1 -- 172.21.15.104:0/2800699905 >> 172.21.15.104:0/2800699905 conn(0x7f282c0c9830 msgr2=0x7f282c0c9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:52.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.974+0000 7f282b59e700 1 -- 172.21.15.104:0/2800699905 shutdown_connections 2024-08-17T02:22:52.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.974+0000 7f282b59e700 1 -- 172.21.15.104:0/2800699905 wait complete. 2024-08-17T02:22:52.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.974+0000 7f282b59e700 1 Processor -- start 2024-08-17T02:22:52.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.974+0000 7f282b59e700 1 -- start start 2024-08-17T02:22:52.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.978+0000 7f282b59e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f282c0acd30 0x7f282c157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:52.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.978+0000 7f282b59e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f282c15d2f0 0x7f282c16dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:52.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.978+0000 7f282b59e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f282c15d6c0 0x7f282c15fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:52.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.978+0000 7f282b59e700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282c15f8a0 con 0x7f282c0acd30 2024-08-17T02:22:52.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.978+0000 7f282b59e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282c158480 con 0x7f282c15d2f0 2024-08-17T02:22:52.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.978+0000 7f282b59e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f282c16e5a0 con 0x7f282c15d6c0 2024-08-17T02:22:52.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.978+0000 7f282a59c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f282c0acd30 0x7f282c157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:52.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.978+0000 7f282a59c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f282c0acd30 0x7f282c157f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45256/0 (socket says 172.21.15.104:45256) 2024-08-17T02:22:52.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.978+0000 7f282a59c700 1 -- 172.21.15.104:0/2611052828 learned_addr learned my addr 172.21.15.104:0/2611052828 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:52.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.978+0000 7f282ad9d700 1 --2- 172.21.15.104:0/2611052828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f282c15d6c0 0x7f282c15fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:52.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.978+0000 7f2829d9b700 1 --2- 172.21.15.104:0/2611052828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f282c15d2f0 0x7f282c16dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:52.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.978+0000 7f282a59c700 1 -- 172.21.15.104:0/2611052828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f282c15d6c0 msgr2=0x7f282c15fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:52.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.978+0000 7f282a59c700 1 --2- 172.21.15.104:0/2611052828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f282c15d6c0 0x7f282c15fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:52.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.978+0000 7f282a59c700 1 -- 172.21.15.104:0/2611052828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f282c15d2f0 msgr2=0x7f282c16dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:52.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.978+0000 7f282a59c700 1 --2- 172.21.15.104:0/2611052828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f282c15d2f0 0x7f282c16dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:52.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.978+0000 7f282a59c700 1 -- 172.21.15.104:0/2611052828 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f281c0094f0 con 0x7f282c0acd30 2024-08-17T02:22:52.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.978+0000 7f282ad9d700 1 --2- 172.21.15.104:0/2611052828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f282c15d6c0 0x7f282c15fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:22:52.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.978+0000 7f282a59c700 1 --2- 172.21.15.104:0/2611052828 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f282c0acd30 0x7f282c157f40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f282c06de30 tx=0x7f281c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:52.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.978+0000 7f281a7fc700 1 -- 172.21.15.104:0/2611052828 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c024440 con 0x7f282c0acd30 2024-08-17T02:22:52.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.978+0000 7f281a7fc700 1 -- 172.21.15.104:0/2611052828 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281c0245a0 con 0x7f282c0acd30 2024-08-17T02:22:52.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.978+0000 7f282b59e700 1 -- 172.21.15.104:0/2611052828 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f282c16e880 con 0x7f282c0acd30 2024-08-17T02:22:52.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.978+0000 7f281a7fc700 1 -- 172.21.15.104:0/2611052828 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c024940 con 0x7f282c0acd30 2024-08-17T02:22:52.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.978+0000 7f282b59e700 1 -- 172.21.15.104:0/2611052828 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f282c15f530 con 0x7f282c0acd30 2024-08-17T02:22:52.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.978+0000 7f282b59e700 1 -- 172.21.15.104:0/2611052828 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f282c0638f0 con 0x7f282c0acd30 2024-08-17T02:22:52.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.982+0000 7f281a7fc700 1 -- 172.21.15.104:0/2611052828 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f281c01a420 con 0x7f282c0acd30 2024-08-17T02:22:52.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.982+0000 7f281a7fc700 1 --2- 172.21.15.104:0/2611052828 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f280c060860 0x7f280c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:52.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.982+0000 7f281a7fc700 1 -- 172.21.15.104:0/2611052828 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f281c07ea30 con 0x7f282c0acd30 2024-08-17T02:22:52.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.982+0000 7f2829d9b700 1 --2- 172.21.15.104:0/2611052828 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f280c060860 0x7f280c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:52.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.982+0000 7f2829d9b700 1 --2- 172.21.15.104:0/2611052828 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f280c060860 0x7f280c062d10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f282c06b720 tx=0x7f2820009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:52.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:52.990+0000 7f281a7fc700 1 -- 172.21.15.104:0/2611052828 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f281c04ef00 con 0x7f282c0acd30 2024-08-17T02:22:53.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.150+0000 7f282b59e700 1 -- 172.21.15.104:0/2611052828 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f282c06b7f0 con 0x7f282c0acd30 2024-08-17T02:22:53.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.150+0000 7f281a7fc700 1 -- 172.21.15.104:0/2611052828 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f281c052520 con 0x7f282c0acd30 2024-08-17T02:22:53.154 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 32 2024-08-17T02:22:53.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.154+0000 7f282b59e700 1 -- 172.21.15.104:0/2611052828 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f280c060860 msgr2=0x7f280c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:53.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.154+0000 7f282b59e700 1 --2- 172.21.15.104:0/2611052828 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f280c060860 0x7f280c062d10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f282c06b720 tx=0x7f2820009040 comp rx=0 tx=0).stop 2024-08-17T02:22:53.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.154+0000 7f282b59e700 1 -- 172.21.15.104:0/2611052828 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f282c0acd30 msgr2=0x7f282c157f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:53.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.154+0000 7f282b59e700 1 --2- 172.21.15.104:0/2611052828 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f282c0acd30 0x7f282c157f40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f282c06de30 tx=0x7f281c017000 comp rx=0 tx=0).stop 2024-08-17T02:22:53.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.154+0000 7f282b59e700 1 -- 172.21.15.104:0/2611052828 shutdown_connections 2024-08-17T02:22:53.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.154+0000 7f282b59e700 1 --2- 172.21.15.104:0/2611052828 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f280c060860 0x7f280c062d10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:53.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.154+0000 7f282b59e700 1 --2- 172.21.15.104:0/2611052828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f282c15d6c0 0x7f282c15fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:53.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.154+0000 7f282b59e700 1 --2- 172.21.15.104:0/2611052828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f282c15d2f0 0x7f282c16dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:53.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.154+0000 7f282b59e700 1 --2- 172.21.15.104:0/2611052828 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f282c0acd30 0x7f282c157f40 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:53.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.154+0000 7f282b59e700 1 -- 172.21.15.104:0/2611052828 >> 172.21.15.104:0/2611052828 conn(0x7f282c0c9830 msgr2=0x7f282c15bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:53.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.154+0000 7f282b59e700 1 -- 172.21.15.104:0/2611052828 shutdown_connections 2024-08-17T02:22:53.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.154+0000 7f282b59e700 1 -- 172.21.15.104:0/2611052828 wait complete. 2024-08-17T02:22:53.167 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:22:53.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.278+0000 7f199b59e700 1 Processor -- start 2024-08-17T02:22:53.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.278+0000 7f199b59e700 1 -- start start 2024-08-17T02:22:53.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.282+0000 7f199b59e700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f199c0cbcc0 0x7f199c15d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:53.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.282+0000 7f199b59e700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f199c0cc350 con 0x7f199c15d9f0 2024-08-17T02:22:53.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.282+0000 7f199b59e700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f199c0cc630 con 0x7f199c0b0390 2024-08-17T02:22:53.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.282+0000 7f199b59e700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f199c0ca760 con 0x7f199c0cbcc0 2024-08-17T02:22:53.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.282+0000 7f199ad9d700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f199c15d9f0 0x7f199c0c2c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:59500/0 (socket says 172.21.15.104:59500) 2024-08-17T02:22:53.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.282+0000 7f199ad9d700 1 -- 172.21.15.104:0/4213229884 learned_addr learned my addr 172.21.15.104:0/4213229884 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:53.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.282+0000 7f1999d9b700 1 --2- 172.21.15.104:0/4213229884 >> v2:172.21.15.117:3300/0 conn(0x7f199c0cbcc0 0x7f199c15d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:53.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.282+0000 7f199959a700 1 -- 172.21.15.104:0/4213229884 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 683467188 0 0) 0x7f199c0cc350 con 0x7f199c15d9f0 2024-08-17T02:22:53.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.282+0000 7f199959a700 1 -- 172.21.15.104:0/4213229884 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1984003570 con 0x7f199c15d9f0 2024-08-17T02:22:53.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.282+0000 7f199959a700 1 -- 172.21.15.104:0/4213229884 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 757454521 0 0) 0x7f199c0cc630 con 0x7f199c0b0390 2024-08-17T02:22:53.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.282+0000 7f199959a700 1 -- 172.21.15.104:0/4213229884 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f199c0cc350 con 0x7f199c0b0390 2024-08-17T02:22:53.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.282+0000 7f199959a700 1 -- 172.21.15.104:0/4213229884 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3101667232 0 0) 0x7f1984003570 con 0x7f199c15d9f0 2024-08-17T02:22:53.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.282+0000 7f199959a700 1 -- 172.21.15.104:0/4213229884 >> v2:172.21.15.117:3300/0 conn(0x7f199c0cbcc0 msgr2=0x7f199c15d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:53.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.282+0000 7f199959a700 1 --2- 172.21.15.104:0/4213229884 >> v2:172.21.15.117:3300/0 conn(0x7f199c0cbcc0 0x7f199c15d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:53.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.282+0000 7f199959a700 1 -- 172.21.15.104:0/4213229884 >> v1:172.21.15.117:6789/0 conn(0x7f199c0b0390 legacy=0x7f199c15cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:53.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.282+0000 7f199959a700 1 -- 172.21.15.104:0/4213229884 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199c0cc910 con 0x7f199c15d9f0 2024-08-17T02:22:53.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.282+0000 7f199959a700 1 -- 172.21.15.104:0/4213229884 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1279957748 0 0) 0x7f19940017f0 con 0x7f199c15d9f0 2024-08-17T02:22:53.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.282+0000 7f199959a700 1 -- 172.21.15.104:0/4213229884 >> v1:172.21.15.104:6789/0 conn(0x7f199c15d9f0 legacy=0x7f199c0c2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:53.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.282+0000 7f199959a700 1 --2- 172.21.15.104:0/4213229884 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1984003c40 0x7f1984004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:53.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.282+0000 7f199959a700 1 --2- 172.21.15.104:0/4213229884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1984004810 0x7f1984004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:53.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.282+0000 7f199959a700 1 --2- 172.21.15.104:0/4213229884 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1984005210 0x7f198400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:53.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.282+0000 7f199959a700 1 -- 172.21.15.104:0/4213229884 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c0ca760 con 0x7f1984005210 2024-08-17T02:22:53.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.282+0000 7f199959a700 1 -- 172.21.15.104:0/4213229884 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198400c130 con 0x7f1984004810 2024-08-17T02:22:53.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.282+0000 7f199959a700 1 -- 172.21.15.104:0/4213229884 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f198400c2c0 con 0x7f1984003c40 2024-08-17T02:22:53.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.282+0000 7f199ad9d700 1 --2- 172.21.15.104:0/4213229884 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1984005210 0x7f198400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:53.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.282+0000 7f199a59c700 1 --2- 172.21.15.104:0/4213229884 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1984003c40 0x7f1984004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:53.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.282+0000 7f1999d9b700 1 --2- 172.21.15.104:0/4213229884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1984004810 0x7f1984004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:53.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.282+0000 7f199ad9d700 1 -- 172.21.15.104:0/4213229884 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1984003c40 msgr2=0x7f1984004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:53.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.282+0000 7f199ad9d700 1 --2- 172.21.15.104:0/4213229884 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1984003c40 0x7f1984004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:53.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.282+0000 7f199ad9d700 1 -- 172.21.15.104:0/4213229884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1984004810 msgr2=0x7f1984004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:53.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.282+0000 7f199ad9d700 1 --2- 172.21.15.104:0/4213229884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1984004810 0x7f1984004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:53.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.282+0000 7f199ad9d700 1 -- 172.21.15.104:0/4213229884 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1984003570 con 0x7f1984005210 2024-08-17T02:22:53.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.282+0000 7f1999d9b700 1 --2- 172.21.15.104:0/4213229884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1984004810 0x7f1984004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:22:53.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.282+0000 7f199ad9d700 1 -- 172.21.15.104:0/4213229884 reap_dead start 2024-08-17T02:22:53.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.282+0000 7f199ad9d700 1 --2- 172.21.15.104:0/4213229884 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1984005210 0x7f198400ba60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f199400a820 tx=0x7f19940020c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=637c310bcf00be1d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:53.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.282+0000 7f199959a700 1 -- 172.21.15.104:0/4213229884 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19940070d0 con 0x7f1984005210 2024-08-17T02:22:53.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.282+0000 7f199959a700 1 -- 172.21.15.104:0/4213229884 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1994007270 con 0x7f1984005210 2024-08-17T02:22:53.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.282+0000 7f199959a700 1 -- 172.21.15.104:0/4213229884 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1994007630 con 0x7f1984005210 2024-08-17T02:22:53.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.286+0000 7f199b59e700 1 -- 172.21.15.104:0/4213229884 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1984005210 msgr2=0x7f198400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:53.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.286+0000 7f199b59e700 1 --2- 172.21.15.104:0/4213229884 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1984005210 0x7f198400ba60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f199400a820 tx=0x7f19940020c0 comp rx=0 tx=0).stop 2024-08-17T02:22:53.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.286+0000 7f199b59e700 1 -- 172.21.15.104:0/4213229884 shutdown_connections 2024-08-17T02:22:53.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.286+0000 7f199b59e700 1 --2- 172.21.15.104:0/4213229884 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1984005210 0x7f198400ba60 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:53.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.286+0000 7f199b59e700 1 -- 172.21.15.104:0/4213229884 >> 172.21.15.104:0/4213229884 conn(0x7f199c0cdee0 msgr2=0x7f199c0ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:53.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.286+0000 7f199b59e700 1 -- 172.21.15.104:0/4213229884 shutdown_connections 2024-08-17T02:22:53.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.286+0000 7f199b59e700 1 -- 172.21.15.104:0/4213229884 wait complete. 2024-08-17T02:22:53.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.286+0000 7f199b59e700 1 Processor -- start 2024-08-17T02:22:53.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.286+0000 7f199b59e700 1 -- start start 2024-08-17T02:22:53.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.290+0000 7f199b59e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1984005210 0x7f199c16d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:53.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.290+0000 7f199b59e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f199c1573c0 0x7f199c0b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:53.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.290+0000 7f199b59e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f199c0b2230 0x7f199c155700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:53.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.290+0000 7f199b59e700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c0c6600 con 0x7f1984005210 2024-08-17T02:22:53.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.290+0000 7f199b59e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c0c6810 con 0x7f199c1573c0 2024-08-17T02:22:53.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.290+0000 7f199b59e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f199c16d720 con 0x7f199c0b2230 2024-08-17T02:22:53.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.290+0000 7f199a59c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1984005210 0x7f199c16d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:53.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.290+0000 7f199a59c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1984005210 0x7f199c16d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45266/0 (socket says 172.21.15.104:45266) 2024-08-17T02:22:53.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.290+0000 7f199a59c700 1 -- 172.21.15.104:0/755159416 learned_addr learned my addr 172.21.15.104:0/755159416 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:53.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.290+0000 7f1999d9b700 1 --2- 172.21.15.104:0/755159416 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f199c1573c0 0x7f199c0b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:53.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.290+0000 7f199ad9d700 1 --2- 172.21.15.104:0/755159416 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f199c0b2230 0x7f199c155700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:53.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.290+0000 7f199a59c700 1 -- 172.21.15.104:0/755159416 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f199c0b2230 msgr2=0x7f199c155700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:53.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.290+0000 7f199a59c700 1 --2- 172.21.15.104:0/755159416 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f199c0b2230 0x7f199c155700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:53.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.290+0000 7f199a59c700 1 -- 172.21.15.104:0/755159416 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f199c1573c0 msgr2=0x7f199c0b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:53.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.290+0000 7f199a59c700 1 --2- 172.21.15.104:0/755159416 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f199c1573c0 0x7f199c0b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:53.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.290+0000 7f199a59c700 1 -- 172.21.15.104:0/755159416 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199c15f300 con 0x7f1984005210 2024-08-17T02:22:53.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.290+0000 7f199a59c700 1 --2- 172.21.15.104:0/755159416 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1984005210 0x7f199c16d1e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f198c002be0 tx=0x7f198c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:53.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.290+0000 7f198a7fc700 1 -- 172.21.15.104:0/755159416 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c00f9a0 con 0x7f1984005210 2024-08-17T02:22:53.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.290+0000 7f198a7fc700 1 -- 172.21.15.104:0/755159416 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f198c00fb00 con 0x7f1984005210 2024-08-17T02:22:53.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.290+0000 7f198a7fc700 1 -- 172.21.15.104:0/755159416 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c00fec0 con 0x7f1984005210 2024-08-17T02:22:53.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.290+0000 7f199b59e700 1 -- 172.21.15.104:0/755159416 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f199c15f5e0 con 0x7f1984005210 2024-08-17T02:22:53.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.290+0000 7f199b59e700 1 -- 172.21.15.104:0/755159416 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f199c0c6a80 con 0x7f1984005210 2024-08-17T02:22:53.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.290+0000 7f199b59e700 1 -- 172.21.15.104:0/755159416 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f199c0638f0 con 0x7f1984005210 2024-08-17T02:22:53.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.294+0000 7f198a7fc700 1 -- 172.21.15.104:0/755159416 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f198c0133f0 con 0x7f1984005210 2024-08-17T02:22:53.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.294+0000 7f198a7fc700 1 --2- 172.21.15.104:0/755159416 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f197c060860 0x7f197c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:53.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.294+0000 7f198a7fc700 1 -- 172.21.15.104:0/755159416 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f198c07ce00 con 0x7f1984005210 2024-08-17T02:22:53.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.294+0000 7f1999d9b700 1 --2- 172.21.15.104:0/755159416 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f197c060860 0x7f197c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:53.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.294+0000 7f1999d9b700 1 --2- 172.21.15.104:0/755159416 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f197c060860 0x7f197c062d10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f199c16c760 tx=0x7f1990008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:53.303 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.302+0000 7f198a7fc700 1 -- 172.21.15.104:0/755159416 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f198c04d270 con 0x7f1984005210 2024-08-17T02:22:53.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.462+0000 7f199b59e700 1 -- 172.21.15.104:0/755159416 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f199c156d80 con 0x7f1984005210 2024-08-17T02:22:53.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.466+0000 7f198a7fc700 1 -- 172.21.15.104:0/755159416 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f198c050890 con 0x7f1984005210 2024-08-17T02:22:53.467 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 64 2024-08-17T02:22:53.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.466+0000 7f199b59e700 1 -- 172.21.15.104:0/755159416 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f197c060860 msgr2=0x7f197c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:53.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.466+0000 7f199b59e700 1 --2- 172.21.15.104:0/755159416 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f197c060860 0x7f197c062d10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f199c16c760 tx=0x7f1990008040 comp rx=0 tx=0).stop 2024-08-17T02:22:53.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.466+0000 7f199b59e700 1 -- 172.21.15.104:0/755159416 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1984005210 msgr2=0x7f199c16d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:53.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.466+0000 7f199b59e700 1 --2- 172.21.15.104:0/755159416 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1984005210 0x7f199c16d1e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f198c002be0 tx=0x7f198c007d30 comp rx=0 tx=0).stop 2024-08-17T02:22:53.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.466+0000 7f199b59e700 1 -- 172.21.15.104:0/755159416 shutdown_connections 2024-08-17T02:22:53.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.466+0000 7f199b59e700 1 --2- 172.21.15.104:0/755159416 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f197c060860 0x7f197c062d10 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:53.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.466+0000 7f199b59e700 1 --2- 172.21.15.104:0/755159416 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f199c0b2230 0x7f199c155700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:53.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.466+0000 7f199b59e700 1 --2- 172.21.15.104:0/755159416 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f199c1573c0 0x7f199c0b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:53.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.466+0000 7f199b59e700 1 --2- 172.21.15.104:0/755159416 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1984005210 0x7f199c16d1e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:53.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.466+0000 7f199b59e700 1 -- 172.21.15.104:0/755159416 >> 172.21.15.104:0/755159416 conn(0x7f199c0cdee0 msgr2=0x7f199c06bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:53.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.466+0000 7f199b59e700 1 -- 172.21.15.104:0/755159416 shutdown_connections 2024-08-17T02:22:53.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.466+0000 7f199b59e700 1 -- 172.21.15.104:0/755159416 wait complete. 2024-08-17T02:22:53.482 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:22:53.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.590+0000 7f51b3fff700 1 Processor -- start 2024-08-17T02:22:53.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.590+0000 7f51b3fff700 1 -- start start 2024-08-17T02:22:53.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.590+0000 7f51b3fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51b4159040 0x7f51b40cf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:53.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.590+0000 7f51b3fff700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f51b415d5b0 0x7f51b40d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:53.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.590+0000 7f51b3fff700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51b40cf190 con 0x7f51b40d0010 2024-08-17T02:22:53.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.590+0000 7f51b3fff700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51b40d09a0 con 0x7f51b415d5b0 2024-08-17T02:22:53.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.590+0000 7f51b3fff700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b40ce5e0 con 0x7f51b4159040 2024-08-17T02:22:53.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.590+0000 7f51b2ffd700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51b4159040 0x7f51b40cf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:53.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.590+0000 7f51b27fc700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f51b40d0010 0x7f51b415cea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.104:36888/0 (socket says 172.21.15.104:36888) 2024-08-17T02:22:53.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.590+0000 7f51b37fe700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f51b415d5b0 0x7f51b40d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:53.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.590+0000 7f51b27fc700 1 -- 172.21.15.104:0/426639475 learned_addr learned my addr 172.21.15.104:0/426639475 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:53.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.590+0000 7f51b1ffb700 1 -- 172.21.15.104:0/426639475 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1241616160 0 0) 0x7f51b40cf190 con 0x7f51b40d0010 2024-08-17T02:22:53.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.590+0000 7f51b1ffb700 1 -- 172.21.15.104:0/426639475 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51a0003570 con 0x7f51b40d0010 2024-08-17T02:22:53.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.590+0000 7f51b37fe700 1 -- 172.21.15.104:0/426639475 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51b4159040 msgr2=0x7f51b40cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:53.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.590+0000 7f51b37fe700 1 --2- 172.21.15.104:0/426639475 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51b4159040 0x7f51b40cf620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:53.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.590+0000 7f51b37fe700 1 -- 172.21.15.104:0/426639475 >> v1:172.21.15.117:6789/0 conn(0x7f51b40d0010 legacy=0x7f51b415cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:53.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.590+0000 7f51b37fe700 1 -- 172.21.15.104:0/426639475 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b40ce860 con 0x7f51b415d5b0 2024-08-17T02:22:53.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.590+0000 7f51b2ffd700 1 --2- 172.21.15.104:0/426639475 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51b4159040 0x7f51b40cf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:22:53.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.590+0000 7f51b37fe700 1 --2- 172.21.15.104:0/426639475 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51b415d5b0 0x7f51b40d0460 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f51ac0098e0 tx=0x7f51ac0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=564b9eb32412d7db server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:53.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.594+0000 7f51b1ffb700 1 -- 172.21.15.104:0/426639475 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ac011630 con 0x7f51b415d5b0 2024-08-17T02:22:53.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.594+0000 7f51b1ffb700 1 -- 172.21.15.104:0/426639475 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ac011790 con 0x7f51b415d5b0 2024-08-17T02:22:53.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.594+0000 7f51b1ffb700 1 -- 172.21.15.104:0/426639475 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ac011b30 con 0x7f51b415d5b0 2024-08-17T02:22:53.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.594+0000 7f51b3fff700 1 -- 172.21.15.104:0/426639475 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51b415d5b0 msgr2=0x7f51b40d0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:53.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.594+0000 7f51b3fff700 1 --2- 172.21.15.104:0/426639475 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51b415d5b0 0x7f51b40d0460 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f51ac0098e0 tx=0x7f51ac0091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:53.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.594+0000 7f51b3fff700 1 -- 172.21.15.104:0/426639475 shutdown_connections 2024-08-17T02:22:53.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.594+0000 7f51b3fff700 1 --2- 172.21.15.104:0/426639475 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51b415d5b0 0x7f51b40d0460 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:53.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.594+0000 7f51b3fff700 1 --2- 172.21.15.104:0/426639475 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51b4159040 0x7f51b40cf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:53.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.594+0000 7f51b3fff700 1 -- 172.21.15.104:0/426639475 >> 172.21.15.104:0/426639475 conn(0x7f51b4068250 msgr2=0x7f51b4068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:53.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.594+0000 7f51b3fff700 1 -- 172.21.15.104:0/426639475 shutdown_connections 2024-08-17T02:22:53.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.594+0000 7f51b3fff700 1 -- 172.21.15.104:0/426639475 wait complete. 2024-08-17T02:22:53.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.594+0000 7f51b3fff700 1 Processor -- start 2024-08-17T02:22:53.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.594+0000 7f51b3fff700 1 -- start start 2024-08-17T02:22:53.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.598+0000 7f51b3fff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51b40d0010 0x7f51b416cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:53.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.598+0000 7f51b3fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51b4159040 0x7f51b416d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:53.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.598+0000 7f51b3fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51b415d5b0 0x7f51b415a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:53.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.598+0000 7f51b3fff700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b416ca20 con 0x7f51b40d0010 2024-08-17T02:22:53.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.598+0000 7f51b3fff700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b4152ed0 con 0x7f51b415d5b0 2024-08-17T02:22:53.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.598+0000 7f51b3fff700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b415c0f0 con 0x7f51b4159040 2024-08-17T02:22:53.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.598+0000 7f51b2ffd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51b40d0010 0x7f51b416cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:53.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.598+0000 7f51b2ffd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51b40d0010 0x7f51b416cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45268/0 (socket says 172.21.15.104:45268) 2024-08-17T02:22:53.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.598+0000 7f51b2ffd700 1 -- 172.21.15.104:0/933860960 learned_addr learned my addr 172.21.15.104:0/933860960 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:53.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.598+0000 7f51b37fe700 1 --2- 172.21.15.104:0/933860960 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51b415d5b0 0x7f51b415a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:53.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.598+0000 7f51b27fc700 1 --2- 172.21.15.104:0/933860960 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51b4159040 0x7f51b416d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:53.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.598+0000 7f51b2ffd700 1 -- 172.21.15.104:0/933860960 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51b4159040 msgr2=0x7f51b416d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:53.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.598+0000 7f51b2ffd700 1 --2- 172.21.15.104:0/933860960 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51b4159040 0x7f51b416d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:53.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.598+0000 7f51b2ffd700 1 -- 172.21.15.104:0/933860960 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51b415d5b0 msgr2=0x7f51b415a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:53.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.598+0000 7f51b2ffd700 1 --2- 172.21.15.104:0/933860960 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51b415d5b0 0x7f51b415a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:53.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.598+0000 7f51b2ffd700 1 -- 172.21.15.104:0/933860960 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519c009420 con 0x7f51b40d0010 2024-08-17T02:22:53.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.598+0000 7f51b27fc700 1 --2- 172.21.15.104:0/933860960 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51b4159040 0x7f51b416d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:22:53.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.598+0000 7f51b2ffd700 1 --2- 172.21.15.104:0/933860960 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51b40d0010 0x7f51b416cc00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f519c00ec80 tx=0x7f519c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:53.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.598+0000 7f51aaffd700 1 -- 172.21.15.104:0/933860960 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c00c8f0 con 0x7f51b40d0010 2024-08-17T02:22:53.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.598+0000 7f51aaffd700 1 -- 172.21.15.104:0/933860960 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519c00ca50 con 0x7f51b40d0010 2024-08-17T02:22:53.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.598+0000 7f51b3fff700 1 -- 172.21.15.104:0/933860960 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51ac009420 con 0x7f51b40d0010 2024-08-17T02:22:53.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.598+0000 7f51aaffd700 1 -- 172.21.15.104:0/933860960 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c00cdd0 con 0x7f51b40d0010 2024-08-17T02:22:53.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.598+0000 7f51b3fff700 1 -- 172.21.15.104:0/933860960 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51b415b7c0 con 0x7f51b40d0010 2024-08-17T02:22:53.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.598+0000 7f51b3fff700 1 -- 172.21.15.104:0/933860960 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51b40643a0 con 0x7f51b40d0010 2024-08-17T02:22:53.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.602+0000 7f51aaffd700 1 -- 172.21.15.104:0/933860960 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f519c013680 con 0x7f51b40d0010 2024-08-17T02:22:53.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.602+0000 7f51aaffd700 1 --2- 172.21.15.104:0/933860960 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f5194060890 0x7f5194062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:53.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.602+0000 7f51aaffd700 1 -- 172.21.15.104:0/933860960 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f519c07d2b0 con 0x7f51b40d0010 2024-08-17T02:22:53.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.602+0000 7f51b27fc700 1 --2- 172.21.15.104:0/933860960 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f5194060890 0x7f5194062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:53.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.602+0000 7f51b27fc700 1 --2- 172.21.15.104:0/933860960 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f5194060890 0x7f5194062d40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f51b40ccfe0 tx=0x7f51a4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:53.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.606+0000 7f51aaffd700 1 -- 172.21.15.104:0/933860960 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f519c04d660 con 0x7f51b40d0010 2024-08-17T02:22:53.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.802+0000 7f51b3fff700 1 -- 172.21.15.104:0/933860960 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51b40cd050 con 0x7f51b40d0010 2024-08-17T02:22:53.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.806+0000 7f51aaffd700 1 -- 172.21.15.104:0/933860960 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4603 (secure 0 0 0) 0x7f519c050c80 con 0x7f51b40d0010 2024-08-17T02:22:53.807 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:22:53.808 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/1242386459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":1242386459},{"type":"v1","addr":"172.21.15.104:6835","nonce":1242386459}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/2581980475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2581980475},{"type":"v1","addr":"172.21.15.104:6833","nonce":2581980475}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1039240942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1039240942},{"type":"v1","addr":"172.21.15.117:6835","nonce":1039240942}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:22:21.527207+0000","modified":"2024-08-17T02:22:25.187188+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/4197149840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":4197149840},{"type":"v1","addr":"172.21.15.117:6837","nonce":4197149840}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:22:53.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.806+0000 7f51b3fff700 1 -- 172.21.15.104:0/933860960 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f5194060890 msgr2=0x7f5194062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:53.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.806+0000 7f51b3fff700 1 --2- 172.21.15.104:0/933860960 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f5194060890 0x7f5194062d40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f51b40ccfe0 tx=0x7f51a4009040 comp rx=0 tx=0).stop 2024-08-17T02:22:53.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.806+0000 7f51b3fff700 1 -- 172.21.15.104:0/933860960 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51b40d0010 msgr2=0x7f51b416cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:53.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.806+0000 7f51b3fff700 1 --2- 172.21.15.104:0/933860960 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51b40d0010 0x7f51b416cc00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f519c00ec80 tx=0x7f519c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:53.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.806+0000 7f51b3fff700 1 -- 172.21.15.104:0/933860960 shutdown_connections 2024-08-17T02:22:53.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.806+0000 7f51b3fff700 1 --2- 172.21.15.104:0/933860960 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f5194060890 0x7f5194062d40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:53.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.806+0000 7f51b3fff700 1 --2- 172.21.15.104:0/933860960 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51b415d5b0 0x7f51b415a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:53.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.806+0000 7f51b3fff700 1 --2- 172.21.15.104:0/933860960 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51b4159040 0x7f51b416d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:53.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.806+0000 7f51b3fff700 1 --2- 172.21.15.104:0/933860960 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51b40d0010 0x7f51b416cc00 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:53.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.806+0000 7f51b3fff700 1 -- 172.21.15.104:0/933860960 >> 172.21.15.104:0/933860960 conn(0x7f51b4068250 msgr2=0x7f51b4063060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:53.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.806+0000 7f51b3fff700 1 -- 172.21.15.104:0/933860960 shutdown_connections 2024-08-17T02:22:53.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.806+0000 7f51b3fff700 1 -- 172.21.15.104:0/933860960 wait complete. 2024-08-17T02:22:53.811 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 7 2024-08-17T02:22:53.822 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:22:53.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.926+0000 7fd3597f9700 1 Processor -- start 2024-08-17T02:22:53.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.926+0000 7fd3597f9700 1 -- start start 2024-08-17T02:22:53.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.926+0000 7fd3597f9700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3540af5a0 0x7fd3540af9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:53.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.926+0000 7fd3597f9700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3540a9f60 con 0x7fd3540aff10 2024-08-17T02:22:53.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.926+0000 7fd3597f9700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd35406e6a0 con 0x7fd354155380 2024-08-17T02:22:53.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.926+0000 7fd3597f9700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd35406e4b0 con 0x7fd3540af5a0 2024-08-17T02:22:53.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.926+0000 7fd3537fe700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fd3540aff10 0x7fd354155750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:59512/0 (socket says 172.21.15.104:59512) 2024-08-17T02:22:53.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.926+0000 7fd3537fe700 1 -- 172.21.15.104:0/594951830 learned_addr learned my addr 172.21.15.104:0/594951830 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:53.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.926+0000 7fd3527fc700 1 --2- 172.21.15.104:0/594951830 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3540af5a0 0x7fd3540af9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:53.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.926+0000 7fd351ffb700 1 -- 172.21.15.104:0/594951830 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 698618664 0 0) 0x7fd3540a9f60 con 0x7fd3540aff10 2024-08-17T02:22:53.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.926+0000 7fd351ffb700 1 -- 172.21.15.104:0/594951830 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd334003570 con 0x7fd3540aff10 2024-08-17T02:22:53.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.926+0000 7fd3527fc700 1 -- 172.21.15.104:0/594951830 >> v1:172.21.15.117:6789/0 conn(0x7fd354155380 legacy=0x7fd3540a9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:53.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.926+0000 7fd3527fc700 1 -- 172.21.15.104:0/594951830 >> v1:172.21.15.104:6789/0 conn(0x7fd3540aff10 legacy=0x7fd354155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:53.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.926+0000 7fd3527fc700 1 -- 172.21.15.104:0/594951830 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd35406e980 con 0x7fd3540af5a0 2024-08-17T02:22:53.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.930+0000 7fd3527fc700 1 --2- 172.21.15.104:0/594951830 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3540af5a0 0x7fd3540af9d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd33c009910 tx=0x7fd33c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60ff9534d33caa6a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:53.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.930+0000 7fd351ffb700 1 -- 172.21.15.104:0/594951830 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33c00b680 con 0x7fd3540af5a0 2024-08-17T02:22:53.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.930+0000 7fd351ffb700 1 -- 172.21.15.104:0/594951830 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33c00b7e0 con 0x7fd3540af5a0 2024-08-17T02:22:53.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.930+0000 7fd351ffb700 1 -- 172.21.15.104:0/594951830 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33c00bba0 con 0x7fd3540af5a0 2024-08-17T02:22:53.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.930+0000 7fd3597f9700 1 -- 172.21.15.104:0/594951830 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3540af5a0 msgr2=0x7fd3540af9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:53.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.930+0000 7fd3597f9700 1 --2- 172.21.15.104:0/594951830 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3540af5a0 0x7fd3540af9d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd33c009910 tx=0x7fd33c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:53.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.930+0000 7fd3597f9700 1 -- 172.21.15.104:0/594951830 shutdown_connections 2024-08-17T02:22:53.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.930+0000 7fd3597f9700 1 --2- 172.21.15.104:0/594951830 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3540af5a0 0x7fd3540af9d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:53.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.930+0000 7fd3597f9700 1 -- 172.21.15.104:0/594951830 >> 172.21.15.104:0/594951830 conn(0x7fd354066e00 msgr2=0x7fd354067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:53.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.930+0000 7fd3597f9700 1 -- 172.21.15.104:0/594951830 shutdown_connections 2024-08-17T02:22:53.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.930+0000 7fd3597f9700 1 -- 172.21.15.104:0/594951830 wait complete. 2024-08-17T02:22:53.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.930+0000 7fd3597f9700 1 Processor -- start 2024-08-17T02:22:53.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.930+0000 7fd3597f9700 1 -- start start 2024-08-17T02:22:53.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.934+0000 7fd3597f9700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd3540af5a0 0x7fd35414d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:53.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.934+0000 7fd3597f9700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3540aff10 0x7fd35414ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:53.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.934+0000 7fd3597f9700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd354155380 0x7fd354147440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:53.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.934+0000 7fd3597f9700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35414f210 con 0x7fd3540af5a0 2024-08-17T02:22:53.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.934+0000 7fd3597f9700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd354147c40 con 0x7fd354155380 2024-08-17T02:22:53.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.934+0000 7fd3597f9700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd354147f20 con 0x7fd3540aff10 2024-08-17T02:22:53.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.934+0000 7fd352ffd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd3540af5a0 0x7fd35414d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:53.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.934+0000 7fd3527fc700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3540aff10 0x7fd35414ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:53.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.934+0000 7fd352ffd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd3540af5a0 0x7fd35414d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45282/0 (socket says 172.21.15.104:45282) 2024-08-17T02:22:53.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.934+0000 7fd352ffd700 1 -- 172.21.15.104:0/1999003784 learned_addr learned my addr 172.21.15.104:0/1999003784 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:53.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.934+0000 7fd3537fe700 1 --2- 172.21.15.104:0/1999003784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd354155380 0x7fd354147440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:53.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.934+0000 7fd352ffd700 1 -- 172.21.15.104:0/1999003784 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3540aff10 msgr2=0x7fd35414ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:53.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.934+0000 7fd352ffd700 1 --2- 172.21.15.104:0/1999003784 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3540aff10 0x7fd35414ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:53.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.934+0000 7fd352ffd700 1 -- 172.21.15.104:0/1999003784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd354155380 msgr2=0x7fd354147440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:53.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.934+0000 7fd352ffd700 1 --2- 172.21.15.104:0/1999003784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd354155380 0x7fd354147440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:53.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.934+0000 7fd352ffd700 1 -- 172.21.15.104:0/1999003784 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd33c009420 con 0x7fd3540af5a0 2024-08-17T02:22:53.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.934+0000 7fd352ffd700 1 --2- 172.21.15.104:0/1999003784 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd3540af5a0 0x7fd35414d570 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd34400c5c0 tx=0x7fd34400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:53.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.934+0000 7fd34affd700 1 -- 172.21.15.104:0/1999003784 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd344011590 con 0x7fd3540af5a0 2024-08-17T02:22:53.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.934+0000 7fd34affd700 1 -- 172.21.15.104:0/1999003784 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd344011710 con 0x7fd3540af5a0 2024-08-17T02:22:53.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.934+0000 7fd3597f9700 1 -- 172.21.15.104:0/1999003784 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd35414f420 con 0x7fd3540af5a0 2024-08-17T02:22:53.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.934+0000 7fd34affd700 1 -- 172.21.15.104:0/1999003784 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd344011ad0 con 0x7fd3540af5a0 2024-08-17T02:22:53.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.934+0000 7fd3597f9700 1 -- 172.21.15.104:0/1999003784 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd35414f9e0 con 0x7fd3540af5a0 2024-08-17T02:22:53.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.934+0000 7fd3597f9700 1 -- 172.21.15.104:0/1999003784 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3540645c0 con 0x7fd3540af5a0 2024-08-17T02:22:53.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.938+0000 7fd34affd700 1 -- 172.21.15.104:0/1999003784 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd34401b3b0 con 0x7fd3540af5a0 2024-08-17T02:22:53.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.938+0000 7fd34affd700 1 --2- 172.21.15.104:0/1999003784 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fd338060860 0x7fd338062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:53.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.938+0000 7fd34affd700 1 -- 172.21.15.104:0/1999003784 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd34407c1f0 con 0x7fd3540af5a0 2024-08-17T02:22:53.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.938+0000 7fd3527fc700 1 --2- 172.21.15.104:0/1999003784 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fd338060860 0x7fd338062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:53.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.938+0000 7fd3527fc700 1 --2- 172.21.15.104:0/1999003784 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fd338060860 0x7fd338062d10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd33c0093f0 tx=0x7fd33c017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:53.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:53.942+0000 7fd34affd700 1 -- 172.21.15.104:0/1999003784 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd34404c5a0 con 0x7fd3540af5a0 2024-08-17T02:22:54.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.106+0000 7fd3597f9700 1 -- 172.21.15.104:0/1999003784 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3540add90 con 0x7fd3540af5a0 2024-08-17T02:22:54.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.106+0000 7fd34affd700 1 -- 172.21.15.104:0/1999003784 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fd344017090 con 0x7fd3540af5a0 2024-08-17T02:22:54.110 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:22:54.111 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":23,"fsid":"fd5f7fb8-d34b-49bb-89a8-62b7dad1bc25","created":"2024-08-17T02:21:57.891389+0000","modified":"2024-08-17T02:22:23.175831+0000","last_up_change":"2024-08-17T02:22:08.924546+0000","last_in_change":"2024-08-17T02:21:59.938028+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:22:10.143970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:22:20.082708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:22:20.521582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"606b9088-590e-4709-aa3a-b0f6e22972ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":24257},{"type":"v1","addr":"172.21.15.104:6809","nonce":24257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":24257},{"type":"v1","addr":"172.21.15.104:6811","nonce":24257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":24257},{"type":"v1","addr":"172.21.15.104:6815","nonce":24257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":24257},{"type":"v1","addr":"172.21.15.104:6813","nonce":24257}]},"public_addr":"172.21.15.104:6809/24257","cluster_addr":"172.21.15.104:6811/24257","heartbeat_back_addr":"172.21.15.104:6815/24257","heartbeat_front_addr":"172.21.15.104:6813/24257","state":["exists","up"]},{"osd":1,"uuid":"9bc6a909-0c2f-4889-afe7-4a47f89b0f64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":24256},{"type":"v1","addr":"172.21.15.104:6825","nonce":24256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":24256},{"type":"v1","addr":"172.21.15.104:6827","nonce":24256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":24256},{"type":"v1","addr":"172.21.15.104:6831","nonce":24256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":24256},{"type":"v1","addr":"172.21.15.104:6829","nonce":24256}]},"public_addr":"172.21.15.104:6825/24256","cluster_addr":"172.21.15.104:6827/24256","heartbeat_back_addr":"172.21.15.104:6831/24256","heartbeat_front_addr":"172.21.15.104:6829/24256","state":["exists","up"]},{"osd":2,"uuid":"23da31d5-aefb-4edb-b79d-fa05e1becef7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":24255},{"type":"v1","addr":"172.21.15.104:6817","nonce":24255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":24255},{"type":"v1","addr":"172.21.15.104:6819","nonce":24255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":24255},{"type":"v1","addr":"172.21.15.104:6823","nonce":24255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":24255},{"type":"v1","addr":"172.21.15.104:6821","nonce":24255}]},"public_addr":"172.21.15.104:6817/24255","cluster_addr":"172.21.15.104:6819/24255","heartbeat_back_addr":"172.21.15.104:6823/24255","heartbeat_front_addr":"172.21.15.104:6821/24255","state":["exists","up"]},{"osd":3,"uuid":"6e4a5ec2-b415-45ef-8381-61a59eb65224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":24254},{"type":"v1","addr":"172.21.15.104:6801","nonce":24254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":24254},{"type":"v1","addr":"172.21.15.104:6803","nonce":24254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":24254},{"type":"v1","addr":"172.21.15.104:6807","nonce":24254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":24254},{"type":"v1","addr":"172.21.15.104:6805","nonce":24254}]},"public_addr":"172.21.15.104:6801/24254","cluster_addr":"172.21.15.104:6803/24254","heartbeat_back_addr":"172.21.15.104:6807/24254","heartbeat_front_addr":"172.21.15.104:6805/24254","state":["exists","up"]},{"osd":4,"uuid":"8d5bea2d-9039-4013-8c99-2c046c5b8a17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":24421},{"type":"v1","addr":"172.21.15.117:6804","nonce":24421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":24421},{"type":"v1","addr":"172.21.15.117:6809","nonce":24421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":24421},{"type":"v1","addr":"172.21.15.117:6815","nonce":24421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":24421},{"type":"v1","addr":"172.21.15.117:6813","nonce":24421}]},"public_addr":"172.21.15.117:6804/24421","cluster_addr":"172.21.15.117:6809/24421","heartbeat_back_addr":"172.21.15.117:6815/24421","heartbeat_front_addr":"172.21.15.117:6813/24421","state":["exists","up"]},{"osd":5,"uuid":"de8b36fc-121c-4f05-8f5b-28f513d9f21f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":24422},{"type":"v1","addr":"172.21.15.117:6817","nonce":24422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":24422},{"type":"v1","addr":"172.21.15.117:6819","nonce":24422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":24422},{"type":"v1","addr":"172.21.15.117:6823","nonce":24422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":24422},{"type":"v1","addr":"172.21.15.117:6821","nonce":24422}]},"public_addr":"172.21.15.117:6817/24422","cluster_addr":"172.21.15.117:6819/24422","heartbeat_back_addr":"172.21.15.117:6823/24422","heartbeat_front_addr":"172.21.15.117:6821/24422","state":["exists","up"]},{"osd":6,"uuid":"6a87f09f-7bf7-4f7a-be87-530ac1ff8ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":24420},{"type":"v1","addr":"172.21.15.117:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6803","nonce":24420},{"type":"v1","addr":"172.21.15.117:6805","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":24420},{"type":"v1","addr":"172.21.15.117:6811","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":24420},{"type":"v1","addr":"172.21.15.117:6808","nonce":24420}]},"public_addr":"172.21.15.117:6801/24420","cluster_addr":"172.21.15.117:6805/24420","heartbeat_back_addr":"172.21.15.117:6811/24420","heartbeat_front_addr":"172.21.15.117:6808/24420","state":["exists","up"]},{"osd":7,"uuid":"e31d8041-1aa1-4b5d-83b3-0a373426dd9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":24423},{"type":"v1","addr":"172.21.15.117:6825","nonce":24423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":24423},{"type":"v1","addr":"172.21.15.117:6827","nonce":24423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":24423},{"type":"v1","addr":"172.21.15.117:6831","nonce":24423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":24423},{"type":"v1","addr":"172.21.15.117:6829","nonce":24423}]},"public_addr":"172.21.15.117:6825/24423","cluster_addr":"172.21.15.117:6827/24423","heartbeat_back_addr":"172.21.15.117:6831/24423","heartbeat_front_addr":"172.21.15.117:6829/24423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.220874+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.210039+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.434762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.247206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.184316+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.306325+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.035719+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.400303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:22:54.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.110+0000 7fd3597f9700 1 -- 172.21.15.104:0/1999003784 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fd338060860 msgr2=0x7fd338062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:54.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.110+0000 7fd3597f9700 1 --2- 172.21.15.104:0/1999003784 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fd338060860 0x7fd338062d10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd33c0093f0 tx=0x7fd33c017000 comp rx=0 tx=0).stop 2024-08-17T02:22:54.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.110+0000 7fd3597f9700 1 -- 172.21.15.104:0/1999003784 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd3540af5a0 msgr2=0x7fd35414d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:54.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.110+0000 7fd3597f9700 1 --2- 172.21.15.104:0/1999003784 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd3540af5a0 0x7fd35414d570 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd34400c5c0 tx=0x7fd34400c8d0 comp rx=0 tx=0).stop 2024-08-17T02:22:54.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.110+0000 7fd3597f9700 1 -- 172.21.15.104:0/1999003784 shutdown_connections 2024-08-17T02:22:54.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.110+0000 7fd3597f9700 1 --2- 172.21.15.104:0/1999003784 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fd338060860 0x7fd338062d10 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:54.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.110+0000 7fd3597f9700 1 --2- 172.21.15.104:0/1999003784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd354155380 0x7fd354147440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:54.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.110+0000 7fd3597f9700 1 --2- 172.21.15.104:0/1999003784 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3540aff10 0x7fd35414ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:54.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.110+0000 7fd3597f9700 1 --2- 172.21.15.104:0/1999003784 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd3540af5a0 0x7fd35414d570 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:54.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.110+0000 7fd3597f9700 1 -- 172.21.15.104:0/1999003784 >> 172.21.15.104:0/1999003784 conn(0x7fd354066e00 msgr2=0x7fd3540abff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:54.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.110+0000 7fd3597f9700 1 -- 172.21.15.104:0/1999003784 shutdown_connections 2024-08-17T02:22:54.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.110+0000 7fd3597f9700 1 -- 172.21.15.104:0/1999003784 wait complete. 2024-08-17T02:22:54.125 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:22:54.125 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:22:54.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.218+0000 7fbe9759e700 1 Processor -- start 2024-08-17T02:22:54.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.218+0000 7fbe9759e700 1 -- start start 2024-08-17T02:22:54.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.222+0000 7fbe9759e700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbe98159200 0x7fbe98164080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:54.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.222+0000 7fbe9759e700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe980ac3b0 con 0x7fbe98068ca0 2024-08-17T02:22:54.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.222+0000 7fbe9759e700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe980aa300 con 0x7fbe980688d0 2024-08-17T02:22:54.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.222+0000 7fbe9759e700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe980aa5e0 con 0x7fbe98159200 2024-08-17T02:22:54.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.222+0000 7fbe95d9b700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fbe98068ca0 0x7fbe98158af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:59514/0 (socket says 172.21.15.104:59514) 2024-08-17T02:22:54.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.222+0000 7fbe95d9b700 1 -- 172.21.15.104:0/1662803906 learned_addr learned my addr 172.21.15.104:0/1662803906 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:54.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.222+0000 7fbe96d9d700 1 --2- 172.21.15.104:0/1662803906 >> v2:172.21.15.117:3300/0 conn(0x7fbe98159200 0x7fbe98164080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:54.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.222+0000 7fbe9559a700 1 -- 172.21.15.104:0/1662803906 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4083628108 0 0) 0x7fbe980ac3b0 con 0x7fbe98068ca0 2024-08-17T02:22:54.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.222+0000 7fbe9559a700 1 -- 172.21.15.104:0/1662803906 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe84003570 con 0x7fbe98068ca0 2024-08-17T02:22:54.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.222+0000 7fbe96d9d700 1 -- 172.21.15.104:0/1662803906 >> v1:172.21.15.117:6789/0 conn(0x7fbe980688d0 legacy=0x7fbe980a9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:54.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.222+0000 7fbe96d9d700 1 -- 172.21.15.104:0/1662803906 >> v1:172.21.15.104:6789/0 conn(0x7fbe98068ca0 legacy=0x7fbe98158af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:54.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.222+0000 7fbe96d9d700 1 -- 172.21.15.104:0/1662803906 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe980aa8c0 con 0x7fbe98159200 2024-08-17T02:22:54.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.222+0000 7fbe96d9d700 1 --2- 172.21.15.104:0/1662803906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe98159200 0x7fbe98164080 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbe88009910 tx=0x7fbe880091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=495630b7cdd94d5d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:54.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.222+0000 7fbe9559a700 1 -- 172.21.15.104:0/1662803906 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8800b640 con 0x7fbe98159200 2024-08-17T02:22:54.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.222+0000 7fbe9559a700 1 -- 172.21.15.104:0/1662803906 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8800b7a0 con 0x7fbe98159200 2024-08-17T02:22:54.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.222+0000 7fbe9559a700 1 -- 172.21.15.104:0/1662803906 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8800bb20 con 0x7fbe98159200 2024-08-17T02:22:54.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.222+0000 7fbe9759e700 1 -- 172.21.15.104:0/1662803906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe98159200 msgr2=0x7fbe98164080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:54.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.222+0000 7fbe9759e700 1 --2- 172.21.15.104:0/1662803906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe98159200 0x7fbe98164080 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbe88009910 tx=0x7fbe880091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:54.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.222+0000 7fbe9759e700 1 -- 172.21.15.104:0/1662803906 shutdown_connections 2024-08-17T02:22:54.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.222+0000 7fbe9759e700 1 --2- 172.21.15.104:0/1662803906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe98159200 0x7fbe98164080 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:54.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.222+0000 7fbe9759e700 1 -- 172.21.15.104:0/1662803906 >> 172.21.15.104:0/1662803906 conn(0x7fbe9806d790 msgr2=0x7fbe9806db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:54.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.222+0000 7fbe9759e700 1 -- 172.21.15.104:0/1662803906 shutdown_connections 2024-08-17T02:22:54.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.222+0000 7fbe9759e700 1 -- 172.21.15.104:0/1662803906 wait complete. 2024-08-17T02:22:54.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.226+0000 7fbe9759e700 1 Processor -- start 2024-08-17T02:22:54.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.226+0000 7fbe9759e700 1 -- start start 2024-08-17T02:22:54.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.230+0000 7fbe9759e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe980688d0 0x7fbe98150090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:54.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.230+0000 7fbe9759e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe98068ca0 0x7fbe9814e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:54.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.230+0000 7fbe9759e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe98159200 0x7fbe98151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:54.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.230+0000 7fbe9759e700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe98150e90 con 0x7fbe98068ca0 2024-08-17T02:22:54.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.230+0000 7fbe9759e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe98151a10 con 0x7fbe98159200 2024-08-17T02:22:54.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.230+0000 7fbe9759e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe981510e0 con 0x7fbe980688d0 2024-08-17T02:22:54.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.230+0000 7fbe95d9b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe98068ca0 0x7fbe9814e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:54.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.230+0000 7fbe95d9b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe98068ca0 0x7fbe9814e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45290/0 (socket says 172.21.15.104:45290) 2024-08-17T02:22:54.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.230+0000 7fbe95d9b700 1 -- 172.21.15.104:0/2829139109 learned_addr learned my addr 172.21.15.104:0/2829139109 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:54.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.230+0000 7fbe96d9d700 1 --2- 172.21.15.104:0/2829139109 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe98159200 0x7fbe98151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:54.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.230+0000 7fbe9659c700 1 --2- 172.21.15.104:0/2829139109 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe980688d0 0x7fbe98150090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:54.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.230+0000 7fbe95d9b700 1 -- 172.21.15.104:0/2829139109 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe980688d0 msgr2=0x7fbe98150090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:54.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.230+0000 7fbe95d9b700 1 --2- 172.21.15.104:0/2829139109 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe980688d0 0x7fbe98150090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:54.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.230+0000 7fbe95d9b700 1 -- 172.21.15.104:0/2829139109 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe98159200 msgr2=0x7fbe98151ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:54.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.230+0000 7fbe95d9b700 1 --2- 172.21.15.104:0/2829139109 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe98159200 0x7fbe98151ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:54.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.230+0000 7fbe95d9b700 1 -- 172.21.15.104:0/2829139109 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe88009420 con 0x7fbe98068ca0 2024-08-17T02:22:54.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.230+0000 7fbe9659c700 1 --2- 172.21.15.104:0/2829139109 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe980688d0 0x7fbe98150090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:22:54.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.230+0000 7fbe95d9b700 1 --2- 172.21.15.104:0/2829139109 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe98068ca0 0x7fbe9814e020 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbe8000c790 tx=0x7fbe80007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:54.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.230+0000 7fbe8e7fc700 1 -- 172.21.15.104:0/2829139109 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe80005b30 con 0x7fbe98068ca0 2024-08-17T02:22:54.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.230+0000 7fbe8e7fc700 1 -- 172.21.15.104:0/2829139109 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe80005c90 con 0x7fbe98068ca0 2024-08-17T02:22:54.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.230+0000 7fbe9759e700 1 -- 172.21.15.104:0/2829139109 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe981513c0 con 0x7fbe98068ca0 2024-08-17T02:22:54.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.230+0000 7fbe8e7fc700 1 -- 172.21.15.104:0/2829139109 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe80007320 con 0x7fbe98068ca0 2024-08-17T02:22:54.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.230+0000 7fbe9759e700 1 -- 172.21.15.104:0/2829139109 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe981505d0 con 0x7fbe98068ca0 2024-08-17T02:22:54.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.230+0000 7fbe9759e700 1 -- 172.21.15.104:0/2829139109 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe980643a0 con 0x7fbe98068ca0 2024-08-17T02:22:54.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.234+0000 7fbe8e7fc700 1 -- 172.21.15.104:0/2829139109 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fbe80007690 con 0x7fbe98068ca0 2024-08-17T02:22:54.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.234+0000 7fbe8e7fc700 1 --2- 172.21.15.104:0/2829139109 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fbe78060860 0x7fbe78062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:54.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.234+0000 7fbe8e7fc700 1 -- 172.21.15.104:0/2829139109 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbe8007c070 con 0x7fbe98068ca0 2024-08-17T02:22:54.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.234+0000 7fbe9659c700 1 --2- 172.21.15.104:0/2829139109 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fbe78060860 0x7fbe78062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:54.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.234+0000 7fbe9659c700 1 --2- 172.21.15.104:0/2829139109 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fbe78060860 0x7fbe78062d10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbe90007fd0 tx=0x7fbe90009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:54.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.238+0000 7fbe8e7fc700 1 -- 172.21.15.104:0/2829139109 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fbe8004c4c0 con 0x7fbe98068ca0 2024-08-17T02:22:54.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.434+0000 7fbe9759e700 1 -- 172.21.15.104:0/2829139109 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe98151b50 con 0x7fbe98068ca0 2024-08-17T02:22:54.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.434+0000 7fbe8e7fc700 1 -- 172.21.15.104:0/2829139109 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4603 (secure 0 0 0) 0x7fbe8004fae0 con 0x7fbe98068ca0 2024-08-17T02:22:54.438 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:22:54.438 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/1242386459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":1242386459},{"type":"v1","addr":"172.21.15.104:6835","nonce":1242386459}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/2581980475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2581980475},{"type":"v1","addr":"172.21.15.104:6833","nonce":2581980475}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1039240942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1039240942},{"type":"v1","addr":"172.21.15.117:6835","nonce":1039240942}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:22:21.527207+0000","modified":"2024-08-17T02:22:25.187188+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/4197149840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":4197149840},{"type":"v1","addr":"172.21.15.117:6837","nonce":4197149840}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:22:54.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.438+0000 7fbe9759e700 1 -- 172.21.15.104:0/2829139109 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fbe78060860 msgr2=0x7fbe78062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:54.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.438+0000 7fbe9759e700 1 --2- 172.21.15.104:0/2829139109 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fbe78060860 0x7fbe78062d10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbe90007fd0 tx=0x7fbe90009040 comp rx=0 tx=0).stop 2024-08-17T02:22:54.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.438+0000 7fbe9759e700 1 -- 172.21.15.104:0/2829139109 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe98068ca0 msgr2=0x7fbe9814e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:54.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.438+0000 7fbe9759e700 1 --2- 172.21.15.104:0/2829139109 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe98068ca0 0x7fbe9814e020 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbe8000c790 tx=0x7fbe80007df0 comp rx=0 tx=0).stop 2024-08-17T02:22:54.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.438+0000 7fbe9759e700 1 -- 172.21.15.104:0/2829139109 shutdown_connections 2024-08-17T02:22:54.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.438+0000 7fbe9759e700 1 --2- 172.21.15.104:0/2829139109 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fbe78060860 0x7fbe78062d10 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:54.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.438+0000 7fbe9759e700 1 --2- 172.21.15.104:0/2829139109 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe98159200 0x7fbe98151ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:54.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.438+0000 7fbe9759e700 1 --2- 172.21.15.104:0/2829139109 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe98068ca0 0x7fbe9814e020 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:54.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.438+0000 7fbe9759e700 1 --2- 172.21.15.104:0/2829139109 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe980688d0 0x7fbe98150090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:54.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.438+0000 7fbe9759e700 1 -- 172.21.15.104:0/2829139109 >> 172.21.15.104:0/2829139109 conn(0x7fbe9806d790 msgr2=0x7fbe9815aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:54.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.438+0000 7fbe9759e700 1 -- 172.21.15.104:0/2829139109 shutdown_connections 2024-08-17T02:22:54.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.438+0000 7fbe9759e700 1 -- 172.21.15.104:0/2829139109 wait complete. 2024-08-17T02:22:54.442 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 7 2024-08-17T02:22:54.452 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:22:54.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.558+0000 7fbaab14b700 1 Processor -- start 2024-08-17T02:22:54.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.558+0000 7fbaab14b700 1 -- start start 2024-08-17T02:22:54.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.562+0000 7fbaab14b700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fbaa4155d20 0x7fbaa40b0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:54.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.562+0000 7fbaab14b700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaa40af2b0 con 0x7fbaa406df10 2024-08-17T02:22:54.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.562+0000 7fbaab14b700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaa40af590 con 0x7fbaa40ad7c0 2024-08-17T02:22:54.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.562+0000 7fbaab14b700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaa40adc10 con 0x7fbaa4155d20 2024-08-17T02:22:54.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.562+0000 7fbaaa149700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fbaa4155d20 0x7fbaa40b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:54.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.562+0000 7fbaaa94a700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fbaa406df10 0x7fbaa406e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:59522/0 (socket says 172.21.15.104:59522) 2024-08-17T02:22:54.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.562+0000 7fbaaa94a700 1 -- 172.21.15.104:0/4037874484 learned_addr learned my addr 172.21.15.104:0/4037874484 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:54.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.562+0000 7fbaaa149700 1 -- 172.21.15.104:0/4037874484 >> v1:172.21.15.117:6789/0 conn(0x7fbaa40ad7c0 legacy=0x7fbaa40aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:54.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.562+0000 7fbaaa149700 1 -- 172.21.15.104:0/4037874484 >> v1:172.21.15.104:6789/0 conn(0x7fbaa406df10 legacy=0x7fbaa406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:54.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.562+0000 7fbaa9147700 1 -- 172.21.15.104:0/4037874484 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4122578517 0 0) 0x7fbaa40af2b0 con 0x7fbaa406df10 2024-08-17T02:22:54.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.562+0000 7fbaaa149700 1 -- 172.21.15.104:0/4037874484 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa40af870 con 0x7fbaa4155d20 2024-08-17T02:22:54.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.562+0000 7fbaaa149700 1 --2- 172.21.15.104:0/4037874484 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbaa4155d20 0x7fbaa40b0350 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbaa00098e0 tx=0x7fbaa00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b71de219396ae2b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:54.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.562+0000 7fbaa9147700 1 -- 172.21.15.104:0/4037874484 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa0009e80 con 0x7fbaa4155d20 2024-08-17T02:22:54.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.562+0000 7fbaa9147700 1 -- 172.21.15.104:0/4037874484 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaa000b860 con 0x7fbaa4155d20 2024-08-17T02:22:54.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.562+0000 7fbaa9147700 1 -- 172.21.15.104:0/4037874484 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa000bbe0 con 0x7fbaa4155d20 2024-08-17T02:22:54.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.562+0000 7fbaab14b700 1 -- 172.21.15.104:0/4037874484 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbaa4155d20 msgr2=0x7fbaa40b0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:54.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.562+0000 7fbaab14b700 1 --2- 172.21.15.104:0/4037874484 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbaa4155d20 0x7fbaa40b0350 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbaa00098e0 tx=0x7fbaa00091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:54.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.562+0000 7fbaab14b700 1 -- 172.21.15.104:0/4037874484 shutdown_connections 2024-08-17T02:22:54.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.562+0000 7fbaab14b700 1 --2- 172.21.15.104:0/4037874484 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbaa4155d20 0x7fbaa40b0350 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:54.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.562+0000 7fbaab14b700 1 -- 172.21.15.104:0/4037874484 >> 172.21.15.104:0/4037874484 conn(0x7fbaa40678d0 msgr2=0x7fbaa4067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:54.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.562+0000 7fbaab14b700 1 -- 172.21.15.104:0/4037874484 shutdown_connections 2024-08-17T02:22:54.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.562+0000 7fbaab14b700 1 -- 172.21.15.104:0/4037874484 wait complete. 2024-08-17T02:22:54.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.566+0000 7fbaab14b700 1 Processor -- start 2024-08-17T02:22:54.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.566+0000 7fbaab14b700 1 -- start start 2024-08-17T02:22:54.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.566+0000 7fbaab14b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbaa406df10 0x7fbaa4144e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:54.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.566+0000 7fbaab14b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbaa40ad7c0 0x7fbaa415bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:54.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.566+0000 7fbaab14b700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaa4155d20 0x7fbaa415c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:54.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.566+0000 7fbaab14b700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa416e0a0 con 0x7fbaa406df10 2024-08-17T02:22:54.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.566+0000 7fbaab14b700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa4156ac0 con 0x7fbaa40ad7c0 2024-08-17T02:22:54.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.566+0000 7fbaab14b700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa41453a0 con 0x7fbaa4155d20 2024-08-17T02:22:54.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.566+0000 7fbaaa149700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbaa406df10 0x7fbaa4144e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:54.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.566+0000 7fbaaa149700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbaa406df10 0x7fbaa4144e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45300/0 (socket says 172.21.15.104:45300) 2024-08-17T02:22:54.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.566+0000 7fbaaa149700 1 -- 172.21.15.104:0/275731813 learned_addr learned my addr 172.21.15.104:0/275731813 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:54.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.566+0000 7fbaa9948700 1 --2- 172.21.15.104:0/275731813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbaa40ad7c0 0x7fbaa415bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:54.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.566+0000 7fbaaa94a700 1 --2- 172.21.15.104:0/275731813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaa4155d20 0x7fbaa415c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:54.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.570+0000 7fbaaa149700 1 -- 172.21.15.104:0/275731813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaa4155d20 msgr2=0x7fbaa415c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:54.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.570+0000 7fbaaa149700 1 --2- 172.21.15.104:0/275731813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaa4155d20 0x7fbaa415c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:54.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.570+0000 7fbaaa149700 1 -- 172.21.15.104:0/275731813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbaa40ad7c0 msgr2=0x7fbaa415bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:54.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.570+0000 7fbaaa149700 1 --2- 172.21.15.104:0/275731813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbaa40ad7c0 0x7fbaa415bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:54.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.570+0000 7fbaaa149700 1 -- 172.21.15.104:0/275731813 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa0009420 con 0x7fbaa406df10 2024-08-17T02:22:54.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.570+0000 7fbaaa149700 1 --2- 172.21.15.104:0/275731813 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbaa406df10 0x7fbaa4144e60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbaa000b3c0 tx=0x7fbaa0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:54.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.570+0000 7fba9a7fc700 1 -- 172.21.15.104:0/275731813 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa001f070 con 0x7fbaa406df10 2024-08-17T02:22:54.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.570+0000 7fba9a7fc700 1 -- 172.21.15.104:0/275731813 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaa0000c90 con 0x7fbaa406df10 2024-08-17T02:22:54.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.570+0000 7fbaab14b700 1 -- 172.21.15.104:0/275731813 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaa4156190 con 0x7fbaa406df10 2024-08-17T02:22:54.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.570+0000 7fba9a7fc700 1 -- 172.21.15.104:0/275731813 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa0025420 con 0x7fbaa406df10 2024-08-17T02:22:54.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.570+0000 7fbaab14b700 1 -- 172.21.15.104:0/275731813 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaa4156750 con 0x7fbaa406df10 2024-08-17T02:22:54.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.570+0000 7fbaab14b700 1 -- 172.21.15.104:0/275731813 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaa40643a0 con 0x7fbaa406df10 2024-08-17T02:22:54.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.574+0000 7fba9a7fc700 1 -- 172.21.15.104:0/275731813 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fbaa0023070 con 0x7fbaa406df10 2024-08-17T02:22:54.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.574+0000 7fba9a7fc700 1 --2- 172.21.15.104:0/275731813 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fba88060860 0x7fba88062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:54.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.574+0000 7fba9a7fc700 1 -- 172.21.15.104:0/275731813 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbaa007e040 con 0x7fbaa406df10 2024-08-17T02:22:54.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.574+0000 7fbaa9948700 1 --2- 172.21.15.104:0/275731813 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fba88060860 0x7fba88062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:54.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.574+0000 7fbaa9948700 1 --2- 172.21.15.104:0/275731813 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fba88060860 0x7fba88062d10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4148e10 tx=0x7fba94007ec0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:54.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.582+0000 7fba9a7fc700 1 -- 172.21.15.104:0/275731813 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fbaa004e490 con 0x7fbaa406df10 2024-08-17T02:22:54.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.782+0000 7fbaab14b700 1 -- 172.21.15.104:0/275731813 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbaa40ae440 con 0x7fbaa406df10 2024-08-17T02:22:54.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.782+0000 7fba9a7fc700 1 -- 172.21.15.104:0/275731813 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4603 (secure 0 0 0) 0x7fbaa0015090 con 0x7fbaa406df10 2024-08-17T02:22:54.787 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:22:54.787 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/1242386459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":1242386459},{"type":"v1","addr":"172.21.15.104:6835","nonce":1242386459}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/2581980475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2581980475},{"type":"v1","addr":"172.21.15.104:6833","nonce":2581980475}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1039240942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1039240942},{"type":"v1","addr":"172.21.15.117:6835","nonce":1039240942}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:22:21.527207+0000","modified":"2024-08-17T02:22:25.187188+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/4197149840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":4197149840},{"type":"v1","addr":"172.21.15.117:6837","nonce":4197149840}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:22:54.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.782+0000 7fbaab14b700 1 -- 172.21.15.104:0/275731813 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fba88060860 msgr2=0x7fba88062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:54.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.782+0000 7fbaab14b700 1 --2- 172.21.15.104:0/275731813 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fba88060860 0x7fba88062d10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4148e10 tx=0x7fba94007ec0 comp rx=0 tx=0).stop 2024-08-17T02:22:54.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.782+0000 7fbaab14b700 1 -- 172.21.15.104:0/275731813 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbaa406df10 msgr2=0x7fbaa4144e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:54.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.782+0000 7fbaab14b700 1 --2- 172.21.15.104:0/275731813 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbaa406df10 0x7fbaa4144e60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbaa000b3c0 tx=0x7fbaa0017000 comp rx=0 tx=0).stop 2024-08-17T02:22:54.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.782+0000 7fbaab14b700 1 -- 172.21.15.104:0/275731813 shutdown_connections 2024-08-17T02:22:54.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.782+0000 7fbaab14b700 1 --2- 172.21.15.104:0/275731813 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fba88060860 0x7fba88062d10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:54.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.782+0000 7fbaab14b700 1 --2- 172.21.15.104:0/275731813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaa4155d20 0x7fbaa415c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:54.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.782+0000 7fbaab14b700 1 --2- 172.21.15.104:0/275731813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbaa40ad7c0 0x7fbaa415bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:54.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.782+0000 7fbaab14b700 1 --2- 172.21.15.104:0/275731813 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbaa406df10 0x7fbaa4144e60 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:54.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.782+0000 7fbaab14b700 1 -- 172.21.15.104:0/275731813 >> 172.21.15.104:0/275731813 conn(0x7fbaa40678d0 msgr2=0x7fbaa40697d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:54.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.782+0000 7fbaab14b700 1 -- 172.21.15.104:0/275731813 shutdown_connections 2024-08-17T02:22:54.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.782+0000 7fbaab14b700 1 -- 172.21.15.104:0/275731813 wait complete. 2024-08-17T02:22:54.789 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 7 2024-08-17T02:22:54.799 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:22:54.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.902+0000 7f75f359e700 1 Processor -- start 2024-08-17T02:22:54.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.902+0000 7f75f359e700 1 -- start start 2024-08-17T02:22:54.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.906+0000 7f75f359e700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f75f41553e0 0x7f75f40af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:54.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.906+0000 7f75f359e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75f41557b0 0x7f75f40b1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:54.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.906+0000 7f75f359e700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75f4155c00 con 0x7f75f40686a0 2024-08-17T02:22:54.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.906+0000 7f75f359e700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75f4155e30 con 0x7f75f41553e0 2024-08-17T02:22:54.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.906+0000 7f75f359e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f4156110 con 0x7f75f41557b0 2024-08-17T02:22:54.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.906+0000 7f75f2d9d700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f75f40686a0 0x7f75f4159170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:59528/0 (socket says 172.21.15.104:59528) 2024-08-17T02:22:54.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.906+0000 7f75f2d9d700 1 -- 172.21.15.104:0/91954187 learned_addr learned my addr 172.21.15.104:0/91954187 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:54.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.906+0000 7f75f259c700 1 --2- 172.21.15.104:0/91954187 >> v2:172.21.15.104:3300/0 conn(0x7f75f41553e0 0x7f75f40af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:54.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.906+0000 7f75ebfff700 1 --2- 172.21.15.104:0/91954187 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75f41557b0 0x7f75f40b1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:54.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.906+0000 7f75f1d9b700 1 -- 172.21.15.104:0/91954187 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1910900729 0 0) 0x7f75f4155c00 con 0x7f75f40686a0 2024-08-17T02:22:54.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.906+0000 7f75f1d9b700 1 -- 172.21.15.104:0/91954187 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75e0003570 con 0x7f75f40686a0 2024-08-17T02:22:54.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.906+0000 7f75f1d9b700 1 -- 172.21.15.104:0/91954187 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1635277037 0 0) 0x7f75e0003570 con 0x7f75f40686a0 2024-08-17T02:22:54.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.906+0000 7f75f1d9b700 1 -- 172.21.15.104:0/91954187 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75f41557b0 msgr2=0x7f75f40b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:54.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.906+0000 7f75f1d9b700 1 --2- 172.21.15.104:0/91954187 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75f41557b0 0x7f75f40b1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:54.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.906+0000 7f75f1d9b700 1 -- 172.21.15.104:0/91954187 >> v2:172.21.15.104:3300/0 conn(0x7f75f41553e0 msgr2=0x7f75f40af4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:54.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.906+0000 7f75f1d9b700 1 --2- 172.21.15.104:0/91954187 >> v2:172.21.15.104:3300/0 conn(0x7f75f41553e0 0x7f75f40af4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:54.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.906+0000 7f75f1d9b700 1 -- 172.21.15.104:0/91954187 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f41563f0 con 0x7f75f40686a0 2024-08-17T02:22:54.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.906+0000 7f75f1d9b700 1 -- 172.21.15.104:0/91954187 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1279957748 0 0) 0x7f75ec0017f0 con 0x7f75f40686a0 2024-08-17T02:22:54.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.906+0000 7f75f1d9b700 1 -- 172.21.15.104:0/91954187 >> v1:172.21.15.104:6789/0 conn(0x7f75f40686a0 legacy=0x7f75f4159170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:54.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.906+0000 7f75f1d9b700 1 --2- 172.21.15.104:0/91954187 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75e0003a60 0x7f75e0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:54.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.906+0000 7f75f1d9b700 1 --2- 172.21.15.104:0/91954187 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75e0004810 0x7f75e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:54.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.906+0000 7f75f1d9b700 1 --2- 172.21.15.104:0/91954187 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75f41557b0 0x7f75e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:54.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.906+0000 7f75f1d9b700 1 -- 172.21.15.104:0/91954187 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f4155e30 con 0x7f75e0004810 2024-08-17T02:22:54.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.906+0000 7f75f1d9b700 1 -- 172.21.15.104:0/91954187 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f4156110 con 0x7f75e0003a60 2024-08-17T02:22:54.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.906+0000 7f75f1d9b700 1 -- 172.21.15.104:0/91954187 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e000ba60 con 0x7f75f41557b0 2024-08-17T02:22:54.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.906+0000 7f75f259c700 1 --2- 172.21.15.104:0/91954187 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75e0003a60 0x7f75e0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:54.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.906+0000 7f75f2d9d700 1 --2- 172.21.15.104:0/91954187 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75f41557b0 0x7f75e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:54.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.906+0000 7f75ebfff700 1 --2- 172.21.15.104:0/91954187 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75e0004810 0x7f75e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:54.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.906+0000 7f75f2d9d700 1 -- 172.21.15.104:0/91954187 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75e0003a60 msgr2=0x7f75e0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:54.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.906+0000 7f75f2d9d700 1 --2- 172.21.15.104:0/91954187 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75e0003a60 0x7f75e0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:54.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.906+0000 7f75f2d9d700 1 -- 172.21.15.104:0/91954187 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75e0004810 msgr2=0x7f75e0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:54.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.906+0000 7f75f2d9d700 1 --2- 172.21.15.104:0/91954187 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75e0004810 0x7f75e0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:54.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.906+0000 7f75f2d9d700 1 -- 172.21.15.104:0/91954187 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e0003570 con 0x7f75f41557b0 2024-08-17T02:22:54.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.906+0000 7f75f259c700 1 --2- 172.21.15.104:0/91954187 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75e0003a60 0x7f75e0003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:22:54.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.906+0000 7f75f2d9d700 1 --2- 172.21.15.104:0/91954187 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75f41557b0 0x7f75e00051c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f75ec00a930 tx=0x7f75ec0021d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f9a8b15d7d92a7d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:54.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.906+0000 7f75f1d9b700 1 -- 172.21.15.104:0/91954187 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec0070d0 con 0x7f75f41557b0 2024-08-17T02:22:54.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.906+0000 7f75f1d9b700 1 -- 172.21.15.104:0/91954187 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75ec007230 con 0x7f75f41557b0 2024-08-17T02:22:54.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.906+0000 7f75f1d9b700 1 -- 172.21.15.104:0/91954187 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec0075d0 con 0x7f75f41557b0 2024-08-17T02:22:54.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.910+0000 7f75f359e700 1 -- 172.21.15.104:0/91954187 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75f41557b0 msgr2=0x7f75e00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:54.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.910+0000 7f75f359e700 1 --2- 172.21.15.104:0/91954187 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75f41557b0 0x7f75e00051c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f75ec00a930 tx=0x7f75ec0021d0 comp rx=0 tx=0).stop 2024-08-17T02:22:54.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.910+0000 7f75f2d9d700 1 -- 172.21.15.104:0/91954187 reap_dead start 2024-08-17T02:22:54.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.910+0000 7f75f359e700 1 -- 172.21.15.104:0/91954187 shutdown_connections 2024-08-17T02:22:54.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.910+0000 7f75f359e700 1 -- 172.21.15.104:0/91954187 >> 172.21.15.104:0/91954187 conn(0x7f75f406d800 msgr2=0x7f75f406dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:54.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.910+0000 7f75f359e700 1 -- 172.21.15.104:0/91954187 shutdown_connections 2024-08-17T02:22:54.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.910+0000 7f75f359e700 1 -- 172.21.15.104:0/91954187 wait complete. 2024-08-17T02:22:54.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.910+0000 7f75f359e700 1 Processor -- start 2024-08-17T02:22:54.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.910+0000 7f75f359e700 1 -- start start 2024-08-17T02:22:54.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.910+0000 7f75f359e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75f41557b0 0x7f75f40a6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:54.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.910+0000 7f75f359e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75f40a6cb0 0x7f75f414f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:54.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.910+0000 7f75f359e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75f414fa40 0x7f75f414feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:54.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.910+0000 7f75f359e700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f41503f0 con 0x7f75f41557b0 2024-08-17T02:22:54.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.910+0000 7f75f359e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f40a7e80 con 0x7f75f414fa40 2024-08-17T02:22:54.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.910+0000 7f75f359e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f40a6780 con 0x7f75f40a6cb0 2024-08-17T02:22:54.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.910+0000 7f75f259c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75f41557b0 0x7f75f40a6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:54.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.910+0000 7f75f259c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75f41557b0 0x7f75f40a6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45342/0 (socket says 172.21.15.104:45342) 2024-08-17T02:22:54.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.910+0000 7f75f259c700 1 -- 172.21.15.104:0/1109911518 learned_addr learned my addr 172.21.15.104:0/1109911518 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:54.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.910+0000 7f75f2d9d700 1 --2- 172.21.15.104:0/1109911518 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75f414fa40 0x7f75f414feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:54.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.910+0000 7f75ebfff700 1 --2- 172.21.15.104:0/1109911518 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75f40a6cb0 0x7f75f414f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:54.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.914+0000 7f75f259c700 1 -- 172.21.15.104:0/1109911518 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75f40a6cb0 msgr2=0x7f75f414f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:54.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.914+0000 7f75f259c700 1 --2- 172.21.15.104:0/1109911518 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75f40a6cb0 0x7f75f414f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:54.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.914+0000 7f75f259c700 1 -- 172.21.15.104:0/1109911518 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75f414fa40 msgr2=0x7f75f414feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:54.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.914+0000 7f75f259c700 1 --2- 172.21.15.104:0/1109911518 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75f414fa40 0x7f75f414feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:54.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.914+0000 7f75f259c700 1 -- 172.21.15.104:0/1109911518 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f40a7270 con 0x7f75f41557b0 2024-08-17T02:22:54.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.914+0000 7f75f259c700 1 --2- 172.21.15.104:0/1109911518 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75f41557b0 0x7f75f40a6240 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f75e400afd0 tx=0x7f75e400a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:54.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.914+0000 7f75ea7fc700 1 -- 172.21.15.104:0/1109911518 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e4010c20 con 0x7f75f41557b0 2024-08-17T02:22:54.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.914+0000 7f75ea7fc700 1 -- 172.21.15.104:0/1109911518 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e4010d80 con 0x7f75f41557b0 2024-08-17T02:22:54.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.914+0000 7f75f359e700 1 -- 172.21.15.104:0/1109911518 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75f40a7550 con 0x7f75f41557b0 2024-08-17T02:22:54.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.914+0000 7f75ea7fc700 1 -- 172.21.15.104:0/1109911518 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e401b670 con 0x7f75f41557b0 2024-08-17T02:22:54.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.914+0000 7f75f359e700 1 -- 172.21.15.104:0/1109911518 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f40a7b10 con 0x7f75f41557b0 2024-08-17T02:22:54.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.914+0000 7f75f359e700 1 -- 172.21.15.104:0/1109911518 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75f406b5b0 con 0x7f75f41557b0 2024-08-17T02:22:54.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.914+0000 7f75ea7fc700 1 -- 172.21.15.104:0/1109911518 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f75e401ba60 con 0x7f75f41557b0 2024-08-17T02:22:54.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.914+0000 7f75ea7fc700 1 --2- 172.21.15.104:0/1109911518 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f75d4060890 0x7f75d4062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:54.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.914+0000 7f75ea7fc700 1 -- 172.21.15.104:0/1109911518 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f75e407e7d0 con 0x7f75f41557b0 2024-08-17T02:22:54.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.918+0000 7f75ebfff700 1 --2- 172.21.15.104:0/1109911518 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f75d4060890 0x7f75d4062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:54.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.918+0000 7f75ebfff700 1 --2- 172.21.15.104:0/1109911518 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f75d4060890 0x7f75d4062d40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f75f406e1e0 tx=0x7f75dc0091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:54.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:54.922+0000 7f75ea7fc700 1 -- 172.21.15.104:0/1109911518 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f75e404ec20 con 0x7f75f41557b0 2024-08-17T02:22:55.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.090+0000 7f75f359e700 1 -- 172.21.15.104:0/1109911518 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75f40682e0 con 0x7f75f41557b0 2024-08-17T02:22:55.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.090+0000 7f75ea7fc700 1 -- 172.21.15.104:0/1109911518 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f75e4052240 con 0x7f75f41557b0 2024-08-17T02:22:55.094 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:22:55.094 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":23,"fsid":"fd5f7fb8-d34b-49bb-89a8-62b7dad1bc25","created":"2024-08-17T02:21:57.891389+0000","modified":"2024-08-17T02:22:23.175831+0000","last_up_change":"2024-08-17T02:22:08.924546+0000","last_in_change":"2024-08-17T02:21:59.938028+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:22:10.143970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:22:20.082708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:22:20.521582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"606b9088-590e-4709-aa3a-b0f6e22972ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":24257},{"type":"v1","addr":"172.21.15.104:6809","nonce":24257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":24257},{"type":"v1","addr":"172.21.15.104:6811","nonce":24257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":24257},{"type":"v1","addr":"172.21.15.104:6815","nonce":24257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":24257},{"type":"v1","addr":"172.21.15.104:6813","nonce":24257}]},"public_addr":"172.21.15.104:6809/24257","cluster_addr":"172.21.15.104:6811/24257","heartbeat_back_addr":"172.21.15.104:6815/24257","heartbeat_front_addr":"172.21.15.104:6813/24257","state":["exists","up"]},{"osd":1,"uuid":"9bc6a909-0c2f-4889-afe7-4a47f89b0f64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":24256},{"type":"v1","addr":"172.21.15.104:6825","nonce":24256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":24256},{"type":"v1","addr":"172.21.15.104:6827","nonce":24256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":24256},{"type":"v1","addr":"172.21.15.104:6831","nonce":24256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":24256},{"type":"v1","addr":"172.21.15.104:6829","nonce":24256}]},"public_addr":"172.21.15.104:6825/24256","cluster_addr":"172.21.15.104:6827/24256","heartbeat_back_addr":"172.21.15.104:6831/24256","heartbeat_front_addr":"172.21.15.104:6829/24256","state":["exists","up"]},{"osd":2,"uuid":"23da31d5-aefb-4edb-b79d-fa05e1becef7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":24255},{"type":"v1","addr":"172.21.15.104:6817","nonce":24255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":24255},{"type":"v1","addr":"172.21.15.104:6819","nonce":24255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":24255},{"type":"v1","addr":"172.21.15.104:6823","nonce":24255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":24255},{"type":"v1","addr":"172.21.15.104:6821","nonce":24255}]},"public_addr":"172.21.15.104:6817/24255","cluster_addr":"172.21.15.104:6819/24255","heartbeat_back_addr":"172.21.15.104:6823/24255","heartbeat_front_addr":"172.21.15.104:6821/24255","state":["exists","up"]},{"osd":3,"uuid":"6e4a5ec2-b415-45ef-8381-61a59eb65224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":24254},{"type":"v1","addr":"172.21.15.104:6801","nonce":24254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":24254},{"type":"v1","addr":"172.21.15.104:6803","nonce":24254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":24254},{"type":"v1","addr":"172.21.15.104:6807","nonce":24254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":24254},{"type":"v1","addr":"172.21.15.104:6805","nonce":24254}]},"public_addr":"172.21.15.104:6801/24254","cluster_addr":"172.21.15.104:6803/24254","heartbeat_back_addr":"172.21.15.104:6807/24254","heartbeat_front_addr":"172.21.15.104:6805/24254","state":["exists","up"]},{"osd":4,"uuid":"8d5bea2d-9039-4013-8c99-2c046c5b8a17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":24421},{"type":"v1","addr":"172.21.15.117:6804","nonce":24421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":24421},{"type":"v1","addr":"172.21.15.117:6809","nonce":24421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":24421},{"type":"v1","addr":"172.21.15.117:6815","nonce":24421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":24421},{"type":"v1","addr":"172.21.15.117:6813","nonce":24421}]},"public_addr":"172.21.15.117:6804/24421","cluster_addr":"172.21.15.117:6809/24421","heartbeat_back_addr":"172.21.15.117:6815/24421","heartbeat_front_addr":"172.21.15.117:6813/24421","state":["exists","up"]},{"osd":5,"uuid":"de8b36fc-121c-4f05-8f5b-28f513d9f21f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":24422},{"type":"v1","addr":"172.21.15.117:6817","nonce":24422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":24422},{"type":"v1","addr":"172.21.15.117:6819","nonce":24422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":24422},{"type":"v1","addr":"172.21.15.117:6823","nonce":24422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":24422},{"type":"v1","addr":"172.21.15.117:6821","nonce":24422}]},"public_addr":"172.21.15.117:6817/24422","cluster_addr":"172.21.15.117:6819/24422","heartbeat_back_addr":"172.21.15.117:6823/24422","heartbeat_front_addr":"172.21.15.117:6821/24422","state":["exists","up"]},{"osd":6,"uuid":"6a87f09f-7bf7-4f7a-be87-530ac1ff8ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":24420},{"type":"v1","addr":"172.21.15.117:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6803","nonce":24420},{"type":"v1","addr":"172.21.15.117:6805","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":24420},{"type":"v1","addr":"172.21.15.117:6811","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":24420},{"type":"v1","addr":"172.21.15.117:6808","nonce":24420}]},"public_addr":"172.21.15.117:6801/24420","cluster_addr":"172.21.15.117:6805/24420","heartbeat_back_addr":"172.21.15.117:6811/24420","heartbeat_front_addr":"172.21.15.117:6808/24420","state":["exists","up"]},{"osd":7,"uuid":"e31d8041-1aa1-4b5d-83b3-0a373426dd9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":24423},{"type":"v1","addr":"172.21.15.117:6825","nonce":24423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":24423},{"type":"v1","addr":"172.21.15.117:6827","nonce":24423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":24423},{"type":"v1","addr":"172.21.15.117:6831","nonce":24423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":24423},{"type":"v1","addr":"172.21.15.117:6829","nonce":24423}]},"public_addr":"172.21.15.117:6825/24423","cluster_addr":"172.21.15.117:6827/24423","heartbeat_back_addr":"172.21.15.117:6831/24423","heartbeat_front_addr":"172.21.15.117:6829/24423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.220874+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.210039+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.434762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.247206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.184316+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.306325+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.035719+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.400303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:22:55.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.094+0000 7f75f359e700 1 -- 172.21.15.104:0/1109911518 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f75d4060890 msgr2=0x7f75d4062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:55.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.094+0000 7f75f359e700 1 --2- 172.21.15.104:0/1109911518 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f75d4060890 0x7f75d4062d40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f75f406e1e0 tx=0x7f75dc0091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:55.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.094+0000 7f75f359e700 1 -- 172.21.15.104:0/1109911518 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75f41557b0 msgr2=0x7f75f40a6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:55.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.094+0000 7f75f359e700 1 --2- 172.21.15.104:0/1109911518 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75f41557b0 0x7f75f40a6240 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f75e400afd0 tx=0x7f75e400a330 comp rx=0 tx=0).stop 2024-08-17T02:22:55.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.094+0000 7f75f359e700 1 -- 172.21.15.104:0/1109911518 shutdown_connections 2024-08-17T02:22:55.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.094+0000 7f75f359e700 1 --2- 172.21.15.104:0/1109911518 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f75d4060890 0x7f75d4062d40 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:55.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.094+0000 7f75f359e700 1 --2- 172.21.15.104:0/1109911518 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75f414fa40 0x7f75f414feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:55.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.094+0000 7f75f359e700 1 --2- 172.21.15.104:0/1109911518 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75f40a6cb0 0x7f75f414f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:55.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.094+0000 7f75f359e700 1 --2- 172.21.15.104:0/1109911518 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75f41557b0 0x7f75f40a6240 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:55.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.094+0000 7f75f359e700 1 -- 172.21.15.104:0/1109911518 >> 172.21.15.104:0/1109911518 conn(0x7f75f406d800 msgr2=0x7f75f40ae650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:55.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.094+0000 7f75f359e700 1 -- 172.21.15.104:0/1109911518 shutdown_connections 2024-08-17T02:22:55.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.094+0000 7f75f359e700 1 -- 172.21.15.104:0/1109911518 wait complete. 2024-08-17T02:22:55.108 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-17T02:22:55.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.210+0000 7f813bfff700 1 Processor -- start 2024-08-17T02:22:55.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.210+0000 7f813bfff700 1 -- start start 2024-08-17T02:22:55.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.214+0000 7f813bfff700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f813c155d20 0x7f813c0b0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:55.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.214+0000 7f813bfff700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f813c0af2b0 con 0x7f813c0ad7c0 2024-08-17T02:22:55.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.214+0000 7f813bfff700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f813c0af590 con 0x7f813c06df10 2024-08-17T02:22:55.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.214+0000 7f813bfff700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f813c0adc10 con 0x7f813c155d20 2024-08-17T02:22:55.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.214+0000 7f813a7fc700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f813c0ad7c0 0x7f813c0aea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:59534/0 (socket says 172.21.15.104:59534) 2024-08-17T02:22:55.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.214+0000 7f813a7fc700 1 -- 172.21.15.104:0/569608946 learned_addr learned my addr 172.21.15.104:0/569608946 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:55.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.214+0000 7f813affd700 1 --2- 172.21.15.104:0/569608946 >> v2:172.21.15.104:3300/0 conn(0x7f813c155d20 0x7f813c0b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:55.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.214+0000 7f8139ffb700 1 -- 172.21.15.104:0/569608946 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 481600231 0 0) 0x7f813c0af2b0 con 0x7f813c0ad7c0 2024-08-17T02:22:55.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.214+0000 7f8139ffb700 1 -- 172.21.15.104:0/569608946 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8124003570 con 0x7f813c0ad7c0 2024-08-17T02:22:55.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.214+0000 7f813affd700 1 -- 172.21.15.104:0/569608946 >> v1:172.21.15.117:6789/0 conn(0x7f813c06df10 legacy=0x7f813c06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:55.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.214+0000 7f813affd700 1 -- 172.21.15.104:0/569608946 >> v1:172.21.15.104:6789/0 conn(0x7f813c0ad7c0 legacy=0x7f813c0aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:55.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.214+0000 7f813affd700 1 -- 172.21.15.104:0/569608946 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f813c0af870 con 0x7f813c155d20 2024-08-17T02:22:55.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.214+0000 7f813affd700 1 --2- 172.21.15.104:0/569608946 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f813c155d20 0x7f813c0b0350 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f81300098e0 tx=0x7f81300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72e189c21eb1d629 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:55.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.214+0000 7f8139ffb700 1 -- 172.21.15.104:0/569608946 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813000b640 con 0x7f813c155d20 2024-08-17T02:22:55.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.214+0000 7f8139ffb700 1 -- 172.21.15.104:0/569608946 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f813000b7a0 con 0x7f813c155d20 2024-08-17T02:22:55.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.214+0000 7f8139ffb700 1 -- 172.21.15.104:0/569608946 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813000bb20 con 0x7f813c155d20 2024-08-17T02:22:55.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.214+0000 7f813bfff700 1 -- 172.21.15.104:0/569608946 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f813c155d20 msgr2=0x7f813c0b0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:55.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.214+0000 7f813bfff700 1 --2- 172.21.15.104:0/569608946 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f813c155d20 0x7f813c0b0350 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f81300098e0 tx=0x7f81300091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:55.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.214+0000 7f813bfff700 1 -- 172.21.15.104:0/569608946 shutdown_connections 2024-08-17T02:22:55.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.214+0000 7f813bfff700 1 --2- 172.21.15.104:0/569608946 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f813c155d20 0x7f813c0b0350 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:55.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.214+0000 7f813bfff700 1 -- 172.21.15.104:0/569608946 >> 172.21.15.104:0/569608946 conn(0x7f813c0678d0 msgr2=0x7f813c067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:55.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.214+0000 7f813bfff700 1 -- 172.21.15.104:0/569608946 shutdown_connections 2024-08-17T02:22:55.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.214+0000 7f813bfff700 1 -- 172.21.15.104:0/569608946 wait complete. 2024-08-17T02:22:55.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.218+0000 7f813bfff700 1 Processor -- start 2024-08-17T02:22:55.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.218+0000 7f813bfff700 1 -- start start 2024-08-17T02:22:55.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.222+0000 7f813bfff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f813c06df10 0x7f813c1569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:55.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.222+0000 7f813bfff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f813c0ad7c0 0x7f813c14e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:55.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.222+0000 7f813bfff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f813c155d20 0x7f813c1586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:55.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.222+0000 7f813bfff700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813c158240 con 0x7f813c155d20 2024-08-17T02:22:55.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.222+0000 7f813bfff700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813c14cac0 con 0x7f813c06df10 2024-08-17T02:22:55.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.222+0000 7f813bfff700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f813c06aac0 con 0x7f813c0ad7c0 2024-08-17T02:22:55.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.222+0000 7f813b7fe700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f813c155d20 0x7f813c1586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:55.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.222+0000 7f813b7fe700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f813c155d20 0x7f813c1586d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45362/0 (socket says 172.21.15.104:45362) 2024-08-17T02:22:55.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.222+0000 7f813b7fe700 1 -- 172.21.15.104:0/836394798 learned_addr learned my addr 172.21.15.104:0/836394798 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:55.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.222+0000 7f813affd700 1 --2- 172.21.15.104:0/836394798 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f813c06df10 0x7f813c1569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:55.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.222+0000 7f813a7fc700 1 --2- 172.21.15.104:0/836394798 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f813c0ad7c0 0x7f813c14e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:55.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.222+0000 7f813b7fe700 1 -- 172.21.15.104:0/836394798 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f813c0ad7c0 msgr2=0x7f813c14e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:55.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.222+0000 7f813b7fe700 1 --2- 172.21.15.104:0/836394798 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f813c0ad7c0 0x7f813c14e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:55.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.222+0000 7f813b7fe700 1 -- 172.21.15.104:0/836394798 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f813c06df10 msgr2=0x7f813c1569c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:55.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.222+0000 7f813b7fe700 1 --2- 172.21.15.104:0/836394798 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f813c06df10 0x7f813c1569c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:55.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.222+0000 7f813b7fe700 1 -- 172.21.15.104:0/836394798 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8130009420 con 0x7f813c155d20 2024-08-17T02:22:55.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.222+0000 7f813b7fe700 1 --2- 172.21.15.104:0/836394798 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f813c155d20 0x7f813c1586d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f813400c8e0 tx=0x7f8134001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:55.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.222+0000 7f8122ffd700 1 -- 172.21.15.104:0/836394798 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8134012630 con 0x7f813c155d20 2024-08-17T02:22:55.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.222+0000 7f8122ffd700 1 -- 172.21.15.104:0/836394798 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8134012790 con 0x7f813c155d20 2024-08-17T02:22:55.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.222+0000 7f813bfff700 1 -- 172.21.15.104:0/836394798 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f813c157350 con 0x7f813c155d20 2024-08-17T02:22:55.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.222+0000 7f8122ffd700 1 -- 172.21.15.104:0/836394798 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8134012b50 con 0x7f813c155d20 2024-08-17T02:22:55.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.222+0000 7f813bfff700 1 -- 172.21.15.104:0/836394798 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f813c157910 con 0x7f813c155d20 2024-08-17T02:22:55.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.222+0000 7f813bfff700 1 -- 172.21.15.104:0/836394798 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f813c1583f0 con 0x7f813c155d20 2024-08-17T02:22:55.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.226+0000 7f8122ffd700 1 -- 172.21.15.104:0/836394798 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f813401a3a0 con 0x7f813c155d20 2024-08-17T02:22:55.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.226+0000 7f8122ffd700 1 --2- 172.21.15.104:0/836394798 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8128060860 0x7f8128062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:55.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.226+0000 7f8122ffd700 1 -- 172.21.15.104:0/836394798 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f813407ce10 con 0x7f813c155d20 2024-08-17T02:22:55.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.226+0000 7f813affd700 1 --2- 172.21.15.104:0/836394798 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8128060860 0x7f8128062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:55.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.226+0000 7f813affd700 1 --2- 172.21.15.104:0/836394798 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8128060860 0x7f8128062d10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f81300093f0 tx=0x7f8130017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:55.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.234+0000 7f8122ffd700 1 -- 172.21.15.104:0/836394798 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f813c1583f0 con 0x7f813c155d20 2024-08-17T02:22:55.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.430+0000 7f813bfff700 1 -- 172.21.15.104:0/836394798 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f813c0643a0 con 0x7f813c155d20 2024-08-17T02:22:55.434 INFO:tasks.ceph.mon.a.smithi104.stderr:2024-08-17T02:22:55.430+0000 7f0dc6781700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:22:55.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.438+0000 7f8122ffd700 1 -- 172.21.15.104:0/836394798 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8134080030 con 0x7f813c155d20 2024-08-17T02:22:55.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.442+0000 7f813bfff700 1 -- 172.21.15.104:0/836394798 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8128060860 msgr2=0x7f8128062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:55.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.442+0000 7f813bfff700 1 --2- 172.21.15.104:0/836394798 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8128060860 0x7f8128062d10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f81300093f0 tx=0x7f8130017000 comp rx=0 tx=0).stop 2024-08-17T02:22:55.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.442+0000 7f813bfff700 1 -- 172.21.15.104:0/836394798 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f813c155d20 msgr2=0x7f813c1586d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:55.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.442+0000 7f813bfff700 1 --2- 172.21.15.104:0/836394798 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f813c155d20 0x7f813c1586d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f813400c8e0 tx=0x7f8134001710 comp rx=0 tx=0).stop 2024-08-17T02:22:55.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.442+0000 7f813bfff700 1 -- 172.21.15.104:0/836394798 shutdown_connections 2024-08-17T02:22:55.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.442+0000 7f813bfff700 1 --2- 172.21.15.104:0/836394798 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8128060860 0x7f8128062d10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:55.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.442+0000 7f813bfff700 1 --2- 172.21.15.104:0/836394798 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f813c155d20 0x7f813c1586d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:55.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.442+0000 7f813bfff700 1 --2- 172.21.15.104:0/836394798 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f813c0ad7c0 0x7f813c14e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:55.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.442+0000 7f813bfff700 1 --2- 172.21.15.104:0/836394798 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f813c06df10 0x7f813c1569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:55.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.442+0000 7f813bfff700 1 -- 172.21.15.104:0/836394798 >> 172.21.15.104:0/836394798 conn(0x7f813c0678d0 msgr2=0x7f813c14bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:55.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.446+0000 7f813bfff700 1 -- 172.21.15.104:0/836394798 shutdown_connections 2024-08-17T02:22:55.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.446+0000 7f813bfff700 1 -- 172.21.15.104:0/836394798 wait complete. 2024-08-17T02:22:55.448 INFO:teuthology.orchestra.run.smithi104.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:22:55.460 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-17T02:22:55.476 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2024-08-17T02:22:55.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.566+0000 7f2186380700 1 Processor -- start 2024-08-17T02:22:55.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.566+0000 7f2186380700 1 -- start start 2024-08-17T02:22:55.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.570+0000 7f2186380700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f21801574f0 0x7f2180157970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:55.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.570+0000 7f2186380700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f218006e010 con 0x7f21801514d0 2024-08-17T02:22:55.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.570+0000 7f2186380700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2180157fb0 con 0x7f21800b0d90 2024-08-17T02:22:55.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.570+0000 7f2186380700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2180158290 con 0x7f21801574f0 2024-08-17T02:22:55.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.570+0000 7f218537e700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f21801514d0 0x7f218006ea60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:59548/0 (socket says 172.21.15.104:59548) 2024-08-17T02:22:55.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.570+0000 7f218537e700 1 -- 172.21.15.104:0/3284498951 learned_addr learned my addr 172.21.15.104:0/3284498951 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:55.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.570+0000 7f2184b7d700 1 --2- 172.21.15.104:0/3284498951 >> v2:172.21.15.117:3300/0 conn(0x7f21801574f0 0x7f2180157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:55.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.570+0000 7f2173fff700 1 -- 172.21.15.104:0/3284498951 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2077427393 0 0) 0x7f218006e010 con 0x7f21801514d0 2024-08-17T02:22:55.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.570+0000 7f2173fff700 1 -- 172.21.15.104:0/3284498951 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f216c003570 con 0x7f21801514d0 2024-08-17T02:22:55.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.570+0000 7f2184b7d700 1 -- 172.21.15.104:0/3284498951 >> v1:172.21.15.117:6789/0 conn(0x7f21800b0d90 legacy=0x7f21800c96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:55.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.570+0000 7f2173fff700 1 -- 172.21.15.104:0/3284498951 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3969137443 0 0) 0x7f216c003570 con 0x7f21801514d0 2024-08-17T02:22:55.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.570+0000 7f2184b7d700 1 -- 172.21.15.104:0/3284498951 >> v1:172.21.15.104:6789/0 conn(0x7f21801514d0 legacy=0x7f218006ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:55.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.570+0000 7f2184b7d700 1 -- 172.21.15.104:0/3284498951 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f218006e260 con 0x7f21801574f0 2024-08-17T02:22:55.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.570+0000 7f2184b7d700 1 --2- 172.21.15.104:0/3284498951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21801574f0 0x7f2180157970 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f21740098e0 tx=0x7f21740091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76ca8554f8c6cbaa server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:55.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.570+0000 7f2173fff700 1 -- 172.21.15.104:0/3284498951 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217c001470 con 0x7f21801574f0 2024-08-17T02:22:55.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.570+0000 7f2173fff700 1 -- 172.21.15.104:0/3284498951 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2174011420 con 0x7f21801574f0 2024-08-17T02:22:55.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.570+0000 7f2173fff700 1 -- 172.21.15.104:0/3284498951 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21740117a0 con 0x7f21801574f0 2024-08-17T02:22:55.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.570+0000 7f2186380700 1 -- 172.21.15.104:0/3284498951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21801574f0 msgr2=0x7f2180157970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:55.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.570+0000 7f2186380700 1 --2- 172.21.15.104:0/3284498951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21801574f0 0x7f2180157970 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f21740098e0 tx=0x7f21740091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:55.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.570+0000 7f2186380700 1 -- 172.21.15.104:0/3284498951 shutdown_connections 2024-08-17T02:22:55.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.570+0000 7f2186380700 1 --2- 172.21.15.104:0/3284498951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21801574f0 0x7f2180157970 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:55.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.570+0000 7f2186380700 1 -- 172.21.15.104:0/3284498951 >> 172.21.15.104:0/3284498951 conn(0x7f21800678a0 msgr2=0x7f2180067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:55.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.570+0000 7f2186380700 1 -- 172.21.15.104:0/3284498951 shutdown_connections 2024-08-17T02:22:55.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.570+0000 7f2186380700 1 -- 172.21.15.104:0/3284498951 wait complete. 2024-08-17T02:22:55.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.574+0000 7f2186380700 1 Processor -- start 2024-08-17T02:22:55.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.574+0000 7f2186380700 1 -- start start 2024-08-17T02:22:55.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.574+0000 7f2186380700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f21800b0d90 0x7f21800aa2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:55.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.574+0000 7f2186380700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21801514d0 0x7f2180169470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:55.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.574+0000 7f2186380700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21801574f0 0x7f21801699b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:55.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.574+0000 7f2186380700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2180169ef0 con 0x7f21800b0d90 2024-08-17T02:22:55.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.574+0000 7f2186380700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21800c7c40 con 0x7f21801574f0 2024-08-17T02:22:55.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.574+0000 7f2186380700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21800c7f20 con 0x7f21801514d0 2024-08-17T02:22:55.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.574+0000 7f218537e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f21800b0d90 0x7f21800aa2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:55.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.574+0000 7f218537e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f21800b0d90 0x7f21800aa2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45372/0 (socket says 172.21.15.104:45372) 2024-08-17T02:22:55.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.574+0000 7f218537e700 1 -- 172.21.15.104:0/1735048920 learned_addr learned my addr 172.21.15.104:0/1735048920 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:55.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.574+0000 7f2184b7d700 1 --2- 172.21.15.104:0/1735048920 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21801514d0 0x7f2180169470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:55.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.574+0000 7f2185b7f700 1 --2- 172.21.15.104:0/1735048920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21801574f0 0x7f21801699b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:55.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.574+0000 7f218537e700 1 -- 172.21.15.104:0/1735048920 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21801514d0 msgr2=0x7f2180169470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:55.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.574+0000 7f218537e700 1 --2- 172.21.15.104:0/1735048920 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21801514d0 0x7f2180169470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:55.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.574+0000 7f218537e700 1 -- 172.21.15.104:0/1735048920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21801574f0 msgr2=0x7f21801699b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:55.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.574+0000 7f218537e700 1 --2- 172.21.15.104:0/1735048920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21801574f0 0x7f21801699b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:55.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.574+0000 7f218537e700 1 -- 172.21.15.104:0/1735048920 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2174009420 con 0x7f21800b0d90 2024-08-17T02:22:55.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.574+0000 7f218537e700 1 --2- 172.21.15.104:0/1735048920 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f21800b0d90 0x7f21800aa2e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f217c00cb90 tx=0x7f217c001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:55.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.574+0000 7f21717fa700 1 -- 172.21.15.104:0/1735048920 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217c007150 con 0x7f21800b0d90 2024-08-17T02:22:55.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.574+0000 7f2186380700 1 -- 172.21.15.104:0/1735048920 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21800c8200 con 0x7f21800b0d90 2024-08-17T02:22:55.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.574+0000 7f21717fa700 1 -- 172.21.15.104:0/1735048920 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f217c0072d0 con 0x7f21800b0d90 2024-08-17T02:22:55.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.574+0000 7f21717fa700 1 -- 172.21.15.104:0/1735048920 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217c007690 con 0x7f21800b0d90 2024-08-17T02:22:55.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.574+0000 7f2186380700 1 -- 172.21.15.104:0/1735048920 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2180168f30 con 0x7f21800b0d90 2024-08-17T02:22:55.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.578+0000 7f2186380700 1 -- 172.21.15.104:0/1735048920 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21800aa880 con 0x7f21800b0d90 2024-08-17T02:22:55.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.578+0000 7f21717fa700 1 -- 172.21.15.104:0/1735048920 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f217c004a40 con 0x7f21800b0d90 2024-08-17T02:22:55.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.578+0000 7f21717fa700 1 --2- 172.21.15.104:0/1735048920 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f2164060890 0x7f2164062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:55.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.578+0000 7f21717fa700 1 -- 172.21.15.104:0/1735048920 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f217c07bfe0 con 0x7f21800b0d90 2024-08-17T02:22:55.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.578+0000 7f2184b7d700 1 --2- 172.21.15.104:0/1735048920 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f2164060890 0x7f2164062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:55.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.582+0000 7f2184b7d700 1 --2- 172.21.15.104:0/1735048920 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f2164060890 0x7f2164062d40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2174009fd0 tx=0x7f2174016000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:55.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.586+0000 7f21717fa700 1 -- 172.21.15.104:0/1735048920 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f217c04c3e0 con 0x7f21800b0d90 2024-08-17T02:22:55.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:55.786+0000 7f2186380700 1 -- 172.21.15.104:0/1735048920 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2180064330 con 0x7f21800b0d90 2024-08-17T02:22:56.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.446+0000 7f21717fa700 1 -- 172.21.15.104:0/1735048920 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f217c04fa00 con 0x7f21800b0d90 2024-08-17T02:22:56.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.450+0000 7f2186380700 1 -- 172.21.15.104:0/1735048920 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f2164060890 msgr2=0x7f2164062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:56.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.450+0000 7f2186380700 1 --2- 172.21.15.104:0/1735048920 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f2164060890 0x7f2164062d40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2174009fd0 tx=0x7f2174016000 comp rx=0 tx=0).stop 2024-08-17T02:22:56.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.450+0000 7f2186380700 1 -- 172.21.15.104:0/1735048920 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f21800b0d90 msgr2=0x7f21800aa2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:56.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.450+0000 7f2186380700 1 --2- 172.21.15.104:0/1735048920 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f21800b0d90 0x7f21800aa2e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f217c00cb90 tx=0x7f217c001aa0 comp rx=0 tx=0).stop 2024-08-17T02:22:56.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.450+0000 7f2186380700 1 -- 172.21.15.104:0/1735048920 shutdown_connections 2024-08-17T02:22:56.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.450+0000 7f2186380700 1 --2- 172.21.15.104:0/1735048920 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f2164060890 0x7f2164062d40 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:56.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.450+0000 7f2186380700 1 --2- 172.21.15.104:0/1735048920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21801574f0 0x7f21801699b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:56.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.450+0000 7f2186380700 1 --2- 172.21.15.104:0/1735048920 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21801514d0 0x7f2180169470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:56.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.450+0000 7f2186380700 1 --2- 172.21.15.104:0/1735048920 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f21800b0d90 0x7f21800aa2e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:56.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.450+0000 7f2186380700 1 -- 172.21.15.104:0/1735048920 >> 172.21.15.104:0/1735048920 conn(0x7f21800678a0 msgr2=0x7f21800c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:56.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.450+0000 7f2186380700 1 -- 172.21.15.104:0/1735048920 shutdown_connections 2024-08-17T02:22:56.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.450+0000 7f2186380700 1 -- 172.21.15.104:0/1735048920 wait complete. 2024-08-17T02:22:56.466 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-17T02:22:56.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.586+0000 7fc7e57ec700 1 Processor -- start 2024-08-17T02:22:56.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.586+0000 7fc7e57ec700 1 -- start start 2024-08-17T02:22:56.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.586+0000 7fc7e57ec700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc7e00b26d0 0x7fc7e00b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:56.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.586+0000 7fc7e57ec700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7e00c5fd0 0x7fc7e00c6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:56.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.586+0000 7fc7e57ec700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e00c5b40 con 0x7fc7e00c6960 2024-08-17T02:22:56.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.586+0000 7fc7e57ec700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7e00b2aa0 con 0x7fc7e00b26d0 2024-08-17T02:22:56.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.586+0000 7fc7e57ec700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e0159820 con 0x7fc7e00c5fd0 2024-08-17T02:22:56.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.586+0000 7fc7e4feb700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fc7e00c6960 0x7fc7e00cacd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:59554/0 (socket says 172.21.15.104:59554) 2024-08-17T02:22:56.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.586+0000 7fc7e4feb700 1 -- 172.21.15.104:0/1277315146 learned_addr learned my addr 172.21.15.104:0/1277315146 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:56.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.586+0000 7fc7df7fe700 1 --2- 172.21.15.104:0/1277315146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7e00c5fd0 0x7fc7e00c6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:56.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.586+0000 7fc7dffff700 1 --2- 172.21.15.104:0/1277315146 >> v2:172.21.15.117:3300/0 conn(0x7fc7e00b26d0 0x7fc7e00b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:56.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.586+0000 7fc7deffd700 1 -- 172.21.15.104:0/1277315146 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2559813807 0 0) 0x7fc7e00c5b40 con 0x7fc7e00c6960 2024-08-17T02:22:56.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.586+0000 7fc7deffd700 1 -- 172.21.15.104:0/1277315146 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7cc003570 con 0x7fc7e00c6960 2024-08-17T02:22:56.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.586+0000 7fc7dffff700 1 -- 172.21.15.104:0/1277315146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7e00c5fd0 msgr2=0x7fc7e00c6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:56.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.586+0000 7fc7dffff700 1 --2- 172.21.15.104:0/1277315146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7e00c5fd0 0x7fc7e00c6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:56.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.586+0000 7fc7dffff700 1 -- 172.21.15.104:0/1277315146 >> v1:172.21.15.104:6789/0 conn(0x7fc7e00c6960 legacy=0x7fc7e00cacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:56.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.586+0000 7fc7dffff700 1 -- 172.21.15.104:0/1277315146 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e00c4f30 con 0x7fc7e00b26d0 2024-08-17T02:22:56.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.586+0000 7fc7df7fe700 1 --2- 172.21.15.104:0/1277315146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7e00c5fd0 0x7fc7e00c6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:22:56.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.586+0000 7fc7dffff700 1 --2- 172.21.15.104:0/1277315146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7e00b26d0 0x7fc7e00b2e90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc7c80098e0 tx=0x7fc7c80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3263ce3b2362850a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:56.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.586+0000 7fc7deffd700 1 -- 172.21.15.104:0/1277315146 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8011630 con 0x7fc7e00b26d0 2024-08-17T02:22:56.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.590+0000 7fc7deffd700 1 -- 172.21.15.104:0/1277315146 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c8011790 con 0x7fc7e00b26d0 2024-08-17T02:22:56.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.590+0000 7fc7deffd700 1 -- 172.21.15.104:0/1277315146 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8011b30 con 0x7fc7e00b26d0 2024-08-17T02:22:56.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.590+0000 7fc7e57ec700 1 -- 172.21.15.104:0/1277315146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7e00b26d0 msgr2=0x7fc7e00b2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:56.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.590+0000 7fc7e57ec700 1 --2- 172.21.15.104:0/1277315146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7e00b26d0 0x7fc7e00b2e90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc7c80098e0 tx=0x7fc7c80091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:56.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.590+0000 7fc7e57ec700 1 -- 172.21.15.104:0/1277315146 shutdown_connections 2024-08-17T02:22:56.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.590+0000 7fc7e57ec700 1 --2- 172.21.15.104:0/1277315146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7e00c5fd0 0x7fc7e00c6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:56.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.590+0000 7fc7e57ec700 1 --2- 172.21.15.104:0/1277315146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7e00b26d0 0x7fc7e00b2e90 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:56.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.590+0000 7fc7e57ec700 1 -- 172.21.15.104:0/1277315146 >> 172.21.15.104:0/1277315146 conn(0x7fc7e0067590 msgr2=0x7fc7e00d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:56.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.590+0000 7fc7e57ec700 1 -- 172.21.15.104:0/1277315146 shutdown_connections 2024-08-17T02:22:56.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.590+0000 7fc7e57ec700 1 -- 172.21.15.104:0/1277315146 wait complete. 2024-08-17T02:22:56.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.590+0000 7fc7e57ec700 1 Processor -- start 2024-08-17T02:22:56.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.590+0000 7fc7e57ec700 1 -- start start 2024-08-17T02:22:56.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.594+0000 7fc7e57ec700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7e00b26d0 0x7fc7e015d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:56.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.594+0000 7fc7e57ec700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7e00c5fd0 0x7fc7e0143260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:56.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.594+0000 7fc7e57ec700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7e00c6960 0x7fc7e00cbb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:56.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.594+0000 7fc7e57ec700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e00c8970 con 0x7fc7e00c5fd0 2024-08-17T02:22:56.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.594+0000 7fc7e57ec700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e00c9790 con 0x7fc7e00c6960 2024-08-17T02:22:56.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.594+0000 7fc7e57ec700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e00c8b80 con 0x7fc7e00b26d0 2024-08-17T02:22:56.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.594+0000 7fc7df7fe700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7e00c5fd0 0x7fc7e0143260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:56.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.594+0000 7fc7df7fe700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7e00c5fd0 0x7fc7e0143260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45388/0 (socket says 172.21.15.104:45388) 2024-08-17T02:22:56.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.594+0000 7fc7df7fe700 1 -- 172.21.15.104:0/4089440183 learned_addr learned my addr 172.21.15.104:0/4089440183 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:56.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.594+0000 7fc7dffff700 1 --2- 172.21.15.104:0/4089440183 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7e00b26d0 0x7fc7e015d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:56.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.594+0000 7fc7e4feb700 1 --2- 172.21.15.104:0/4089440183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7e00c6960 0x7fc7e00cbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:56.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.594+0000 7fc7df7fe700 1 -- 172.21.15.104:0/4089440183 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7e00b26d0 msgr2=0x7fc7e015d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:56.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.594+0000 7fc7df7fe700 1 --2- 172.21.15.104:0/4089440183 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7e00b26d0 0x7fc7e015d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:56.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.594+0000 7fc7df7fe700 1 -- 172.21.15.104:0/4089440183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7e00c6960 msgr2=0x7fc7e00cbb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:56.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.594+0000 7fc7df7fe700 1 --2- 172.21.15.104:0/4089440183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7e00c6960 0x7fc7e00cbb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:56.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.594+0000 7fc7df7fe700 1 -- 172.21.15.104:0/4089440183 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d00093c0 con 0x7fc7e00c5fd0 2024-08-17T02:22:56.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.594+0000 7fc7dffff700 1 --2- 172.21.15.104:0/4089440183 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7e00b26d0 0x7fc7e015d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:22:56.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.594+0000 7fc7e4feb700 1 --2- 172.21.15.104:0/4089440183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7e00c6960 0x7fc7e00cbb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:22:56.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.594+0000 7fc7df7fe700 1 --2- 172.21.15.104:0/4089440183 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7e00c5fd0 0x7fc7e0143260 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc7d000ec80 tx=0x7fc7d0009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:56.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.594+0000 7fc7d7fff700 1 -- 172.21.15.104:0/4089440183 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d0005a00 con 0x7fc7e00c5fd0 2024-08-17T02:22:56.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.594+0000 7fc7d7fff700 1 -- 172.21.15.104:0/4089440183 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d0005b60 con 0x7fc7e00c5fd0 2024-08-17T02:22:56.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.594+0000 7fc7d7fff700 1 -- 172.21.15.104:0/4089440183 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d000c9d0 con 0x7fc7e00c5fd0 2024-08-17T02:22:56.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.594+0000 7fc7e57ec700 1 -- 172.21.15.104:0/4089440183 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7c8009420 con 0x7fc7e00c5fd0 2024-08-17T02:22:56.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.594+0000 7fc7e57ec700 1 -- 172.21.15.104:0/4089440183 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7e00c9140 con 0x7fc7e00c5fd0 2024-08-17T02:22:56.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.594+0000 7fc7e57ec700 1 -- 172.21.15.104:0/4089440183 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7e00644b0 con 0x7fc7e00c5fd0 2024-08-17T02:22:56.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.598+0000 7fc7d7fff700 1 -- 172.21.15.104:0/4089440183 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fc7d000cd80 con 0x7fc7e00c5fd0 2024-08-17T02:22:56.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.598+0000 7fc7d7fff700 1 --2- 172.21.15.104:0/4089440183 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fc7c0060860 0x7fc7c0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:56.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.598+0000 7fc7d7fff700 1 -- 172.21.15.104:0/4089440183 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fc7d007d270 con 0x7fc7e00c5fd0 2024-08-17T02:22:56.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.598+0000 7fc7dffff700 1 --2- 172.21.15.104:0/4089440183 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fc7c0060860 0x7fc7c0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:56.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.598+0000 7fc7dffff700 1 --2- 172.21.15.104:0/4089440183 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fc7c0060860 0x7fc7c0062d10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc7c80091e0 tx=0x7fc7c8017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:56.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.606+0000 7fc7d7fff700 1 -- 172.21.15.104:0/4089440183 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fc7d004d5d0 con 0x7fc7e00c5fd0 2024-08-17T02:22:56.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:56.770+0000 7fc7e57ec700 1 -- 172.21.15.104:0/4089440183 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc7e00b31b0 con 0x7fc7e00c5fd0 2024-08-17T02:22:57.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.450+0000 7fc7d7fff700 1 -- 172.21.15.104:0/4089440183 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc7d0050bf0 con 0x7fc7e00c5fd0 2024-08-17T02:22:57.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.454+0000 7fc7e57ec700 1 -- 172.21.15.104:0/4089440183 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fc7c0060860 msgr2=0x7fc7c0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:57.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.454+0000 7fc7e57ec700 1 --2- 172.21.15.104:0/4089440183 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fc7c0060860 0x7fc7c0062d10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc7c80091e0 tx=0x7fc7c8017000 comp rx=0 tx=0).stop 2024-08-17T02:22:57.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.454+0000 7fc7e57ec700 1 -- 172.21.15.104:0/4089440183 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7e00c5fd0 msgr2=0x7fc7e0143260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:57.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.454+0000 7fc7e57ec700 1 --2- 172.21.15.104:0/4089440183 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7e00c5fd0 0x7fc7e0143260 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc7d000ec80 tx=0x7fc7d0009120 comp rx=0 tx=0).stop 2024-08-17T02:22:57.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.454+0000 7fc7e57ec700 1 -- 172.21.15.104:0/4089440183 shutdown_connections 2024-08-17T02:22:57.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.454+0000 7fc7e57ec700 1 --2- 172.21.15.104:0/4089440183 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fc7c0060860 0x7fc7c0062d10 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:57.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.454+0000 7fc7e57ec700 1 --2- 172.21.15.104:0/4089440183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7e00c6960 0x7fc7e00cbb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:57.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.454+0000 7fc7e57ec700 1 --2- 172.21.15.104:0/4089440183 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7e00c5fd0 0x7fc7e0143260 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:57.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.454+0000 7fc7e57ec700 1 --2- 172.21.15.104:0/4089440183 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7e00b26d0 0x7fc7e015d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:57.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.454+0000 7fc7e57ec700 1 -- 172.21.15.104:0/4089440183 >> 172.21.15.104:0/4089440183 conn(0x7fc7e0067590 msgr2=0x7fc7e00b4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:57.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.454+0000 7fc7e57ec700 1 -- 172.21.15.104:0/4089440183 shutdown_connections 2024-08-17T02:22:57.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.454+0000 7fc7e57ec700 1 -- 172.21.15.104:0/4089440183 wait complete. 2024-08-17T02:22:57.460 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_metadata' removed 2024-08-17T02:22:57.474 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-17T02:22:57.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.586+0000 7f94cb216700 1 Processor -- start 2024-08-17T02:22:57.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.586+0000 7f94cb216700 1 -- start start 2024-08-17T02:22:57.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.586+0000 7f94cb216700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94c415a3b0 0x7f94c40b0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:57.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.586+0000 7f94cb216700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f94c415a780 0x7f94c40686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:57.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.586+0000 7f94cb216700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f94c4068be0 0x7f94c40ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:57.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.586+0000 7f94cb216700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94c4069040 con 0x7f94c415a780 2024-08-17T02:22:57.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.586+0000 7f94cb216700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94c406e350 con 0x7f94c4068be0 2024-08-17T02:22:57.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.586+0000 7f94cb216700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c406ebf0 con 0x7f94c415a3b0 2024-08-17T02:22:57.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.586+0000 7f94c9a13700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f94c415a780 0x7f94c40686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:57.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.586+0000 7f94c9a13700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f94c415a780 0x7f94c40686a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44648/0 (socket says 172.21.15.104:44648) 2024-08-17T02:22:57.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.586+0000 7f94c9a13700 1 -- 172.21.15.104:0/1892672556 learned_addr learned my addr 172.21.15.104:0/1892672556 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:57.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.586+0000 7f94caa15700 1 --2- 172.21.15.104:0/1892672556 >> v2:172.21.15.117:3300/0 conn(0x7f94c4068be0 0x7f94c40ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:57.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.590+0000 7f94ca214700 1 --2- 172.21.15.104:0/1892672556 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94c415a3b0 0x7f94c40b0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:57.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.590+0000 7f94c9a13700 1 -- 172.21.15.104:0/1892672556 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94c415a3b0 msgr2=0x7f94c40b0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:57.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.590+0000 7f94c9a13700 1 --2- 172.21.15.104:0/1892672556 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94c415a3b0 0x7f94c40b0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:57.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.590+0000 7f94c9a13700 1 -- 172.21.15.104:0/1892672556 >> v2:172.21.15.117:3300/0 conn(0x7f94c4068be0 msgr2=0x7f94c40ca3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:57.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.590+0000 7f94c9a13700 1 --2- 172.21.15.104:0/1892672556 >> v2:172.21.15.117:3300/0 conn(0x7f94c4068be0 0x7f94c40ca3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:57.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.590+0000 7f94c9a13700 1 -- 172.21.15.104:0/1892672556 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c40af0b0 con 0x7f94c415a780 2024-08-17T02:22:57.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.590+0000 7f94c9a13700 1 --2- 172.21.15.104:0/1892672556 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f94c415a780 0x7f94c40686a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f94c4066f00 tx=0x7f94b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=898d54b715367a89 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:57.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.590+0000 7f94c9212700 1 -- 172.21.15.104:0/1892672556 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b800b860 con 0x7f94c415a780 2024-08-17T02:22:57.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.590+0000 7f94c9212700 1 -- 172.21.15.104:0/1892672556 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b800b9c0 con 0x7f94c415a780 2024-08-17T02:22:57.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.590+0000 7f94c9212700 1 -- 172.21.15.104:0/1892672556 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b800bd80 con 0x7f94c415a780 2024-08-17T02:22:57.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.590+0000 7f94cb216700 1 -- 172.21.15.104:0/1892672556 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f94c415a780 msgr2=0x7f94c40686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:57.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.590+0000 7f94cb216700 1 --2- 172.21.15.104:0/1892672556 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f94c415a780 0x7f94c40686a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f94c4066f00 tx=0x7f94b8009250 comp rx=0 tx=0).stop 2024-08-17T02:22:57.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.590+0000 7f94cb216700 1 -- 172.21.15.104:0/1892672556 shutdown_connections 2024-08-17T02:22:57.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.590+0000 7f94cb216700 1 --2- 172.21.15.104:0/1892672556 >> v2:172.21.15.117:3300/0 conn(0x7f94c4068be0 0x7f94c40ca3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:57.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.590+0000 7f94cb216700 1 --2- 172.21.15.104:0/1892672556 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f94c415a780 0x7f94c40686a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:57.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.590+0000 7f94cb216700 1 --2- 172.21.15.104:0/1892672556 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94c415a3b0 0x7f94c40b0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:57.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.590+0000 7f94cb216700 1 -- 172.21.15.104:0/1892672556 >> 172.21.15.104:0/1892672556 conn(0x7f94c40ccf70 msgr2=0x7f94c406d980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:57.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.590+0000 7f94cb216700 1 -- 172.21.15.104:0/1892672556 shutdown_connections 2024-08-17T02:22:57.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.590+0000 7f94cb216700 1 -- 172.21.15.104:0/1892672556 wait complete. 2024-08-17T02:22:57.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.594+0000 7f94cb216700 1 Processor -- start 2024-08-17T02:22:57.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.594+0000 7f94cb216700 1 -- start start 2024-08-17T02:22:57.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.594+0000 7f94cb216700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f94c4068be0 0x7f94c40aaf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:57.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.594+0000 7f94cb216700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94c415a3b0 0x7f94c4146520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:57.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.594+0000 7f94cb216700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94c415a780 0x7f94c406aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:57.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.594+0000 7f94cb216700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c41450d0 con 0x7f94c4068be0 2024-08-17T02:22:57.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.594+0000 7f94cb216700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c41444c0 con 0x7f94c415a780 2024-08-17T02:22:57.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.594+0000 7f94cb216700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c41447a0 con 0x7f94c415a3b0 2024-08-17T02:22:57.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.594+0000 7f94ca214700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f94c4068be0 0x7f94c40aaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:57.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.594+0000 7f94ca214700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f94c4068be0 0x7f94c40aaf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44652/0 (socket says 172.21.15.104:44652) 2024-08-17T02:22:57.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.594+0000 7f94ca214700 1 -- 172.21.15.104:0/3842590679 learned_addr learned my addr 172.21.15.104:0/3842590679 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:57.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.594+0000 7f94c9a13700 1 --2- 172.21.15.104:0/3842590679 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94c415a3b0 0x7f94c4146520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:57.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.594+0000 7f94caa15700 1 --2- 172.21.15.104:0/3842590679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94c415a780 0x7f94c406aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:57.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.598+0000 7f94ca214700 1 -- 172.21.15.104:0/3842590679 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94c415a3b0 msgr2=0x7f94c4146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:57.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.598+0000 7f94ca214700 1 --2- 172.21.15.104:0/3842590679 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94c415a3b0 0x7f94c4146520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:57.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.598+0000 7f94ca214700 1 -- 172.21.15.104:0/3842590679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94c415a780 msgr2=0x7f94c406aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:57.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.598+0000 7f94ca214700 1 --2- 172.21.15.104:0/3842590679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94c415a780 0x7f94c406aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:57.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.598+0000 7f94ca214700 1 -- 172.21.15.104:0/3842590679 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b80094f0 con 0x7f94c4068be0 2024-08-17T02:22:57.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.598+0000 7f94ca214700 1 --2- 172.21.15.104:0/3842590679 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f94c4068be0 0x7f94c40aaf70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f94c000d890 tx=0x7f94c0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:57.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.598+0000 7f94b67fc700 1 -- 172.21.15.104:0/3842590679 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c00125f0 con 0x7f94c4068be0 2024-08-17T02:22:57.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.598+0000 7f94b67fc700 1 -- 172.21.15.104:0/3842590679 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c0012750 con 0x7f94c4068be0 2024-08-17T02:22:57.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.598+0000 7f94cb216700 1 -- 172.21.15.104:0/3842590679 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94c4144a80 con 0x7f94c4068be0 2024-08-17T02:22:57.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.598+0000 7f94b67fc700 1 -- 172.21.15.104:0/3842590679 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c0012af0 con 0x7f94c4068be0 2024-08-17T02:22:57.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.598+0000 7f94cb216700 1 -- 172.21.15.104:0/3842590679 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94c40ab4b0 con 0x7f94c4068be0 2024-08-17T02:22:57.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.598+0000 7f94cb216700 1 -- 172.21.15.104:0/3842590679 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94c40644b0 con 0x7f94c4068be0 2024-08-17T02:22:57.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.598+0000 7f94b67fc700 1 -- 172.21.15.104:0/3842590679 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f94c001e460 con 0x7f94c4068be0 2024-08-17T02:22:57.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.602+0000 7f94b67fc700 1 --2- 172.21.15.104:0/3842590679 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f94a8060860 0x7f94a8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:57.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.602+0000 7f94b67fc700 1 -- 172.21.15.104:0/3842590679 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f94c007cfc0 con 0x7f94c4068be0 2024-08-17T02:22:57.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.602+0000 7f94c9a13700 1 --2- 172.21.15.104:0/3842590679 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f94a8060860 0x7f94a8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:57.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.602+0000 7f94c9a13700 1 --2- 172.21.15.104:0/3842590679 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f94a8060860 0x7f94a8062d10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f94c4066f00 tx=0x7f94b8017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:57.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.610+0000 7f94b67fc700 1 -- 172.21.15.104:0/3842590679 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f94c00ad480 con 0x7f94c4068be0 2024-08-17T02:22:57.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:57.782+0000 7f94cb216700 1 -- 172.21.15.104:0/3842590679 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f94c40c8750 con 0x7f94c4068be0 2024-08-17T02:22:58.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.462+0000 7f94b67fc700 1 -- 172.21.15.104:0/3842590679 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7f94c0051000 con 0x7f94c4068be0 2024-08-17T02:22:58.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.466+0000 7f94cb216700 1 -- 172.21.15.104:0/3842590679 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f94a8060860 msgr2=0x7f94a8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:58.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.466+0000 7f94cb216700 1 --2- 172.21.15.104:0/3842590679 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f94a8060860 0x7f94a8062d10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f94c4066f00 tx=0x7f94b8017000 comp rx=0 tx=0).stop 2024-08-17T02:22:58.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.466+0000 7f94cb216700 1 -- 172.21.15.104:0/3842590679 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f94c4068be0 msgr2=0x7f94c40aaf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:58.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.466+0000 7f94cb216700 1 --2- 172.21.15.104:0/3842590679 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f94c4068be0 0x7f94c40aaf70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f94c000d890 tx=0x7f94c0008040 comp rx=0 tx=0).stop 2024-08-17T02:22:58.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.466+0000 7f94cb216700 1 -- 172.21.15.104:0/3842590679 shutdown_connections 2024-08-17T02:22:58.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.466+0000 7f94cb216700 1 --2- 172.21.15.104:0/3842590679 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f94a8060860 0x7f94a8062d10 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:58.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.466+0000 7f94cb216700 1 --2- 172.21.15.104:0/3842590679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94c415a780 0x7f94c406aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:58.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.466+0000 7f94cb216700 1 --2- 172.21.15.104:0/3842590679 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94c415a3b0 0x7f94c4146520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:58.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.466+0000 7f94cb216700 1 --2- 172.21.15.104:0/3842590679 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f94c4068be0 0x7f94c40aaf70 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:58.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.466+0000 7f94cb216700 1 -- 172.21.15.104:0/3842590679 >> 172.21.15.104:0/3842590679 conn(0x7f94c40ccf70 msgr2=0x7f94c40ca2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:58.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.466+0000 7f94cb216700 1 -- 172.21.15.104:0/3842590679 shutdown_connections 2024-08-17T02:22:58.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.466+0000 7f94cb216700 1 -- 172.21.15.104:0/3842590679 wait complete. 2024-08-17T02:22:58.474 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_data' removed 2024-08-17T02:22:58.483 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-17T02:22:58.484 INFO:tasks.ceph.mds.a:Stopping old one... 2024-08-17T02:22:58.484 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-17T02:22:58.484 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:22:58.484 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-17T02:22:58.484 INFO:tasks.ceph.mds.c:Stopping old one... 2024-08-17T02:22:58.485 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-17T02:22:58.485 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:22:58.485 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-17T02:22:58.485 INFO:tasks.ceph.mds.b:Stopping old one... 2024-08-17T02:22:58.485 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-17T02:22:58.485 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:22:58.485 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-17T02:22:58.485 INFO:tasks.ceph.mds.d:Stopping old one... 2024-08-17T02:22:58.486 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-17T02:22:58.486 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:22:58.494 INFO:tasks.ceph.mds.c:Stopped 2024-08-17T02:22:58.494 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-17T02:22:58.496 INFO:tasks.ceph.mds.a:Stopped 2024-08-17T02:22:58.496 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-17T02:22:58.496 INFO:tasks.ceph.mds.c:Started 2024-08-17T02:22:58.497 DEBUG:teuthology.parallel:result is None 2024-08-17T02:22:58.498 INFO:tasks.ceph.mds.b:Stopped 2024-08-17T02:22:58.498 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-17T02:22:58.499 INFO:tasks.ceph.mds.d:Stopped 2024-08-17T02:22:58.500 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-17T02:22:58.500 INFO:tasks.ceph.mds.a:Started 2024-08-17T02:22:58.501 DEBUG:teuthology.parallel:result is None 2024-08-17T02:22:58.501 INFO:tasks.ceph.mds.b:Started 2024-08-17T02:22:58.502 DEBUG:teuthology.parallel:result is None 2024-08-17T02:22:58.503 INFO:tasks.ceph.mds.d:Started 2024-08-17T02:22:58.503 DEBUG:teuthology.parallel:result is None 2024-08-17T02:22:58.503 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-08-17T02:22:58.571 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2024-08-17T02:22:58.571 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2024-08-17T02:22:58.578 INFO:tasks.ceph.mds.c.smithi104.stdout:starting mds.c at 2024-08-17T02:22:58.584 INFO:tasks.ceph.mds.a.smithi104.stdout:starting mds.a at 2024-08-17T02:22:58.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.598+0000 7f7e315ac700 1 Processor -- start 2024-08-17T02:22:58.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.598+0000 7f7e315ac700 1 -- start start 2024-08-17T02:22:58.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.602+0000 7f7e315ac700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7e2c0ad0d0 0x7f7e2c0ad4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:58.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.602+0000 7f7e315ac700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e2c0ac540 0x7f7e2c0aa440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:58.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.602+0000 7f7e315ac700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7e2c0ac9b0 0x7f7e2c0aa980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:58.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.602+0000 7f7e315ac700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e2c0ab020 con 0x7f7e2c0ad0d0 2024-08-17T02:22:58.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.602+0000 7f7e315ac700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e2c0ac0b0 con 0x7f7e2c0ac9b0 2024-08-17T02:22:58.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.602+0000 7f7e315ac700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c0ab780 con 0x7f7e2c0ac540 2024-08-17T02:22:58.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.602+0000 7f7e2affd700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7e2c0ad0d0 0x7f7e2c0ad4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:58.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.602+0000 7f7e2affd700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7e2c0ad0d0 0x7f7e2c0ad4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44700/0 (socket says 172.21.15.104:44700) 2024-08-17T02:22:58.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.602+0000 7f7e2affd700 1 -- 172.21.15.104:0/3678970472 learned_addr learned my addr 172.21.15.104:0/3678970472 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:58.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.602+0000 7f7e2a7fc700 1 --2- 172.21.15.104:0/3678970472 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e2c0ac540 0x7f7e2c0aa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:58.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.602+0000 7f7e2b7fe700 1 --2- 172.21.15.104:0/3678970472 >> v2:172.21.15.117:3300/0 conn(0x7f7e2c0ac9b0 0x7f7e2c0aa980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:58.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.602+0000 7f7e2affd700 1 -- 172.21.15.104:0/3678970472 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e2c0ac540 msgr2=0x7f7e2c0aa440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:58.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.602+0000 7f7e2affd700 1 --2- 172.21.15.104:0/3678970472 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e2c0ac540 0x7f7e2c0aa440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:58.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.602+0000 7f7e2affd700 1 -- 172.21.15.104:0/3678970472 >> v2:172.21.15.117:3300/0 conn(0x7f7e2c0ac9b0 msgr2=0x7f7e2c0aa980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:58.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.602+0000 7f7e2affd700 1 --2- 172.21.15.104:0/3678970472 >> v2:172.21.15.117:3300/0 conn(0x7f7e2c0ac9b0 0x7f7e2c0aa980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:58.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.602+0000 7f7e2affd700 1 -- 172.21.15.104:0/3678970472 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e2c0aba60 con 0x7f7e2c0ad0d0 2024-08-17T02:22:58.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.602+0000 7f7e2affd700 1 --2- 172.21.15.104:0/3678970472 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7e2c0ad0d0 0x7f7e2c0ad4a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c00bc50 tx=0x7f7e1c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55345096e65deea5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:58.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.602+0000 7f7e29ffb700 1 -- 172.21.15.104:0/3678970472 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c00be60 con 0x7f7e2c0ad0d0 2024-08-17T02:22:58.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.602+0000 7f7e29ffb700 1 -- 172.21.15.104:0/3678970472 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1c00ddc0 con 0x7f7e2c0ad0d0 2024-08-17T02:22:58.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.602+0000 7f7e29ffb700 1 -- 172.21.15.104:0/3678970472 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c0196b0 con 0x7f7e2c0ad0d0 2024-08-17T02:22:58.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.602+0000 7f7e315ac700 1 -- 172.21.15.104:0/3678970472 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7e2c0ad0d0 msgr2=0x7f7e2c0ad4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:58.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.602+0000 7f7e315ac700 1 --2- 172.21.15.104:0/3678970472 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7e2c0ad0d0 0x7f7e2c0ad4a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c00bc50 tx=0x7f7e1c00b4f0 comp rx=0 tx=0).stop 2024-08-17T02:22:58.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.602+0000 7f7e315ac700 1 -- 172.21.15.104:0/3678970472 shutdown_connections 2024-08-17T02:22:58.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.602+0000 7f7e315ac700 1 --2- 172.21.15.104:0/3678970472 >> v2:172.21.15.117:3300/0 conn(0x7f7e2c0ac9b0 0x7f7e2c0aa980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:58.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.602+0000 7f7e315ac700 1 --2- 172.21.15.104:0/3678970472 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e2c0ac540 0x7f7e2c0aa440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:58.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.602+0000 7f7e315ac700 1 --2- 172.21.15.104:0/3678970472 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7e2c0ad0d0 0x7f7e2c0ad4a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:58.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.602+0000 7f7e315ac700 1 -- 172.21.15.104:0/3678970472 >> 172.21.15.104:0/3678970472 conn(0x7f7e2c068300 msgr2=0x7f7e2c0a8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:58.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.602+0000 7f7e315ac700 1 -- 172.21.15.104:0/3678970472 shutdown_connections 2024-08-17T02:22:58.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.602+0000 7f7e315ac700 1 -- 172.21.15.104:0/3678970472 wait complete. 2024-08-17T02:22:58.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.602+0000 7f7e315ac700 1 Processor -- start 2024-08-17T02:22:58.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.602+0000 7f7e315ac700 1 -- start start 2024-08-17T02:22:58.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.606+0000 7f7e315ac700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7e2c0ac540 0x7f7e2c165210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:58.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.606+0000 7f7e315ac700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e2c0ac9b0 0x7f7e2c14ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:58.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.606+0000 7f7e315ac700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e2c0ad0d0 0x7f7e2c152000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:58.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.606+0000 7f7e315ac700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c166880 con 0x7f7e2c0ac540 2024-08-17T02:22:58.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.606+0000 7f7e315ac700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c1658a0 con 0x7f7e2c0ad0d0 2024-08-17T02:22:58.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.606+0000 7f7e315ac700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c165b80 con 0x7f7e2c0ac9b0 2024-08-17T02:22:58.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.606+0000 7f7e2affd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7e2c0ac540 0x7f7e2c165210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:58.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.606+0000 7f7e2affd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7e2c0ac540 0x7f7e2c165210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44702/0 (socket says 172.21.15.104:44702) 2024-08-17T02:22:58.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.606+0000 7f7e2affd700 1 -- 172.21.15.104:0/1186132999 learned_addr learned my addr 172.21.15.104:0/1186132999 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:58.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.606+0000 7f7e2b7fe700 1 --2- 172.21.15.104:0/1186132999 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e2c0ad0d0 0x7f7e2c152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:58.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.606+0000 7f7e2a7fc700 1 --2- 172.21.15.104:0/1186132999 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e2c0ac9b0 0x7f7e2c14ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:58.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.606+0000 7f7e2affd700 1 -- 172.21.15.104:0/1186132999 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e2c0ac9b0 msgr2=0x7f7e2c14ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:58.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.606+0000 7f7e2affd700 1 --2- 172.21.15.104:0/1186132999 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e2c0ac9b0 0x7f7e2c14ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:58.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.606+0000 7f7e2affd700 1 -- 172.21.15.104:0/1186132999 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e2c0ad0d0 msgr2=0x7f7e2c152000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:58.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.606+0000 7f7e2affd700 1 --2- 172.21.15.104:0/1186132999 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e2c0ad0d0 0x7f7e2c152000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:58.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.606+0000 7f7e2affd700 1 -- 172.21.15.104:0/1186132999 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1c00b790 con 0x7f7e2c0ac540 2024-08-17T02:22:58.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.606+0000 7f7e2a7fc700 1 --2- 172.21.15.104:0/1186132999 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e2c0ac9b0 0x7f7e2c14ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:22:58.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.606+0000 7f7e2affd700 1 --2- 172.21.15.104:0/1186132999 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7e2c0ac540 0x7f7e2c165210 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c00b760 tx=0x7f7e1c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:58.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.606+0000 7f7e12ffd700 1 -- 172.21.15.104:0/1186132999 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c010540 con 0x7f7e2c0ac540 2024-08-17T02:22:58.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.606+0000 7f7e12ffd700 1 -- 172.21.15.104:0/1186132999 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1c0106a0 con 0x7f7e2c0ac540 2024-08-17T02:22:58.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.606+0000 7f7e315ac700 1 -- 172.21.15.104:0/1186132999 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e2c165e60 con 0x7f7e2c0ac540 2024-08-17T02:22:58.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.606+0000 7f7e12ffd700 1 -- 172.21.15.104:0/1186132999 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c010a40 con 0x7f7e2c0ac540 2024-08-17T02:22:58.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.606+0000 7f7e315ac700 1 -- 172.21.15.104:0/1186132999 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e2c152540 con 0x7f7e2c0ac540 2024-08-17T02:22:58.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.610+0000 7f7e12ffd700 1 -- 172.21.15.104:0/1186132999 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7e1c022030 con 0x7f7e2c0ac540 2024-08-17T02:22:58.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.610+0000 7f7e315ac700 1 -- 172.21.15.104:0/1186132999 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e2c070360 con 0x7f7e2c0ac540 2024-08-17T02:22:58.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.610+0000 7f7e12ffd700 1 --2- 172.21.15.104:0/1186132999 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7e18060860 0x7f7e18062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:58.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.610+0000 7f7e12ffd700 1 -- 172.21.15.104:0/1186132999 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f7e1c014070 con 0x7f7e2c0ac540 2024-08-17T02:22:58.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.610+0000 7f7e2a7fc700 1 --2- 172.21.15.104:0/1186132999 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7e18060860 0x7f7e18062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:58.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.610+0000 7f7e2a7fc700 1 --2- 172.21.15.104:0/1186132999 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7e18060860 0x7f7e18062d10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c166620 tx=0x7f7e20008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:58.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.618+0000 7f7e12ffd700 1 -- 172.21.15.104:0/1186132999 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f7e1c0511f0 con 0x7f7e2c0ac540 2024-08-17T02:22:58.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:58.786+0000 7f7e315ac700 1 -- 172.21.15.104:0/1186132999 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f7e2c0645c0 con 0x7f7e2c0ac540 2024-08-17T02:22:59.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.482+0000 7f7e12ffd700 1 -- 172.21.15.104:0/1186132999 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v28) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7e1c023380 con 0x7f7e2c0ac540 2024-08-17T02:22:59.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.486+0000 7f7e315ac700 1 -- 172.21.15.104:0/1186132999 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7e18060860 msgr2=0x7f7e18062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:59.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.486+0000 7f7e315ac700 1 --2- 172.21.15.104:0/1186132999 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7e18060860 0x7f7e18062d10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c166620 tx=0x7f7e20008040 comp rx=0 tx=0).stop 2024-08-17T02:22:59.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.486+0000 7f7e315ac700 1 -- 172.21.15.104:0/1186132999 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7e2c0ac540 msgr2=0x7f7e2c165210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:59.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.486+0000 7f7e315ac700 1 --2- 172.21.15.104:0/1186132999 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7e2c0ac540 0x7f7e2c165210 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c00b760 tx=0x7f7e1c01b000 comp rx=0 tx=0).stop 2024-08-17T02:22:59.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.486+0000 7f7e315ac700 1 -- 172.21.15.104:0/1186132999 shutdown_connections 2024-08-17T02:22:59.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.486+0000 7f7e315ac700 1 --2- 172.21.15.104:0/1186132999 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7e18060860 0x7f7e18062d10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:59.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.486+0000 7f7e315ac700 1 --2- 172.21.15.104:0/1186132999 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e2c0ad0d0 0x7f7e2c152000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:59.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.486+0000 7f7e315ac700 1 --2- 172.21.15.104:0/1186132999 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e2c0ac9b0 0x7f7e2c14ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:59.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.486+0000 7f7e315ac700 1 --2- 172.21.15.104:0/1186132999 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7e2c0ac540 0x7f7e2c165210 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:59.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.490+0000 7f7e315ac700 1 -- 172.21.15.104:0/1186132999 >> 172.21.15.104:0/1186132999 conn(0x7f7e2c068300 msgr2=0x7f7e2c0b1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:59.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.490+0000 7f7e315ac700 1 -- 172.21.15.104:0/1186132999 shutdown_connections 2024-08-17T02:22:59.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.490+0000 7f7e315ac700 1 -- 172.21.15.104:0/1186132999 wait complete. 2024-08-17T02:22:59.497 INFO:teuthology.orchestra.run.smithi104.stderr: removed all blocklist entries 2024-08-17T02:22:59.515 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-08-17T02:22:59.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.610+0000 7fb7a1f63700 1 Processor -- start 2024-08-17T02:22:59.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.610+0000 7fb7a1f63700 1 -- start start 2024-08-17T02:22:59.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.610+0000 7fb7a1f63700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb79c0b0080 0x7fb79c161140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:59.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.610+0000 7fb7a1f63700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb79c161680 0x7fb79c15dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:59.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.610+0000 7fb7a1f63700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb79c161af0 con 0x7fb79c15e020 2024-08-17T02:22:59.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.610+0000 7fb7a1f63700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb79c15ef50 con 0x7fb79c161680 2024-08-17T02:22:59.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.610+0000 7fb7a1f63700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb79c15ec50 con 0x7fb79c0b0080 2024-08-17T02:22:59.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.610+0000 7fb79bfff700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb79c161680 0x7fb79c15dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:59.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.610+0000 7fb7a1762700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fb79c15e020 0x7fb79c15e480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:50628/0 (socket says 172.21.15.104:50628) 2024-08-17T02:22:59.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.610+0000 7fb7a1762700 1 -- 172.21.15.104:0/2524923725 learned_addr learned my addr 172.21.15.104:0/2524923725 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:59.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.610+0000 7fb7a0f61700 1 --2- 172.21.15.104:0/2524923725 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb79c0b0080 0x7fb79c161140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:59.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.610+0000 7fb79bfff700 1 -- 172.21.15.104:0/2524923725 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb79c0b0080 msgr2=0x7fb79c161140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:22:59.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.610+0000 7fb79bfff700 1 --2- 172.21.15.104:0/2524923725 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb79c0b0080 0x7fb79c161140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:59.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.610+0000 7fb79bfff700 1 -- 172.21.15.104:0/2524923725 >> v1:172.21.15.104:6789/0 conn(0x7fb79c15e020 legacy=0x7fb79c15e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:59.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.610+0000 7fb79bfff700 1 -- 172.21.15.104:0/2524923725 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb79c0b1460 con 0x7fb79c161680 2024-08-17T02:22:59.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.610+0000 7fb79bfff700 1 --2- 172.21.15.104:0/2524923725 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb79c161680 0x7fb79c15dae0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb78c0098e0 tx=0x7fb78c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d48f9b66ee24a99 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:59.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.610+0000 7fb79b7fe700 1 -- 172.21.15.104:0/2524923725 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78c009e80 con 0x7fb79c161680 2024-08-17T02:22:59.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.610+0000 7fb79b7fe700 1 -- 172.21.15.104:0/2524923725 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb78c00b860 con 0x7fb79c161680 2024-08-17T02:22:59.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.610+0000 7fb79b7fe700 1 -- 172.21.15.104:0/2524923725 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78c00bbe0 con 0x7fb79c161680 2024-08-17T02:22:59.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.610+0000 7fb7a1f63700 1 -- 172.21.15.104:0/2524923725 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb79c161680 msgr2=0x7fb79c15dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:59.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.610+0000 7fb7a1f63700 1 --2- 172.21.15.104:0/2524923725 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb79c161680 0x7fb79c15dae0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb78c0098e0 tx=0x7fb78c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:59.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.610+0000 7fb7a1f63700 1 -- 172.21.15.104:0/2524923725 shutdown_connections 2024-08-17T02:22:59.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.610+0000 7fb7a1f63700 1 --2- 172.21.15.104:0/2524923725 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb79c161680 0x7fb79c15dae0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:59.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.610+0000 7fb7a1f63700 1 --2- 172.21.15.104:0/2524923725 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb79c0b0080 0x7fb79c161140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:59.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.610+0000 7fb7a1f63700 1 -- 172.21.15.104:0/2524923725 >> 172.21.15.104:0/2524923725 conn(0x7fb79c0ccdb0 msgr2=0x7fb79c0cd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:59.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.610+0000 7fb7a1f63700 1 -- 172.21.15.104:0/2524923725 shutdown_connections 2024-08-17T02:22:59.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.610+0000 7fb7a1f63700 1 -- 172.21.15.104:0/2524923725 wait complete. 2024-08-17T02:22:59.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.614+0000 7fb7a1f63700 1 Processor -- start 2024-08-17T02:22:59.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.614+0000 7fb7a1f63700 1 -- start start 2024-08-17T02:22:59.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.614+0000 7fb7a1f63700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb79c0b0080 0x7fb79c14c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:59.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.614+0000 7fb7a1f63700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb79c15e020 0x7fb79c14d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:59.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.614+0000 7fb7a1f63700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb79c161680 0x7fb79c0ad6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:59.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.614+0000 7fb7a1f63700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79c068a40 con 0x7fb79c161680 2024-08-17T02:22:59.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.614+0000 7fb7a1f63700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79c068ed0 con 0x7fb79c15e020 2024-08-17T02:22:59.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.614+0000 7fb7a1f63700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb79c14c5e0 con 0x7fb79c0b0080 2024-08-17T02:22:59.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.614+0000 7fb7a1762700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb79c161680 0x7fb79c0ad6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:59.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.614+0000 7fb7a1762700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb79c161680 0x7fb79c0ad6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44720/0 (socket says 172.21.15.104:44720) 2024-08-17T02:22:59.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.614+0000 7fb7a1762700 1 -- 172.21.15.104:0/3129466118 learned_addr learned my addr 172.21.15.104:0/3129466118 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:59.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.614+0000 7fb79bfff700 1 --2- 172.21.15.104:0/3129466118 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb79c15e020 0x7fb79c14d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:59.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.614+0000 7fb7a0f61700 1 --2- 172.21.15.104:0/3129466118 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb79c0b0080 0x7fb79c14c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:59.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.614+0000 7fb7a1762700 1 -- 172.21.15.104:0/3129466118 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb79c0b0080 msgr2=0x7fb79c14c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:59.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.614+0000 7fb7a1762700 1 --2- 172.21.15.104:0/3129466118 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb79c0b0080 0x7fb79c14c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:59.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.614+0000 7fb7a1762700 1 -- 172.21.15.104:0/3129466118 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb79c15e020 msgr2=0x7fb79c14d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:59.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.614+0000 7fb7a1762700 1 --2- 172.21.15.104:0/3129466118 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb79c15e020 0x7fb79c14d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:59.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.614+0000 7fb7a1762700 1 -- 172.21.15.104:0/3129466118 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb78c009420 con 0x7fb79c161680 2024-08-17T02:22:59.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.614+0000 7fb7a1762700 1 --2- 172.21.15.104:0/3129466118 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb79c161680 0x7fb79c0ad6a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb79400cca0 tx=0x7fb794001a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:59.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.614+0000 7fb798ff9700 1 -- 172.21.15.104:0/3129466118 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79400a870 con 0x7fb79c161680 2024-08-17T02:22:59.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.614+0000 7fb798ff9700 1 -- 172.21.15.104:0/3129466118 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb79400a9f0 con 0x7fb79c161680 2024-08-17T02:22:59.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.614+0000 7fb798ff9700 1 -- 172.21.15.104:0/3129466118 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79400adf0 con 0x7fb79c161680 2024-08-17T02:22:59.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.614+0000 7fb7a1f63700 1 -- 172.21.15.104:0/3129466118 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb79c067e30 con 0x7fb79c161680 2024-08-17T02:22:59.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.618+0000 7fb7a1f63700 1 -- 172.21.15.104:0/3129466118 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb79c0683f0 con 0x7fb79c161680 2024-08-17T02:22:59.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.618+0000 7fb7a1f63700 1 -- 172.21.15.104:0/3129466118 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb79c068bf0 con 0x7fb79c161680 2024-08-17T02:22:59.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.618+0000 7fb798ff9700 1 -- 172.21.15.104:0/3129466118 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb794007300 con 0x7fb79c161680 2024-08-17T02:22:59.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.618+0000 7fb798ff9700 1 --2- 172.21.15.104:0/3129466118 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb77c060860 0x7fb77c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:59.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.618+0000 7fb798ff9700 1 -- 172.21.15.104:0/3129466118 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb79407cab0 con 0x7fb79c161680 2024-08-17T02:22:59.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.618+0000 7fb7a0f61700 1 --2- 172.21.15.104:0/3129466118 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb77c060860 0x7fb77c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:59.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.618+0000 7fb7a0f61700 1 --2- 172.21.15.104:0/3129466118 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb77c060860 0x7fb77c062d10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb784006fd0 tx=0x7fb784008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:59.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.626+0000 7fb798ff9700 1 -- 172.21.15.104:0/3129466118 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb79c068bf0 con 0x7fb79c161680 2024-08-17T02:22:59.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.846+0000 7fb7a1f63700 1 -- 172.21.15.104:0/3129466118 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb79c068bf0 con 0x7fb79c161680 2024-08-17T02:22:59.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.846+0000 7fb798ff9700 1 -- 172.21.15.104:0/3129466118 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fb79c068bf0 con 0x7fb79c161680 2024-08-17T02:22:59.849 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:22:59.849 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-08-17T02:22:59.849 INFO:teuthology.orchestra.run.smithi104.stdout: "auth_dump": [ 2024-08-17T02:22:59.849 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-08-17T02:22:59.849 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.a", 2024-08-17T02:22:59.849 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQAhCcBmDbpBABAAUmID7XhUQDBm+L94n9esyg==", 2024-08-17T02:22:59.849 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-08-17T02:22:59.849 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-08-17T02:22:59.849 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-08-17T02:22:59.850 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-08-17T02:22:59.850 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-08-17T02:22:59.850 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-08-17T02:22:59.850 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-08-17T02:22:59.850 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-08-17T02:22:59.850 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.b", 2024-08-17T02:22:59.850 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQAhCcBmb1J0BxAAT7dMMS4PPwRpwxaG7641ig==", 2024-08-17T02:22:59.850 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-08-17T02:22:59.850 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-08-17T02:22:59.850 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-08-17T02:22:59.851 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-08-17T02:22:59.851 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-08-17T02:22:59.851 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-08-17T02:22:59.851 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-08-17T02:22:59.851 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-08-17T02:22:59.851 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.c", 2024-08-17T02:22:59.851 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQAhCcBm/udiAxAA1K2ANrUuNmQOfrcynTS+RA==", 2024-08-17T02:22:59.851 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-08-17T02:22:59.851 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-08-17T02:22:59.851 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-08-17T02:22:59.852 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-08-17T02:22:59.852 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-08-17T02:22:59.852 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-08-17T02:22:59.852 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-08-17T02:22:59.852 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-08-17T02:22:59.852 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.d", 2024-08-17T02:22:59.852 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQAhCcBmYJypChAAPoQjjYW497n+RdXMj7dMfg==", 2024-08-17T02:22:59.852 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-08-17T02:22:59.852 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-08-17T02:22:59.852 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-08-17T02:22:59.852 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-08-17T02:22:59.853 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-08-17T02:22:59.853 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-08-17T02:22:59.853 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-08-17T02:22:59.853 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-08-17T02:22:59.853 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.0", 2024-08-17T02:22:59.853 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQAjCcBm/3suOBAAyxBjstycyfsr8beMKRxfKQ==", 2024-08-17T02:22:59.853 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-08-17T02:22:59.853 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-08-17T02:22:59.853 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-08-17T02:22:59.853 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-08-17T02:22:59.853 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-08-17T02:22:59.854 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-08-17T02:22:59.854 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-08-17T02:22:59.854 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.1", 2024-08-17T02:22:59.854 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQAmCcBmea8zOhAAfOPbwQTzP9LmMtt2Jscz3A==", 2024-08-17T02:22:59.854 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-08-17T02:22:59.854 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-08-17T02:22:59.854 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-08-17T02:22:59.854 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-08-17T02:22:59.854 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-08-17T02:22:59.854 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-08-17T02:22:59.855 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-08-17T02:22:59.855 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.2", 2024-08-17T02:22:59.855 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQAqCcBm+CANBBAAWsByvoejX1yztveba17DLA==", 2024-08-17T02:22:59.855 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-08-17T02:22:59.855 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-08-17T02:22:59.855 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-08-17T02:22:59.855 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-08-17T02:22:59.855 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-08-17T02:22:59.855 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-08-17T02:22:59.855 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-08-17T02:22:59.855 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.3", 2024-08-17T02:22:59.856 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQAtCcBmxaFsBxAAjNBy/KSF80ElAuQo+4m7/Q==", 2024-08-17T02:22:59.856 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-08-17T02:22:59.856 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-08-17T02:22:59.856 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-08-17T02:22:59.856 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-08-17T02:22:59.856 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-08-17T02:22:59.856 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-08-17T02:22:59.856 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-08-17T02:22:59.856 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.4", 2024-08-17T02:22:59.856 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQAyCcBmB7CnJxAACtG2PU/jmmUK3uqCry9G8g==", 2024-08-17T02:22:59.856 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-08-17T02:22:59.856 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-08-17T02:22:59.857 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-08-17T02:22:59.857 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-08-17T02:22:59.857 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-08-17T02:22:59.857 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-08-17T02:22:59.857 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-08-17T02:22:59.857 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.5", 2024-08-17T02:22:59.857 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQA1CcBmKR/5KBAA0ru8bq7qKQNgpt0E6rtSOw==", 2024-08-17T02:22:59.857 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-08-17T02:22:59.857 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-08-17T02:22:59.857 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-08-17T02:22:59.857 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-08-17T02:22:59.857 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-08-17T02:22:59.857 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-08-17T02:22:59.857 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-08-17T02:22:59.858 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.6", 2024-08-17T02:22:59.858 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQA4CcBmuaS0LRAAbY5vhocCAXeNKczOWFK13w==", 2024-08-17T02:22:59.858 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-08-17T02:22:59.858 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-08-17T02:22:59.858 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-08-17T02:22:59.858 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-08-17T02:22:59.858 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-08-17T02:22:59.858 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-08-17T02:22:59.858 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-08-17T02:22:59.858 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.7", 2024-08-17T02:22:59.858 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQA7CcBmUZ9HMhAAe+ELd8Y6t2BKg8kojYYMqg==", 2024-08-17T02:22:59.858 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-08-17T02:22:59.858 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-08-17T02:22:59.859 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-08-17T02:22:59.859 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-08-17T02:22:59.859 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-08-17T02:22:59.859 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-08-17T02:22:59.859 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-08-17T02:22:59.859 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.0", 2024-08-17T02:22:59.859 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQAhCcBmu02NDRAA0N4TaUHvOE2jwscxvIEMEA==", 2024-08-17T02:22:59.859 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-08-17T02:22:59.859 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-08-17T02:22:59.859 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow r", 2024-08-17T02:22:59.859 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow rw", 2024-08-17T02:22:59.859 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rwx" 2024-08-17T02:22:59.860 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-08-17T02:22:59.860 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-08-17T02:22:59.860 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-08-17T02:22:59.860 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.1", 2024-08-17T02:22:59.860 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQAhCcBmk59FExAAgtpMGiCPrqo2TowB76IS1g==", 2024-08-17T02:22:59.860 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-08-17T02:22:59.860 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-08-17T02:22:59.860 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow r", 2024-08-17T02:22:59.861 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow rw", 2024-08-17T02:22:59.861 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rwx" 2024-08-17T02:22:59.861 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-08-17T02:22:59.861 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-08-17T02:22:59.861 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-08-17T02:22:59.861 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.2", 2024-08-17T02:22:59.862 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQAhCcBm+mFUEBAA2oxoEOrku7/H/+vbhE43Gg==", 2024-08-17T02:22:59.862 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-08-17T02:22:59.862 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-08-17T02:22:59.862 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow r", 2024-08-17T02:22:59.862 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow rw", 2024-08-17T02:22:59.862 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rwx" 2024-08-17T02:22:59.862 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-08-17T02:22:59.862 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-08-17T02:22:59.862 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-08-17T02:22:59.863 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.3", 2024-08-17T02:22:59.863 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQAhCcBmKh6dGBAA51WmpSLd+0Csj7lnE/uOHw==", 2024-08-17T02:22:59.863 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-08-17T02:22:59.863 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-08-17T02:22:59.863 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow r", 2024-08-17T02:22:59.863 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow rw", 2024-08-17T02:22:59.863 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rwx" 2024-08-17T02:22:59.863 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-08-17T02:22:59.863 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-08-17T02:22:59.863 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-08-17T02:22:59.863 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.admin", 2024-08-17T02:22:59.863 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQAgCcBmRiuVKxAAALkDq1i81hAEUWGljnZT1Q==", 2024-08-17T02:22:59.863 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-08-17T02:22:59.863 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow *", 2024-08-17T02:22:59.864 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-08-17T02:22:59.864 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-08-17T02:22:59.864 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-08-17T02:22:59.864 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-08-17T02:22:59.864 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-08-17T02:22:59.864 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-08-17T02:22:59.864 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.bootstrap-mds", 2024-08-17T02:22:59.864 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBFCcBmWdQ5NRAAjXl0qygxEryK8IArkiDH1w==", 2024-08-17T02:22:59.864 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-08-17T02:22:59.864 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile bootstrap-mds" 2024-08-17T02:22:59.864 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-08-17T02:22:59.864 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-08-17T02:22:59.864 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-08-17T02:22:59.865 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.bootstrap-mgr", 2024-08-17T02:22:59.865 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBFCcBmJPE5NRAAezGc7v0Odaiqh/wbqaxOTg==", 2024-08-17T02:22:59.865 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-08-17T02:22:59.865 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile bootstrap-mgr" 2024-08-17T02:22:59.865 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-08-17T02:22:59.865 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-08-17T02:22:59.865 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-08-17T02:22:59.865 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.bootstrap-osd", 2024-08-17T02:22:59.865 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBFCcBmIwg6NRAAV5+MMwdnaWcFTO3E7N2pXg==", 2024-08-17T02:22:59.865 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-08-17T02:22:59.865 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile bootstrap-osd" 2024-08-17T02:22:59.865 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-08-17T02:22:59.865 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-08-17T02:22:59.865 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-08-17T02:22:59.866 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.bootstrap-rbd", 2024-08-17T02:22:59.866 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBFCcBmvh46NRAAAnYwm2WBaUOb++X4SoZAhw==", 2024-08-17T02:22:59.866 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-08-17T02:22:59.866 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile bootstrap-rbd" 2024-08-17T02:22:59.866 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-08-17T02:22:59.866 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-08-17T02:22:59.866 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-08-17T02:22:59.866 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-08-17T02:22:59.866 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBFCcBmDjg6NRAAYCc7Gt5ivhwcjn6C5k9umw==", 2024-08-17T02:22:59.866 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-08-17T02:22:59.866 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-08-17T02:22:59.866 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-08-17T02:22:59.866 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-08-17T02:22:59.867 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-08-17T02:22:59.867 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.bootstrap-rgw", 2024-08-17T02:22:59.867 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBFCcBmAFA6NRAAi64ELUci+cO4qec//0bdbw==", 2024-08-17T02:22:59.867 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-08-17T02:22:59.867 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile bootstrap-rgw" 2024-08-17T02:22:59.867 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-08-17T02:22:59.867 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-08-17T02:22:59.867 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-08-17T02:22:59.867 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mgr.x", 2024-08-17T02:22:59.867 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQAgCcBmKT4qORAA8RmWfPRvKrIgatfaJFYcxQ==", 2024-08-17T02:22:59.867 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-08-17T02:22:59.867 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow *", 2024-08-17T02:22:59.867 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile mgr", 2024-08-17T02:22:59.868 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-08-17T02:22:59.868 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-08-17T02:22:59.868 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-08-17T02:22:59.868 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-08-17T02:22:59.868 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mgr.y", 2024-08-17T02:22:59.868 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQAgCcBmIPdDNhAAj3Eob8uWRA+tPv6sdo8Dkg==", 2024-08-17T02:22:59.868 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-08-17T02:22:59.868 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow *", 2024-08-17T02:22:59.868 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile mgr", 2024-08-17T02:22:59.868 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-08-17T02:22:59.868 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-08-17T02:22:59.868 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-08-17T02:22:59.868 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-08-17T02:22:59.869 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-08-17T02:22:59.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.846+0000 7fb7a1f63700 1 -- 172.21.15.104:0/3129466118 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb77c060860 msgr2=0x7fb77c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:59.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.846+0000 7fb7a1f63700 1 --2- 172.21.15.104:0/3129466118 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb77c060860 0x7fb77c062d10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb784006fd0 tx=0x7fb784008040 comp rx=0 tx=0).stop 2024-08-17T02:22:59.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.846+0000 7fb7a1f63700 1 -- 172.21.15.104:0/3129466118 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb79c161680 msgr2=0x7fb79c0ad6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:59.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.846+0000 7fb7a1f63700 1 --2- 172.21.15.104:0/3129466118 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb79c161680 0x7fb79c0ad6a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb79400cca0 tx=0x7fb794001a10 comp rx=0 tx=0).stop 2024-08-17T02:22:59.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.846+0000 7fb7a1f63700 1 -- 172.21.15.104:0/3129466118 shutdown_connections 2024-08-17T02:22:59.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.850+0000 7fb7a1f63700 1 --2- 172.21.15.104:0/3129466118 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb77c060860 0x7fb77c062d10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:59.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.850+0000 7fb7a1f63700 1 --2- 172.21.15.104:0/3129466118 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb79c161680 0x7fb79c0ad6a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:59.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.850+0000 7fb7a1f63700 1 --2- 172.21.15.104:0/3129466118 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb79c15e020 0x7fb79c14d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:59.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.850+0000 7fb7a1f63700 1 --2- 172.21.15.104:0/3129466118 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb79c0b0080 0x7fb79c14c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:59.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.850+0000 7fb7a1f63700 1 -- 172.21.15.104:0/3129466118 >> 172.21.15.104:0/3129466118 conn(0x7fb79c0ccdb0 msgr2=0x7fb79c0cb1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:59.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.850+0000 7fb7a1f63700 1 -- 172.21.15.104:0/3129466118 shutdown_connections 2024-08-17T02:22:59.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.850+0000 7fb7a1f63700 1 -- 172.21.15.104:0/3129466118 wait complete. 2024-08-17T02:22:59.872 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-08-17T02:22:59.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.978+0000 7fe584d66700 1 Processor -- start 2024-08-17T02:22:59.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.978+0000 7fe584d66700 1 -- start start 2024-08-17T02:22:59.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.978+0000 7fe584d66700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe58006e620 0x7fe5800b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:59.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.978+0000 7fe584d66700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe580141a00 con 0x7fe5800b1630 2024-08-17T02:22:59.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.978+0000 7fe584d66700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe580140b10 con 0x7fe5800b0d20 2024-08-17T02:22:59.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.978+0000 7fe584d66700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe580140df0 con 0x7fe58006e620 2024-08-17T02:22:59.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.978+0000 7fe57ffff700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fe5800b1630 0x7fe580141e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:50636/0 (socket says 172.21.15.104:50636) 2024-08-17T02:22:59.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.978+0000 7fe57ffff700 1 -- 172.21.15.104:0/2322893859 learned_addr learned my addr 172.21.15.104:0/2322893859 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:22:59.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.982+0000 7fe577fff700 1 --2- 172.21.15.104:0/2322893859 >> v2:172.21.15.117:3300/0 conn(0x7fe58006e620 0x7fe5800b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:59.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.982+0000 7fe57effd700 1 -- 172.21.15.104:0/2322893859 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4243775588 0 0) 0x7fe580141a00 con 0x7fe5800b1630 2024-08-17T02:22:59.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.982+0000 7fe57effd700 1 -- 172.21.15.104:0/2322893859 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe56c003570 con 0x7fe5800b1630 2024-08-17T02:22:59.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.982+0000 7fe577fff700 1 -- 172.21.15.104:0/2322893859 >> v1:172.21.15.117:6789/0 conn(0x7fe5800b0d20 legacy=0x7fe58006df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:59.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.982+0000 7fe577fff700 1 -- 172.21.15.104:0/2322893859 >> v1:172.21.15.104:6789/0 conn(0x7fe5800b1630 legacy=0x7fe580141e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:59.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.982+0000 7fe577fff700 1 -- 172.21.15.104:0/2322893859 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5801410d0 con 0x7fe58006e620 2024-08-17T02:22:59.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.982+0000 7fe577fff700 1 --2- 172.21.15.104:0/2322893859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe58006e620 0x7fe5800b10f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe5680098e0 tx=0x7fe5680091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6edf3834c64b184b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:59.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.982+0000 7fe57effd700 1 -- 172.21.15.104:0/2322893859 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56800b640 con 0x7fe58006e620 2024-08-17T02:22:59.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.982+0000 7fe57effd700 1 -- 172.21.15.104:0/2322893859 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe56800b7a0 con 0x7fe58006e620 2024-08-17T02:22:59.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.982+0000 7fe57effd700 1 -- 172.21.15.104:0/2322893859 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56800bb20 con 0x7fe58006e620 2024-08-17T02:22:59.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.982+0000 7fe584d66700 1 -- 172.21.15.104:0/2322893859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe58006e620 msgr2=0x7fe5800b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:59.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.982+0000 7fe584d66700 1 --2- 172.21.15.104:0/2322893859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe58006e620 0x7fe5800b10f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe5680098e0 tx=0x7fe5680091a0 comp rx=0 tx=0).stop 2024-08-17T02:22:59.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.982+0000 7fe584d66700 1 -- 172.21.15.104:0/2322893859 shutdown_connections 2024-08-17T02:22:59.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.982+0000 7fe584d66700 1 --2- 172.21.15.104:0/2322893859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe58006e620 0x7fe5800b10f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:59.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.982+0000 7fe584d66700 1 -- 172.21.15.104:0/2322893859 >> 172.21.15.104:0/2322893859 conn(0x7fe5800678d0 msgr2=0x7fe580067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:22:59.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.982+0000 7fe584d66700 1 -- 172.21.15.104:0/2322893859 shutdown_connections 2024-08-17T02:22:59.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.982+0000 7fe584d66700 1 -- 172.21.15.104:0/2322893859 wait complete. 2024-08-17T02:22:59.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.986+0000 7fe584d66700 1 Processor -- start 2024-08-17T02:22:59.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.986+0000 7fe584d66700 1 -- start start 2024-08-17T02:22:59.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.986+0000 7fe584d66700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe58006e620 0x7fe580159b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:59.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.986+0000 7fe584d66700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5800b0d20 0x7fe5801450c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:59.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.986+0000 7fe584d66700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5800b1630 0x7fe5800a8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:59.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.986+0000 7fe584d66700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5801460e0 con 0x7fe5800b0d20 2024-08-17T02:22:59.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.986+0000 7fe584d66700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58015a090 con 0x7fe58006e620 2024-08-17T02:22:59.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.986+0000 7fe584d66700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5800a6750 con 0x7fe5800b1630 2024-08-17T02:22:59.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.986+0000 7fe577fff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5800b0d20 0x7fe5801450c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:59.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.986+0000 7fe577fff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5800b0d20 0x7fe5801450c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44728/0 (socket says 172.21.15.104:44728) 2024-08-17T02:22:59.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.986+0000 7fe577fff700 1 -- 172.21.15.104:0/951121667 learned_addr learned my addr 172.21.15.104:0/951121667 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:22:59.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.986+0000 7fe57f7fe700 1 --2- 172.21.15.104:0/951121667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe58006e620 0x7fe580159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:59.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.986+0000 7fe57ffff700 1 --2- 172.21.15.104:0/951121667 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5800b1630 0x7fe5800a8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:59.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.986+0000 7fe577fff700 1 -- 172.21.15.104:0/951121667 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5800b1630 msgr2=0x7fe5800a8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:59.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.986+0000 7fe577fff700 1 --2- 172.21.15.104:0/951121667 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5800b1630 0x7fe5800a8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:59.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.986+0000 7fe577fff700 1 -- 172.21.15.104:0/951121667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe58006e620 msgr2=0x7fe580159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:22:59.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.986+0000 7fe577fff700 1 --2- 172.21.15.104:0/951121667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe58006e620 0x7fe580159b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:22:59.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.986+0000 7fe577fff700 1 -- 172.21.15.104:0/951121667 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe568009420 con 0x7fe5800b0d20 2024-08-17T02:22:59.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.986+0000 7fe577fff700 1 --2- 172.21.15.104:0/951121667 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5800b0d20 0x7fe5801450c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe58006c2d0 tx=0x7fe568017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:59.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.986+0000 7fe5777fe700 1 -- 172.21.15.104:0/951121667 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe568000c90 con 0x7fe5800b0d20 2024-08-17T02:22:59.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.986+0000 7fe5777fe700 1 -- 172.21.15.104:0/951121667 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe56800b910 con 0x7fe5800b0d20 2024-08-17T02:22:59.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.986+0000 7fe584d66700 1 -- 172.21.15.104:0/951121667 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe580145b20 con 0x7fe5800b0d20 2024-08-17T02:22:59.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.986+0000 7fe5777fe700 1 -- 172.21.15.104:0/951121667 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe568025670 con 0x7fe5800b0d20 2024-08-17T02:22:59.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.986+0000 7fe584d66700 1 -- 172.21.15.104:0/951121667 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5800a63e0 con 0x7fe5800b0d20 2024-08-17T02:22:59.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.990+0000 7fe5777fe700 1 -- 172.21.15.104:0/951121667 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe568023070 con 0x7fe5800b0d20 2024-08-17T02:22:59.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.990+0000 7fe584d66700 1 -- 172.21.15.104:0/951121667 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5800643a0 con 0x7fe5800b0d20 2024-08-17T02:22:59.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.990+0000 7fe5777fe700 1 --2- 172.21.15.104:0/951121667 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fe560060890 0x7fe560062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:22:59.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.990+0000 7fe5777fe700 1 -- 172.21.15.104:0/951121667 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe56807dc60 con 0x7fe5800b0d20 2024-08-17T02:22:59.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.990+0000 7fe57f7fe700 1 --2- 172.21.15.104:0/951121667 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fe560060890 0x7fe560062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:22:59.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.990+0000 7fe57f7fe700 1 --2- 172.21.15.104:0/951121667 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fe560060890 0x7fe560062d40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe5700039e0 tx=0x7fe570007ec0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:22:59.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:22:59.994+0000 7fe5777fe700 1 -- 172.21.15.104:0/951121667 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fe56804e400 con 0x7fe5800b0d20 2024-08-17T02:23:00.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.222+0000 7fe584d66700 1 -- 172.21.15.104:0/951121667 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fe5800a6890 con 0x7fe5800b0d20 2024-08-17T02:23:00.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.230+0000 7fe5777fe700 1 -- 172.21.15.104:0/951121667 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe5680150a0 con 0x7fe5800b0d20 2024-08-17T02:23:00.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.230+0000 7fe584d66700 1 -- 172.21.15.104:0/951121667 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fe560060890 msgr2=0x7fe560062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:00.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.230+0000 7fe584d66700 1 --2- 172.21.15.104:0/951121667 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fe560060890 0x7fe560062d40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe5700039e0 tx=0x7fe570007ec0 comp rx=0 tx=0).stop 2024-08-17T02:23:00.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.230+0000 7fe584d66700 1 -- 172.21.15.104:0/951121667 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5800b0d20 msgr2=0x7fe5801450c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:00.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.230+0000 7fe584d66700 1 --2- 172.21.15.104:0/951121667 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5800b0d20 0x7fe5801450c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe58006c2d0 tx=0x7fe568017000 comp rx=0 tx=0).stop 2024-08-17T02:23:00.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.230+0000 7fe584d66700 1 -- 172.21.15.104:0/951121667 shutdown_connections 2024-08-17T02:23:00.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.230+0000 7fe584d66700 1 --2- 172.21.15.104:0/951121667 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fe560060890 0x7fe560062d40 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:00.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.230+0000 7fe584d66700 1 --2- 172.21.15.104:0/951121667 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5800b1630 0x7fe5800a8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:00.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.230+0000 7fe584d66700 1 --2- 172.21.15.104:0/951121667 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5800b0d20 0x7fe5801450c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:00.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.230+0000 7fe584d66700 1 --2- 172.21.15.104:0/951121667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe58006e620 0x7fe580159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:00.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.230+0000 7fe584d66700 1 -- 172.21.15.104:0/951121667 >> 172.21.15.104:0/951121667 conn(0x7fe5800678d0 msgr2=0x7fe58006dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:00.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.230+0000 7fe584d66700 1 -- 172.21.15.104:0/951121667 shutdown_connections 2024-08-17T02:23:00.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.230+0000 7fe584d66700 1 -- 172.21.15.104:0/951121667 wait complete. 2024-08-17T02:23:00.249 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-08-17T02:23:00.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.354+0000 7fe707fff700 1 Processor -- start 2024-08-17T02:23:00.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.354+0000 7fe707fff700 1 -- start start 2024-08-17T02:23:00.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.358+0000 7fe707fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7081538d0 0x7fe708156f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:00.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.358+0000 7fe707fff700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe7080af4d0 0x7fe7080b0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:00.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.358+0000 7fe707fff700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7080b0830 con 0x7fe7080686a0 2024-08-17T02:23:00.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.358+0000 7fe707fff700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7080b2640 con 0x7fe7080af4d0 2024-08-17T02:23:00.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.358+0000 7fe707fff700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7080b1200 con 0x7fe7081538d0 2024-08-17T02:23:00.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.358+0000 7fe7077fe700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fe7080686a0 0x7fe7081575b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:50638/0 (socket says 172.21.15.104:50638) 2024-08-17T02:23:00.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.358+0000 7fe7077fe700 1 -- 172.21.15.104:0/3313700885 learned_addr learned my addr 172.21.15.104:0/3313700885 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:23:00.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.358+0000 7fe7067fc700 1 --2- 172.21.15.104:0/3313700885 >> v2:172.21.15.117:3300/0 conn(0x7fe7080af4d0 0x7fe7080b0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:00.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.358+0000 7fe706ffd700 1 --2- 172.21.15.104:0/3313700885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7081538d0 0x7fe708156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:00.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.358+0000 7fe705ffb700 1 -- 172.21.15.104:0/3313700885 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2967569806 0 0) 0x7fe7080b0830 con 0x7fe7080686a0 2024-08-17T02:23:00.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.358+0000 7fe705ffb700 1 -- 172.21.15.104:0/3313700885 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6f0003570 con 0x7fe7080686a0 2024-08-17T02:23:00.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.358+0000 7fe706ffd700 1 -- 172.21.15.104:0/3313700885 >> v2:172.21.15.117:3300/0 conn(0x7fe7080af4d0 msgr2=0x7fe7080b0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:00.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.358+0000 7fe706ffd700 1 --2- 172.21.15.104:0/3313700885 >> v2:172.21.15.117:3300/0 conn(0x7fe7080af4d0 0x7fe7080b0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:00.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.358+0000 7fe706ffd700 1 -- 172.21.15.104:0/3313700885 >> v1:172.21.15.104:6789/0 conn(0x7fe7080686a0 legacy=0x7fe7081575b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:00.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.358+0000 7fe706ffd700 1 -- 172.21.15.104:0/3313700885 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7080afc20 con 0x7fe7081538d0 2024-08-17T02:23:00.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.358+0000 7fe706ffd700 1 --2- 172.21.15.104:0/3313700885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7081538d0 0x7fe708156f40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe6f80098e0 tx=0x7fe6f80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7cf4ad035371b81 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:00.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.358+0000 7fe705ffb700 1 -- 172.21.15.104:0/3313700885 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f8011630 con 0x7fe7081538d0 2024-08-17T02:23:00.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.358+0000 7fe705ffb700 1 -- 172.21.15.104:0/3313700885 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f8011790 con 0x7fe7081538d0 2024-08-17T02:23:00.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.358+0000 7fe705ffb700 1 -- 172.21.15.104:0/3313700885 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f8011b30 con 0x7fe7081538d0 2024-08-17T02:23:00.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.358+0000 7fe707fff700 1 -- 172.21.15.104:0/3313700885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7081538d0 msgr2=0x7fe708156f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:00.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.358+0000 7fe707fff700 1 --2- 172.21.15.104:0/3313700885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7081538d0 0x7fe708156f40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe6f80098e0 tx=0x7fe6f80091a0 comp rx=0 tx=0).stop 2024-08-17T02:23:00.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.358+0000 7fe707fff700 1 -- 172.21.15.104:0/3313700885 shutdown_connections 2024-08-17T02:23:00.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.358+0000 7fe707fff700 1 --2- 172.21.15.104:0/3313700885 >> v2:172.21.15.117:3300/0 conn(0x7fe7080af4d0 0x7fe7080b0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:00.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.358+0000 7fe707fff700 1 --2- 172.21.15.104:0/3313700885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7081538d0 0x7fe708156f40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:00.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.358+0000 7fe707fff700 1 -- 172.21.15.104:0/3313700885 >> 172.21.15.104:0/3313700885 conn(0x7fe70806d870 msgr2=0x7fe70806dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:00.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.358+0000 7fe707fff700 1 -- 172.21.15.104:0/3313700885 shutdown_connections 2024-08-17T02:23:00.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.358+0000 7fe707fff700 1 -- 172.21.15.104:0/3313700885 wait complete. 2024-08-17T02:23:00.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.362+0000 7fe707fff700 1 Processor -- start 2024-08-17T02:23:00.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.362+0000 7fe707fff700 1 -- start start 2024-08-17T02:23:00.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.362+0000 7fe707fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7080686a0 0x7fe7080a8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:00.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.362+0000 7fe707fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7080af4d0 0x7fe70814efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:00.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.362+0000 7fe707fff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe7081538d0 0x7fe70816a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:00.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.362+0000 7fe707fff700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70816ae50 con 0x7fe7081538d0 2024-08-17T02:23:00.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.362+0000 7fe707fff700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70816b130 con 0x7fe7080686a0 2024-08-17T02:23:00.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.362+0000 7fe707fff700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7080a7660 con 0x7fe7080af4d0 2024-08-17T02:23:00.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.362+0000 7fe7077fe700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe7081538d0 0x7fe70816a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:00.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.362+0000 7fe7077fe700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe7081538d0 0x7fe70816a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44732/0 (socket says 172.21.15.104:44732) 2024-08-17T02:23:00.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.362+0000 7fe7077fe700 1 -- 172.21.15.104:0/767040581 learned_addr learned my addr 172.21.15.104:0/767040581 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:00.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.362+0000 7fe7067fc700 1 --2- 172.21.15.104:0/767040581 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7080af4d0 0x7fe70814efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:00.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.362+0000 7fe706ffd700 1 --2- 172.21.15.104:0/767040581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7080686a0 0x7fe7080a8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:00.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.362+0000 7fe7077fe700 1 -- 172.21.15.104:0/767040581 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7080af4d0 msgr2=0x7fe70814efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:00.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.362+0000 7fe7077fe700 1 --2- 172.21.15.104:0/767040581 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7080af4d0 0x7fe70814efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:00.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.362+0000 7fe7077fe700 1 -- 172.21.15.104:0/767040581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7080686a0 msgr2=0x7fe7080a8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:00.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.362+0000 7fe7077fe700 1 --2- 172.21.15.104:0/767040581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7080686a0 0x7fe7080a8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:00.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.362+0000 7fe7077fe700 1 -- 172.21.15.104:0/767040581 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f8009420 con 0x7fe7081538d0 2024-08-17T02:23:00.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.362+0000 7fe7077fe700 1 --2- 172.21.15.104:0/767040581 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe7081538d0 0x7fe70816a350 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe700001460 tx=0x7fe700001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:00.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.362+0000 7fe6eeffd700 1 -- 172.21.15.104:0/767040581 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70000a890 con 0x7fe7081538d0 2024-08-17T02:23:00.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.362+0000 7fe707fff700 1 -- 172.21.15.104:0/767040581 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7080a7940 con 0x7fe7081538d0 2024-08-17T02:23:00.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.362+0000 7fe6eeffd700 1 -- 172.21.15.104:0/767040581 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70000a9f0 con 0x7fe7081538d0 2024-08-17T02:23:00.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.362+0000 7fe6eeffd700 1 -- 172.21.15.104:0/767040581 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70000ad70 con 0x7fe7081538d0 2024-08-17T02:23:00.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.362+0000 7fe707fff700 1 -- 172.21.15.104:0/767040581 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7080a8cd0 con 0x7fe7081538d0 2024-08-17T02:23:00.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.366+0000 7fe707fff700 1 -- 172.21.15.104:0/767040581 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7080a7e40 con 0x7fe7081538d0 2024-08-17T02:23:00.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.366+0000 7fe6eeffd700 1 -- 172.21.15.104:0/767040581 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe700007300 con 0x7fe7081538d0 2024-08-17T02:23:00.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.366+0000 7fe6eeffd700 1 --2- 172.21.15.104:0/767040581 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fe6f4060860 0x7fe6f4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:00.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.366+0000 7fe6eeffd700 1 -- 172.21.15.104:0/767040581 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe70007cd20 con 0x7fe7081538d0 2024-08-17T02:23:00.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.366+0000 7fe706ffd700 1 --2- 172.21.15.104:0/767040581 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fe6f4060860 0x7fe6f4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:00.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.370+0000 7fe706ffd700 1 --2- 172.21.15.104:0/767040581 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fe6f4060860 0x7fe6f4062d10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe6f80091e0 tx=0x7fe6f8017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:00.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.374+0000 7fe6eeffd700 1 -- 172.21.15.104:0/767040581 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fe70004d430 con 0x7fe7081538d0 2024-08-17T02:23:00.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.598+0000 7fe707fff700 1 -- 172.21.15.104:0/767040581 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fe7080638f0 con 0x7fe7081538d0 2024-08-17T02:23:00.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.610+0000 7fe6eeffd700 1 -- 172.21.15.104:0/767040581 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe700050a50 con 0x7fe7081538d0 2024-08-17T02:23:00.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.614+0000 7fe707fff700 1 -- 172.21.15.104:0/767040581 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fe6f4060860 msgr2=0x7fe6f4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:00.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.614+0000 7fe707fff700 1 --2- 172.21.15.104:0/767040581 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fe6f4060860 0x7fe6f4062d10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe6f80091e0 tx=0x7fe6f8017000 comp rx=0 tx=0).stop 2024-08-17T02:23:00.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.614+0000 7fe707fff700 1 -- 172.21.15.104:0/767040581 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe7081538d0 msgr2=0x7fe70816a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:00.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.614+0000 7fe707fff700 1 --2- 172.21.15.104:0/767040581 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe7081538d0 0x7fe70816a350 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe700001460 tx=0x7fe700001ae0 comp rx=0 tx=0).stop 2024-08-17T02:23:00.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.614+0000 7fe707fff700 1 -- 172.21.15.104:0/767040581 shutdown_connections 2024-08-17T02:23:00.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.614+0000 7fe707fff700 1 --2- 172.21.15.104:0/767040581 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fe6f4060860 0x7fe6f4062d10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:00.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.614+0000 7fe707fff700 1 --2- 172.21.15.104:0/767040581 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe7081538d0 0x7fe70816a350 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:00.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.614+0000 7fe707fff700 1 --2- 172.21.15.104:0/767040581 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7080af4d0 0x7fe70814efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:00.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.614+0000 7fe707fff700 1 --2- 172.21.15.104:0/767040581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7080686a0 0x7fe7080a8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:00.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.614+0000 7fe707fff700 1 -- 172.21.15.104:0/767040581 >> 172.21.15.104:0/767040581 conn(0x7fe70806d870 msgr2=0x7fe708152b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:00.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.614+0000 7fe707fff700 1 -- 172.21.15.104:0/767040581 shutdown_connections 2024-08-17T02:23:00.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.614+0000 7fe707fff700 1 -- 172.21.15.104:0/767040581 wait complete. 2024-08-17T02:23:00.630 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-08-17T02:23:00.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.738+0000 7f679b7cc700 1 Processor -- start 2024-08-17T02:23:00.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.738+0000 7f679b7cc700 1 -- start start 2024-08-17T02:23:00.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.738+0000 7f679b7cc700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f679415a050 0x7f679406ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:00.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.738+0000 7f679b7cc700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f679415a8e0 con 0x7f67940ac490 2024-08-17T02:23:00.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.738+0000 7f679b7cc700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f679415a600 con 0x7f679406e680 2024-08-17T02:23:00.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.738+0000 7f679b7cc700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67940ab9b0 con 0x7f679415a050 2024-08-17T02:23:00.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.738+0000 7f6799d69700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f67940ac490 0x7f67940ade10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:50642/0 (socket says 172.21.15.104:50642) 2024-08-17T02:23:00.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.738+0000 7f6799d69700 1 -- 172.21.15.104:0/3521471716 learned_addr learned my addr 172.21.15.104:0/3521471716 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:23:00.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.738+0000 7f6798d67700 1 --2- 172.21.15.104:0/3521471716 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f679415a050 0x7f679406ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:00.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.738+0000 7f6787fff700 1 -- 172.21.15.104:0/3521471716 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 844778931 0 0) 0x7f679415a8e0 con 0x7f67940ac490 2024-08-17T02:23:00.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.738+0000 7f6787fff700 1 -- 172.21.15.104:0/3521471716 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6780003570 con 0x7f67940ac490 2024-08-17T02:23:00.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.738+0000 7f6798d67700 1 -- 172.21.15.104:0/3521471716 >> v1:172.21.15.117:6789/0 conn(0x7f679406e680 legacy=0x7f6794159940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:00.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.738+0000 7f6798d67700 1 -- 172.21.15.104:0/3521471716 >> v1:172.21.15.104:6789/0 conn(0x7f67940ac490 legacy=0x7f67940ade10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:00.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.738+0000 7f6787fff700 1 -- 172.21.15.104:0/3521471716 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3571385578 0 0) 0x7f679415a600 con 0x7f679406e680 2024-08-17T02:23:00.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.738+0000 7f6798d67700 1 -- 172.21.15.104:0/3521471716 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67940abc90 con 0x7f679415a050 2024-08-17T02:23:00.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.738+0000 7f6798d67700 1 --2- 172.21.15.104:0/3521471716 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f679415a050 0x7f679406ea50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6788009910 tx=0x7f67880091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70379284600be327 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:00.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.738+0000 7f6787fff700 1 -- 172.21.15.104:0/3521471716 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678800b680 con 0x7f679415a050 2024-08-17T02:23:00.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.738+0000 7f6787fff700 1 -- 172.21.15.104:0/3521471716 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f678800b7e0 con 0x7f679415a050 2024-08-17T02:23:00.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.738+0000 7f6787fff700 1 -- 172.21.15.104:0/3521471716 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678800bba0 con 0x7f679415a050 2024-08-17T02:23:00.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.742+0000 7f679b7cc700 1 -- 172.21.15.104:0/3521471716 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f679415a050 msgr2=0x7f679406ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:00.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.742+0000 7f679b7cc700 1 --2- 172.21.15.104:0/3521471716 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f679415a050 0x7f679406ea50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6788009910 tx=0x7f67880091a0 comp rx=0 tx=0).stop 2024-08-17T02:23:00.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.742+0000 7f679b7cc700 1 -- 172.21.15.104:0/3521471716 shutdown_connections 2024-08-17T02:23:00.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.742+0000 7f679b7cc700 1 --2- 172.21.15.104:0/3521471716 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f679415a050 0x7f679406ea50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:00.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.742+0000 7f679b7cc700 1 -- 172.21.15.104:0/3521471716 >> 172.21.15.104:0/3521471716 conn(0x7f6794067810 msgr2=0x7f6794067c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:00.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.742+0000 7f679b7cc700 1 -- 172.21.15.104:0/3521471716 shutdown_connections 2024-08-17T02:23:00.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.742+0000 7f679b7cc700 1 -- 172.21.15.104:0/3521471716 wait complete. 2024-08-17T02:23:00.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.742+0000 7f679b7cc700 1 Processor -- start 2024-08-17T02:23:00.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.742+0000 7f679b7cc700 1 -- start start 2024-08-17T02:23:00.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.746+0000 7f679b7cc700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f679406e680 0x7f6794153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:00.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.746+0000 7f679b7cc700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67940ac490 0x7f67940b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:00.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.746+0000 7f679b7cc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f679415a050 0x7f67940ae000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:00.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.746+0000 7f679b7cc700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67940b0f60 con 0x7f67940ac490 2024-08-17T02:23:00.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.746+0000 7f679b7cc700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f679416d620 con 0x7f679415a050 2024-08-17T02:23:00.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.746+0000 7f679b7cc700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67940b0ce0 con 0x7f679406e680 2024-08-17T02:23:00.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.746+0000 7f6798d67700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67940ac490 0x7f67940b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:00.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.746+0000 7f6798d67700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67940ac490 0x7f67940b07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44746/0 (socket says 172.21.15.104:44746) 2024-08-17T02:23:00.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.746+0000 7f6798d67700 1 -- 172.21.15.104:0/2223170877 learned_addr learned my addr 172.21.15.104:0/2223170877 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:00.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.746+0000 7f6799568700 1 --2- 172.21.15.104:0/2223170877 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f679406e680 0x7f6794153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:00.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.746+0000 7f6799d69700 1 --2- 172.21.15.104:0/2223170877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f679415a050 0x7f67940ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:00.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.746+0000 7f6798d67700 1 -- 172.21.15.104:0/2223170877 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f679406e680 msgr2=0x7f6794153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:00.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.746+0000 7f6798d67700 1 --2- 172.21.15.104:0/2223170877 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f679406e680 0x7f6794153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:00.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.746+0000 7f6798d67700 1 -- 172.21.15.104:0/2223170877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f679415a050 msgr2=0x7f67940ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:00.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.746+0000 7f6798d67700 1 --2- 172.21.15.104:0/2223170877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f679415a050 0x7f67940ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:00.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.746+0000 7f6798d67700 1 -- 172.21.15.104:0/2223170877 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6788009420 con 0x7f67940ac490 2024-08-17T02:23:00.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.746+0000 7f6799568700 1 --2- 172.21.15.104:0/2223170877 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f679406e680 0x7f6794153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:00.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.746+0000 7f6799d69700 1 --2- 172.21.15.104:0/2223170877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f679415a050 0x7f67940ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:00.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.746+0000 7f6798d67700 1 --2- 172.21.15.104:0/2223170877 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67940ac490 0x7f67940b07a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f679406ccb0 tx=0x7f6788017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:00.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.746+0000 7f67857fa700 1 -- 172.21.15.104:0/2223170877 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678800bb60 con 0x7f67940ac490 2024-08-17T02:23:00.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.746+0000 7f67857fa700 1 -- 172.21.15.104:0/2223170877 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6788027450 con 0x7f67940ac490 2024-08-17T02:23:00.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.746+0000 7f679b7cc700 1 -- 172.21.15.104:0/2223170877 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f679416ccf0 con 0x7f67940ac490 2024-08-17T02:23:00.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.746+0000 7f67857fa700 1 -- 172.21.15.104:0/2223170877 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67880277f0 con 0x7f67940ac490 2024-08-17T02:23:00.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.746+0000 7f679b7cc700 1 -- 172.21.15.104:0/2223170877 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f679416d2b0 con 0x7f67940ac490 2024-08-17T02:23:00.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.746+0000 7f67857fa700 1 -- 172.21.15.104:0/2223170877 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f678801a430 con 0x7f67940ac490 2024-08-17T02:23:00.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.746+0000 7f679b7cc700 1 -- 172.21.15.104:0/2223170877 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67940645c0 con 0x7f67940ac490 2024-08-17T02:23:00.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.750+0000 7f67857fa700 1 --2- 172.21.15.104:0/2223170877 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f6778060860 0x7f6778062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:00.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.750+0000 7f67857fa700 1 -- 172.21.15.104:0/2223170877 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f678807e7e0 con 0x7f67940ac490 2024-08-17T02:23:00.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.750+0000 7f6799568700 1 --2- 172.21.15.104:0/2223170877 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f6778060860 0x7f6778062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:00.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.750+0000 7f6799568700 1 --2- 172.21.15.104:0/2223170877 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f6778060860 0x7f6778062d10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6790007e90 tx=0x7f6790009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:00.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.754+0000 7f67857fa700 1 -- 172.21.15.104:0/2223170877 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f678804ef90 con 0x7f67940ac490 2024-08-17T02:23:00.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.966+0000 7f679b7cc700 1 -- 172.21.15.104:0/2223170877 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f679416d760 con 0x7f67940ac490 2024-08-17T02:23:00.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.974+0000 7f67857fa700 1 -- 172.21.15.104:0/2223170877 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7f67880525b0 con 0x7f67940ac490 2024-08-17T02:23:00.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.978+0000 7f679b7cc700 1 -- 172.21.15.104:0/2223170877 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f6778060860 msgr2=0x7f6778062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:00.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.978+0000 7f679b7cc700 1 --2- 172.21.15.104:0/2223170877 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f6778060860 0x7f6778062d10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6790007e90 tx=0x7f6790009040 comp rx=0 tx=0).stop 2024-08-17T02:23:00.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.978+0000 7f679b7cc700 1 -- 172.21.15.104:0/2223170877 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67940ac490 msgr2=0x7f67940b07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:00.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.978+0000 7f679b7cc700 1 --2- 172.21.15.104:0/2223170877 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67940ac490 0x7f67940b07a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f679406ccb0 tx=0x7f6788017000 comp rx=0 tx=0).stop 2024-08-17T02:23:00.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.978+0000 7f679b7cc700 1 -- 172.21.15.104:0/2223170877 shutdown_connections 2024-08-17T02:23:00.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.978+0000 7f679b7cc700 1 --2- 172.21.15.104:0/2223170877 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f6778060860 0x7f6778062d10 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:00.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.978+0000 7f679b7cc700 1 --2- 172.21.15.104:0/2223170877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f679415a050 0x7f67940ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:00.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.978+0000 7f679b7cc700 1 --2- 172.21.15.104:0/2223170877 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67940ac490 0x7f67940b07a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:00.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.978+0000 7f679b7cc700 1 --2- 172.21.15.104:0/2223170877 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f679406e680 0x7f6794153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:00.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.978+0000 7f679b7cc700 1 -- 172.21.15.104:0/2223170877 >> 172.21.15.104:0/2223170877 conn(0x7f6794067810 msgr2=0x7f679406aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:00.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.978+0000 7f679b7cc700 1 -- 172.21.15.104:0/2223170877 shutdown_connections 2024-08-17T02:23:00.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:00.978+0000 7f679b7cc700 1 -- 172.21.15.104:0/2223170877 wait complete. 2024-08-17T02:23:00.993 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-08-17T02:23:01.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.098+0000 7f3055933700 1 Processor -- start 2024-08-17T02:23:01.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.102+0000 7f3055933700 1 -- start start 2024-08-17T02:23:01.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.102+0000 7f3055933700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f30500688d0 0x7f3050068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:01.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.102+0000 7f3055933700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30500cc060 0x7f30500b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:01.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.102+0000 7f3055933700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30500cafc0 con 0x7f30500caa20 2024-08-17T02:23:01.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.102+0000 7f3055933700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30500cb2a0 con 0x7f30500688d0 2024-08-17T02:23:01.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.102+0000 7f3055933700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30500cb580 con 0x7f30500cc060 2024-08-17T02:23:01.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.102+0000 7f3047fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30500cc060 0x7f30500b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:01.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.102+0000 7f3054931700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f30500688d0 0x7f3050068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:01.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.102+0000 7f3047fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30500cc060 0x7f30500b1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.104:34980/0 (socket says 172.21.15.104:34980) 2024-08-17T02:23:01.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.102+0000 7f3047fff700 1 -- 172.21.15.104:0/2095466422 learned_addr learned my addr 172.21.15.104:0/2095466422 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:01.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.102+0000 7f3055132700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f30500caa20 0x7f3050156800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.104:46734/0 (socket says 172.21.15.104:46734) 2024-08-17T02:23:01.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.102+0000 7f3047fff700 1 -- 172.21.15.104:0/2095466422 >> v2:172.21.15.117:3300/0 conn(0x7f30500688d0 msgr2=0x7f3050068ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:01.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.102+0000 7f3047fff700 1 --2- 172.21.15.104:0/2095466422 >> v2:172.21.15.117:3300/0 conn(0x7f30500688d0 0x7f3050068ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:01.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.102+0000 7f3047fff700 1 -- 172.21.15.104:0/2095466422 >> v1:172.21.15.117:6789/0 conn(0x7f30500caa20 legacy=0x7f3050156800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:01.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.102+0000 7f3047fff700 1 -- 172.21.15.104:0/2095466422 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30500cb860 con 0x7f30500cc060 2024-08-17T02:23:01.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.106+0000 7f3047fff700 1 --2- 172.21.15.104:0/2095466422 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30500cc060 0x7f30500b1f50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f30400099b0 tx=0x7f3040009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42b7826bb0ca009b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:01.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.106+0000 7f30477fe700 1 -- 172.21.15.104:0/2095466422 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3040009ea0 con 0x7f30500cc060 2024-08-17T02:23:01.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.106+0000 7f30477fe700 1 -- 172.21.15.104:0/2095466422 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304000b860 con 0x7f30500cc060 2024-08-17T02:23:01.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.106+0000 7f30477fe700 1 -- 172.21.15.104:0/2095466422 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304000bc00 con 0x7f30500cc060 2024-08-17T02:23:01.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.106+0000 7f3055933700 1 -- 172.21.15.104:0/2095466422 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30500cc060 msgr2=0x7f30500b1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:01.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.106+0000 7f3055933700 1 --2- 172.21.15.104:0/2095466422 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30500cc060 0x7f30500b1f50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f30400099b0 tx=0x7f3040009250 comp rx=0 tx=0).stop 2024-08-17T02:23:01.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.106+0000 7f3055933700 1 -- 172.21.15.104:0/2095466422 shutdown_connections 2024-08-17T02:23:01.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.106+0000 7f3055933700 1 --2- 172.21.15.104:0/2095466422 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30500cc060 0x7f30500b1f50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:01.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.106+0000 7f3055933700 1 --2- 172.21.15.104:0/2095466422 >> v2:172.21.15.117:3300/0 conn(0x7f30500688d0 0x7f3050068ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:01.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.106+0000 7f3055933700 1 -- 172.21.15.104:0/2095466422 >> 172.21.15.104:0/2095466422 conn(0x7f305006d790 msgr2=0x7f305006db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:01.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.106+0000 7f3055933700 1 -- 172.21.15.104:0/2095466422 shutdown_connections 2024-08-17T02:23:01.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.106+0000 7f3055933700 1 -- 172.21.15.104:0/2095466422 wait complete. 2024-08-17T02:23:01.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.106+0000 7f3055933700 1 Processor -- start 2024-08-17T02:23:01.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.106+0000 7f3055933700 1 -- start start 2024-08-17T02:23:01.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.110+0000 7f3055933700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30500688d0 0x7f3050158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:01.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.110+0000 7f3055933700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30500caa20 0x7f305014dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:01.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.110+0000 7f3055933700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30500cc060 0x7f3050156f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:01.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.110+0000 7f3055933700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30501585d0 con 0x7f30500cc060 2024-08-17T02:23:01.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.110+0000 7f3055933700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305014e1b0 con 0x7f30500caa20 2024-08-17T02:23:01.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.110+0000 7f3055933700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30501579c0 con 0x7f30500688d0 2024-08-17T02:23:01.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.110+0000 7f3055132700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30500cc060 0x7f3050156f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:01.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.110+0000 7f3055132700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30500cc060 0x7f3050156f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44750/0 (socket says 172.21.15.104:44750) 2024-08-17T02:23:01.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.110+0000 7f3055132700 1 -- 172.21.15.104:0/881652703 learned_addr learned my addr 172.21.15.104:0/881652703 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:01.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.110+0000 7f3047fff700 1 --2- 172.21.15.104:0/881652703 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30500caa20 0x7f305014dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:01.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.110+0000 7f3054931700 1 --2- 172.21.15.104:0/881652703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30500688d0 0x7f3050158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:01.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.110+0000 7f3055132700 1 -- 172.21.15.104:0/881652703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30500688d0 msgr2=0x7f3050158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:01.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.110+0000 7f3055132700 1 --2- 172.21.15.104:0/881652703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30500688d0 0x7f3050158a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:01.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.110+0000 7f3055132700 1 -- 172.21.15.104:0/881652703 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30500caa20 msgr2=0x7f305014dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:01.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.110+0000 7f3055132700 1 --2- 172.21.15.104:0/881652703 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30500caa20 0x7f305014dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:01.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.110+0000 7f3055132700 1 -- 172.21.15.104:0/881652703 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30400094f0 con 0x7f30500cc060 2024-08-17T02:23:01.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.110+0000 7f3055132700 1 --2- 172.21.15.104:0/881652703 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30500cc060 0x7f3050156f90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f304800cd30 tx=0x7f3048001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:01.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.110+0000 7f3044ff9700 1 -- 172.21.15.104:0/881652703 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304800ce90 con 0x7f30500cc060 2024-08-17T02:23:01.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.110+0000 7f3044ff9700 1 -- 172.21.15.104:0/881652703 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3048005df0 con 0x7f30500cc060 2024-08-17T02:23:01.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.110+0000 7f3055933700 1 -- 172.21.15.104:0/881652703 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3050157ca0 con 0x7f30500cc060 2024-08-17T02:23:01.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.110+0000 7f3044ff9700 1 -- 172.21.15.104:0/881652703 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304800aac0 con 0x7f30500cc060 2024-08-17T02:23:01.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.110+0000 7f3055933700 1 -- 172.21.15.104:0/881652703 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3050158260 con 0x7f30500cc060 2024-08-17T02:23:01.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.110+0000 7f3055933700 1 -- 172.21.15.104:0/881652703 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3050158780 con 0x7f30500cc060 2024-08-17T02:23:01.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.114+0000 7f3044ff9700 1 -- 172.21.15.104:0/881652703 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f30480070f0 con 0x7f30500cc060 2024-08-17T02:23:01.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.114+0000 7f3044ff9700 1 --2- 172.21.15.104:0/881652703 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f303c060860 0x7f303c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:01.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.114+0000 7f3044ff9700 1 -- 172.21.15.104:0/881652703 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f304807c8a0 con 0x7f30500cc060 2024-08-17T02:23:01.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.114+0000 7f3054931700 1 --2- 172.21.15.104:0/881652703 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f303c060860 0x7f303c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:01.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.114+0000 7f3054931700 1 --2- 172.21.15.104:0/881652703 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f303c060860 0x7f303c062d10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f304c009db0 tx=0x7f304c0091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:01.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.122+0000 7f3044ff9700 1 -- 172.21.15.104:0/881652703 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f3050158780 con 0x7f30500cc060 2024-08-17T02:23:01.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.342+0000 7f3055933700 1 -- 172.21.15.104:0/881652703 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f3050158780 con 0x7f30500cc060 2024-08-17T02:23:01.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.350+0000 7f3044ff9700 1 -- 172.21.15.104:0/881652703 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f3050158780 con 0x7f30500cc060 2024-08-17T02:23:01.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.350+0000 7f3055933700 1 -- 172.21.15.104:0/881652703 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f303c060860 msgr2=0x7f303c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:01.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.350+0000 7f3055933700 1 --2- 172.21.15.104:0/881652703 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f303c060860 0x7f303c062d10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f304c009db0 tx=0x7f304c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:23:01.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.350+0000 7f3055933700 1 -- 172.21.15.104:0/881652703 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30500cc060 msgr2=0x7f3050156f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:01.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.350+0000 7f3055933700 1 --2- 172.21.15.104:0/881652703 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30500cc060 0x7f3050156f90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f304800cd30 tx=0x7f3048001b10 comp rx=0 tx=0).stop 2024-08-17T02:23:01.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.350+0000 7f3055933700 1 -- 172.21.15.104:0/881652703 shutdown_connections 2024-08-17T02:23:01.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.350+0000 7f3055933700 1 --2- 172.21.15.104:0/881652703 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f303c060860 0x7f303c062d10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:01.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.350+0000 7f3055933700 1 --2- 172.21.15.104:0/881652703 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30500cc060 0x7f3050156f90 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:01.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.350+0000 7f3055933700 1 --2- 172.21.15.104:0/881652703 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30500caa20 0x7f305014dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:01.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.350+0000 7f3055933700 1 --2- 172.21.15.104:0/881652703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30500688d0 0x7f3050158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:01.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.350+0000 7f3055933700 1 -- 172.21.15.104:0/881652703 >> 172.21.15.104:0/881652703 conn(0x7f305006d790 msgr2=0x7f3050067450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:01.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.350+0000 7f3055933700 1 -- 172.21.15.104:0/881652703 shutdown_connections 2024-08-17T02:23:01.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.350+0000 7f3055933700 1 -- 172.21.15.104:0/881652703 wait complete. 2024-08-17T02:23:01.369 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-08-17T02:23:01.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.478+0000 7f575f3d5700 1 Processor -- start 2024-08-17T02:23:01.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.478+0000 7f575f3d5700 1 -- start start 2024-08-17T02:23:01.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.478+0000 7f575f3d5700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f57580b0d20 0x7f575806df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:01.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.478+0000 7f575f3d5700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57580b1800 0x7f5758141e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:01.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.478+0000 7f575f3d5700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5758141a00 con 0x7f575806e450 2024-08-17T02:23:01.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.478+0000 7f575f3d5700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f575806e8a0 con 0x7f57580b0d20 2024-08-17T02:23:01.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.478+0000 7f575f3d5700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5758140b10 con 0x7f57580b1800 2024-08-17T02:23:01.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.478+0000 7f575dbd2700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f575806e450 0x7f57580b10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:50658/0 (socket says 172.21.15.104:50658) 2024-08-17T02:23:01.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.478+0000 7f575dbd2700 1 -- 172.21.15.104:0/1079944569 learned_addr learned my addr 172.21.15.104:0/1079944569 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:23:01.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.478+0000 7f575e3d3700 1 --2- 172.21.15.104:0/1079944569 >> v2:172.21.15.117:3300/0 conn(0x7f57580b0d20 0x7f575806df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:01.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.478+0000 7f575ebd4700 1 --2- 172.21.15.104:0/1079944569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57580b1800 0x7f5758141e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:01.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.478+0000 7f575d3d1700 1 -- 172.21.15.104:0/1079944569 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1549329100 0 0) 0x7f5758141a00 con 0x7f575806e450 2024-08-17T02:23:01.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.478+0000 7f575d3d1700 1 -- 172.21.15.104:0/1079944569 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5744003570 con 0x7f575806e450 2024-08-17T02:23:01.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.478+0000 7f575d3d1700 1 -- 172.21.15.104:0/1079944569 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2972789200 0 0) 0x7f5744003570 con 0x7f575806e450 2024-08-17T02:23:01.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.478+0000 7f575d3d1700 1 -- 172.21.15.104:0/1079944569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57580b1800 msgr2=0x7f5758141e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:01.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.478+0000 7f575d3d1700 1 --2- 172.21.15.104:0/1079944569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57580b1800 0x7f5758141e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:01.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.478+0000 7f575d3d1700 1 -- 172.21.15.104:0/1079944569 >> v2:172.21.15.117:3300/0 conn(0x7f57580b0d20 msgr2=0x7f575806df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:01.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.478+0000 7f575d3d1700 1 --2- 172.21.15.104:0/1079944569 >> v2:172.21.15.117:3300/0 conn(0x7f57580b0d20 0x7f575806df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:01.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.478+0000 7f575d3d1700 1 -- 172.21.15.104:0/1079944569 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5758140df0 con 0x7f575806e450 2024-08-17T02:23:01.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.478+0000 7f575d3d1700 1 -- 172.21.15.104:0/1079944569 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1279957748 0 0) 0x7f5754001470 con 0x7f575806e450 2024-08-17T02:23:01.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.478+0000 7f575d3d1700 1 -- 172.21.15.104:0/1079944569 >> v1:172.21.15.104:6789/0 conn(0x7f575806e450 legacy=0x7f57580b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:01.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.478+0000 7f575d3d1700 1 --2- 172.21.15.104:0/1079944569 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5744003a60 0x7f5744003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:01.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.478+0000 7f575d3d1700 1 --2- 172.21.15.104:0/1079944569 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5744004810 0x7f5744004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:01.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.478+0000 7f575d3d1700 1 --2- 172.21.15.104:0/1079944569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57580b1800 0x7f57440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:01.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.478+0000 7f575d3d1700 1 -- 172.21.15.104:0/1079944569 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575806e8a0 con 0x7f5744003a60 2024-08-17T02:23:01.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.478+0000 7f575d3d1700 1 -- 172.21.15.104:0/1079944569 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5758140b10 con 0x7f5744004810 2024-08-17T02:23:01.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.478+0000 7f575d3d1700 1 -- 172.21.15.104:0/1079944569 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f574400ba60 con 0x7f57580b1800 2024-08-17T02:23:01.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.478+0000 7f575e3d3700 1 --2- 172.21.15.104:0/1079944569 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5744003a60 0x7f5744003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:01.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.478+0000 7f575dbd2700 1 --2- 172.21.15.104:0/1079944569 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5744004810 0x7f5744004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:01.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.478+0000 7f575e3d3700 1 -- 172.21.15.104:0/1079944569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57580b1800 msgr2=0x7f57440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:01.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.478+0000 7f575e3d3700 1 --2- 172.21.15.104:0/1079944569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57580b1800 0x7f57440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:01.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.478+0000 7f575e3d3700 1 -- 172.21.15.104:0/1079944569 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5744004810 msgr2=0x7f5744004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:01.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.478+0000 7f575e3d3700 1 --2- 172.21.15.104:0/1079944569 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5744004810 0x7f5744004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:01.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.478+0000 7f575e3d3700 1 -- 172.21.15.104:0/1079944569 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5744003570 con 0x7f5744003a60 2024-08-17T02:23:01.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.478+0000 7f575e3d3700 1 --2- 172.21.15.104:0/1079944569 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5744003a60 0x7f5744003e70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5748009c30 tx=0x7f57480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c62babd9a1935522 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:01.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.478+0000 7f575d3d1700 1 -- 172.21.15.104:0/1079944569 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574800e710 con 0x7f5744003a60 2024-08-17T02:23:01.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.478+0000 7f575d3d1700 1 -- 172.21.15.104:0/1079944569 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f574800e870 con 0x7f5744003a60 2024-08-17T02:23:01.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.478+0000 7f575d3d1700 1 -- 172.21.15.104:0/1079944569 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574800ec30 con 0x7f5744003a60 2024-08-17T02:23:01.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.482+0000 7f575f3d5700 1 -- 172.21.15.104:0/1079944569 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5744003a60 msgr2=0x7f5744003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:01.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.482+0000 7f575f3d5700 1 --2- 172.21.15.104:0/1079944569 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5744003a60 0x7f5744003e70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5748009c30 tx=0x7f57480091a0 comp rx=0 tx=0).stop 2024-08-17T02:23:01.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.482+0000 7f575ebd4700 1 -- 172.21.15.104:0/1079944569 reap_dead start 2024-08-17T02:23:01.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.482+0000 7f575f3d5700 1 -- 172.21.15.104:0/1079944569 shutdown_connections 2024-08-17T02:23:01.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.482+0000 7f575f3d5700 1 -- 172.21.15.104:0/1079944569 >> 172.21.15.104:0/1079944569 conn(0x7f57580678d0 msgr2=0x7f5758067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:01.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.482+0000 7f575f3d5700 1 -- 172.21.15.104:0/1079944569 shutdown_connections 2024-08-17T02:23:01.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.482+0000 7f575f3d5700 1 -- 172.21.15.104:0/1079944569 wait complete. 2024-08-17T02:23:01.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.482+0000 7f575f3d5700 1 Processor -- start 2024-08-17T02:23:01.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.482+0000 7f575f3d5700 1 -- start start 2024-08-17T02:23:01.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.486+0000 7f575f3d5700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5744003a60 0x7f5758159920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:01.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.486+0000 7f575f3d5700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5758159e60 0x7f57580a6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:01.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.486+0000 7f575f3d5700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57580a6bb0 0x7f57580a5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:01.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.486+0000 7f575f3d5700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5758140540 con 0x7f5758159e60 2024-08-17T02:23:01.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.486+0000 7f575f3d5700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57581572f0 con 0x7f5744003a60 2024-08-17T02:23:01.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.486+0000 7f575f3d5700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f575816da30 con 0x7f57580a6bb0 2024-08-17T02:23:01.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.486+0000 7f575dbd2700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5758159e60 0x7f57580a6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:01.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.486+0000 7f575dbd2700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5758159e60 0x7f57580a6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44760/0 (socket says 172.21.15.104:44760) 2024-08-17T02:23:01.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.486+0000 7f575dbd2700 1 -- 172.21.15.104:0/1027333332 learned_addr learned my addr 172.21.15.104:0/1027333332 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:01.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.486+0000 7f575e3d3700 1 --2- 172.21.15.104:0/1027333332 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5744003a60 0x7f5758159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:01.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.486+0000 7f575ebd4700 1 --2- 172.21.15.104:0/1027333332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57580a6bb0 0x7f57580a5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:01.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.486+0000 7f575dbd2700 1 -- 172.21.15.104:0/1027333332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57580a6bb0 msgr2=0x7f57580a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:01.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.486+0000 7f575dbd2700 1 --2- 172.21.15.104:0/1027333332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57580a6bb0 0x7f57580a5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:01.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.486+0000 7f575dbd2700 1 -- 172.21.15.104:0/1027333332 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5744003a60 msgr2=0x7f5758159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:01.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.486+0000 7f575dbd2700 1 --2- 172.21.15.104:0/1027333332 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5744003a60 0x7f5758159920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:01.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.486+0000 7f575dbd2700 1 -- 172.21.15.104:0/1027333332 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57580a7360 con 0x7f5758159e60 2024-08-17T02:23:01.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.486+0000 7f575dbd2700 1 --2- 172.21.15.104:0/1027333332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5758159e60 0x7f57580a6670 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5754007340 tx=0x7f5754001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:01.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.486+0000 7f574e7fc700 1 -- 172.21.15.104:0/1027333332 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5754018030 con 0x7f5758159e60 2024-08-17T02:23:01.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.486+0000 7f575f3d5700 1 -- 172.21.15.104:0/1027333332 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57580a7640 con 0x7f5758159e60 2024-08-17T02:23:01.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.486+0000 7f574e7fc700 1 -- 172.21.15.104:0/1027333332 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575400fae0 con 0x7f5758159e60 2024-08-17T02:23:01.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.486+0000 7f575f3d5700 1 -- 172.21.15.104:0/1027333332 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57580a7920 con 0x7f5758159e60 2024-08-17T02:23:01.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.486+0000 7f574e7fc700 1 -- 172.21.15.104:0/1027333332 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575400fc50 con 0x7f5758159e60 2024-08-17T02:23:01.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.490+0000 7f575f3d5700 1 -- 172.21.15.104:0/1027333332 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57580643a0 con 0x7f5758159e60 2024-08-17T02:23:01.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.490+0000 7f574e7fc700 1 -- 172.21.15.104:0/1027333332 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f575401b070 con 0x7f5758159e60 2024-08-17T02:23:01.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.490+0000 7f574e7fc700 1 --2- 172.21.15.104:0/1027333332 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f573c060860 0x7f573c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:01.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.490+0000 7f574e7fc700 1 -- 172.21.15.104:0/1027333332 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5754019070 con 0x7f5758159e60 2024-08-17T02:23:01.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.490+0000 7f575e3d3700 1 --2- 172.21.15.104:0/1027333332 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f573c060860 0x7f573c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:01.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.490+0000 7f575e3d3700 1 --2- 172.21.15.104:0/1027333332 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f573c060860 0x7f573c062d10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f57480091e0 tx=0x7f574801a000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:01.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.498+0000 7f574e7fc700 1 -- 172.21.15.104:0/1027333332 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f575404cf00 con 0x7f5758159e60 2024-08-17T02:23:01.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.718+0000 7f575f3d5700 1 -- 172.21.15.104:0/1027333332 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f5758157430 con 0x7f5758159e60 2024-08-17T02:23:01.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.726+0000 7f574e7fc700 1 -- 172.21.15.104:0/1027333332 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5754050520 con 0x7f5758159e60 2024-08-17T02:23:01.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.726+0000 7f575f3d5700 1 -- 172.21.15.104:0/1027333332 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f573c060860 msgr2=0x7f573c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:01.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.726+0000 7f575f3d5700 1 --2- 172.21.15.104:0/1027333332 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f573c060860 0x7f573c062d10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f57480091e0 tx=0x7f574801a000 comp rx=0 tx=0).stop 2024-08-17T02:23:01.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.726+0000 7f575f3d5700 1 -- 172.21.15.104:0/1027333332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5758159e60 msgr2=0x7f57580a6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:01.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.726+0000 7f575f3d5700 1 --2- 172.21.15.104:0/1027333332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5758159e60 0x7f57580a6670 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5754007340 tx=0x7f5754001e90 comp rx=0 tx=0).stop 2024-08-17T02:23:01.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.726+0000 7f575f3d5700 1 -- 172.21.15.104:0/1027333332 shutdown_connections 2024-08-17T02:23:01.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.726+0000 7f575f3d5700 1 --2- 172.21.15.104:0/1027333332 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f573c060860 0x7f573c062d10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:01.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.726+0000 7f575f3d5700 1 --2- 172.21.15.104:0/1027333332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57580a6bb0 0x7f57580a5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:01.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.726+0000 7f575f3d5700 1 --2- 172.21.15.104:0/1027333332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5758159e60 0x7f57580a6670 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:01.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.726+0000 7f575f3d5700 1 --2- 172.21.15.104:0/1027333332 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5744003a60 0x7f5758159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:01.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.726+0000 7f575f3d5700 1 -- 172.21.15.104:0/1027333332 >> 172.21.15.104:0/1027333332 conn(0x7f57580678d0 msgr2=0x7f5758160150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:01.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.726+0000 7f575f3d5700 1 -- 172.21.15.104:0/1027333332 shutdown_connections 2024-08-17T02:23:01.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.726+0000 7f575f3d5700 1 -- 172.21.15.104:0/1027333332 wait complete. 2024-08-17T02:23:01.744 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-08-17T02:23:01.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.850+0000 7fd69300f700 1 Processor -- start 2024-08-17T02:23:01.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.850+0000 7fd69300f700 1 -- start start 2024-08-17T02:23:01.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.854+0000 7fd69300f700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd68c06e470 0x7fd68c06e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:01.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.854+0000 7fd69300f700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd68c0cad40 0x7fd68c0cb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:01.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.854+0000 7fd69300f700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd68c1610c0 con 0x7fd68c0adf10 2024-08-17T02:23:01.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.854+0000 7fd69300f700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd68c158290 con 0x7fd68c06e470 2024-08-17T02:23:01.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.854+0000 7fd69300f700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd68c15dff0 con 0x7fd68c0cad40 2024-08-17T02:23:01.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.854+0000 7fd690dab700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fd68c0adf10 0x7fd68c0ae2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.104:46750/0 (socket says 172.21.15.104:46750) 2024-08-17T02:23:01.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.854+0000 7fd690dab700 1 -- 172.21.15.104:0/1446729144 learned_addr learned my addr 172.21.15.104:0/1446729144 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:23:01.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.854+0000 7fd68bfff700 1 --2- 172.21.15.104:0/1446729144 >> v2:172.21.15.117:3300/0 conn(0x7fd68c06e470 0x7fd68c06e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:01.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.854+0000 7fd6915ac700 1 --2- 172.21.15.104:0/1446729144 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd68c0cad40 0x7fd68c0cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:01.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.854+0000 7fd68bfff700 1 -- 172.21.15.104:0/1446729144 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd68c0cad40 msgr2=0x7fd68c0cb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:01.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.854+0000 7fd68bfff700 1 --2- 172.21.15.104:0/1446729144 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd68c0cad40 0x7fd68c0cb160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:01.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.854+0000 7fd68bfff700 1 -- 172.21.15.104:0/1446729144 >> v1:172.21.15.117:6789/0 conn(0x7fd68c0adf10 legacy=0x7fd68c0ae2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:01.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.854+0000 7fd68bfff700 1 -- 172.21.15.104:0/1446729144 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd68c15e2d0 con 0x7fd68c06e470 2024-08-17T02:23:01.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.854+0000 7fd68bfff700 1 --2- 172.21.15.104:0/1446729144 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd68c06e470 0x7fd68c06e910 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd6800098e0 tx=0x7fd6800091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e63814a5beca669f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:01.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.854+0000 7fd68b7fe700 1 -- 172.21.15.104:0/1446729144 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68000b640 con 0x7fd68c06e470 2024-08-17T02:23:01.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.854+0000 7fd68b7fe700 1 -- 172.21.15.104:0/1446729144 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd68000b7a0 con 0x7fd68c06e470 2024-08-17T02:23:01.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.854+0000 7fd68b7fe700 1 -- 172.21.15.104:0/1446729144 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68000bb40 con 0x7fd68c06e470 2024-08-17T02:23:01.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.854+0000 7fd69300f700 1 -- 172.21.15.104:0/1446729144 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd68c06e470 msgr2=0x7fd68c06e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:01.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.854+0000 7fd69300f700 1 --2- 172.21.15.104:0/1446729144 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd68c06e470 0x7fd68c06e910 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd6800098e0 tx=0x7fd6800091a0 comp rx=0 tx=0).stop 2024-08-17T02:23:01.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.854+0000 7fd69300f700 1 -- 172.21.15.104:0/1446729144 shutdown_connections 2024-08-17T02:23:01.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.854+0000 7fd69300f700 1 --2- 172.21.15.104:0/1446729144 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd68c0cad40 0x7fd68c0cb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:01.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.854+0000 7fd69300f700 1 --2- 172.21.15.104:0/1446729144 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd68c06e470 0x7fd68c06e910 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:01.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.854+0000 7fd69300f700 1 -- 172.21.15.104:0/1446729144 >> 172.21.15.104:0/1446729144 conn(0x7fd68c067810 msgr2=0x7fd68c067c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:01.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.854+0000 7fd69300f700 1 -- 172.21.15.104:0/1446729144 shutdown_connections 2024-08-17T02:23:01.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.854+0000 7fd69300f700 1 -- 172.21.15.104:0/1446729144 wait complete. 2024-08-17T02:23:01.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.858+0000 7fd69300f700 1 Processor -- start 2024-08-17T02:23:01.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.858+0000 7fd69300f700 1 -- start start 2024-08-17T02:23:01.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.858+0000 7fd69300f700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd68c06e470 0x7fd68c15f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:01.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.858+0000 7fd69300f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd68c0adf10 0x7fd68c0969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:01.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.858+0000 7fd69300f700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd68c0cad40 0x7fd68c096f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:01.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.858+0000 7fd69300f700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68c0af350 con 0x7fd68c06e470 2024-08-17T02:23:01.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.858+0000 7fd69300f700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68c0991b0 con 0x7fd68c0adf10 2024-08-17T02:23:01.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.858+0000 7fd69300f700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd68c146b10 con 0x7fd68c0cad40 2024-08-17T02:23:01.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.858+0000 7fd690dab700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd68c06e470 0x7fd68c15f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:01.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.858+0000 7fd690dab700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd68c06e470 0x7fd68c15f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44768/0 (socket says 172.21.15.104:44768) 2024-08-17T02:23:01.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.858+0000 7fd690dab700 1 -- 172.21.15.104:0/3633171615 learned_addr learned my addr 172.21.15.104:0/3633171615 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:01.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.858+0000 7fd6915ac700 1 --2- 172.21.15.104:0/3633171615 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd68c0cad40 0x7fd68c096f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:01.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.858+0000 7fd68bfff700 1 --2- 172.21.15.104:0/3633171615 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd68c0adf10 0x7fd68c0969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:01.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.858+0000 7fd690dab700 1 -- 172.21.15.104:0/3633171615 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd68c0cad40 msgr2=0x7fd68c096f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:01.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.858+0000 7fd690dab700 1 --2- 172.21.15.104:0/3633171615 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd68c0cad40 0x7fd68c096f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:01.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.858+0000 7fd690dab700 1 -- 172.21.15.104:0/3633171615 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd68c0adf10 msgr2=0x7fd68c0969f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:01.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.858+0000 7fd690dab700 1 --2- 172.21.15.104:0/3633171615 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd68c0adf10 0x7fd68c0969f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:01.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.858+0000 7fd690dab700 1 -- 172.21.15.104:0/3633171615 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd680009420 con 0x7fd68c06e470 2024-08-17T02:23:01.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.858+0000 7fd690dab700 1 --2- 172.21.15.104:0/3633171615 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd68c06e470 0x7fd68c15f9a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd68400cc70 tx=0x7fd684001a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:01.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.862+0000 7fd688ff9700 1 -- 172.21.15.104:0/3633171615 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68400a830 con 0x7fd68c06e470 2024-08-17T02:23:01.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.862+0000 7fd688ff9700 1 -- 172.21.15.104:0/3633171615 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd68400a9b0 con 0x7fd68c06e470 2024-08-17T02:23:01.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.862+0000 7fd69300f700 1 -- 172.21.15.104:0/3633171615 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd68c0aed20 con 0x7fd68c06e470 2024-08-17T02:23:01.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.862+0000 7fd688ff9700 1 -- 172.21.15.104:0/3633171615 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68400ad70 con 0x7fd68c06e470 2024-08-17T02:23:01.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.862+0000 7fd69300f700 1 -- 172.21.15.104:0/3633171615 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd68c097840 con 0x7fd68c06e470 2024-08-17T02:23:01.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.862+0000 7fd69300f700 1 -- 172.21.15.104:0/3633171615 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd68c0645c0 con 0x7fd68c06e470 2024-08-17T02:23:01.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.862+0000 7fd688ff9700 1 -- 172.21.15.104:0/3633171615 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd684007300 con 0x7fd68c06e470 2024-08-17T02:23:01.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.866+0000 7fd688ff9700 1 --2- 172.21.15.104:0/3633171615 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fd678060860 0x7fd678062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:01.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.866+0000 7fd688ff9700 1 -- 172.21.15.104:0/3633171615 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd68407cb00 con 0x7fd68c06e470 2024-08-17T02:23:01.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.866+0000 7fd68bfff700 1 --2- 172.21.15.104:0/3633171615 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fd678060860 0x7fd678062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:01.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.866+0000 7fd68bfff700 1 --2- 172.21.15.104:0/3633171615 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fd678060860 0x7fd678062d10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd6800093f0 tx=0x7fd680017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:01.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:01.870+0000 7fd688ff9700 1 -- 172.21.15.104:0/3633171615 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd68404d320 con 0x7fd68c06e470 2024-08-17T02:23:02.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.090+0000 7fd69300f700 1 -- 172.21.15.104:0/3633171615 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fd68c0684a0 con 0x7fd68c06e470 2024-08-17T02:23:02.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.098+0000 7fd688ff9700 1 -- 172.21.15.104:0/3633171615 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd684050940 con 0x7fd68c06e470 2024-08-17T02:23:02.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.098+0000 7fd69300f700 1 -- 172.21.15.104:0/3633171615 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fd678060860 msgr2=0x7fd678062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:02.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.098+0000 7fd69300f700 1 --2- 172.21.15.104:0/3633171615 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fd678060860 0x7fd678062d10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd6800093f0 tx=0x7fd680017000 comp rx=0 tx=0).stop 2024-08-17T02:23:02.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.098+0000 7fd69300f700 1 -- 172.21.15.104:0/3633171615 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd68c06e470 msgr2=0x7fd68c15f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:02.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.098+0000 7fd69300f700 1 --2- 172.21.15.104:0/3633171615 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd68c06e470 0x7fd68c15f9a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd68400cc70 tx=0x7fd684001a10 comp rx=0 tx=0).stop 2024-08-17T02:23:02.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.098+0000 7fd69300f700 1 -- 172.21.15.104:0/3633171615 shutdown_connections 2024-08-17T02:23:02.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.098+0000 7fd69300f700 1 --2- 172.21.15.104:0/3633171615 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fd678060860 0x7fd678062d10 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:02.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.098+0000 7fd69300f700 1 --2- 172.21.15.104:0/3633171615 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd68c0cad40 0x7fd68c096f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:02.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.098+0000 7fd69300f700 1 --2- 172.21.15.104:0/3633171615 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd68c0adf10 0x7fd68c0969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:02.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.098+0000 7fd69300f700 1 --2- 172.21.15.104:0/3633171615 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd68c06e470 0x7fd68c15f9a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:02.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.098+0000 7fd69300f700 1 -- 172.21.15.104:0/3633171615 >> 172.21.15.104:0/3633171615 conn(0x7fd68c067810 msgr2=0x7fd68c1574c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:02.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.098+0000 7fd69300f700 1 -- 172.21.15.104:0/3633171615 shutdown_connections 2024-08-17T02:23:02.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.098+0000 7fd69300f700 1 -- 172.21.15.104:0/3633171615 wait complete. 2024-08-17T02:23:02.114 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:23:02.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.258+0000 7f0d62cf5700 1 Processor -- start 2024-08-17T02:23:02.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.258+0000 7f0d62cf5700 1 -- start start 2024-08-17T02:23:02.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.262+0000 7f0d62cf5700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0d5c0c9820 0x7f0d5c159b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:02.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.262+0000 7f0d62cf5700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f0d5c15a090 0x7f0d5c0ada90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:02.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.262+0000 7f0d62cf5700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d5c0c9e00 con 0x7f0d5c153a40 2024-08-17T02:23:02.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.262+0000 7f0d62cf5700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d5c0ccd20 con 0x7f0d5c15a090 2024-08-17T02:23:02.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.262+0000 7f0d62cf5700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d5c0cc890 con 0x7f0d5c0c9820 2024-08-17T02:23:02.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.262+0000 7f0d60a91700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f0d5c153a40 0x7f0d5c0b29f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:50670/0 (socket says 172.21.15.104:50670) 2024-08-17T02:23:02.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.262+0000 7f0d60a91700 1 -- 172.21.15.104:0/1679282314 learned_addr learned my addr 172.21.15.104:0/1679282314 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:23:02.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.262+0000 7f0d61292700 1 --2- 172.21.15.104:0/1679282314 >> v2:172.21.15.104:3300/0 conn(0x7f0d5c15a090 0x7f0d5c0ada90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:02.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.262+0000 7f0d5bfff700 1 --2- 172.21.15.104:0/1679282314 >> v2:172.21.15.117:3300/0 conn(0x7f0d5c0c9820 0x7f0d5c159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:02.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.262+0000 7f0d5b7fe700 1 -- 172.21.15.104:0/1679282314 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3290609036 0 0) 0x7f0d5c0c9e00 con 0x7f0d5c153a40 2024-08-17T02:23:02.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.262+0000 7f0d5b7fe700 1 -- 172.21.15.104:0/1679282314 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d44003570 con 0x7f0d5c153a40 2024-08-17T02:23:02.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.262+0000 7f0d5bfff700 1 -- 172.21.15.104:0/1679282314 >> v2:172.21.15.104:3300/0 conn(0x7f0d5c15a090 msgr2=0x7f0d5c0ada90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:02.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.262+0000 7f0d5bfff700 1 --2- 172.21.15.104:0/1679282314 >> v2:172.21.15.104:3300/0 conn(0x7f0d5c15a090 0x7f0d5c0ada90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:02.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.262+0000 7f0d5bfff700 1 -- 172.21.15.104:0/1679282314 >> v1:172.21.15.104:6789/0 conn(0x7f0d5c153a40 legacy=0x7f0d5c0b29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:02.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.262+0000 7f0d5bfff700 1 -- 172.21.15.104:0/1679282314 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d5c15a480 con 0x7f0d5c0c9820 2024-08-17T02:23:02.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.262+0000 7f0d5bfff700 1 --2- 172.21.15.104:0/1679282314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d5c0c9820 0x7f0d5c159b50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c0ccf10 tx=0x7f0d500091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7772cb8e459580a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:02.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.262+0000 7f0d5b7fe700 1 -- 172.21.15.104:0/1679282314 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d50011630 con 0x7f0d5c0c9820 2024-08-17T02:23:02.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.262+0000 7f0d5b7fe700 1 -- 172.21.15.104:0/1679282314 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d50011790 con 0x7f0d5c0c9820 2024-08-17T02:23:02.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.262+0000 7f0d5b7fe700 1 -- 172.21.15.104:0/1679282314 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d50011b10 con 0x7f0d5c0c9820 2024-08-17T02:23:02.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.262+0000 7f0d62cf5700 1 -- 172.21.15.104:0/1679282314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d5c0c9820 msgr2=0x7f0d5c159b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:02.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.262+0000 7f0d62cf5700 1 --2- 172.21.15.104:0/1679282314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d5c0c9820 0x7f0d5c159b50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c0ccf10 tx=0x7f0d500091a0 comp rx=0 tx=0).stop 2024-08-17T02:23:02.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.262+0000 7f0d62cf5700 1 -- 172.21.15.104:0/1679282314 shutdown_connections 2024-08-17T02:23:02.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.262+0000 7f0d62cf5700 1 --2- 172.21.15.104:0/1679282314 >> v2:172.21.15.104:3300/0 conn(0x7f0d5c15a090 0x7f0d5c0ada90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:02.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.262+0000 7f0d62cf5700 1 --2- 172.21.15.104:0/1679282314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d5c0c9820 0x7f0d5c159b50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:02.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.262+0000 7f0d62cf5700 1 -- 172.21.15.104:0/1679282314 >> 172.21.15.104:0/1679282314 conn(0x7f0d5c0a9db0 msgr2=0x7f0d5c0ac1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:02.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.262+0000 7f0d62cf5700 1 -- 172.21.15.104:0/1679282314 shutdown_connections 2024-08-17T02:23:02.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.262+0000 7f0d62cf5700 1 -- 172.21.15.104:0/1679282314 wait complete. 2024-08-17T02:23:02.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.266+0000 7f0d62cf5700 1 Processor -- start 2024-08-17T02:23:02.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.266+0000 7f0d62cf5700 1 -- start start 2024-08-17T02:23:02.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.266+0000 7f0d62cf5700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0d5c0c9820 0x7f0d5c097970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:02.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.266+0000 7f0d62cf5700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d5c153a40 0x7f0d5c099310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:02.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.266+0000 7f0d62cf5700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d5c15a090 0x7f0d5c0ab6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:02.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.266+0000 7f0d62cf5700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c099850 con 0x7f0d5c0c9820 2024-08-17T02:23:02.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.266+0000 7f0d62cf5700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c099b10 con 0x7f0d5c153a40 2024-08-17T02:23:02.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.266+0000 7f0d62cf5700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c099df0 con 0x7f0d5c15a090 2024-08-17T02:23:02.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.266+0000 7f0d60a91700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0d5c0c9820 0x7f0d5c097970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:02.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.266+0000 7f0d60a91700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0d5c0c9820 0x7f0d5c097970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44774/0 (socket says 172.21.15.104:44774) 2024-08-17T02:23:02.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.266+0000 7f0d60a91700 1 -- 172.21.15.104:0/2942777892 learned_addr learned my addr 172.21.15.104:0/2942777892 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:02.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.266+0000 7f0d61292700 1 --2- 172.21.15.104:0/2942777892 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d5c15a090 0x7f0d5c0ab6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:02.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.266+0000 7f0d5bfff700 1 --2- 172.21.15.104:0/2942777892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d5c153a40 0x7f0d5c099310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:02.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.266+0000 7f0d60a91700 1 -- 172.21.15.104:0/2942777892 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d5c15a090 msgr2=0x7f0d5c0ab6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:02.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.266+0000 7f0d60a91700 1 --2- 172.21.15.104:0/2942777892 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d5c15a090 0x7f0d5c0ab6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:02.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.266+0000 7f0d60a91700 1 -- 172.21.15.104:0/2942777892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d5c153a40 msgr2=0x7f0d5c099310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:02.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.266+0000 7f0d60a91700 1 --2- 172.21.15.104:0/2942777892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d5c153a40 0x7f0d5c099310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:02.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.266+0000 7f0d60a91700 1 -- 172.21.15.104:0/2942777892 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d50009420 con 0x7f0d5c0c9820 2024-08-17T02:23:02.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.266+0000 7f0d60a91700 1 --2- 172.21.15.104:0/2942777892 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0d5c0c9820 0x7f0d5c097970 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c00cc40 tx=0x7f0d4c001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:02.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.266+0000 7f0d58ff9700 1 -- 172.21.15.104:0/2942777892 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c00a9c0 con 0x7f0d5c0c9820 2024-08-17T02:23:02.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.266+0000 7f0d62cf5700 1 -- 172.21.15.104:0/2942777892 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d5c09a0d0 con 0x7f0d5c0c9820 2024-08-17T02:23:02.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.266+0000 7f0d58ff9700 1 -- 172.21.15.104:0/2942777892 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4c00ab40 con 0x7f0d5c0c9820 2024-08-17T02:23:02.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.266+0000 7f0d58ff9700 1 -- 172.21.15.104:0/2942777892 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c0070f0 con 0x7f0d5c0c9820 2024-08-17T02:23:02.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.266+0000 7f0d62cf5700 1 -- 172.21.15.104:0/2942777892 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d5c09a690 con 0x7f0d5c0c9820 2024-08-17T02:23:02.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.270+0000 7f0d62cf5700 1 -- 172.21.15.104:0/2942777892 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d5c0645c0 con 0x7f0d5c0c9820 2024-08-17T02:23:02.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.270+0000 7f0d58ff9700 1 -- 172.21.15.104:0/2942777892 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f0d4c007520 con 0x7f0d5c0c9820 2024-08-17T02:23:02.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.270+0000 7f0d58ff9700 1 --2- 172.21.15.104:0/2942777892 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f0d48060860 0x7f0d48062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:02.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.270+0000 7f0d58ff9700 1 -- 172.21.15.104:0/2942777892 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0d4c07cdc0 con 0x7f0d5c0c9820 2024-08-17T02:23:02.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.270+0000 7f0d5bfff700 1 --2- 172.21.15.104:0/2942777892 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f0d48060860 0x7f0d48062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:02.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.274+0000 7f0d5bfff700 1 --2- 172.21.15.104:0/2942777892 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f0d48060860 0x7f0d48062d10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0d50009fd0 tx=0x7f0d50017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:02.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.278+0000 7f0d58ff9700 1 -- 172.21.15.104:0/2942777892 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f0d4c04d560 con 0x7f0d5c0c9820 2024-08-17T02:23:02.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.438+0000 7f0d62cf5700 1 -- 172.21.15.104:0/2942777892 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d5c0b0230 con 0x7f0d5c0c9820 2024-08-17T02:23:02.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.438+0000 7f0d58ff9700 1 -- 172.21.15.104:0/2942777892 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+12182 (secure 0 0 0) 0x7f0d4c050b80 con 0x7f0d5c0c9820 2024-08-17T02:23:02.441 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:23:02.441 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":30,"fsid":"fd5f7fb8-d34b-49bb-89a8-62b7dad1bc25","created":"2024-08-17T02:21:57.891389+0000","modified":"2024-08-17T02:22:59.491252+0000","last_up_change":"2024-08-17T02:22:08.924546+0000","last_in_change":"2024-08-17T02:21:59.938028+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:22:10.143970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"606b9088-590e-4709-aa3a-b0f6e22972ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":24257},{"type":"v1","addr":"172.21.15.104:6809","nonce":24257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":24257},{"type":"v1","addr":"172.21.15.104:6811","nonce":24257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":24257},{"type":"v1","addr":"172.21.15.104:6815","nonce":24257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":24257},{"type":"v1","addr":"172.21.15.104:6813","nonce":24257}]},"public_addr":"172.21.15.104:6809/24257","cluster_addr":"172.21.15.104:6811/24257","heartbeat_back_addr":"172.21.15.104:6815/24257","heartbeat_front_addr":"172.21.15.104:6813/24257","state":["exists","up"]},{"osd":1,"uuid":"9bc6a909-0c2f-4889-afe7-4a47f89b0f64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":24256},{"type":"v1","addr":"172.21.15.104:6825","nonce":24256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":24256},{"type":"v1","addr":"172.21.15.104:6827","nonce":24256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":24256},{"type":"v1","addr":"172.21.15.104:6831","nonce":24256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":24256},{"type":"v1","addr":"172.21.15.104:6829","nonce":24256}]},"public_addr":"172.21.15.104:6825/24256","cluster_addr":"172.21.15.104:6827/24256","heartbeat_back_addr":"172.21.15.104:6831/24256","heartbeat_front_addr":"172.21.15.104:6829/24256","state":["exists","up"]},{"osd":2,"uuid":"23da31d5-aefb-4edb-b79d-fa05e1becef7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":24255},{"type":"v1","addr":"172.21.15.104:6817","nonce":24255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":24255},{"type":"v1","addr":"172.21.15.104:6819","nonce":24255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":24255},{"type":"v1","addr":"172.21.15.104:6823","nonce":24255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":24255},{"type":"v1","addr":"172.21.15.104:6821","nonce":24255}]},"public_addr":"172.21.15.104:6817/24255","cluster_addr":"172.21.15.104:6819/24255","heartbeat_back_addr":"172.21.15.104:6823/24255","heartbeat_front_addr":"172.21.15.104:6821/24255","state":["exists","up"]},{"osd":3,"uuid":"6e4a5ec2-b415-45ef-8381-61a59eb65224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":24254},{"type":"v1","addr":"172.21.15.104:6801","nonce":24254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":24254},{"type":"v1","addr":"172.21.15.104:6803","nonce":24254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":24254},{"type":"v1","addr":"172.21.15.104:6807","nonce":24254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":24254},{"type":"v1","addr":"172.21.15.104:6805","nonce":24254}]},"public_addr":"172.21.15.104:6801/24254","cluster_addr":"172.21.15.104:6803/24254","heartbeat_back_addr":"172.21.15.104:6807/24254","heartbeat_front_addr":"172.21.15.104:6805/24254","state":["exists","up"]},{"osd":4,"uuid":"8d5bea2d-9039-4013-8c99-2c046c5b8a17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":24421},{"type":"v1","addr":"172.21.15.117:6804","nonce":24421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":24421},{"type":"v1","addr":"172.21.15.117:6809","nonce":24421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":24421},{"type":"v1","addr":"172.21.15.117:6815","nonce":24421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":24421},{"type":"v1","addr":"172.21.15.117:6813","nonce":24421}]},"public_addr":"172.21.15.117:6804/24421","cluster_addr":"172.21.15.117:6809/24421","heartbeat_back_addr":"172.21.15.117:6815/24421","heartbeat_front_addr":"172.21.15.117:6813/24421","state":["exists","up"]},{"osd":5,"uuid":"de8b36fc-121c-4f05-8f5b-28f513d9f21f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":24422},{"type":"v1","addr":"172.21.15.117:6817","nonce":24422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":24422},{"type":"v1","addr":"172.21.15.117:6819","nonce":24422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":24422},{"type":"v1","addr":"172.21.15.117:6823","nonce":24422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":24422},{"type":"v1","addr":"172.21.15.117:6821","nonce":24422}]},"public_addr":"172.21.15.117:6817/24422","cluster_addr":"172.21.15.117:6819/24422","heartbeat_back_addr":"172.21.15.117:6823/24422","heartbeat_front_addr":"172.21.15.117:6821/24422","state":["exists","up"]},{"osd":6,"uuid":"6a87f09f-7bf7-4f7a-be87-530ac1ff8ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":24420},{"type":"v1","addr":"172.21.15.117:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6803","nonce":24420},{"type":"v1","addr":"172.21.15.117:6805","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":24420},{"type":"v1","addr":"172.21.15.117:6811","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":24420},{"type":"v1","addr":"172.21.15.117:6808","nonce":24420}]},"public_addr":"172.21.15.117:6801/24420","cluster_addr":"172.21.15.117:6805/24420","heartbeat_back_addr":"172.21.15.117:6811/24420","heartbeat_front_addr":"172.21.15.117:6808/24420","state":["exists","up"]},{"osd":7,"uuid":"e31d8041-1aa1-4b5d-83b3-0a373426dd9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":24423},{"type":"v1","addr":"172.21.15.117:6825","nonce":24423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":24423},{"type":"v1","addr":"172.21.15.117:6827","nonce":24423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":24423},{"type":"v1","addr":"172.21.15.117:6831","nonce":24423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":24423},{"type":"v1","addr":"172.21.15.117:6829","nonce":24423}]},"public_addr":"172.21.15.117:6825/24423","cluster_addr":"172.21.15.117:6827/24423","heartbeat_back_addr":"172.21.15.117:6831/24423","heartbeat_front_addr":"172.21.15.117:6829/24423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.220874+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.210039+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.434762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.247206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.184316+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.306325+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.035719+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.400303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:23:02.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.442+0000 7f0d62cf5700 1 -- 172.21.15.104:0/2942777892 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f0d48060860 msgr2=0x7f0d48062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:02.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.442+0000 7f0d62cf5700 1 --2- 172.21.15.104:0/2942777892 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f0d48060860 0x7f0d48062d10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0d50009fd0 tx=0x7f0d50017000 comp rx=0 tx=0).stop 2024-08-17T02:23:02.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.442+0000 7f0d62cf5700 1 -- 172.21.15.104:0/2942777892 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0d5c0c9820 msgr2=0x7f0d5c097970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:02.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.442+0000 7f0d62cf5700 1 --2- 172.21.15.104:0/2942777892 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0d5c0c9820 0x7f0d5c097970 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c00cc40 tx=0x7f0d4c001a70 comp rx=0 tx=0).stop 2024-08-17T02:23:02.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.442+0000 7f0d62cf5700 1 -- 172.21.15.104:0/2942777892 shutdown_connections 2024-08-17T02:23:02.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.442+0000 7f0d62cf5700 1 --2- 172.21.15.104:0/2942777892 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f0d48060860 0x7f0d48062d10 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:02.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.442+0000 7f0d62cf5700 1 --2- 172.21.15.104:0/2942777892 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d5c15a090 0x7f0d5c0ab6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:02.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.442+0000 7f0d62cf5700 1 --2- 172.21.15.104:0/2942777892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d5c153a40 0x7f0d5c099310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:02.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.442+0000 7f0d62cf5700 1 --2- 172.21.15.104:0/2942777892 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0d5c0c9820 0x7f0d5c097970 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:02.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.442+0000 7f0d62cf5700 1 -- 172.21.15.104:0/2942777892 >> 172.21.15.104:0/2942777892 conn(0x7f0d5c0a9db0 msgr2=0x7f0d5c0b29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:02.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.442+0000 7f0d62cf5700 1 -- 172.21.15.104:0/2942777892 shutdown_connections 2024-08-17T02:23:02.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.442+0000 7f0d62cf5700 1 -- 172.21.15.104:0/2942777892 wait complete. 2024-08-17T02:23:02.456 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:22:10.143970+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:23:02.456 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:23:02.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.566+0000 7fe6fc86f700 1 Processor -- start 2024-08-17T02:23:02.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.566+0000 7fe6fc86f700 1 -- start start 2024-08-17T02:23:02.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.570+0000 7fe6fc86f700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe6f813f680 0x7fe6f80aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:02.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.570+0000 7fe6fc86f700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6f80b0810 con 0x7fe6f80ad6c0 2024-08-17T02:23:02.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.570+0000 7fe6fc86f700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6f80afc70 con 0x7fe6f813fa50 2024-08-17T02:23:02.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.570+0000 7fe6fc86f700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f80af060 con 0x7fe6f813f680 2024-08-17T02:23:02.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.570+0000 7fe6f77fe700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe6f813f680 0x7fe6f80aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:02.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.570+0000 7fe6f7fff700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fe6f80ad6c0 0x7fe6f806e010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:50686/0 (socket says 172.21.15.104:50686) 2024-08-17T02:23:02.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.570+0000 7fe6f7fff700 1 -- 172.21.15.104:0/666113898 learned_addr learned my addr 172.21.15.104:0/666113898 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:23:02.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.570+0000 7fe6f77fe700 1 -- 172.21.15.104:0/666113898 >> v1:172.21.15.117:6789/0 conn(0x7fe6f813fa50 legacy=0x7fe6f80b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:02.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.570+0000 7fe6f77fe700 1 -- 172.21.15.104:0/666113898 >> v1:172.21.15.104:6789/0 conn(0x7fe6f80ad6c0 legacy=0x7fe6f806e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:02.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.570+0000 7fe6f67fc700 1 -- 172.21.15.104:0/666113898 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2783831924 0 0) 0x7fe6f80b0810 con 0x7fe6f80ad6c0 2024-08-17T02:23:02.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.570+0000 7fe6f77fe700 1 -- 172.21.15.104:0/666113898 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f80af340 con 0x7fe6f813f680 2024-08-17T02:23:02.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.570+0000 7fe6f77fe700 1 --2- 172.21.15.104:0/666113898 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6f813f680 0x7fe6f80aea80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe6e80098e0 tx=0x7fe6e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85020942fd564a58 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:02.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.570+0000 7fe6f67fc700 1 -- 172.21.15.104:0/666113898 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e8009e80 con 0x7fe6f813f680 2024-08-17T02:23:02.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.570+0000 7fe6f67fc700 1 -- 172.21.15.104:0/666113898 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e800b860 con 0x7fe6f813f680 2024-08-17T02:23:02.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.570+0000 7fe6f67fc700 1 -- 172.21.15.104:0/666113898 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e800bbe0 con 0x7fe6f813f680 2024-08-17T02:23:02.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.570+0000 7fe6fc86f700 1 -- 172.21.15.104:0/666113898 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6f813f680 msgr2=0x7fe6f80aea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:02.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.570+0000 7fe6fc86f700 1 --2- 172.21.15.104:0/666113898 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6f813f680 0x7fe6f80aea80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe6e80098e0 tx=0x7fe6e80091a0 comp rx=0 tx=0).stop 2024-08-17T02:23:02.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.570+0000 7fe6fc86f700 1 -- 172.21.15.104:0/666113898 shutdown_connections 2024-08-17T02:23:02.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.570+0000 7fe6fc86f700 1 --2- 172.21.15.104:0/666113898 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6f813f680 0x7fe6f80aea80 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:02.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.570+0000 7fe6fc86f700 1 -- 172.21.15.104:0/666113898 >> 172.21.15.104:0/666113898 conn(0x7fe6f80678a0 msgr2=0x7fe6f8067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:02.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.570+0000 7fe6fc86f700 1 -- 172.21.15.104:0/666113898 shutdown_connections 2024-08-17T02:23:02.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.570+0000 7fe6fc86f700 1 -- 172.21.15.104:0/666113898 wait complete. 2024-08-17T02:23:02.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.574+0000 7fe6fc86f700 1 Processor -- start 2024-08-17T02:23:02.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.574+0000 7fe6fc86f700 1 -- start start 2024-08-17T02:23:02.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.574+0000 7fe6fc86f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6f80ad6c0 0x7fe6f8157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:02.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.574+0000 7fe6fc86f700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6f813f680 0x7fe6f816ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:02.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.574+0000 7fe6fc86f700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6f813fa50 0x7fe6f816d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:02.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.574+0000 7fe6fc86f700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f80c2240 con 0x7fe6f813f680 2024-08-17T02:23:02.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.574+0000 7fe6fc86f700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f81593b0 con 0x7fe6f80ad6c0 2024-08-17T02:23:02.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.574+0000 7fe6fc86f700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f81587a0 con 0x7fe6f813fa50 2024-08-17T02:23:02.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.574+0000 7fe6f6ffd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6f813f680 0x7fe6f816ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:02.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.574+0000 7fe6f6ffd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6f813f680 0x7fe6f816ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44804/0 (socket says 172.21.15.104:44804) 2024-08-17T02:23:02.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.574+0000 7fe6f6ffd700 1 -- 172.21.15.104:0/3734158145 learned_addr learned my addr 172.21.15.104:0/3734158145 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:02.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.574+0000 7fe6f77fe700 1 --2- 172.21.15.104:0/3734158145 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6f80ad6c0 0x7fe6f8157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:02.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.574+0000 7fe6f7fff700 1 --2- 172.21.15.104:0/3734158145 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6f813fa50 0x7fe6f816d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:02.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.574+0000 7fe6f6ffd700 1 -- 172.21.15.104:0/3734158145 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6f813fa50 msgr2=0x7fe6f816d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:02.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.574+0000 7fe6f6ffd700 1 --2- 172.21.15.104:0/3734158145 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6f813fa50 0x7fe6f816d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:02.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.574+0000 7fe6f6ffd700 1 -- 172.21.15.104:0/3734158145 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6f80ad6c0 msgr2=0x7fe6f8157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:02.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.574+0000 7fe6f6ffd700 1 --2- 172.21.15.104:0/3734158145 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6f80ad6c0 0x7fe6f8157ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:02.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.574+0000 7fe6f6ffd700 1 -- 172.21.15.104:0/3734158145 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e8009420 con 0x7fe6f813f680 2024-08-17T02:23:02.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.574+0000 7fe6f77fe700 1 --2- 172.21.15.104:0/3734158145 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6f80ad6c0 0x7fe6f8157ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:02.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.574+0000 7fe6f7fff700 1 --2- 172.21.15.104:0/3734158145 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6f813fa50 0x7fe6f816d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:23:02.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.574+0000 7fe6f6ffd700 1 --2- 172.21.15.104:0/3734158145 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6f813f680 0x7fe6f816ce60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe6e000c4e0 tx=0x7fe6e000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:02.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.574+0000 7fe6ef7fe700 1 -- 172.21.15.104:0/3734158145 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e0011590 con 0x7fe6f813f680 2024-08-17T02:23:02.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.574+0000 7fe6ef7fe700 1 -- 172.21.15.104:0/3734158145 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e0011710 con 0x7fe6f813f680 2024-08-17T02:23:02.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.574+0000 7fe6fc86f700 1 -- 172.21.15.104:0/3734158145 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6f8158a80 con 0x7fe6f813f680 2024-08-17T02:23:02.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.574+0000 7fe6ef7fe700 1 -- 172.21.15.104:0/3734158145 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e0011ad0 con 0x7fe6f813f680 2024-08-17T02:23:02.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.574+0000 7fe6fc86f700 1 -- 172.21.15.104:0/3734158145 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f81590c0 con 0x7fe6f813f680 2024-08-17T02:23:02.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.574+0000 7fe6fc86f700 1 -- 172.21.15.104:0/3734158145 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6f8159540 con 0x7fe6f813f680 2024-08-17T02:23:02.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.578+0000 7fe6ef7fe700 1 -- 172.21.15.104:0/3734158145 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe6e001b3b0 con 0x7fe6f813f680 2024-08-17T02:23:02.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.578+0000 7fe6ef7fe700 1 --2- 172.21.15.104:0/3734158145 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fe6dc060860 0x7fe6dc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:02.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.578+0000 7fe6ef7fe700 1 -- 172.21.15.104:0/3734158145 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe6e007be50 con 0x7fe6f813f680 2024-08-17T02:23:02.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.578+0000 7fe6f77fe700 1 --2- 172.21.15.104:0/3734158145 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fe6dc060860 0x7fe6dc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:02.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.578+0000 7fe6f77fe700 1 --2- 172.21.15.104:0/3734158145 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fe6dc060860 0x7fe6dc062d10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe6e80093f0 tx=0x7fe6e8017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:02.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.586+0000 7fe6ef7fe700 1 -- 172.21.15.104:0/3734158145 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fe6e004c550 con 0x7fe6f813f680 2024-08-17T02:23:02.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.742+0000 7fe6fc86f700 1 -- 172.21.15.104:0/3734158145 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe6f8064330 con 0x7fe6f813f680 2024-08-17T02:23:02.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.742+0000 7fe6ef7fe700 1 -- 172.21.15.104:0/3734158145 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe6e0017020 con 0x7fe6f813f680 2024-08-17T02:23:02.748 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-08-17T02:23:02.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.742+0000 7fe6fc86f700 1 -- 172.21.15.104:0/3734158145 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fe6dc060860 msgr2=0x7fe6dc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:02.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.742+0000 7fe6fc86f700 1 --2- 172.21.15.104:0/3734158145 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fe6dc060860 0x7fe6dc062d10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe6e80093f0 tx=0x7fe6e8017000 comp rx=0 tx=0).stop 2024-08-17T02:23:02.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.746+0000 7fe6fc86f700 1 -- 172.21.15.104:0/3734158145 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6f813f680 msgr2=0x7fe6f816ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:02.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.746+0000 7fe6fc86f700 1 --2- 172.21.15.104:0/3734158145 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6f813f680 0x7fe6f816ce60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe6e000c4e0 tx=0x7fe6e000c8a0 comp rx=0 tx=0).stop 2024-08-17T02:23:02.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.746+0000 7fe6fc86f700 1 -- 172.21.15.104:0/3734158145 shutdown_connections 2024-08-17T02:23:02.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.746+0000 7fe6fc86f700 1 --2- 172.21.15.104:0/3734158145 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fe6dc060860 0x7fe6dc062d10 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:02.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.746+0000 7fe6fc86f700 1 --2- 172.21.15.104:0/3734158145 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6f813fa50 0x7fe6f816d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:02.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.746+0000 7fe6fc86f700 1 --2- 172.21.15.104:0/3734158145 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6f813f680 0x7fe6f816ce60 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:02.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.746+0000 7fe6fc86f700 1 --2- 172.21.15.104:0/3734158145 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6f80ad6c0 0x7fe6f8157ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:02.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.746+0000 7fe6fc86f700 1 -- 172.21.15.104:0/3734158145 >> 172.21.15.104:0/3734158145 conn(0x7fe6f80678a0 msgr2=0x7fe6f8155470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:02.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.746+0000 7fe6fc86f700 1 -- 172.21.15.104:0/3734158145 shutdown_connections 2024-08-17T02:23:02.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.746+0000 7fe6fc86f700 1 -- 172.21.15.104:0/3734158145 wait complete. 2024-08-17T02:23:02.763 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-17T02:23:02.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.858+0000 7f9cf2c90700 1 Processor -- start 2024-08-17T02:23:02.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.858+0000 7f9cf2c90700 1 -- start start 2024-08-17T02:23:02.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.862+0000 7f9cf2c90700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f9cec156c80 0x7f9cec157050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:02.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.862+0000 7f9cf2c90700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cec0ae030 0x7f9cec0b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:02.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.862+0000 7f9cf2c90700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cec06ed00 con 0x7f9cec0b0e20 2024-08-17T02:23:02.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.862+0000 7f9cf2c90700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cec06df10 con 0x7f9cec156c80 2024-08-17T02:23:02.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.862+0000 7f9cf2c90700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec0b17e0 con 0x7f9cec0ae030 2024-08-17T02:23:02.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.862+0000 7f9cf1c8e700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f9cec156c80 0x7f9cec157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:02.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.862+0000 7f9cf1c8e700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f9cec156c80 0x7f9cec157050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44818/0 (socket says 172.21.15.104:44818) 2024-08-17T02:23:02.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.862+0000 7f9cf1c8e700 1 -- 172.21.15.104:0/3302124449 learned_addr learned my addr 172.21.15.104:0/3302124449 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:02.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.862+0000 7f9cf248f700 1 --2- 172.21.15.104:0/3302124449 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cec0ae030 0x7f9cec0b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:02.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.862+0000 7f9cf1c8e700 1 -- 172.21.15.104:0/3302124449 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cec0ae030 msgr2=0x7f9cec0b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:02.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.862+0000 7f9cf1c8e700 1 --2- 172.21.15.104:0/3302124449 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cec0ae030 0x7f9cec0b12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:02.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.862+0000 7f9cf1c8e700 1 -- 172.21.15.104:0/3302124449 >> v1:172.21.15.117:6789/0 conn(0x7f9cec0b0e20 legacy=0x7f9cec0ad920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:02.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.862+0000 7f9cf0c8c700 1 -- 172.21.15.104:0/3302124449 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3555843260 0 0) 0x7f9cec06ed00 con 0x7f9cec0b0e20 2024-08-17T02:23:02.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.862+0000 7f9cf1c8e700 1 -- 172.21.15.104:0/3302124449 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cec0accc0 con 0x7f9cec156c80 2024-08-17T02:23:02.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.862+0000 7f9cf248f700 1 --2- 172.21.15.104:0/3302124449 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cec0ae030 0x7f9cec0b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:02.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.862+0000 7f9cf1c8e700 1 --2- 172.21.15.104:0/3302124449 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9cec156c80 0x7f9cec157050 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9ce00099e0 tx=0x7f9ce0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3b3ec6003fa3945 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:02.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.862+0000 7f9cf0c8c700 1 -- 172.21.15.104:0/3302124449 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce000b820 con 0x7f9cec156c80 2024-08-17T02:23:02.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.862+0000 7f9cf0c8c700 1 -- 172.21.15.104:0/3302124449 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce000b980 con 0x7f9cec156c80 2024-08-17T02:23:02.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.862+0000 7f9cf0c8c700 1 -- 172.21.15.104:0/3302124449 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce000bd20 con 0x7f9cec156c80 2024-08-17T02:23:02.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.862+0000 7f9cf2c90700 1 -- 172.21.15.104:0/3302124449 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9cec156c80 msgr2=0x7f9cec157050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:02.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.862+0000 7f9cf2c90700 1 --2- 172.21.15.104:0/3302124449 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9cec156c80 0x7f9cec157050 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9ce00099e0 tx=0x7f9ce0009250 comp rx=0 tx=0).stop 2024-08-17T02:23:02.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.862+0000 7f9cf2c90700 1 -- 172.21.15.104:0/3302124449 shutdown_connections 2024-08-17T02:23:02.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.862+0000 7f9cf2c90700 1 --2- 172.21.15.104:0/3302124449 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cec0ae030 0x7f9cec0b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:02.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.862+0000 7f9cf2c90700 1 --2- 172.21.15.104:0/3302124449 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9cec156c80 0x7f9cec157050 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:02.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.862+0000 7f9cf2c90700 1 -- 172.21.15.104:0/3302124449 >> 172.21.15.104:0/3302124449 conn(0x7f9cec067860 msgr2=0x7f9cec067c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:02.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.862+0000 7f9cf2c90700 1 -- 172.21.15.104:0/3302124449 shutdown_connections 2024-08-17T02:23:02.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.862+0000 7f9cf2c90700 1 -- 172.21.15.104:0/3302124449 wait complete. 2024-08-17T02:23:02.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.870+0000 7f9cf2c90700 1 Processor -- start 2024-08-17T02:23:02.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.870+0000 7f9cf2c90700 1 -- start start 2024-08-17T02:23:02.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.870+0000 7f9cf2c90700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cec0ae030 0x7f9cec151aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:02.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.870+0000 7f9cf2c90700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9cec0b0e20 0x7f9cec155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:02.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.870+0000 7f9cf2c90700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cec156c80 0x7f9cec155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:02.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.870+0000 7f9cf2c90700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec15bc00 con 0x7f9cec0b0e20 2024-08-17T02:23:02.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.870+0000 7f9cf2c90700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec15b350 con 0x7f9cec0ae030 2024-08-17T02:23:02.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.870+0000 7f9cf2c90700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec151fe0 con 0x7f9cec156c80 2024-08-17T02:23:02.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.870+0000 7f9cf148d700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9cec0b0e20 0x7f9cec155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:02.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.870+0000 7f9cf148d700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9cec0b0e20 0x7f9cec155240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44824/0 (socket says 172.21.15.104:44824) 2024-08-17T02:23:02.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.870+0000 7f9cf148d700 1 -- 172.21.15.104:0/316705961 learned_addr learned my addr 172.21.15.104:0/316705961 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:02.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.870+0000 7f9cf1c8e700 1 --2- 172.21.15.104:0/316705961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cec0ae030 0x7f9cec151aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:02.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.870+0000 7f9cf248f700 1 --2- 172.21.15.104:0/316705961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cec156c80 0x7f9cec155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:02.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.870+0000 7f9cf148d700 1 -- 172.21.15.104:0/316705961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cec156c80 msgr2=0x7f9cec155780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:02.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.870+0000 7f9cf148d700 1 --2- 172.21.15.104:0/316705961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cec156c80 0x7f9cec155780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:02.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.870+0000 7f9cf148d700 1 -- 172.21.15.104:0/316705961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cec0ae030 msgr2=0x7f9cec151aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:02.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.870+0000 7f9cf148d700 1 --2- 172.21.15.104:0/316705961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cec0ae030 0x7f9cec151aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:02.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.870+0000 7f9cf148d700 1 -- 172.21.15.104:0/316705961 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce00094f0 con 0x7f9cec0b0e20 2024-08-17T02:23:02.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.870+0000 7f9cf148d700 1 --2- 172.21.15.104:0/316705961 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9cec0b0e20 0x7f9cec155240 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9ce800c7e0 tx=0x7f9ce8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:02.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.870+0000 7f9cddffb700 1 -- 172.21.15.104:0/316705961 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce8012700 con 0x7f9cec0b0e20 2024-08-17T02:23:02.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.870+0000 7f9cddffb700 1 -- 172.21.15.104:0/316705961 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce8012880 con 0x7f9cec0b0e20 2024-08-17T02:23:02.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.870+0000 7f9cf2c90700 1 -- 172.21.15.104:0/316705961 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cec15b5d0 con 0x7f9cec0b0e20 2024-08-17T02:23:02.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.870+0000 7f9cddffb700 1 -- 172.21.15.104:0/316705961 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce8012c40 con 0x7f9cec0b0e20 2024-08-17T02:23:02.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.870+0000 7f9cf2c90700 1 -- 172.21.15.104:0/316705961 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cec15b890 con 0x7f9cec0b0e20 2024-08-17T02:23:02.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.870+0000 7f9cf2c90700 1 -- 172.21.15.104:0/316705961 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cec15bd70 con 0x7f9cec0b0e20 2024-08-17T02:23:02.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.870+0000 7f9cddffb700 1 -- 172.21.15.104:0/316705961 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9ce801b400 con 0x7f9cec0b0e20 2024-08-17T02:23:02.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.870+0000 7f9cddffb700 1 --2- 172.21.15.104:0/316705961 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f9cd0060860 0x7f9cd0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:02.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.870+0000 7f9cddffb700 1 -- 172.21.15.104:0/316705961 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f9ce807c410 con 0x7f9cec0b0e20 2024-08-17T02:23:02.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.870+0000 7f9cf1c8e700 1 --2- 172.21.15.104:0/316705961 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f9cd0060860 0x7f9cd0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:02.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.874+0000 7f9cf1c8e700 1 --2- 172.21.15.104:0/316705961 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f9cd0060860 0x7f9cd0062d10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9ce00099e0 tx=0x7f9ce0017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:02.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:02.878+0000 7f9cddffb700 1 -- 172.21.15.104:0/316705961 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f9ce804cbb0 con 0x7f9cec0b0e20 2024-08-17T02:23:03.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.038+0000 7f9cf2c90700 1 -- 172.21.15.104:0/316705961 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9cec0643a0 con 0x7f9cec0b0e20 2024-08-17T02:23:03.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.038+0000 7f9cddffb700 1 -- 172.21.15.104:0/316705961 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+65 (secure 0 0 0) 0x7f9ce80501d0 con 0x7f9cec0b0e20 2024-08-17T02:23:03.046 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:23:03.046 INFO:teuthology.orchestra.run.smithi104.stdout:[ 2024-08-17T02:23:03.046 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-08-17T02:23:03.047 INFO:teuthology.orchestra.run.smithi104.stdout: "poolnum": 1, 2024-08-17T02:23:03.047 INFO:teuthology.orchestra.run.smithi104.stdout: "poolname": ".mgr" 2024-08-17T02:23:03.047 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-08-17T02:23:03.047 INFO:teuthology.orchestra.run.smithi104.stdout:] 2024-08-17T02:23:03.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.042+0000 7f9cf2c90700 1 -- 172.21.15.104:0/316705961 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f9cd0060860 msgr2=0x7f9cd0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:03.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.042+0000 7f9cf2c90700 1 --2- 172.21.15.104:0/316705961 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f9cd0060860 0x7f9cd0062d10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9ce00099e0 tx=0x7f9ce0017000 comp rx=0 tx=0).stop 2024-08-17T02:23:03.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.042+0000 7f9cf2c90700 1 -- 172.21.15.104:0/316705961 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9cec0b0e20 msgr2=0x7f9cec155240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:03.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.042+0000 7f9cf2c90700 1 --2- 172.21.15.104:0/316705961 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9cec0b0e20 0x7f9cec155240 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9ce800c7e0 tx=0x7f9ce8007df0 comp rx=0 tx=0).stop 2024-08-17T02:23:03.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.042+0000 7f9cf2c90700 1 -- 172.21.15.104:0/316705961 shutdown_connections 2024-08-17T02:23:03.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.042+0000 7f9cf2c90700 1 --2- 172.21.15.104:0/316705961 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f9cd0060860 0x7f9cd0062d10 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:03.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.042+0000 7f9cf2c90700 1 --2- 172.21.15.104:0/316705961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cec156c80 0x7f9cec155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:03.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.042+0000 7f9cf2c90700 1 --2- 172.21.15.104:0/316705961 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9cec0b0e20 0x7f9cec155240 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:03.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.042+0000 7f9cf2c90700 1 --2- 172.21.15.104:0/316705961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cec0ae030 0x7f9cec151aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:03.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.042+0000 7f9cf2c90700 1 -- 172.21.15.104:0/316705961 >> 172.21.15.104:0/316705961 conn(0x7f9cec067860 msgr2=0x7f9cec069a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:03.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.042+0000 7f9cf2c90700 1 -- 172.21.15.104:0/316705961 shutdown_connections 2024-08-17T02:23:03.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.042+0000 7f9cf2c90700 1 -- 172.21.15.104:0/316705961 wait complete. 2024-08-17T02:23:03.060 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-17T02:23:03.060 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-17T02:23:03.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.166+0000 7fcffaf56700 1 Processor -- start 2024-08-17T02:23:03.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.166+0000 7fcffaf56700 1 -- start start 2024-08-17T02:23:03.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.166+0000 7fcffaf56700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fcff406b960 0x7fcff406bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:03.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.166+0000 7fcffaf56700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcff4068ae0 0x7fcff406a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:03.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.166+0000 7fcffaf56700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcff4068f40 0x7fcff4069520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:03.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.166+0000 7fcffaf56700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcff40afaa0 con 0x7fcff406b960 2024-08-17T02:23:03.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.166+0000 7fcffaf56700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcff4068650 con 0x7fcff4068ae0 2024-08-17T02:23:03.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.166+0000 7fcffaf56700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcff40acbd0 con 0x7fcff4068f40 2024-08-17T02:23:03.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.166+0000 7fcff8cf2700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fcff406b960 0x7fcff406bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:03.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.166+0000 7fcff8cf2700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fcff406b960 0x7fcff406bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44830/0 (socket says 172.21.15.104:44830) 2024-08-17T02:23:03.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.166+0000 7fcff8cf2700 1 -- 172.21.15.104:0/1059780102 learned_addr learned my addr 172.21.15.104:0/1059780102 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:03.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.166+0000 7fcff94f3700 1 --2- 172.21.15.104:0/1059780102 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcff4068f40 0x7fcff4069520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:03.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.166+0000 7fcff3fff700 1 --2- 172.21.15.104:0/1059780102 >> v2:172.21.15.117:3300/0 conn(0x7fcff4068ae0 0x7fcff406a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:03.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.166+0000 7fcff8cf2700 1 -- 172.21.15.104:0/1059780102 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcff4068f40 msgr2=0x7fcff4069520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:03.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.166+0000 7fcff8cf2700 1 --2- 172.21.15.104:0/1059780102 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcff4068f40 0x7fcff4069520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:03.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.166+0000 7fcff8cf2700 1 -- 172.21.15.104:0/1059780102 >> v2:172.21.15.117:3300/0 conn(0x7fcff4068ae0 msgr2=0x7fcff406a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:03.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.166+0000 7fcff8cf2700 1 --2- 172.21.15.104:0/1059780102 >> v2:172.21.15.117:3300/0 conn(0x7fcff4068ae0 0x7fcff406a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:03.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.166+0000 7fcff8cf2700 1 -- 172.21.15.104:0/1059780102 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff406b200 con 0x7fcff406b960 2024-08-17T02:23:03.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.166+0000 7fcff8cf2700 1 --2- 172.21.15.104:0/1059780102 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcff406b960 0x7fcff406bd30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fcff4067890 tx=0x7fcfe4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3240353861cc02ad server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:03.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.166+0000 7fcff37fe700 1 -- 172.21.15.104:0/1059780102 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe400b640 con 0x7fcff406b960 2024-08-17T02:23:03.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.166+0000 7fcff37fe700 1 -- 172.21.15.104:0/1059780102 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe400b7a0 con 0x7fcff406b960 2024-08-17T02:23:03.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.166+0000 7fcff37fe700 1 -- 172.21.15.104:0/1059780102 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe400bb60 con 0x7fcff406b960 2024-08-17T02:23:03.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.174+0000 7fcffaf56700 1 -- 172.21.15.104:0/1059780102 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcff406b960 msgr2=0x7fcff406bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:03.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.174+0000 7fcffaf56700 1 --2- 172.21.15.104:0/1059780102 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcff406b960 0x7fcff406bd30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fcff4067890 tx=0x7fcfe4009250 comp rx=0 tx=0).stop 2024-08-17T02:23:03.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.174+0000 7fcffaf56700 1 -- 172.21.15.104:0/1059780102 shutdown_connections 2024-08-17T02:23:03.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.174+0000 7fcffaf56700 1 --2- 172.21.15.104:0/1059780102 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcff4068f40 0x7fcff4069520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:03.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.174+0000 7fcffaf56700 1 --2- 172.21.15.104:0/1059780102 >> v2:172.21.15.117:3300/0 conn(0x7fcff4068ae0 0x7fcff406a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:03.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.174+0000 7fcffaf56700 1 --2- 172.21.15.104:0/1059780102 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcff406b960 0x7fcff406bd30 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:03.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.174+0000 7fcffaf56700 1 -- 172.21.15.104:0/1059780102 >> 172.21.15.104:0/1059780102 conn(0x7fcff406e270 msgr2=0x7fcff40b1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:03.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.174+0000 7fcffaf56700 1 -- 172.21.15.104:0/1059780102 shutdown_connections 2024-08-17T02:23:03.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.174+0000 7fcffaf56700 1 -- 172.21.15.104:0/1059780102 wait complete. 2024-08-17T02:23:03.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.174+0000 7fcffaf56700 1 Processor -- start 2024-08-17T02:23:03.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.174+0000 7fcffaf56700 1 -- start start 2024-08-17T02:23:03.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.178+0000 7fcffaf56700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcff4068ae0 0x7fcff40c3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:03.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.178+0000 7fcffaf56700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcff4068f40 0x7fcff4169f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:03.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.178+0000 7fcffaf56700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcff406b960 0x7fcff415e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:03.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.178+0000 7fcffaf56700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff40c2ba0 con 0x7fcff4068ae0 2024-08-17T02:23:03.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.178+0000 7fcffaf56700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff40c1fd0 con 0x7fcff4068f40 2024-08-17T02:23:03.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.178+0000 7fcffaf56700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcff40c2270 con 0x7fcff406b960 2024-08-17T02:23:03.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.178+0000 7fcff8cf2700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcff4068ae0 0x7fcff40c3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:03.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.178+0000 7fcff8cf2700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcff4068ae0 0x7fcff40c3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44836/0 (socket says 172.21.15.104:44836) 2024-08-17T02:23:03.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.178+0000 7fcff8cf2700 1 -- 172.21.15.104:0/1871622104 learned_addr learned my addr 172.21.15.104:0/1871622104 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:03.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.178+0000 7fcff94f3700 1 --2- 172.21.15.104:0/1871622104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcff406b960 0x7fcff415e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:03.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.178+0000 7fcff3fff700 1 --2- 172.21.15.104:0/1871622104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcff4068f40 0x7fcff4169f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:03.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.178+0000 7fcff8cf2700 1 -- 172.21.15.104:0/1871622104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcff406b960 msgr2=0x7fcff415e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:03.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.178+0000 7fcff8cf2700 1 --2- 172.21.15.104:0/1871622104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcff406b960 0x7fcff415e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:03.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.178+0000 7fcff8cf2700 1 -- 172.21.15.104:0/1871622104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcff4068f40 msgr2=0x7fcff4169f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:03.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.178+0000 7fcff8cf2700 1 --2- 172.21.15.104:0/1871622104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcff4068f40 0x7fcff4169f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:03.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.178+0000 7fcff8cf2700 1 -- 172.21.15.104:0/1871622104 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe40094f0 con 0x7fcff4068ae0 2024-08-17T02:23:03.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.178+0000 7fcff8cf2700 1 --2- 172.21.15.104:0/1871622104 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcff4068ae0 0x7fcff40c3030 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fcff40b3100 tx=0x7fcfe4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:03.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.178+0000 7fcff0ff9700 1 -- 172.21.15.104:0/1871622104 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe4000d10 con 0x7fcff4068ae0 2024-08-17T02:23:03.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.178+0000 7fcff0ff9700 1 -- 172.21.15.104:0/1871622104 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe400bb20 con 0x7fcff4068ae0 2024-08-17T02:23:03.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.178+0000 7fcffaf56700 1 -- 172.21.15.104:0/1871622104 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcff40c2550 con 0x7fcff4068ae0 2024-08-17T02:23:03.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.178+0000 7fcff0ff9700 1 -- 172.21.15.104:0/1871622104 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe4011670 con 0x7fcff4068ae0 2024-08-17T02:23:03.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.178+0000 7fcffaf56700 1 -- 172.21.15.104:0/1871622104 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcff416a440 con 0x7fcff4068ae0 2024-08-17T02:23:03.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.178+0000 7fcff0ff9700 1 -- 172.21.15.104:0/1871622104 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fcfe40119e0 con 0x7fcff4068ae0 2024-08-17T02:23:03.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.178+0000 7fcffaf56700 1 -- 172.21.15.104:0/1871622104 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcff40638f0 con 0x7fcff4068ae0 2024-08-17T02:23:03.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.178+0000 7fcff0ff9700 1 --2- 172.21.15.104:0/1871622104 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fcfd8060890 0x7fcfd8062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:03.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.178+0000 7fcff0ff9700 1 -- 172.21.15.104:0/1871622104 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fcfe407dfd0 con 0x7fcff4068ae0 2024-08-17T02:23:03.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.178+0000 7fcff3fff700 1 --2- 172.21.15.104:0/1871622104 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fcfd8060890 0x7fcfd8062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:03.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.178+0000 7fcff3fff700 1 --2- 172.21.15.104:0/1871622104 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fcfd8060890 0x7fcfd8062d40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcff40ae5e0 tx=0x7fcfdc0091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:03.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.186+0000 7fcff0ff9700 1 -- 172.21.15.104:0/1871622104 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fcfe404e6d0 con 0x7fcff4068ae0 2024-08-17T02:23:03.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:03.342+0000 7fcffaf56700 1 -- 172.21.15.104:0/1871622104 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fcff4067670 con 0x7fcff4068ae0 2024-08-17T02:23:04.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.102+0000 7fcff0ff9700 1 -- 172.21.15.104:0/1871622104 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) v1 ==== 138+0+0 (secure 0 0 0) 0x7fcfe40150b0 con 0x7fcff4068ae0 2024-08-17T02:23:04.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.106+0000 7fcffaf56700 1 -- 172.21.15.104:0/1871622104 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fcfd8060890 msgr2=0x7fcfd8062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:04.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.106+0000 7fcffaf56700 1 --2- 172.21.15.104:0/1871622104 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fcfd8060890 0x7fcfd8062d40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcff40ae5e0 tx=0x7fcfdc0091a0 comp rx=0 tx=0).stop 2024-08-17T02:23:04.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.106+0000 7fcffaf56700 1 -- 172.21.15.104:0/1871622104 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcff4068ae0 msgr2=0x7fcff40c3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:04.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.106+0000 7fcffaf56700 1 --2- 172.21.15.104:0/1871622104 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcff4068ae0 0x7fcff40c3030 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fcff40b3100 tx=0x7fcfe4017000 comp rx=0 tx=0).stop 2024-08-17T02:23:04.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.106+0000 7fcffaf56700 1 -- 172.21.15.104:0/1871622104 shutdown_connections 2024-08-17T02:23:04.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.106+0000 7fcffaf56700 1 --2- 172.21.15.104:0/1871622104 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fcfd8060890 0x7fcfd8062d40 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:04.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.106+0000 7fcffaf56700 1 --2- 172.21.15.104:0/1871622104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcff406b960 0x7fcff415e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:04.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.106+0000 7fcffaf56700 1 --2- 172.21.15.104:0/1871622104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcff4068f40 0x7fcff4169f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:04.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.106+0000 7fcffaf56700 1 --2- 172.21.15.104:0/1871622104 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcff4068ae0 0x7fcff40c3030 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:04.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.106+0000 7fcffaf56700 1 -- 172.21.15.104:0/1871622104 >> 172.21.15.104:0/1871622104 conn(0x7fcff406e270 msgr2=0x7fcff40aeac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:04.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.110+0000 7fcffaf56700 1 -- 172.21.15.104:0/1871622104 shutdown_connections 2024-08-17T02:23:04.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.110+0000 7fcffaf56700 1 -- 172.21.15.104:0/1871622104 wait complete. 2024-08-17T02:23:04.116 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_metadata' created 2024-08-17T02:23:04.130 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-17T02:23:04.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.234+0000 7fa06759e700 1 Processor -- start 2024-08-17T02:23:04.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.234+0000 7fa06759e700 1 -- start start 2024-08-17T02:23:04.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.234+0000 7fa06759e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa06806e8c0 0x7fa0680ae290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:04.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.234+0000 7fa06759e700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa0680aeb10 0x7fa06813f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:04.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.234+0000 7fa06759e700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0681573c0 con 0x7fa0680adec0 2024-08-17T02:23:04.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.234+0000 7fa06759e700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0680aefb0 con 0x7fa0680aeb10 2024-08-17T02:23:04.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.234+0000 7fa06759e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa068156480 con 0x7fa06806e8c0 2024-08-17T02:23:04.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.234+0000 7fa066d9d700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa0680aeb10 0x7fa06813f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:04.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.234+0000 7fa066d9d700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa0680aeb10 0x7fa06813f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44840/0 (socket says 172.21.15.104:44840) 2024-08-17T02:23:04.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.234+0000 7fa066d9d700 1 -- 172.21.15.104:0/1772171166 learned_addr learned my addr 172.21.15.104:0/1772171166 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:04.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.238+0000 7fa065d9b700 1 --2- 172.21.15.104:0/1772171166 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa06806e8c0 0x7fa0680ae290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:04.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.238+0000 7fa066d9d700 1 -- 172.21.15.104:0/1772171166 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa06806e8c0 msgr2=0x7fa0680ae290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:04.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.238+0000 7fa066d9d700 1 --2- 172.21.15.104:0/1772171166 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa06806e8c0 0x7fa0680ae290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:04.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.238+0000 7fa066d9d700 1 -- 172.21.15.104:0/1772171166 >> v1:172.21.15.117:6789/0 conn(0x7fa0680adec0 legacy=0x7fa06806e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:04.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.238+0000 7fa066d9d700 1 -- 172.21.15.104:0/1772171166 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa068156740 con 0x7fa0680aeb10 2024-08-17T02:23:04.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.238+0000 7fa066d9d700 1 --2- 172.21.15.104:0/1772171166 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0680aeb10 0x7fa06813f1b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa060009f50 tx=0x7fa060009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47a60b5eadd1f4e8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:04.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.238+0000 7fa06559a700 1 -- 172.21.15.104:0/1772171166 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06000e070 con 0x7fa0680aeb10 2024-08-17T02:23:04.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.238+0000 7fa06559a700 1 -- 172.21.15.104:0/1772171166 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06000ba70 con 0x7fa0680aeb10 2024-08-17T02:23:04.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.238+0000 7fa06559a700 1 -- 172.21.15.104:0/1772171166 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0600092e0 con 0x7fa0680aeb10 2024-08-17T02:23:04.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.238+0000 7fa06759e700 1 -- 172.21.15.104:0/1772171166 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0680aeb10 msgr2=0x7fa06813f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:04.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.238+0000 7fa06759e700 1 --2- 172.21.15.104:0/1772171166 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0680aeb10 0x7fa06813f1b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa060009f50 tx=0x7fa060009840 comp rx=0 tx=0).stop 2024-08-17T02:23:04.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.238+0000 7fa06759e700 1 -- 172.21.15.104:0/1772171166 shutdown_connections 2024-08-17T02:23:04.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.238+0000 7fa06759e700 1 --2- 172.21.15.104:0/1772171166 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0680aeb10 0x7fa06813f1b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:04.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.238+0000 7fa06759e700 1 --2- 172.21.15.104:0/1772171166 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa06806e8c0 0x7fa0680ae290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:04.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.238+0000 7fa06759e700 1 -- 172.21.15.104:0/1772171166 >> 172.21.15.104:0/1772171166 conn(0x7fa068067880 msgr2=0x7fa068067c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:04.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.238+0000 7fa06759e700 1 -- 172.21.15.104:0/1772171166 shutdown_connections 2024-08-17T02:23:04.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.238+0000 7fa06759e700 1 -- 172.21.15.104:0/1772171166 wait complete. 2024-08-17T02:23:04.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.242+0000 7fa06759e700 1 Processor -- start 2024-08-17T02:23:04.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.242+0000 7fa06759e700 1 -- start start 2024-08-17T02:23:04.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.242+0000 7fa06759e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa06806e8c0 0x7fa06813ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:04.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.242+0000 7fa06759e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0680adec0 0x7fa06816a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:04.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.242+0000 7fa06759e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0680aeb10 0x7fa0680aadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:04.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.242+0000 7fa06759e700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06812aa50 con 0x7fa06806e8c0 2024-08-17T02:23:04.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.242+0000 7fa06759e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06812a6b0 con 0x7fa0680adec0 2024-08-17T02:23:04.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.242+0000 7fa06759e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa06816ad00 con 0x7fa0680aeb10 2024-08-17T02:23:04.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.242+0000 7fa06659c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa06806e8c0 0x7fa06813ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:04.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.242+0000 7fa06659c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa06806e8c0 0x7fa06813ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44850/0 (socket says 172.21.15.104:44850) 2024-08-17T02:23:04.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.242+0000 7fa06659c700 1 -- 172.21.15.104:0/674577215 learned_addr learned my addr 172.21.15.104:0/674577215 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:04.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.242+0000 7fa065d9b700 1 --2- 172.21.15.104:0/674577215 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0680adec0 0x7fa06816a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:04.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.242+0000 7fa066d9d700 1 --2- 172.21.15.104:0/674577215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0680aeb10 0x7fa0680aadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:04.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.242+0000 7fa06659c700 1 -- 172.21.15.104:0/674577215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0680aeb10 msgr2=0x7fa0680aadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:04.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.242+0000 7fa06659c700 1 --2- 172.21.15.104:0/674577215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0680aeb10 0x7fa0680aadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:04.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.242+0000 7fa06659c700 1 -- 172.21.15.104:0/674577215 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0680adec0 msgr2=0x7fa06816a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:04.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.242+0000 7fa06659c700 1 --2- 172.21.15.104:0/674577215 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0680adec0 0x7fa06816a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:04.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.242+0000 7fa06659c700 1 -- 172.21.15.104:0/674577215 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa060009ae0 con 0x7fa06806e8c0 2024-08-17T02:23:04.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.242+0000 7fa06659c700 1 --2- 172.21.15.104:0/674577215 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa06806e8c0 0x7fa06813ccf0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa05800c590 tx=0x7fa05800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:04.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.242+0000 7fa05e7fc700 1 -- 172.21.15.104:0/674577215 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa058011590 con 0x7fa06806e8c0 2024-08-17T02:23:04.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.242+0000 7fa05e7fc700 1 -- 172.21.15.104:0/674577215 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa058011710 con 0x7fa06806e8c0 2024-08-17T02:23:04.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.242+0000 7fa06759e700 1 -- 172.21.15.104:0/674577215 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0680ab330 con 0x7fa06806e8c0 2024-08-17T02:23:04.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.242+0000 7fa05e7fc700 1 -- 172.21.15.104:0/674577215 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa058011ad0 con 0x7fa06806e8c0 2024-08-17T02:23:04.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.242+0000 7fa06759e700 1 -- 172.21.15.104:0/674577215 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa06816b280 con 0x7fa06806e8c0 2024-08-17T02:23:04.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.246+0000 7fa06759e700 1 -- 172.21.15.104:0/674577215 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0680643d0 con 0x7fa06806e8c0 2024-08-17T02:23:04.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.246+0000 7fa05e7fc700 1 -- 172.21.15.104:0/674577215 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa05801b3b0 con 0x7fa06806e8c0 2024-08-17T02:23:04.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.246+0000 7fa05e7fc700 1 --2- 172.21.15.104:0/674577215 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fa048060860 0x7fa048062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:04.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.246+0000 7fa05e7fc700 1 -- 172.21.15.104:0/674577215 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fa05807bef0 con 0x7fa06806e8c0 2024-08-17T02:23:04.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.246+0000 7fa065d9b700 1 --2- 172.21.15.104:0/674577215 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fa048060860 0x7fa048062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:04.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.246+0000 7fa065d9b700 1 --2- 172.21.15.104:0/674577215 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fa048060860 0x7fa048062d10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa0680aa340 tx=0x7fa050008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:04.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.254+0000 7fa05e7fc700 1 -- 172.21.15.104:0/674577215 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa05804c480 con 0x7fa06806e8c0 2024-08-17T02:23:04.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:04.414+0000 7fa06759e700 1 -- 172.21.15.104:0/674577215 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa06806ed00 con 0x7fa06806e8c0 2024-08-17T02:23:05.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.106+0000 7fa05e7fc700 1 -- 172.21.15.104:0/674577215 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa058017020 con 0x7fa06806e8c0 2024-08-17T02:23:05.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.126+0000 7fa06759e700 1 -- 172.21.15.104:0/674577215 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fa048060860 msgr2=0x7fa048062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:05.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.126+0000 7fa06759e700 1 --2- 172.21.15.104:0/674577215 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fa048060860 0x7fa048062d10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa0680aa340 tx=0x7fa050008040 comp rx=0 tx=0).stop 2024-08-17T02:23:05.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.126+0000 7fa06759e700 1 -- 172.21.15.104:0/674577215 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa06806e8c0 msgr2=0x7fa06813ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:05.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.126+0000 7fa06759e700 1 --2- 172.21.15.104:0/674577215 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa06806e8c0 0x7fa06813ccf0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa05800c590 tx=0x7fa05800c8a0 comp rx=0 tx=0).stop 2024-08-17T02:23:05.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.126+0000 7fa06759e700 1 -- 172.21.15.104:0/674577215 shutdown_connections 2024-08-17T02:23:05.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.126+0000 7fa06759e700 1 --2- 172.21.15.104:0/674577215 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fa048060860 0x7fa048062d10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:05.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.126+0000 7fa06759e700 1 --2- 172.21.15.104:0/674577215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0680aeb10 0x7fa0680aadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:05.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.126+0000 7fa06759e700 1 --2- 172.21.15.104:0/674577215 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0680adec0 0x7fa06816a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:05.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.126+0000 7fa06759e700 1 --2- 172.21.15.104:0/674577215 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa06806e8c0 0x7fa06813ccf0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:05.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.126+0000 7fa06759e700 1 -- 172.21.15.104:0/674577215 >> 172.21.15.104:0/674577215 conn(0x7fa068067880 msgr2=0x7fa068157990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:05.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.126+0000 7fa06759e700 1 -- 172.21.15.104:0/674577215 shutdown_connections 2024-08-17T02:23:05.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.126+0000 7fa06759e700 1 -- 172.21.15.104:0/674577215 wait complete. 2024-08-17T02:23:05.135 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_data' created 2024-08-17T02:23:05.146 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-17T02:23:05.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.242+0000 7f4ecee7e700 1 Processor -- start 2024-08-17T02:23:05.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.242+0000 7f4ecee7e700 1 -- start start 2024-08-17T02:23:05.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.246+0000 7f4ecee7e700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f4ec8159400 0x7f4ec80b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:05.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.246+0000 7f4ecee7e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ec806bac0 0x7f4ec80686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:05.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.246+0000 7f4ecee7e700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ec80adb00 con 0x7f4ec81597d0 2024-08-17T02:23:05.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.246+0000 7f4ecee7e700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ec806bf60 con 0x7f4ec8159400 2024-08-17T02:23:05.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.246+0000 7f4ecee7e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec80ac630 con 0x7f4ec806bac0 2024-08-17T02:23:05.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.246+0000 7f4eccc1a700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f4ec8159400 0x7f4ec80b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:05.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.246+0000 7f4eccc1a700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f4ec8159400 0x7f4ec80b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44854/0 (socket says 172.21.15.104:44854) 2024-08-17T02:23:05.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.246+0000 7f4eccc1a700 1 -- 172.21.15.104:0/271141426 learned_addr learned my addr 172.21.15.104:0/271141426 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:05.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.246+0000 7f4ebffff700 1 --1- 172.21.15.104:0/271141426 >> v1:172.21.15.104:6789/0 conn(0x7f4ec81597d0 0x7f4ec80ad3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:50694/0 (socket says 172.21.15.104:50694) 2024-08-17T02:23:05.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.246+0000 7f4ecd41b700 1 --2- 172.21.15.104:0/271141426 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ec806bac0 0x7f4ec80686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:05.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.246+0000 7f4eccc1a700 1 -- 172.21.15.104:0/271141426 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ec806bac0 msgr2=0x7f4ec80686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:05.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.246+0000 7f4eccc1a700 1 --2- 172.21.15.104:0/271141426 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ec806bac0 0x7f4ec80686a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:05.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.246+0000 7f4eccc1a700 1 -- 172.21.15.104:0/271141426 >> v1:172.21.15.104:6789/0 conn(0x7f4ec81597d0 legacy=0x7f4ec80ad3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:05.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.246+0000 7f4eccc1a700 1 -- 172.21.15.104:0/271141426 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec80ac910 con 0x7f4ec8159400 2024-08-17T02:23:05.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.246+0000 7f4eccc1a700 1 --2- 172.21.15.104:0/271141426 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4ec8159400 0x7f4ec80b1c00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4ec40099b0 tx=0x7f4ec4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7271c1dd4b3f1ac server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:05.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.246+0000 7f4ebf7fe700 1 -- 172.21.15.104:0/271141426 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec400b860 con 0x7f4ec8159400 2024-08-17T02:23:05.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.246+0000 7f4ebf7fe700 1 -- 172.21.15.104:0/271141426 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec400b9c0 con 0x7f4ec8159400 2024-08-17T02:23:05.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.246+0000 7f4ebf7fe700 1 -- 172.21.15.104:0/271141426 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec400bd60 con 0x7f4ec8159400 2024-08-17T02:23:05.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.246+0000 7f4ecee7e700 1 -- 172.21.15.104:0/271141426 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4ec8159400 msgr2=0x7f4ec80b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:05.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.246+0000 7f4ecee7e700 1 --2- 172.21.15.104:0/271141426 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4ec8159400 0x7f4ec80b1c00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4ec40099b0 tx=0x7f4ec4009250 comp rx=0 tx=0).stop 2024-08-17T02:23:05.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.246+0000 7f4ecee7e700 1 -- 172.21.15.104:0/271141426 shutdown_connections 2024-08-17T02:23:05.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.246+0000 7f4ecee7e700 1 --2- 172.21.15.104:0/271141426 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ec806bac0 0x7f4ec80686a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:05.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.246+0000 7f4ecee7e700 1 --2- 172.21.15.104:0/271141426 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4ec8159400 0x7f4ec80b1c00 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:05.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.246+0000 7f4ecee7e700 1 -- 172.21.15.104:0/271141426 >> 172.21.15.104:0/271141426 conn(0x7f4ec80c9bf0 msgr2=0x7f4ec806d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:05.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.246+0000 7f4ecee7e700 1 -- 172.21.15.104:0/271141426 shutdown_connections 2024-08-17T02:23:05.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.246+0000 7f4ecee7e700 1 -- 172.21.15.104:0/271141426 wait complete. 2024-08-17T02:23:05.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.250+0000 7f4ecee7e700 1 Processor -- start 2024-08-17T02:23:05.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.250+0000 7f4ecee7e700 1 -- start start 2024-08-17T02:23:05.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.250+0000 7f4ecee7e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4ec806bac0 0x7f4ec80a9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:05.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.250+0000 7f4ecee7e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ec8159400 0x7f4ec814e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:05.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.250+0000 7f4ecee7e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ec81597d0 0x7f4ec816a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:05.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.250+0000 7f4ecee7e700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec815aeb0 con 0x7f4ec806bac0 2024-08-17T02:23:05.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.250+0000 7f4ecee7e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec814e860 con 0x7f4ec8159400 2024-08-17T02:23:05.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.250+0000 7f4ecee7e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec816aa40 con 0x7f4ec81597d0 2024-08-17T02:23:05.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.250+0000 7f4eccc1a700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4ec806bac0 0x7f4ec80a9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:05.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.250+0000 7f4eccc1a700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4ec806bac0 0x7f4ec80a9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44870/0 (socket says 172.21.15.104:44870) 2024-08-17T02:23:05.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.250+0000 7f4eccc1a700 1 -- 172.21.15.104:0/3715751389 learned_addr learned my addr 172.21.15.104:0/3715751389 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:05.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.250+0000 7f4ecd41b700 1 --2- 172.21.15.104:0/3715751389 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ec81597d0 0x7f4ec816a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:05.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.250+0000 7f4ebffff700 1 --2- 172.21.15.104:0/3715751389 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ec8159400 0x7f4ec814e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:05.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.250+0000 7f4eccc1a700 1 -- 172.21.15.104:0/3715751389 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ec81597d0 msgr2=0x7f4ec816a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:05.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.250+0000 7f4eccc1a700 1 --2- 172.21.15.104:0/3715751389 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ec81597d0 0x7f4ec816a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:05.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.250+0000 7f4eccc1a700 1 -- 172.21.15.104:0/3715751389 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ec8159400 msgr2=0x7f4ec814e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:05.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.250+0000 7f4eccc1a700 1 --2- 172.21.15.104:0/3715751389 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ec8159400 0x7f4ec814e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:05.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.250+0000 7f4eccc1a700 1 -- 172.21.15.104:0/3715751389 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec40094f0 con 0x7f4ec806bac0 2024-08-17T02:23:05.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.250+0000 7f4eccc1a700 1 --2- 172.21.15.104:0/3715751389 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4ec806bac0 0x7f4ec80a9c80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8070500 tx=0x7f4ec4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:05.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.254+0000 7f4ebcff9700 1 -- 172.21.15.104:0/3715751389 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec4011e40 con 0x7f4ec806bac0 2024-08-17T02:23:05.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.254+0000 7f4ebcff9700 1 -- 172.21.15.104:0/3715751389 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec4024440 con 0x7f4ec806bac0 2024-08-17T02:23:05.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.254+0000 7f4ebcff9700 1 -- 172.21.15.104:0/3715751389 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec4024800 con 0x7f4ec806bac0 2024-08-17T02:23:05.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.254+0000 7f4ecee7e700 1 -- 172.21.15.104:0/3715751389 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ec80aa260 con 0x7f4ec806bac0 2024-08-17T02:23:05.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.254+0000 7f4ecee7e700 1 -- 172.21.15.104:0/3715751389 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ec815b430 con 0x7f4ec806bac0 2024-08-17T02:23:05.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.254+0000 7f4ecee7e700 1 -- 172.21.15.104:0/3715751389 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ec80645c0 con 0x7f4ec806bac0 2024-08-17T02:23:05.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.254+0000 7f4ebcff9700 1 -- 172.21.15.104:0/3715751389 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f4ec401a420 con 0x7f4ec806bac0 2024-08-17T02:23:05.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.254+0000 7f4ebcff9700 1 --2- 172.21.15.104:0/3715751389 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4eb4060860 0x7f4eb4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:05.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.254+0000 7f4ebcff9700 1 -- 172.21.15.104:0/3715751389 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f4ec407ea70 con 0x7f4ec806bac0 2024-08-17T02:23:05.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.254+0000 7f4ebffff700 1 --2- 172.21.15.104:0/3715751389 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4eb4060860 0x7f4eb4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:05.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.258+0000 7f4ebffff700 1 --2- 172.21.15.104:0/3715751389 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4eb4060860 0x7f4eb4062d10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4ec80cc120 tx=0x7f4eb8007eb0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:05.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.262+0000 7f4ebcff9700 1 -- 172.21.15.104:0/3715751389 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f4ec404ef20 con 0x7f4ec806bac0 2024-08-17T02:23:05.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:05.462+0000 7f4ecee7e700 1 -- 172.21.15.104:0/3715751389 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f4ec806eb30 con 0x7f4ec806bac0 2024-08-17T02:23:06.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.138+0000 7f4ebcff9700 1 -- 172.21.15.104:0/3715751389 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f4ec4052540 con 0x7f4ec806bac0 2024-08-17T02:23:06.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.154+0000 7f4ecee7e700 1 -- 172.21.15.104:0/3715751389 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4eb4060860 msgr2=0x7f4eb4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:06.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.154+0000 7f4ecee7e700 1 --2- 172.21.15.104:0/3715751389 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4eb4060860 0x7f4eb4062d10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4ec80cc120 tx=0x7f4eb8007eb0 comp rx=0 tx=0).stop 2024-08-17T02:23:06.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.154+0000 7f4ecee7e700 1 -- 172.21.15.104:0/3715751389 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4ec806bac0 msgr2=0x7f4ec80a9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:06.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.154+0000 7f4ecee7e700 1 --2- 172.21.15.104:0/3715751389 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4ec806bac0 0x7f4ec80a9c80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8070500 tx=0x7f4ec4017000 comp rx=0 tx=0).stop 2024-08-17T02:23:06.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.154+0000 7f4ecee7e700 1 -- 172.21.15.104:0/3715751389 shutdown_connections 2024-08-17T02:23:06.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.154+0000 7f4ecee7e700 1 --2- 172.21.15.104:0/3715751389 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4eb4060860 0x7f4eb4062d10 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:06.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.154+0000 7f4ecee7e700 1 --2- 172.21.15.104:0/3715751389 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ec81597d0 0x7f4ec816a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:06.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.154+0000 7f4ecee7e700 1 --2- 172.21.15.104:0/3715751389 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ec8159400 0x7f4ec814e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:06.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.154+0000 7f4ecee7e700 1 --2- 172.21.15.104:0/3715751389 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4ec806bac0 0x7f4ec80a9c80 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:06.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.154+0000 7f4ecee7e700 1 -- 172.21.15.104:0/3715751389 >> 172.21.15.104:0/3715751389 conn(0x7f4ec80c9bf0 msgr2=0x7f4ec80cad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:06.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.154+0000 7f4ecee7e700 1 -- 172.21.15.104:0/3715751389 shutdown_connections 2024-08-17T02:23:06.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.154+0000 7f4ecee7e700 1 -- 172.21.15.104:0/3715751389 wait complete. 2024-08-17T02:23:06.160 INFO:teuthology.orchestra.run.smithi104.stderr:new fs with metadata pool 4 and data pool 5 2024-08-17T02:23:06.171 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:23:06.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.262+0000 7fc9af0a3700 1 Processor -- start 2024-08-17T02:23:06.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.262+0000 7fc9af0a3700 1 -- start start 2024-08-17T02:23:06.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.262+0000 7fc9af0a3700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9a80b0350 0x7fc9a80ad7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:06.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.262+0000 7fc9af0a3700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc9a806df10 0x7fc9a806e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:06.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.262+0000 7fc9af0a3700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9a80af2b0 con 0x7fc9a8155d20 2024-08-17T02:23:06.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.262+0000 7fc9af0a3700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9a80b07a0 con 0x7fc9a806df10 2024-08-17T02:23:06.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.262+0000 7fc9af0a3700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a806e8d0 con 0x7fc9a80b0350 2024-08-17T02:23:06.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.262+0000 7fc9ae0a1700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fc9a8155d20 0x7fc9a80aea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:50704/0 (socket says 172.21.15.104:50704) 2024-08-17T02:23:06.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.262+0000 7fc9ae0a1700 1 -- 172.21.15.104:0/2636447054 learned_addr learned my addr 172.21.15.104:0/2636447054 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:23:06.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.262+0000 7fc9ae8a2700 1 --2- 172.21.15.104:0/2636447054 >> v2:172.21.15.117:3300/0 conn(0x7fc9a806df10 0x7fc9a806e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:06.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.262+0000 7fc9ad8a0700 1 --2- 172.21.15.104:0/2636447054 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9a80b0350 0x7fc9a80ad7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:06.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.262+0000 7fc9ad09f700 1 -- 172.21.15.104:0/2636447054 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3468072635 0 0) 0x7fc9a80af2b0 con 0x7fc9a8155d20 2024-08-17T02:23:06.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.262+0000 7fc9ad09f700 1 -- 172.21.15.104:0/2636447054 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc994003570 con 0x7fc9a8155d20 2024-08-17T02:23:06.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.262+0000 7fc9ad8a0700 1 -- 172.21.15.104:0/2636447054 >> v2:172.21.15.117:3300/0 conn(0x7fc9a806df10 msgr2=0x7fc9a806e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:06.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.262+0000 7fc9ad8a0700 1 --2- 172.21.15.104:0/2636447054 >> v2:172.21.15.117:3300/0 conn(0x7fc9a806df10 0x7fc9a806e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:06.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.262+0000 7fc9ad8a0700 1 -- 172.21.15.104:0/2636447054 >> v1:172.21.15.104:6789/0 conn(0x7fc9a8155d20 legacy=0x7fc9a80aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:06.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.262+0000 7fc9ad8a0700 1 -- 172.21.15.104:0/2636447054 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a80af590 con 0x7fc9a80b0350 2024-08-17T02:23:06.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.266+0000 7fc9ad8a0700 1 --2- 172.21.15.104:0/2636447054 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9a80b0350 0x7fc9a80ad7c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc9980098e0 tx=0x7fc9980091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79ec151f0d1212c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:06.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.266+0000 7fc9ad09f700 1 -- 172.21.15.104:0/2636447054 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc998011630 con 0x7fc9a80b0350 2024-08-17T02:23:06.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.266+0000 7fc9ad09f700 1 -- 172.21.15.104:0/2636447054 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc998011790 con 0x7fc9a80b0350 2024-08-17T02:23:06.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.266+0000 7fc9ad09f700 1 -- 172.21.15.104:0/2636447054 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc998011b30 con 0x7fc9a80b0350 2024-08-17T02:23:06.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.266+0000 7fc9af0a3700 1 -- 172.21.15.104:0/2636447054 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9a80b0350 msgr2=0x7fc9a80ad7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:06.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.266+0000 7fc9af0a3700 1 --2- 172.21.15.104:0/2636447054 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9a80b0350 0x7fc9a80ad7c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc9980098e0 tx=0x7fc9980091a0 comp rx=0 tx=0).stop 2024-08-17T02:23:06.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.266+0000 7fc9af0a3700 1 -- 172.21.15.104:0/2636447054 shutdown_connections 2024-08-17T02:23:06.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.266+0000 7fc9af0a3700 1 --2- 172.21.15.104:0/2636447054 >> v2:172.21.15.117:3300/0 conn(0x7fc9a806df10 0x7fc9a806e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:06.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.266+0000 7fc9af0a3700 1 --2- 172.21.15.104:0/2636447054 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9a80b0350 0x7fc9a80ad7c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:06.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.266+0000 7fc9af0a3700 1 -- 172.21.15.104:0/2636447054 >> 172.21.15.104:0/2636447054 conn(0x7fc9a80678d0 msgr2=0x7fc9a8067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:06.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.266+0000 7fc9af0a3700 1 -- 172.21.15.104:0/2636447054 shutdown_connections 2024-08-17T02:23:06.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.266+0000 7fc9af0a3700 1 -- 172.21.15.104:0/2636447054 wait complete. 2024-08-17T02:23:06.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.266+0000 7fc9af0a3700 1 Processor -- start 2024-08-17T02:23:06.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.266+0000 7fc9af0a3700 1 -- start start 2024-08-17T02:23:06.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.270+0000 7fc9af0a3700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9a806df10 0x7fc9a81522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:06.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.270+0000 7fc9af0a3700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9a80b0350 0x7fc9a8142920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:06.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.270+0000 7fc9af0a3700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9a8155d20 0x7fc9a814d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:06.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.270+0000 7fc9af0a3700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a8156d30 con 0x7fc9a806df10 2024-08-17T02:23:06.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.270+0000 7fc9af0a3700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a8156a20 con 0x7fc9a8155d20 2024-08-17T02:23:06.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.270+0000 7fc9af0a3700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a814da80 con 0x7fc9a80b0350 2024-08-17T02:23:06.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.270+0000 7fc9ae0a1700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9a806df10 0x7fc9a81522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:06.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.270+0000 7fc9ae0a1700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9a806df10 0x7fc9a81522b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44876/0 (socket says 172.21.15.104:44876) 2024-08-17T02:23:06.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.270+0000 7fc9ae0a1700 1 -- 172.21.15.104:0/2382293064 learned_addr learned my addr 172.21.15.104:0/2382293064 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:06.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.270+0000 7fc9ae8a2700 1 --2- 172.21.15.104:0/2382293064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9a8155d20 0x7fc9a814d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:06.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.270+0000 7fc9ad8a0700 1 --2- 172.21.15.104:0/2382293064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9a80b0350 0x7fc9a8142920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:06.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.270+0000 7fc9ae0a1700 1 -- 172.21.15.104:0/2382293064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9a80b0350 msgr2=0x7fc9a8142920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:06.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.270+0000 7fc9ae0a1700 1 --2- 172.21.15.104:0/2382293064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9a80b0350 0x7fc9a8142920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:06.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.270+0000 7fc9ae0a1700 1 -- 172.21.15.104:0/2382293064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9a8155d20 msgr2=0x7fc9a814d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:06.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.270+0000 7fc9ae0a1700 1 --2- 172.21.15.104:0/2382293064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9a8155d20 0x7fc9a814d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:06.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.270+0000 7fc9ae0a1700 1 -- 172.21.15.104:0/2382293064 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc998009420 con 0x7fc9a806df10 2024-08-17T02:23:06.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.270+0000 7fc9ad8a0700 1 --2- 172.21.15.104:0/2382293064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9a80b0350 0x7fc9a8142920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:06.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.270+0000 7fc9ae0a1700 1 --2- 172.21.15.104:0/2382293064 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9a806df10 0x7fc9a81522b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc9a000cc70 tx=0x7fc9a0001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:06.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.270+0000 7fc99e7fc700 1 -- 172.21.15.104:0/2382293064 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a000a900 con 0x7fc9a806df10 2024-08-17T02:23:06.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.270+0000 7fc99e7fc700 1 -- 172.21.15.104:0/2382293064 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a000aa80 con 0x7fc9a806df10 2024-08-17T02:23:06.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.270+0000 7fc99e7fc700 1 -- 172.21.15.104:0/2382293064 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a000ae40 con 0x7fc9a806df10 2024-08-17T02:23:06.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.270+0000 7fc9af0a3700 1 -- 172.21.15.104:0/2382293064 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9a814dd60 con 0x7fc9a806df10 2024-08-17T02:23:06.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.270+0000 7fc9af0a3700 1 -- 172.21.15.104:0/2382293064 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9a8142e60 con 0x7fc9a806df10 2024-08-17T02:23:06.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.270+0000 7fc9af0a3700 1 -- 172.21.15.104:0/2382293064 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9a814e260 con 0x7fc9a806df10 2024-08-17T02:23:06.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.270+0000 7fc99e7fc700 1 -- 172.21.15.104:0/2382293064 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fc9a0007300 con 0x7fc9a806df10 2024-08-17T02:23:06.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.274+0000 7fc99e7fc700 1 --2- 172.21.15.104:0/2382293064 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fc98c060860 0x7fc98c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:06.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.274+0000 7fc99e7fc700 1 -- 172.21.15.104:0/2382293064 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc9a007cfb0 con 0x7fc9a806df10 2024-08-17T02:23:06.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.274+0000 7fc9ad8a0700 1 --2- 172.21.15.104:0/2382293064 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fc98c060860 0x7fc98c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:06.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.274+0000 7fc9ad8a0700 1 --2- 172.21.15.104:0/2382293064 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fc98c060860 0x7fc98c062d10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc9a81471a0 tx=0x7fc998017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:06.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.282+0000 7fc99e7fc700 1 -- 172.21.15.104:0/2382293064 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fc9a004d480 con 0x7fc9a806df10 2024-08-17T02:23:06.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.438+0000 7fc9af0a3700 1 -- 172.21.15.104:0/2382293064 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9a80643a0 con 0x7fc9a806df10 2024-08-17T02:23:06.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.438+0000 7fc99e7fc700 1 -- 172.21.15.104:0/2382293064 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+15411 (secure 0 0 0) 0x7fc9a0050aa0 con 0x7fc9a806df10 2024-08-17T02:23:06.446 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:23:06.446 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":33,"fsid":"fd5f7fb8-d34b-49bb-89a8-62b7dad1bc25","created":"2024-08-17T02:21:57.891389+0000","modified":"2024-08-17T02:23:05.467660+0000","last_up_change":"2024-08-17T02:22:08.924546+0000","last_in_change":"2024-08-17T02:21:59.938028+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:22:10.143970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:23:03.390787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:23:04.462361+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"606b9088-590e-4709-aa3a-b0f6e22972ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":24257},{"type":"v1","addr":"172.21.15.104:6809","nonce":24257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":24257},{"type":"v1","addr":"172.21.15.104:6811","nonce":24257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":24257},{"type":"v1","addr":"172.21.15.104:6815","nonce":24257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":24257},{"type":"v1","addr":"172.21.15.104:6813","nonce":24257}]},"public_addr":"172.21.15.104:6809/24257","cluster_addr":"172.21.15.104:6811/24257","heartbeat_back_addr":"172.21.15.104:6815/24257","heartbeat_front_addr":"172.21.15.104:6813/24257","state":["exists","up"]},{"osd":1,"uuid":"9bc6a909-0c2f-4889-afe7-4a47f89b0f64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":24256},{"type":"v1","addr":"172.21.15.104:6825","nonce":24256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":24256},{"type":"v1","addr":"172.21.15.104:6827","nonce":24256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":24256},{"type":"v1","addr":"172.21.15.104:6831","nonce":24256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":24256},{"type":"v1","addr":"172.21.15.104:6829","nonce":24256}]},"public_addr":"172.21.15.104:6825/24256","cluster_addr":"172.21.15.104:6827/24256","heartbeat_back_addr":"172.21.15.104:6831/24256","heartbeat_front_addr":"172.21.15.104:6829/24256","state":["exists","up"]},{"osd":2,"uuid":"23da31d5-aefb-4edb-b79d-fa05e1becef7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":24255},{"type":"v1","addr":"172.21.15.104:6817","nonce":24255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":24255},{"type":"v1","addr":"172.21.15.104:6819","nonce":24255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":24255},{"type":"v1","addr":"172.21.15.104:6823","nonce":24255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":24255},{"type":"v1","addr":"172.21.15.104:6821","nonce":24255}]},"public_addr":"172.21.15.104:6817/24255","cluster_addr":"172.21.15.104:6819/24255","heartbeat_back_addr":"172.21.15.104:6823/24255","heartbeat_front_addr":"172.21.15.104:6821/24255","state":["exists","up"]},{"osd":3,"uuid":"6e4a5ec2-b415-45ef-8381-61a59eb65224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":24254},{"type":"v1","addr":"172.21.15.104:6801","nonce":24254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":24254},{"type":"v1","addr":"172.21.15.104:6803","nonce":24254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":24254},{"type":"v1","addr":"172.21.15.104:6807","nonce":24254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":24254},{"type":"v1","addr":"172.21.15.104:6805","nonce":24254}]},"public_addr":"172.21.15.104:6801/24254","cluster_addr":"172.21.15.104:6803/24254","heartbeat_back_addr":"172.21.15.104:6807/24254","heartbeat_front_addr":"172.21.15.104:6805/24254","state":["exists","up"]},{"osd":4,"uuid":"8d5bea2d-9039-4013-8c99-2c046c5b8a17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":24421},{"type":"v1","addr":"172.21.15.117:6804","nonce":24421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":24421},{"type":"v1","addr":"172.21.15.117:6809","nonce":24421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":24421},{"type":"v1","addr":"172.21.15.117:6815","nonce":24421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":24421},{"type":"v1","addr":"172.21.15.117:6813","nonce":24421}]},"public_addr":"172.21.15.117:6804/24421","cluster_addr":"172.21.15.117:6809/24421","heartbeat_back_addr":"172.21.15.117:6815/24421","heartbeat_front_addr":"172.21.15.117:6813/24421","state":["exists","up"]},{"osd":5,"uuid":"de8b36fc-121c-4f05-8f5b-28f513d9f21f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":24422},{"type":"v1","addr":"172.21.15.117:6817","nonce":24422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":24422},{"type":"v1","addr":"172.21.15.117:6819","nonce":24422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":24422},{"type":"v1","addr":"172.21.15.117:6823","nonce":24422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":24422},{"type":"v1","addr":"172.21.15.117:6821","nonce":24422}]},"public_addr":"172.21.15.117:6817/24422","cluster_addr":"172.21.15.117:6819/24422","heartbeat_back_addr":"172.21.15.117:6823/24422","heartbeat_front_addr":"172.21.15.117:6821/24422","state":["exists","up"]},{"osd":6,"uuid":"6a87f09f-7bf7-4f7a-be87-530ac1ff8ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":24420},{"type":"v1","addr":"172.21.15.117:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6803","nonce":24420},{"type":"v1","addr":"172.21.15.117:6805","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":24420},{"type":"v1","addr":"172.21.15.117:6811","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":24420},{"type":"v1","addr":"172.21.15.117:6808","nonce":24420}]},"public_addr":"172.21.15.117:6801/24420","cluster_addr":"172.21.15.117:6805/24420","heartbeat_back_addr":"172.21.15.117:6811/24420","heartbeat_front_addr":"172.21.15.117:6808/24420","state":["exists","up"]},{"osd":7,"uuid":"e31d8041-1aa1-4b5d-83b3-0a373426dd9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":24423},{"type":"v1","addr":"172.21.15.117:6825","nonce":24423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":24423},{"type":"v1","addr":"172.21.15.117:6827","nonce":24423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":24423},{"type":"v1","addr":"172.21.15.117:6831","nonce":24423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":24423},{"type":"v1","addr":"172.21.15.117:6829","nonce":24423}]},"public_addr":"172.21.15.117:6825/24423","cluster_addr":"172.21.15.117:6827/24423","heartbeat_back_addr":"172.21.15.117:6831/24423","heartbeat_front_addr":"172.21.15.117:6829/24423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.220874+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.210039+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.434762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.247206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.184316+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.306325+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.035719+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.400303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:23:06.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.442+0000 7fc9af0a3700 1 -- 172.21.15.104:0/2382293064 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fc98c060860 msgr2=0x7fc98c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:06.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.442+0000 7fc9af0a3700 1 --2- 172.21.15.104:0/2382293064 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fc98c060860 0x7fc98c062d10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc9a81471a0 tx=0x7fc998017000 comp rx=0 tx=0).stop 2024-08-17T02:23:06.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.442+0000 7fc9af0a3700 1 -- 172.21.15.104:0/2382293064 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9a806df10 msgr2=0x7fc9a81522b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:06.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.442+0000 7fc9af0a3700 1 --2- 172.21.15.104:0/2382293064 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9a806df10 0x7fc9a81522b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc9a000cc70 tx=0x7fc9a0001a70 comp rx=0 tx=0).stop 2024-08-17T02:23:06.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.442+0000 7fc9af0a3700 1 -- 172.21.15.104:0/2382293064 shutdown_connections 2024-08-17T02:23:06.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.442+0000 7fc9af0a3700 1 --2- 172.21.15.104:0/2382293064 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fc98c060860 0x7fc98c062d10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:06.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.442+0000 7fc9af0a3700 1 --2- 172.21.15.104:0/2382293064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9a8155d20 0x7fc9a814d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:06.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.442+0000 7fc9af0a3700 1 --2- 172.21.15.104:0/2382293064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9a80b0350 0x7fc9a8142920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:06.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.442+0000 7fc9af0a3700 1 --2- 172.21.15.104:0/2382293064 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9a806df10 0x7fc9a81522b0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:06.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.442+0000 7fc9af0a3700 1 -- 172.21.15.104:0/2382293064 >> 172.21.15.104:0/2382293064 conn(0x7fc9a80678d0 msgr2=0x7fc9a8069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:06.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.442+0000 7fc9af0a3700 1 -- 172.21.15.104:0/2382293064 shutdown_connections 2024-08-17T02:23:06.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.442+0000 7fc9af0a3700 1 -- 172.21.15.104:0/2382293064 wait complete. 2024-08-17T02:23:06.460 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:23:06.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.562+0000 7f8093fff700 1 Processor -- start 2024-08-17T02:23:06.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.562+0000 7f8093fff700 1 -- start start 2024-08-17T02:23:06.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.562+0000 7f8093fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8094153320 0x7f80941536f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:06.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.562+0000 7f8093fff700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f809415a190 0x7f809415cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:06.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.562+0000 7f8093fff700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f80940ccaa0 0x7f80940ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:06.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.562+0000 7f8093fff700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80940ce430 con 0x7f80940ccaa0 2024-08-17T02:23:06.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.562+0000 7f8093fff700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80940cd440 con 0x7f809415a190 2024-08-17T02:23:06.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.562+0000 7f8093fff700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f809415dbd0 con 0x7f8094153320 2024-08-17T02:23:06.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.562+0000 7f80937fe700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f80940ccaa0 0x7f80940ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:06.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.562+0000 7f8092ffd700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8094153320 0x7f80941536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:06.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.562+0000 7f80927fc700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f809415a190 0x7f809415cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:06.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.562+0000 7f80937fe700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f80940ccaa0 0x7f80940ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44888/0 (socket says 172.21.15.104:44888) 2024-08-17T02:23:06.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.562+0000 7f80937fe700 1 -- 172.21.15.104:0/3202658698 learned_addr learned my addr 172.21.15.104:0/3202658698 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:06.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.562+0000 7f80937fe700 1 -- 172.21.15.104:0/3202658698 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8094153320 msgr2=0x7f80941536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:06.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.562+0000 7f80937fe700 1 --2- 172.21.15.104:0/3202658698 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8094153320 0x7f80941536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:06.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.562+0000 7f80937fe700 1 -- 172.21.15.104:0/3202658698 >> v2:172.21.15.117:3300/0 conn(0x7f809415a190 msgr2=0x7f809415cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:06.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.562+0000 7f80937fe700 1 --2- 172.21.15.104:0/3202658698 >> v2:172.21.15.117:3300/0 conn(0x7f809415a190 0x7f809415cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:06.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.562+0000 7f80937fe700 1 -- 172.21.15.104:0/3202658698 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f809415d370 con 0x7f80940ccaa0 2024-08-17T02:23:06.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.562+0000 7f80927fc700 1 --2- 172.21.15.104:0/3202658698 >> v2:172.21.15.117:3300/0 conn(0x7f809415a190 0x7f809415cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:06.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.562+0000 7f8092ffd700 1 --2- 172.21.15.104:0/3202658698 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8094153320 0x7f80941536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:06.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.562+0000 7f80937fe700 1 --2- 172.21.15.104:0/3202658698 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80940ccaa0 0x7f80940ccf00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8094064720 tx=0x7f808c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5cd65d6287eb988 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:06.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.562+0000 7f8091ffb700 1 -- 172.21.15.104:0/3202658698 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c00b640 con 0x7f80940ccaa0 2024-08-17T02:23:06.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.562+0000 7f8091ffb700 1 -- 172.21.15.104:0/3202658698 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808c00b7a0 con 0x7f80940ccaa0 2024-08-17T02:23:06.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.562+0000 7f8091ffb700 1 -- 172.21.15.104:0/3202658698 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c00bb60 con 0x7f80940ccaa0 2024-08-17T02:23:06.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.566+0000 7f8093fff700 1 -- 172.21.15.104:0/3202658698 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80940ccaa0 msgr2=0x7f80940ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:06.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.566+0000 7f8093fff700 1 --2- 172.21.15.104:0/3202658698 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80940ccaa0 0x7f80940ccf00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8094064720 tx=0x7f808c009250 comp rx=0 tx=0).stop 2024-08-17T02:23:06.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.566+0000 7f8093fff700 1 -- 172.21.15.104:0/3202658698 shutdown_connections 2024-08-17T02:23:06.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.566+0000 7f8093fff700 1 --2- 172.21.15.104:0/3202658698 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80940ccaa0 0x7f80940ccf00 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:06.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.566+0000 7f8093fff700 1 --2- 172.21.15.104:0/3202658698 >> v2:172.21.15.117:3300/0 conn(0x7f809415a190 0x7f809415cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:06.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.566+0000 7f8093fff700 1 --2- 172.21.15.104:0/3202658698 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8094153320 0x7f80941536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:06.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.566+0000 7f8093fff700 1 -- 172.21.15.104:0/3202658698 >> 172.21.15.104:0/3202658698 conn(0x7f80940d00a0 msgr2=0x7f80940d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:06.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.566+0000 7f8093fff700 1 -- 172.21.15.104:0/3202658698 shutdown_connections 2024-08-17T02:23:06.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.566+0000 7f8093fff700 1 -- 172.21.15.104:0/3202658698 wait complete. 2024-08-17T02:23:06.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.566+0000 7f8093fff700 1 Processor -- start 2024-08-17T02:23:06.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.566+0000 7f8093fff700 1 -- start start 2024-08-17T02:23:06.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.570+0000 7f8093fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80940ccaa0 0x7f80940b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:06.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.570+0000 7f8093fff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8094153320 0x7f80941527a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:06.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.570+0000 7f8093fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f809415a190 0x7f80940b5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:06.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.570+0000 7f8093fff700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8094153cc0 con 0x7f8094153320 2024-08-17T02:23:06.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.570+0000 7f8093fff700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80940b0aa0 con 0x7f80940ccaa0 2024-08-17T02:23:06.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.570+0000 7f8093fff700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80940afe90 con 0x7f809415a190 2024-08-17T02:23:06.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.570+0000 7f80927fc700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8094153320 0x7f80941527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:06.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.570+0000 7f80927fc700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8094153320 0x7f80941527a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44900/0 (socket says 172.21.15.104:44900) 2024-08-17T02:23:06.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.570+0000 7f80927fc700 1 -- 172.21.15.104:0/963733640 learned_addr learned my addr 172.21.15.104:0/963733640 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:06.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.570+0000 7f8092ffd700 1 --2- 172.21.15.104:0/963733640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80940ccaa0 0x7f80940b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:06.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.570+0000 7f80937fe700 1 --2- 172.21.15.104:0/963733640 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f809415a190 0x7f80940b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:06.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.570+0000 7f80927fc700 1 -- 172.21.15.104:0/963733640 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f809415a190 msgr2=0x7f80940b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:06.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.570+0000 7f80927fc700 1 --2- 172.21.15.104:0/963733640 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f809415a190 0x7f80940b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:06.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.570+0000 7f80927fc700 1 -- 172.21.15.104:0/963733640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80940ccaa0 msgr2=0x7f80940b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:06.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.570+0000 7f80927fc700 1 --2- 172.21.15.104:0/963733640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80940ccaa0 0x7f80940b36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:06.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.570+0000 7f80927fc700 1 -- 172.21.15.104:0/963733640 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8088009420 con 0x7f8094153320 2024-08-17T02:23:06.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.570+0000 7f80927fc700 1 --2- 172.21.15.104:0/963733640 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8094153320 0x7f80941527a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f808400c0c0 tx=0x7f808400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:06.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.570+0000 7f807affd700 1 -- 172.21.15.104:0/963733640 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808400cd60 con 0x7f8094153320 2024-08-17T02:23:06.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.570+0000 7f807affd700 1 -- 172.21.15.104:0/963733640 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808400f040 con 0x7f8094153320 2024-08-17T02:23:06.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.570+0000 7f807affd700 1 -- 172.21.15.104:0/963733640 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80840146b0 con 0x7f8094153320 2024-08-17T02:23:06.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.570+0000 7f8093fff700 1 -- 172.21.15.104:0/963733640 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8084009a20 con 0x7f8094153320 2024-08-17T02:23:06.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.570+0000 7f8093fff700 1 -- 172.21.15.104:0/963733640 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f808c0094f0 con 0x7f8094153320 2024-08-17T02:23:06.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.574+0000 7f8093fff700 1 -- 172.21.15.104:0/963733640 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80940b0c30 con 0x7f8094153320 2024-08-17T02:23:06.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.574+0000 7f807affd700 1 -- 172.21.15.104:0/963733640 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8084014a20 con 0x7f8094153320 2024-08-17T02:23:06.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.574+0000 7f807affd700 1 --2- 172.21.15.104:0/963733640 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8080060860 0x7f8080062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:06.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.574+0000 7f807affd700 1 -- 172.21.15.104:0/963733640 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f808407d970 con 0x7f8094153320 2024-08-17T02:23:06.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.574+0000 7f8092ffd700 1 --2- 172.21.15.104:0/963733640 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8080060860 0x7f8080062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:06.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.578+0000 7f8092ffd700 1 --2- 172.21.15.104:0/963733640 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8080060860 0x7f8080062d10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f80880093f0 tx=0x7f8088008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:06.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.582+0000 7f807affd700 1 -- 172.21.15.104:0/963733640 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f808404ddc0 con 0x7f8094153320 2024-08-17T02:23:06.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.742+0000 7f8093fff700 1 -- 172.21.15.104:0/963733640 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f80940638f0 con 0x7f8094153320 2024-08-17T02:23:06.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.746+0000 7f807affd700 1 -- 172.21.15.104:0/963733640 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+15411 (secure 0 0 0) 0x7f80840513e0 con 0x7f8094153320 2024-08-17T02:23:06.752 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:23:06.752 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":33,"fsid":"fd5f7fb8-d34b-49bb-89a8-62b7dad1bc25","created":"2024-08-17T02:21:57.891389+0000","modified":"2024-08-17T02:23:05.467660+0000","last_up_change":"2024-08-17T02:22:08.924546+0000","last_in_change":"2024-08-17T02:21:59.938028+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:22:10.143970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:23:03.390787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:23:04.462361+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"606b9088-590e-4709-aa3a-b0f6e22972ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":24257},{"type":"v1","addr":"172.21.15.104:6809","nonce":24257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":24257},{"type":"v1","addr":"172.21.15.104:6811","nonce":24257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":24257},{"type":"v1","addr":"172.21.15.104:6815","nonce":24257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":24257},{"type":"v1","addr":"172.21.15.104:6813","nonce":24257}]},"public_addr":"172.21.15.104:6809/24257","cluster_addr":"172.21.15.104:6811/24257","heartbeat_back_addr":"172.21.15.104:6815/24257","heartbeat_front_addr":"172.21.15.104:6813/24257","state":["exists","up"]},{"osd":1,"uuid":"9bc6a909-0c2f-4889-afe7-4a47f89b0f64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":24256},{"type":"v1","addr":"172.21.15.104:6825","nonce":24256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":24256},{"type":"v1","addr":"172.21.15.104:6827","nonce":24256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":24256},{"type":"v1","addr":"172.21.15.104:6831","nonce":24256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":24256},{"type":"v1","addr":"172.21.15.104:6829","nonce":24256}]},"public_addr":"172.21.15.104:6825/24256","cluster_addr":"172.21.15.104:6827/24256","heartbeat_back_addr":"172.21.15.104:6831/24256","heartbeat_front_addr":"172.21.15.104:6829/24256","state":["exists","up"]},{"osd":2,"uuid":"23da31d5-aefb-4edb-b79d-fa05e1becef7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":24255},{"type":"v1","addr":"172.21.15.104:6817","nonce":24255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":24255},{"type":"v1","addr":"172.21.15.104:6819","nonce":24255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":24255},{"type":"v1","addr":"172.21.15.104:6823","nonce":24255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":24255},{"type":"v1","addr":"172.21.15.104:6821","nonce":24255}]},"public_addr":"172.21.15.104:6817/24255","cluster_addr":"172.21.15.104:6819/24255","heartbeat_back_addr":"172.21.15.104:6823/24255","heartbeat_front_addr":"172.21.15.104:6821/24255","state":["exists","up"]},{"osd":3,"uuid":"6e4a5ec2-b415-45ef-8381-61a59eb65224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":24254},{"type":"v1","addr":"172.21.15.104:6801","nonce":24254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":24254},{"type":"v1","addr":"172.21.15.104:6803","nonce":24254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":24254},{"type":"v1","addr":"172.21.15.104:6807","nonce":24254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":24254},{"type":"v1","addr":"172.21.15.104:6805","nonce":24254}]},"public_addr":"172.21.15.104:6801/24254","cluster_addr":"172.21.15.104:6803/24254","heartbeat_back_addr":"172.21.15.104:6807/24254","heartbeat_front_addr":"172.21.15.104:6805/24254","state":["exists","up"]},{"osd":4,"uuid":"8d5bea2d-9039-4013-8c99-2c046c5b8a17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":24421},{"type":"v1","addr":"172.21.15.117:6804","nonce":24421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":24421},{"type":"v1","addr":"172.21.15.117:6809","nonce":24421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":24421},{"type":"v1","addr":"172.21.15.117:6815","nonce":24421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":24421},{"type":"v1","addr":"172.21.15.117:6813","nonce":24421}]},"public_addr":"172.21.15.117:6804/24421","cluster_addr":"172.21.15.117:6809/24421","heartbeat_back_addr":"172.21.15.117:6815/24421","heartbeat_front_addr":"172.21.15.117:6813/24421","state":["exists","up"]},{"osd":5,"uuid":"de8b36fc-121c-4f05-8f5b-28f513d9f21f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":24422},{"type":"v1","addr":"172.21.15.117:6817","nonce":24422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":24422},{"type":"v1","addr":"172.21.15.117:6819","nonce":24422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":24422},{"type":"v1","addr":"172.21.15.117:6823","nonce":24422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":24422},{"type":"v1","addr":"172.21.15.117:6821","nonce":24422}]},"public_addr":"172.21.15.117:6817/24422","cluster_addr":"172.21.15.117:6819/24422","heartbeat_back_addr":"172.21.15.117:6823/24422","heartbeat_front_addr":"172.21.15.117:6821/24422","state":["exists","up"]},{"osd":6,"uuid":"6a87f09f-7bf7-4f7a-be87-530ac1ff8ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":24420},{"type":"v1","addr":"172.21.15.117:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6803","nonce":24420},{"type":"v1","addr":"172.21.15.117:6805","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":24420},{"type":"v1","addr":"172.21.15.117:6811","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":24420},{"type":"v1","addr":"172.21.15.117:6808","nonce":24420}]},"public_addr":"172.21.15.117:6801/24420","cluster_addr":"172.21.15.117:6805/24420","heartbeat_back_addr":"172.21.15.117:6811/24420","heartbeat_front_addr":"172.21.15.117:6808/24420","state":["exists","up"]},{"osd":7,"uuid":"e31d8041-1aa1-4b5d-83b3-0a373426dd9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":24423},{"type":"v1","addr":"172.21.15.117:6825","nonce":24423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":24423},{"type":"v1","addr":"172.21.15.117:6827","nonce":24423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":24423},{"type":"v1","addr":"172.21.15.117:6831","nonce":24423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":24423},{"type":"v1","addr":"172.21.15.117:6829","nonce":24423}]},"public_addr":"172.21.15.117:6825/24423","cluster_addr":"172.21.15.117:6827/24423","heartbeat_back_addr":"172.21.15.117:6831/24423","heartbeat_front_addr":"172.21.15.117:6829/24423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.220874+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.210039+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.434762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.247206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.184316+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.306325+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.035719+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.400303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:23:06.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.750+0000 7f8093fff700 1 -- 172.21.15.104:0/963733640 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8080060860 msgr2=0x7f8080062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:06.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.750+0000 7f8093fff700 1 --2- 172.21.15.104:0/963733640 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8080060860 0x7f8080062d10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f80880093f0 tx=0x7f8088008040 comp rx=0 tx=0).stop 2024-08-17T02:23:06.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.750+0000 7f8093fff700 1 -- 172.21.15.104:0/963733640 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8094153320 msgr2=0x7f80941527a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:06.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.750+0000 7f8093fff700 1 --2- 172.21.15.104:0/963733640 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8094153320 0x7f80941527a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f808400c0c0 tx=0x7f808400b040 comp rx=0 tx=0).stop 2024-08-17T02:23:06.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.750+0000 7f8093fff700 1 -- 172.21.15.104:0/963733640 shutdown_connections 2024-08-17T02:23:06.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.750+0000 7f8093fff700 1 --2- 172.21.15.104:0/963733640 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f8080060860 0x7f8080062d10 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:06.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.750+0000 7f8093fff700 1 --2- 172.21.15.104:0/963733640 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f809415a190 0x7f80940b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:06.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.750+0000 7f8093fff700 1 --2- 172.21.15.104:0/963733640 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8094153320 0x7f80941527a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:06.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.750+0000 7f8093fff700 1 --2- 172.21.15.104:0/963733640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80940ccaa0 0x7f80940b36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:06.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.750+0000 7f8093fff700 1 -- 172.21.15.104:0/963733640 >> 172.21.15.104:0/963733640 conn(0x7f80940d00a0 msgr2=0x7f80940d0470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:06.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.750+0000 7f8093fff700 1 -- 172.21.15.104:0/963733640 shutdown_connections 2024-08-17T02:23:06.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.750+0000 7f8093fff700 1 -- 172.21.15.104:0/963733640 wait complete. 2024-08-17T02:23:06.771 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-17T02:23:06.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.878+0000 7ff644867700 1 Processor -- start 2024-08-17T02:23:06.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.878+0000 7ff644867700 1 -- start start 2024-08-17T02:23:06.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.878+0000 7ff644867700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff640157140 0x7ff6400b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:06.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.878+0000 7ff644867700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff6400b25a0 0x7ff6400698a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:06.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.878+0000 7ff644867700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6400cba90 con 0x7ff640156d70 2024-08-17T02:23:06.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.878+0000 7ff644867700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6400b29e0 con 0x7ff6400b25a0 2024-08-17T02:23:06.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.878+0000 7ff644867700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6400cae80 con 0x7ff640157140 2024-08-17T02:23:06.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.878+0000 7ff63ffff700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff6400b25a0 0x7ff6400698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:06.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.878+0000 7ff63ffff700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff6400b25a0 0x7ff6400698a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35124/0 (socket says 172.21.15.104:35124) 2024-08-17T02:23:06.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.878+0000 7ff63ffff700 1 -- 172.21.15.104:0/2520945948 learned_addr learned my addr 172.21.15.104:0/2520945948 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:06.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.878+0000 7ff63effd700 1 --2- 172.21.15.104:0/2520945948 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff640157140 0x7ff6400b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:06.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.882+0000 7ff63ffff700 1 -- 172.21.15.104:0/2520945948 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff640157140 msgr2=0x7ff6400b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:06.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.882+0000 7ff63ffff700 1 --2- 172.21.15.104:0/2520945948 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff640157140 0x7ff6400b2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:06.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.882+0000 7ff63ffff700 1 -- 172.21.15.104:0/2520945948 >> v1:172.21.15.117:6789/0 conn(0x7ff640156d70 legacy=0x7ff6400678c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:06.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.882+0000 7ff63ffff700 1 -- 172.21.15.104:0/2520945948 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6400cb160 con 0x7ff6400b25a0 2024-08-17T02:23:06.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.882+0000 7ff63ffff700 1 --2- 172.21.15.104:0/2520945948 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6400b25a0 0x7ff6400698a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff6380099b0 tx=0x7ff638009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad6a13b868c3dbe7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:06.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.882+0000 7ff63e7fc700 1 -- 172.21.15.104:0/2520945948 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff638009ea0 con 0x7ff6400b25a0 2024-08-17T02:23:06.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.882+0000 7ff63e7fc700 1 -- 172.21.15.104:0/2520945948 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff63800b860 con 0x7ff6400b25a0 2024-08-17T02:23:06.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.882+0000 7ff63e7fc700 1 -- 172.21.15.104:0/2520945948 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63800bc00 con 0x7ff6400b25a0 2024-08-17T02:23:06.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.882+0000 7ff644867700 1 -- 172.21.15.104:0/2520945948 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6400b25a0 msgr2=0x7ff6400698a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:06.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.882+0000 7ff644867700 1 --2- 172.21.15.104:0/2520945948 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6400b25a0 0x7ff6400698a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff6380099b0 tx=0x7ff638009250 comp rx=0 tx=0).stop 2024-08-17T02:23:06.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.882+0000 7ff644867700 1 -- 172.21.15.104:0/2520945948 shutdown_connections 2024-08-17T02:23:06.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.882+0000 7ff644867700 1 --2- 172.21.15.104:0/2520945948 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6400b25a0 0x7ff6400698a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:06.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.882+0000 7ff644867700 1 --2- 172.21.15.104:0/2520945948 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff640157140 0x7ff6400b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:06.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.882+0000 7ff644867700 1 -- 172.21.15.104:0/2520945948 >> 172.21.15.104:0/2520945948 conn(0x7ff64006e170 msgr2=0x7ff64006e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:06.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.882+0000 7ff644867700 1 -- 172.21.15.104:0/2520945948 shutdown_connections 2024-08-17T02:23:06.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.882+0000 7ff644867700 1 -- 172.21.15.104:0/2520945948 wait complete. 2024-08-17T02:23:06.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.882+0000 7ff644867700 1 Processor -- start 2024-08-17T02:23:06.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.882+0000 7ff644867700 1 -- start start 2024-08-17T02:23:06.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.886+0000 7ff644867700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6400b25a0 0x7ff640150150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:06.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.886+0000 7ff644867700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff640156d70 0x7ff640166f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:06.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.886+0000 7ff644867700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff640157140 0x7ff64016ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:06.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.886+0000 7ff644867700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64014e750 con 0x7ff6400b25a0 2024-08-17T02:23:06.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.886+0000 7ff644867700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff640150690 con 0x7ff640157140 2024-08-17T02:23:06.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.886+0000 7ff644867700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff64014db40 con 0x7ff640156d70 2024-08-17T02:23:06.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.886+0000 7ff63f7fe700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6400b25a0 0x7ff640150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:06.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.886+0000 7ff63f7fe700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6400b25a0 0x7ff640150150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35136/0 (socket says 172.21.15.104:35136) 2024-08-17T02:23:06.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.886+0000 7ff63f7fe700 1 -- 172.21.15.104:0/4263971008 learned_addr learned my addr 172.21.15.104:0/4263971008 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:06.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.886+0000 7ff63effd700 1 --2- 172.21.15.104:0/4263971008 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff640156d70 0x7ff640166f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:06.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.886+0000 7ff63ffff700 1 --2- 172.21.15.104:0/4263971008 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff640157140 0x7ff64016ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:06.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.886+0000 7ff63f7fe700 1 -- 172.21.15.104:0/4263971008 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff640156d70 msgr2=0x7ff640166f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:06.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.886+0000 7ff63f7fe700 1 --2- 172.21.15.104:0/4263971008 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff640156d70 0x7ff640166f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:06.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.886+0000 7ff63f7fe700 1 -- 172.21.15.104:0/4263971008 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff640157140 msgr2=0x7ff64016ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:06.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.886+0000 7ff63f7fe700 1 --2- 172.21.15.104:0/4263971008 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff640157140 0x7ff64016ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:06.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.886+0000 7ff63f7fe700 1 -- 172.21.15.104:0/4263971008 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6380094f0 con 0x7ff6400b25a0 2024-08-17T02:23:06.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.886+0000 7ff63ffff700 1 --2- 172.21.15.104:0/4263971008 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff640157140 0x7ff64016ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:06.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.886+0000 7ff63f7fe700 1 --2- 172.21.15.104:0/4263971008 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6400b25a0 0x7ff640150150 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff63000c4e0 tx=0x7ff63000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:06.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.886+0000 7ff6377fe700 1 -- 172.21.15.104:0/4263971008 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff630011590 con 0x7ff6400b25a0 2024-08-17T02:23:06.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.886+0000 7ff6377fe700 1 -- 172.21.15.104:0/4263971008 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff630011710 con 0x7ff6400b25a0 2024-08-17T02:23:06.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.886+0000 7ff644867700 1 -- 172.21.15.104:0/4263971008 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff64014de20 con 0x7ff6400b25a0 2024-08-17T02:23:06.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.886+0000 7ff6377fe700 1 -- 172.21.15.104:0/4263971008 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff630011ad0 con 0x7ff6400b25a0 2024-08-17T02:23:06.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.886+0000 7ff644867700 1 -- 172.21.15.104:0/4263971008 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff64014e3e0 con 0x7ff6400b25a0 2024-08-17T02:23:06.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.886+0000 7ff644867700 1 -- 172.21.15.104:0/4263971008 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6400638f0 con 0x7ff6400b25a0 2024-08-17T02:23:06.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.890+0000 7ff6377fe700 1 -- 172.21.15.104:0/4263971008 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff63001b3b0 con 0x7ff6400b25a0 2024-08-17T02:23:06.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.890+0000 7ff6377fe700 1 --2- 172.21.15.104:0/4263971008 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff620060890 0x7ff620062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:06.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.890+0000 7ff6377fe700 1 -- 172.21.15.104:0/4263971008 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff63007c130 con 0x7ff6400b25a0 2024-08-17T02:23:06.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.890+0000 7ff63effd700 1 --2- 172.21.15.104:0/4263971008 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff620060890 0x7ff620062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:06.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.890+0000 7ff63effd700 1 --2- 172.21.15.104:0/4263971008 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff620060890 0x7ff620062d40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff6400afa40 tx=0x7ff62800b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:06.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:06.894+0000 7ff6377fe700 1 -- 172.21.15.104:0/4263971008 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff63004c4e0 con 0x7ff6400b25a0 2024-08-17T02:23:07.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.094+0000 7ff644867700 1 -- 172.21.15.104:0/4263971008 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff640157f70 con 0x7ff6400b25a0 2024-08-17T02:23:07.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.138+0000 7ff6377fe700 1 -- 172.21.15.104:0/4263971008 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v13) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff6300170b0 con 0x7ff6400b25a0 2024-08-17T02:23:07.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.142+0000 7ff644867700 1 -- 172.21.15.104:0/4263971008 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff620060890 msgr2=0x7ff620062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:07.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.142+0000 7ff644867700 1 --2- 172.21.15.104:0/4263971008 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff620060890 0x7ff620062d40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff6400afa40 tx=0x7ff62800b040 comp rx=0 tx=0).stop 2024-08-17T02:23:07.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.142+0000 7ff644867700 1 -- 172.21.15.104:0/4263971008 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6400b25a0 msgr2=0x7ff640150150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:07.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.142+0000 7ff644867700 1 --2- 172.21.15.104:0/4263971008 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6400b25a0 0x7ff640150150 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff63000c4e0 tx=0x7ff63000c7f0 comp rx=0 tx=0).stop 2024-08-17T02:23:07.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.146+0000 7ff644867700 1 -- 172.21.15.104:0/4263971008 shutdown_connections 2024-08-17T02:23:07.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.146+0000 7ff644867700 1 --2- 172.21.15.104:0/4263971008 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff620060890 0x7ff620062d40 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:07.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.146+0000 7ff644867700 1 --2- 172.21.15.104:0/4263971008 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff640157140 0x7ff64016ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:07.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.146+0000 7ff644867700 1 --2- 172.21.15.104:0/4263971008 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff640156d70 0x7ff640166f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:07.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.146+0000 7ff644867700 1 --2- 172.21.15.104:0/4263971008 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6400b25a0 0x7ff640150150 secure :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff63000c4e0 tx=0x7ff63000c7f0 comp rx=0 tx=0).stop 2024-08-17T02:23:07.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.146+0000 7ff644867700 1 -- 172.21.15.104:0/4263971008 >> 172.21.15.104:0/4263971008 conn(0x7ff64006e170 msgr2=0x7ff640157530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:07.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.146+0000 7ff644867700 1 -- 172.21.15.104:0/4263971008 shutdown_connections 2024-08-17T02:23:07.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.146+0000 7ff644867700 1 -- 172.21.15.104:0/4263971008 wait complete. 2024-08-17T02:23:07.170 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-17T02:23:07.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.278+0000 7fe54359e700 1 Processor -- start 2024-08-17T02:23:07.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.278+0000 7fe54359e700 1 -- start start 2024-08-17T02:23:07.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.278+0000 7fe54359e700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe54413f680 0x7fe5440aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:07.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.282+0000 7fe54359e700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5440b0810 con 0x7fe5440ad6c0 2024-08-17T02:23:07.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.282+0000 7fe54359e700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5440afc70 con 0x7fe54413fa50 2024-08-17T02:23:07.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.282+0000 7fe54359e700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5440af060 con 0x7fe54413f680 2024-08-17T02:23:07.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.282+0000 7fe54259c700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe54413f680 0x7fe5440aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:07.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.282+0000 7fe542d9d700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fe5440ad6c0 0x7fe54406e010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:33706/0 (socket says 172.21.15.104:33706) 2024-08-17T02:23:07.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.282+0000 7fe542d9d700 1 -- 172.21.15.104:0/926485431 learned_addr learned my addr 172.21.15.104:0/926485431 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:23:07.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.282+0000 7fe54159a700 1 -- 172.21.15.104:0/926485431 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1647338587 0 0) 0x7fe5440b0810 con 0x7fe5440ad6c0 2024-08-17T02:23:07.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.282+0000 7fe54159a700 1 -- 172.21.15.104:0/926485431 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe524003570 con 0x7fe5440ad6c0 2024-08-17T02:23:07.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.282+0000 7fe54259c700 1 -- 172.21.15.104:0/926485431 >> v1:172.21.15.117:6789/0 conn(0x7fe54413fa50 legacy=0x7fe5440b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:07.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.282+0000 7fe54259c700 1 -- 172.21.15.104:0/926485431 >> v1:172.21.15.104:6789/0 conn(0x7fe5440ad6c0 legacy=0x7fe54406e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:07.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.282+0000 7fe54259c700 1 -- 172.21.15.104:0/926485431 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5440af340 con 0x7fe54413f680 2024-08-17T02:23:07.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.282+0000 7fe54259c700 1 --2- 172.21.15.104:0/926485431 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe54413f680 0x7fe5440aea80 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe53c009e60 tx=0x7fe53c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=662373132a23ad81 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:07.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.282+0000 7fe54159a700 1 -- 172.21.15.104:0/926485431 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53c00e070 con 0x7fe54413f680 2024-08-17T02:23:07.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.282+0000 7fe54159a700 1 -- 172.21.15.104:0/926485431 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53c00bb60 con 0x7fe54413f680 2024-08-17T02:23:07.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.282+0000 7fe54159a700 1 -- 172.21.15.104:0/926485431 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53c012430 con 0x7fe54413f680 2024-08-17T02:23:07.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.282+0000 7fe54359e700 1 -- 172.21.15.104:0/926485431 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe54413f680 msgr2=0x7fe5440aea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:07.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.282+0000 7fe54359e700 1 --2- 172.21.15.104:0/926485431 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe54413f680 0x7fe5440aea80 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe53c009e60 tx=0x7fe53c009780 comp rx=0 tx=0).stop 2024-08-17T02:23:07.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.282+0000 7fe54359e700 1 -- 172.21.15.104:0/926485431 shutdown_connections 2024-08-17T02:23:07.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.282+0000 7fe54359e700 1 --2- 172.21.15.104:0/926485431 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe54413f680 0x7fe5440aea80 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:07.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.282+0000 7fe54359e700 1 -- 172.21.15.104:0/926485431 >> 172.21.15.104:0/926485431 conn(0x7fe5440678a0 msgr2=0x7fe544067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:07.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.282+0000 7fe54359e700 1 -- 172.21.15.104:0/926485431 shutdown_connections 2024-08-17T02:23:07.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.282+0000 7fe54359e700 1 -- 172.21.15.104:0/926485431 wait complete. 2024-08-17T02:23:07.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.286+0000 7fe54359e700 1 Processor -- start 2024-08-17T02:23:07.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.286+0000 7fe54359e700 1 -- start start 2024-08-17T02:23:07.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.286+0000 7fe54359e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5440ad6c0 0x7fe54416d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:07.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.286+0000 7fe54359e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe54413f680 0x7fe544170fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:07.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.286+0000 7fe54359e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe54413fa50 0x7fe54416e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:07.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.286+0000 7fe54359e700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe54416de70 con 0x7fe5440ad6c0 2024-08-17T02:23:07.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.286+0000 7fe54359e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe54416d840 con 0x7fe54413fa50 2024-08-17T02:23:07.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.286+0000 7fe54359e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe544171890 con 0x7fe54413f680 2024-08-17T02:23:07.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.286+0000 7fe54259c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5440ad6c0 0x7fe54416d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:07.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.286+0000 7fe54259c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5440ad6c0 0x7fe54416d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35158/0 (socket says 172.21.15.104:35158) 2024-08-17T02:23:07.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.286+0000 7fe54259c700 1 -- 172.21.15.104:0/1716508011 learned_addr learned my addr 172.21.15.104:0/1716508011 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:07.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.286+0000 7fe542d9d700 1 --2- 172.21.15.104:0/1716508011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe54413fa50 0x7fe54416e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:07.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.286+0000 7fe541d9b700 1 --2- 172.21.15.104:0/1716508011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe54413f680 0x7fe544170fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:07.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.290+0000 7fe54259c700 1 -- 172.21.15.104:0/1716508011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe54413f680 msgr2=0x7fe544170fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:07.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.290+0000 7fe54259c700 1 --2- 172.21.15.104:0/1716508011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe54413f680 0x7fe544170fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:07.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.290+0000 7fe54259c700 1 -- 172.21.15.104:0/1716508011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe54413fa50 msgr2=0x7fe54416e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:07.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.290+0000 7fe54259c700 1 --2- 172.21.15.104:0/1716508011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe54413fa50 0x7fe54416e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:07.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.290+0000 7fe54259c700 1 -- 172.21.15.104:0/1716508011 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe53c009a20 con 0x7fe5440ad6c0 2024-08-17T02:23:07.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.290+0000 7fe542d9d700 1 --2- 172.21.15.104:0/1716508011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe54413fa50 0x7fe54416e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:07.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.290+0000 7fe541d9b700 1 --2- 172.21.15.104:0/1716508011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe54413f680 0x7fe544170fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:07.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.290+0000 7fe54259c700 1 --2- 172.21.15.104:0/1716508011 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5440ad6c0 0x7fe54416d300 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe54406fbb0 tx=0x7fe53c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:07.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.290+0000 7fe53a7fc700 1 -- 172.21.15.104:0/1716508011 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53c012b10 con 0x7fe5440ad6c0 2024-08-17T02:23:07.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.290+0000 7fe53a7fc700 1 -- 172.21.15.104:0/1716508011 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53c021070 con 0x7fe5440ad6c0 2024-08-17T02:23:07.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.290+0000 7fe54359e700 1 -- 172.21.15.104:0/1716508011 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe544171b70 con 0x7fe5440ad6c0 2024-08-17T02:23:07.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.290+0000 7fe53a7fc700 1 -- 172.21.15.104:0/1716508011 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53c026430 con 0x7fe5440ad6c0 2024-08-17T02:23:07.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.290+0000 7fe54359e700 1 -- 172.21.15.104:0/1716508011 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe544171510 con 0x7fe5440ad6c0 2024-08-17T02:23:07.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.290+0000 7fe54359e700 1 -- 172.21.15.104:0/1716508011 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe544064330 con 0x7fe5440ad6c0 2024-08-17T02:23:07.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.290+0000 7fe53a7fc700 1 -- 172.21.15.104:0/1716508011 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe53c023030 con 0x7fe5440ad6c0 2024-08-17T02:23:07.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.294+0000 7fe53a7fc700 1 --2- 172.21.15.104:0/1716508011 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fe528060860 0x7fe528062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:07.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.294+0000 7fe53a7fc700 1 -- 172.21.15.104:0/1716508011 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe53c07ea70 con 0x7fe5440ad6c0 2024-08-17T02:23:07.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.294+0000 7fe541d9b700 1 --2- 172.21.15.104:0/1716508011 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fe528060860 0x7fe528062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:07.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.294+0000 7fe541d9b700 1 --2- 172.21.15.104:0/1716508011 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fe528060860 0x7fe528062d10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe5440a6dc0 tx=0x7fe52c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:07.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.298+0000 7fe53a7fc700 1 -- 172.21.15.104:0/1716508011 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fe53c04eec0 con 0x7fe5440ad6c0 2024-08-17T02:23:07.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:07.498+0000 7fe54359e700 1 -- 172.21.15.104:0/1716508011 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe54406ed70 con 0x7fe5440ad6c0 2024-08-17T02:23:08.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.154+0000 7fe53a7fc700 1 -- 172.21.15.104:0/1716508011 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe53c0524e0 con 0x7fe5440ad6c0 2024-08-17T02:23:08.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.158+0000 7fe54359e700 1 -- 172.21.15.104:0/1716508011 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fe528060860 msgr2=0x7fe528062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:08.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.158+0000 7fe54359e700 1 --2- 172.21.15.104:0/1716508011 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fe528060860 0x7fe528062d10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe5440a6dc0 tx=0x7fe52c009040 comp rx=0 tx=0).stop 2024-08-17T02:23:08.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.158+0000 7fe54359e700 1 -- 172.21.15.104:0/1716508011 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5440ad6c0 msgr2=0x7fe54416d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:08.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.158+0000 7fe54359e700 1 --2- 172.21.15.104:0/1716508011 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5440ad6c0 0x7fe54416d300 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe54406fbb0 tx=0x7fe53c019000 comp rx=0 tx=0).stop 2024-08-17T02:23:08.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.158+0000 7fe54359e700 1 -- 172.21.15.104:0/1716508011 shutdown_connections 2024-08-17T02:23:08.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.158+0000 7fe54359e700 1 --2- 172.21.15.104:0/1716508011 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fe528060860 0x7fe528062d10 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:08.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.158+0000 7fe54359e700 1 --2- 172.21.15.104:0/1716508011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe54413fa50 0x7fe54416e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:08.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.158+0000 7fe54359e700 1 --2- 172.21.15.104:0/1716508011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe54413f680 0x7fe544170fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:08.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.158+0000 7fe54359e700 1 --2- 172.21.15.104:0/1716508011 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5440ad6c0 0x7fe54416d300 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:08.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.158+0000 7fe54359e700 1 -- 172.21.15.104:0/1716508011 >> 172.21.15.104:0/1716508011 conn(0x7fe5440678a0 msgr2=0x7fe54413c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:08.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.158+0000 7fe54359e700 1 -- 172.21.15.104:0/1716508011 shutdown_connections 2024-08-17T02:23:08.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.158+0000 7fe54359e700 1 -- 172.21.15.104:0/1716508011 wait complete. 2024-08-17T02:23:08.180 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:23:08.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.286+0000 7f3763348700 1 Processor -- start 2024-08-17T02:23:08.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.286+0000 7f3763348700 1 -- start start 2024-08-17T02:23:08.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.286+0000 7f3763348700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f375c155d20 0x7f375c0b0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:08.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.286+0000 7f3763348700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f375c0ad7c0 0x7f375c0aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:08.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.286+0000 7f3763348700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f375c06df10 0x7f375c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:08.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.286+0000 7f3763348700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f375c0adc10 con 0x7f375c0ad7c0 2024-08-17T02:23:08.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.286+0000 7f3763348700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f375c06e8b0 con 0x7f375c155d20 2024-08-17T02:23:08.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.286+0000 7f3763348700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375c0af2b0 con 0x7f375c06df10 2024-08-17T02:23:08.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.286+0000 7f3761b45700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f375c0ad7c0 0x7f375c0aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:08.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.290+0000 7f3761b45700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f375c0ad7c0 0x7f375c0aea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35162/0 (socket says 172.21.15.104:35162) 2024-08-17T02:23:08.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.290+0000 7f3761b45700 1 -- 172.21.15.104:0/3423174259 learned_addr learned my addr 172.21.15.104:0/3423174259 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:08.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.290+0000 7f3762b47700 1 --2- 172.21.15.104:0/3423174259 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f375c06df10 0x7f375c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:08.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.290+0000 7f3762346700 1 --2- 172.21.15.104:0/3423174259 >> v2:172.21.15.117:3300/0 conn(0x7f375c155d20 0x7f375c0b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:08.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.290+0000 7f3761b45700 1 -- 172.21.15.104:0/3423174259 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f375c06df10 msgr2=0x7f375c06e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:08.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.290+0000 7f3761b45700 1 --2- 172.21.15.104:0/3423174259 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f375c06df10 0x7f375c06e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:08.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.290+0000 7f3761b45700 1 -- 172.21.15.104:0/3423174259 >> v2:172.21.15.117:3300/0 conn(0x7f375c155d20 msgr2=0x7f375c0b0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:08.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.290+0000 7f3761b45700 1 --2- 172.21.15.104:0/3423174259 >> v2:172.21.15.117:3300/0 conn(0x7f375c155d20 0x7f375c0b0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:08.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.290+0000 7f3761b45700 1 -- 172.21.15.104:0/3423174259 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f375c0af590 con 0x7f375c0ad7c0 2024-08-17T02:23:08.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.290+0000 7f3761b45700 1 --2- 172.21.15.104:0/3423174259 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f375c0ad7c0 0x7f375c0aea80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f375c0b1d50 tx=0x7f374c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46a65e7b8e71d144 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:08.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.290+0000 7f3761344700 1 -- 172.21.15.104:0/3423174259 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374c00b860 con 0x7f375c0ad7c0 2024-08-17T02:23:08.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.290+0000 7f3761344700 1 -- 172.21.15.104:0/3423174259 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374c00b9c0 con 0x7f375c0ad7c0 2024-08-17T02:23:08.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.290+0000 7f3761344700 1 -- 172.21.15.104:0/3423174259 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374c00bd60 con 0x7f375c0ad7c0 2024-08-17T02:23:08.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.290+0000 7f3763348700 1 -- 172.21.15.104:0/3423174259 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f375c0ad7c0 msgr2=0x7f375c0aea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:08.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.290+0000 7f3763348700 1 --2- 172.21.15.104:0/3423174259 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f375c0ad7c0 0x7f375c0aea80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f375c0b1d50 tx=0x7f374c009250 comp rx=0 tx=0).stop 2024-08-17T02:23:08.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.290+0000 7f3763348700 1 -- 172.21.15.104:0/3423174259 shutdown_connections 2024-08-17T02:23:08.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.290+0000 7f3763348700 1 --2- 172.21.15.104:0/3423174259 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f375c06df10 0x7f375c06e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:08.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.290+0000 7f3763348700 1 --2- 172.21.15.104:0/3423174259 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f375c0ad7c0 0x7f375c0aea80 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:08.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.290+0000 7f3763348700 1 --2- 172.21.15.104:0/3423174259 >> v2:172.21.15.117:3300/0 conn(0x7f375c155d20 0x7f375c0b0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:08.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.290+0000 7f3763348700 1 -- 172.21.15.104:0/3423174259 >> 172.21.15.104:0/3423174259 conn(0x7f375c0678d0 msgr2=0x7f375c067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:08.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.290+0000 7f3763348700 1 -- 172.21.15.104:0/3423174259 shutdown_connections 2024-08-17T02:23:08.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.290+0000 7f3763348700 1 -- 172.21.15.104:0/3423174259 wait complete. 2024-08-17T02:23:08.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.294+0000 7f3763348700 1 Processor -- start 2024-08-17T02:23:08.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.294+0000 7f3763348700 1 -- start start 2024-08-17T02:23:08.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.294+0000 7f3763348700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f375c06df10 0x7f375c14f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:08.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.294+0000 7f3763348700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f375c0ad7c0 0x7f375c151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:08.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.294+0000 7f3763348700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f375c155d20 0x7f375c14e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:08.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.294+0000 7f3763348700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375c14c8b0 con 0x7f375c155d20 2024-08-17T02:23:08.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.294+0000 7f3763348700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375c1521b0 con 0x7f375c06df10 2024-08-17T02:23:08.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.294+0000 7f3763348700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375c152430 con 0x7f375c0ad7c0 2024-08-17T02:23:08.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.294+0000 7f3762b47700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f375c155d20 0x7f375c14e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:08.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.294+0000 7f3762b47700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f375c155d20 0x7f375c14e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35174/0 (socket says 172.21.15.104:35174) 2024-08-17T02:23:08.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.294+0000 7f3762b47700 1 -- 172.21.15.104:0/1887676421 learned_addr learned my addr 172.21.15.104:0/1887676421 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:08.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.294+0000 7f3761b45700 1 --2- 172.21.15.104:0/1887676421 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f375c0ad7c0 0x7f375c151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:08.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.294+0000 7f3762346700 1 --2- 172.21.15.104:0/1887676421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f375c06df10 0x7f375c14f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:08.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.294+0000 7f3762b47700 1 -- 172.21.15.104:0/1887676421 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f375c0ad7c0 msgr2=0x7f375c151c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:08.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.294+0000 7f3762b47700 1 --2- 172.21.15.104:0/1887676421 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f375c0ad7c0 0x7f375c151c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:08.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.294+0000 7f3762b47700 1 -- 172.21.15.104:0/1887676421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f375c06df10 msgr2=0x7f375c14f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:08.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.294+0000 7f3762b47700 1 --2- 172.21.15.104:0/1887676421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f375c06df10 0x7f375c14f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:08.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.294+0000 7f3762b47700 1 -- 172.21.15.104:0/1887676421 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f374c0094f0 con 0x7f375c155d20 2024-08-17T02:23:08.303 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.294+0000 7f3762346700 1 --2- 172.21.15.104:0/1887676421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f375c06df10 0x7f375c14f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:08.303 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.294+0000 7f3761b45700 1 --2- 172.21.15.104:0/1887676421 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f375c0ad7c0 0x7f375c151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:08.303 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.294+0000 7f3762b47700 1 --2- 172.21.15.104:0/1887676421 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f375c155d20 0x7f375c14e710 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3754009fa0 tx=0x7f3754009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:08.303 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.294+0000 7f37527fc700 1 -- 172.21.15.104:0/1887676421 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375400ed20 con 0x7f375c155d20 2024-08-17T02:23:08.303 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.294+0000 7f3763348700 1 -- 172.21.15.104:0/1887676421 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f375c152710 con 0x7f375c155d20 2024-08-17T02:23:08.303 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.294+0000 7f37527fc700 1 -- 172.21.15.104:0/1887676421 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375400ee80 con 0x7f375c155d20 2024-08-17T02:23:08.303 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.294+0000 7f37527fc700 1 -- 172.21.15.104:0/1887676421 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3754014670 con 0x7f375c155d20 2024-08-17T02:23:08.303 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.294+0000 7f3763348700 1 -- 172.21.15.104:0/1887676421 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f375c152cd0 con 0x7f375c155d20 2024-08-17T02:23:08.303 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.298+0000 7f3763348700 1 -- 172.21.15.104:0/1887676421 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f375c14ca20 con 0x7f375c155d20 2024-08-17T02:23:08.304 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.298+0000 7f37527fc700 1 -- 172.21.15.104:0/1887676421 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f37540149e0 con 0x7f375c155d20 2024-08-17T02:23:08.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.298+0000 7f37527fc700 1 --2- 172.21.15.104:0/1887676421 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3740060860 0x7f3740062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:08.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.298+0000 7f37527fc700 1 -- 172.21.15.104:0/1887676421 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f375407d400 con 0x7f375c155d20 2024-08-17T02:23:08.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.298+0000 7f3762346700 1 --2- 172.21.15.104:0/1887676421 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3740060860 0x7f3740062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:08.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.298+0000 7f3762346700 1 --2- 172.21.15.104:0/1887676421 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3740060860 0x7f3740062d10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f375c152fb0 tx=0x7f3758008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:08.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.306+0000 7f37527fc700 1 -- 172.21.15.104:0/1887676421 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f375404d850 con 0x7f375c155d20 2024-08-17T02:23:08.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.502+0000 7f3763348700 1 -- 172.21.15.104:0/1887676421 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f375c0643a0 con 0x7f375c155d20 2024-08-17T02:23:08.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.502+0000 7f37527fc700 1 -- 172.21.15.104:0/1887676421 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f3754050e70 con 0x7f375c155d20 2024-08-17T02:23:08.509 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:23:08.510 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/3848434798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3848434798},{"type":"v1","addr":"172.21.15.117:6836","nonce":3848434798}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4894,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1461239637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1461239637},{"type":"v1","addr":"172.21.15.117:6837","nonce":1461239637}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4959,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/4148924116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":4148924116},{"type":"v1","addr":"172.21.15.104:6833","nonce":4148924116}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:23:05.468383+0000","modified":"2024-08-17T02:23:08.148034+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4965},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4965":{"gid":4965,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/38993094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":38993094},{"type":"v1","addr":"172.21.15.104:6835","nonce":38993094}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-08-17T02:23:08.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.506+0000 7f3763348700 1 -- 172.21.15.104:0/1887676421 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3740060860 msgr2=0x7f3740062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:08.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.506+0000 7f3763348700 1 --2- 172.21.15.104:0/1887676421 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3740060860 0x7f3740062d10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f375c152fb0 tx=0x7f3758008040 comp rx=0 tx=0).stop 2024-08-17T02:23:08.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.506+0000 7f3763348700 1 -- 172.21.15.104:0/1887676421 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f375c155d20 msgr2=0x7f375c14e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:08.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.506+0000 7f3763348700 1 --2- 172.21.15.104:0/1887676421 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f375c155d20 0x7f375c14e710 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3754009fa0 tx=0x7f3754009900 comp rx=0 tx=0).stop 2024-08-17T02:23:08.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.506+0000 7f3763348700 1 -- 172.21.15.104:0/1887676421 shutdown_connections 2024-08-17T02:23:08.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.506+0000 7f3763348700 1 --2- 172.21.15.104:0/1887676421 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3740060860 0x7f3740062d10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:08.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.506+0000 7f3763348700 1 --2- 172.21.15.104:0/1887676421 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f375c155d20 0x7f375c14e710 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:08.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.506+0000 7f3763348700 1 --2- 172.21.15.104:0/1887676421 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f375c0ad7c0 0x7f375c151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:08.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.506+0000 7f3763348700 1 --2- 172.21.15.104:0/1887676421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f375c06df10 0x7f375c14f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:08.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.506+0000 7f3763348700 1 -- 172.21.15.104:0/1887676421 >> 172.21.15.104:0/1887676421 conn(0x7f375c0678d0 msgr2=0x7f375c154820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:08.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.506+0000 7f3763348700 1 -- 172.21.15.104:0/1887676421 shutdown_connections 2024-08-17T02:23:08.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.506+0000 7f3763348700 1 -- 172.21.15.104:0/1887676421 wait complete. 2024-08-17T02:23:08.513 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 14 2024-08-17T02:23:08.524 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:23:08.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.622+0000 7fde4414d700 1 Processor -- start 2024-08-17T02:23:08.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.622+0000 7fde4414d700 1 -- start start 2024-08-17T02:23:08.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.622+0000 7fde4414d700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fde3c156f80 0x7fde3c0ae3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:08.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.622+0000 7fde4414d700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde3c06f040 0x7fde3c0aab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:08.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.622+0000 7fde4414d700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde3c0adf50 con 0x7fde3c0ace80 2024-08-17T02:23:08.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.622+0000 7fde4414d700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde3c0ae920 con 0x7fde3c156f80 2024-08-17T02:23:08.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.622+0000 7fde4414d700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c0ad340 con 0x7fde3c06f040 2024-08-17T02:23:08.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.622+0000 7fde41ee9700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fde3c156f80 0x7fde3c0ae3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:08.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.622+0000 7fde416e8700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fde3c0ace80 0x7fde3c157350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:33722/0 (socket says 172.21.15.104:33722) 2024-08-17T02:23:08.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.622+0000 7fde416e8700 1 -- 172.21.15.104:0/680922307 learned_addr learned my addr 172.21.15.104:0/680922307 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:23:08.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.622+0000 7fde426ea700 1 --2- 172.21.15.104:0/680922307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde3c06f040 0x7fde3c0aab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:08.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.622+0000 7fde41ee9700 1 -- 172.21.15.104:0/680922307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde3c06f040 msgr2=0x7fde3c0aab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:08.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.622+0000 7fde41ee9700 1 --2- 172.21.15.104:0/680922307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde3c06f040 0x7fde3c0aab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:08.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.622+0000 7fde41ee9700 1 -- 172.21.15.104:0/680922307 >> v1:172.21.15.104:6789/0 conn(0x7fde3c0ace80 legacy=0x7fde3c157350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:08.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.622+0000 7fde41ee9700 1 -- 172.21.15.104:0/680922307 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde3c0ad620 con 0x7fde3c156f80 2024-08-17T02:23:08.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.622+0000 7fde426ea700 1 --2- 172.21.15.104:0/680922307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde3c06f040 0x7fde3c0aab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:23:08.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.622+0000 7fde41ee9700 1 --2- 172.21.15.104:0/680922307 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fde3c156f80 0x7fde3c0ae3e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fde380098e0 tx=0x7fde380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a57fcdea3d59223 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:08.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.622+0000 7fde40ee7700 1 -- 172.21.15.104:0/680922307 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde38009e80 con 0x7fde3c156f80 2024-08-17T02:23:08.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.622+0000 7fde40ee7700 1 -- 172.21.15.104:0/680922307 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde3800b860 con 0x7fde3c156f80 2024-08-17T02:23:08.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.622+0000 7fde40ee7700 1 -- 172.21.15.104:0/680922307 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3800bbe0 con 0x7fde3c156f80 2024-08-17T02:23:08.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.622+0000 7fde4414d700 1 -- 172.21.15.104:0/680922307 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fde3c156f80 msgr2=0x7fde3c0ae3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:08.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.622+0000 7fde4414d700 1 --2- 172.21.15.104:0/680922307 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fde3c156f80 0x7fde3c0ae3e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fde380098e0 tx=0x7fde380091a0 comp rx=0 tx=0).stop 2024-08-17T02:23:08.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.622+0000 7fde4414d700 1 -- 172.21.15.104:0/680922307 shutdown_connections 2024-08-17T02:23:08.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.622+0000 7fde4414d700 1 --2- 172.21.15.104:0/680922307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde3c06f040 0x7fde3c0aab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:08.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.622+0000 7fde4414d700 1 --2- 172.21.15.104:0/680922307 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fde3c156f80 0x7fde3c0ae3e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:08.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.622+0000 7fde4414d700 1 -- 172.21.15.104:0/680922307 >> 172.21.15.104:0/680922307 conn(0x7fde3c066e00 msgr2=0x7fde3c067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:08.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.622+0000 7fde4414d700 1 -- 172.21.15.104:0/680922307 shutdown_connections 2024-08-17T02:23:08.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.622+0000 7fde4414d700 1 -- 172.21.15.104:0/680922307 wait complete. 2024-08-17T02:23:08.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.626+0000 7fde4414d700 1 Processor -- start 2024-08-17T02:23:08.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.626+0000 7fde4414d700 1 -- start start 2024-08-17T02:23:08.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.626+0000 7fde4414d700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde3c06f040 0x7fde3c0995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:08.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.626+0000 7fde4414d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde3c0ace80 0x7fde3c1599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:08.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.626+0000 7fde4414d700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fde3c156f80 0x7fde3c167220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:08.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.626+0000 7fde4414d700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c159f10 con 0x7fde3c156f80 2024-08-17T02:23:08.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.626+0000 7fde4414d700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c0969f0 con 0x7fde3c0ace80 2024-08-17T02:23:08.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.626+0000 7fde4414d700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c099c30 con 0x7fde3c06f040 2024-08-17T02:23:08.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.626+0000 7fde426ea700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fde3c156f80 0x7fde3c167220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:08.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.626+0000 7fde426ea700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fde3c156f80 0x7fde3c167220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35200/0 (socket says 172.21.15.104:35200) 2024-08-17T02:23:08.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.626+0000 7fde426ea700 1 -- 172.21.15.104:0/794724501 learned_addr learned my addr 172.21.15.104:0/794724501 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:08.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.626+0000 7fde416e8700 1 --2- 172.21.15.104:0/794724501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde3c0ace80 0x7fde3c1599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:08.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.626+0000 7fde41ee9700 1 --2- 172.21.15.104:0/794724501 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde3c06f040 0x7fde3c0995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:08.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.630+0000 7fde426ea700 1 -- 172.21.15.104:0/794724501 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde3c06f040 msgr2=0x7fde3c0995c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:08.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.630+0000 7fde426ea700 1 --2- 172.21.15.104:0/794724501 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde3c06f040 0x7fde3c0995c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:08.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.630+0000 7fde426ea700 1 -- 172.21.15.104:0/794724501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde3c0ace80 msgr2=0x7fde3c1599d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:08.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.630+0000 7fde426ea700 1 --2- 172.21.15.104:0/794724501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde3c0ace80 0x7fde3c1599d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:08.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.630+0000 7fde426ea700 1 -- 172.21.15.104:0/794724501 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde38009420 con 0x7fde3c156f80 2024-08-17T02:23:08.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.630+0000 7fde426ea700 1 --2- 172.21.15.104:0/794724501 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fde3c156f80 0x7fde3c167220 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fde3400cfb0 tx=0x7fde340078c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:08.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.630+0000 7fde31ffb700 1 -- 172.21.15.104:0/794724501 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3400aea0 con 0x7fde3c156f80 2024-08-17T02:23:08.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.630+0000 7fde31ffb700 1 -- 172.21.15.104:0/794724501 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde34015440 con 0x7fde3c156f80 2024-08-17T02:23:08.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.630+0000 7fde4414d700 1 -- 172.21.15.104:0/794724501 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde3c096c90 con 0x7fde3c156f80 2024-08-17T02:23:08.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.630+0000 7fde31ffb700 1 -- 172.21.15.104:0/794724501 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde34015800 con 0x7fde3c156f80 2024-08-17T02:23:08.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.630+0000 7fde4414d700 1 -- 172.21.15.104:0/794724501 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde3c097250 con 0x7fde3c156f80 2024-08-17T02:23:08.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.630+0000 7fde4414d700 1 -- 172.21.15.104:0/794724501 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde3c0974a0 con 0x7fde3c156f80 2024-08-17T02:23:08.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.630+0000 7fde31ffb700 1 -- 172.21.15.104:0/794724501 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fde34003020 con 0x7fde3c156f80 2024-08-17T02:23:08.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.630+0000 7fde31ffb700 1 --2- 172.21.15.104:0/794724501 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fde20060860 0x7fde20062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:08.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.630+0000 7fde31ffb700 1 -- 172.21.15.104:0/794724501 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fde3407d290 con 0x7fde3c156f80 2024-08-17T02:23:08.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.630+0000 7fde41ee9700 1 --2- 172.21.15.104:0/794724501 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fde20060860 0x7fde20062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:08.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.634+0000 7fde41ee9700 1 --2- 172.21.15.104:0/794724501 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fde20060860 0x7fde20062d10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fde380091e0 tx=0x7fde38017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:08.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.642+0000 7fde31ffb700 1 -- 172.21.15.104:0/794724501 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fde3404d6e0 con 0x7fde3c156f80 2024-08-17T02:23:08.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.806+0000 7fde4414d700 1 -- 172.21.15.104:0/794724501 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde3c0645c0 con 0x7fde3c156f80 2024-08-17T02:23:08.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.806+0000 7fde31ffb700 1 -- 172.21.15.104:0/794724501 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fde34050d00 con 0x7fde3c156f80 2024-08-17T02:23:08.814 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:23:08.814 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":34,"fsid":"fd5f7fb8-d34b-49bb-89a8-62b7dad1bc25","created":"2024-08-17T02:21:57.891389+0000","modified":"2024-08-17T02:23:07.139700+0000","last_up_change":"2024-08-17T02:22:08.924546+0000","last_in_change":"2024-08-17T02:21:59.938028+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:22:10.143970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:23:03.390787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:23:04.462361+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"606b9088-590e-4709-aa3a-b0f6e22972ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":24257},{"type":"v1","addr":"172.21.15.104:6809","nonce":24257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":24257},{"type":"v1","addr":"172.21.15.104:6811","nonce":24257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":24257},{"type":"v1","addr":"172.21.15.104:6815","nonce":24257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":24257},{"type":"v1","addr":"172.21.15.104:6813","nonce":24257}]},"public_addr":"172.21.15.104:6809/24257","cluster_addr":"172.21.15.104:6811/24257","heartbeat_back_addr":"172.21.15.104:6815/24257","heartbeat_front_addr":"172.21.15.104:6813/24257","state":["exists","up"]},{"osd":1,"uuid":"9bc6a909-0c2f-4889-afe7-4a47f89b0f64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":24256},{"type":"v1","addr":"172.21.15.104:6825","nonce":24256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":24256},{"type":"v1","addr":"172.21.15.104:6827","nonce":24256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":24256},{"type":"v1","addr":"172.21.15.104:6831","nonce":24256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":24256},{"type":"v1","addr":"172.21.15.104:6829","nonce":24256}]},"public_addr":"172.21.15.104:6825/24256","cluster_addr":"172.21.15.104:6827/24256","heartbeat_back_addr":"172.21.15.104:6831/24256","heartbeat_front_addr":"172.21.15.104:6829/24256","state":["exists","up"]},{"osd":2,"uuid":"23da31d5-aefb-4edb-b79d-fa05e1becef7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":24255},{"type":"v1","addr":"172.21.15.104:6817","nonce":24255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":24255},{"type":"v1","addr":"172.21.15.104:6819","nonce":24255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":24255},{"type":"v1","addr":"172.21.15.104:6823","nonce":24255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":24255},{"type":"v1","addr":"172.21.15.104:6821","nonce":24255}]},"public_addr":"172.21.15.104:6817/24255","cluster_addr":"172.21.15.104:6819/24255","heartbeat_back_addr":"172.21.15.104:6823/24255","heartbeat_front_addr":"172.21.15.104:6821/24255","state":["exists","up"]},{"osd":3,"uuid":"6e4a5ec2-b415-45ef-8381-61a59eb65224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":24254},{"type":"v1","addr":"172.21.15.104:6801","nonce":24254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":24254},{"type":"v1","addr":"172.21.15.104:6803","nonce":24254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":24254},{"type":"v1","addr":"172.21.15.104:6807","nonce":24254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":24254},{"type":"v1","addr":"172.21.15.104:6805","nonce":24254}]},"public_addr":"172.21.15.104:6801/24254","cluster_addr":"172.21.15.104:6803/24254","heartbeat_back_addr":"172.21.15.104:6807/24254","heartbeat_front_addr":"172.21.15.104:6805/24254","state":["exists","up"]},{"osd":4,"uuid":"8d5bea2d-9039-4013-8c99-2c046c5b8a17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":24421},{"type":"v1","addr":"172.21.15.117:6804","nonce":24421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":24421},{"type":"v1","addr":"172.21.15.117:6809","nonce":24421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":24421},{"type":"v1","addr":"172.21.15.117:6815","nonce":24421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":24421},{"type":"v1","addr":"172.21.15.117:6813","nonce":24421}]},"public_addr":"172.21.15.117:6804/24421","cluster_addr":"172.21.15.117:6809/24421","heartbeat_back_addr":"172.21.15.117:6815/24421","heartbeat_front_addr":"172.21.15.117:6813/24421","state":["exists","up"]},{"osd":5,"uuid":"de8b36fc-121c-4f05-8f5b-28f513d9f21f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":24422},{"type":"v1","addr":"172.21.15.117:6817","nonce":24422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":24422},{"type":"v1","addr":"172.21.15.117:6819","nonce":24422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":24422},{"type":"v1","addr":"172.21.15.117:6823","nonce":24422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":24422},{"type":"v1","addr":"172.21.15.117:6821","nonce":24422}]},"public_addr":"172.21.15.117:6817/24422","cluster_addr":"172.21.15.117:6819/24422","heartbeat_back_addr":"172.21.15.117:6823/24422","heartbeat_front_addr":"172.21.15.117:6821/24422","state":["exists","up"]},{"osd":6,"uuid":"6a87f09f-7bf7-4f7a-be87-530ac1ff8ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":24420},{"type":"v1","addr":"172.21.15.117:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6803","nonce":24420},{"type":"v1","addr":"172.21.15.117:6805","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":24420},{"type":"v1","addr":"172.21.15.117:6811","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":24420},{"type":"v1","addr":"172.21.15.117:6808","nonce":24420}]},"public_addr":"172.21.15.117:6801/24420","cluster_addr":"172.21.15.117:6805/24420","heartbeat_back_addr":"172.21.15.117:6811/24420","heartbeat_front_addr":"172.21.15.117:6808/24420","state":["exists","up"]},{"osd":7,"uuid":"e31d8041-1aa1-4b5d-83b3-0a373426dd9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":24423},{"type":"v1","addr":"172.21.15.117:6825","nonce":24423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":24423},{"type":"v1","addr":"172.21.15.117:6827","nonce":24423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":24423},{"type":"v1","addr":"172.21.15.117:6831","nonce":24423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":24423},{"type":"v1","addr":"172.21.15.117:6829","nonce":24423}]},"public_addr":"172.21.15.117:6825/24423","cluster_addr":"172.21.15.117:6827/24423","heartbeat_back_addr":"172.21.15.117:6831/24423","heartbeat_front_addr":"172.21.15.117:6829/24423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.220874+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.210039+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.434762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.247206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.184316+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.306325+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.035719+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.400303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:23:08.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.810+0000 7fde4414d700 1 -- 172.21.15.104:0/794724501 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fde20060860 msgr2=0x7fde20062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:08.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.810+0000 7fde4414d700 1 --2- 172.21.15.104:0/794724501 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fde20060860 0x7fde20062d10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fde380091e0 tx=0x7fde38017000 comp rx=0 tx=0).stop 2024-08-17T02:23:08.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.810+0000 7fde4414d700 1 -- 172.21.15.104:0/794724501 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fde3c156f80 msgr2=0x7fde3c167220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:08.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.810+0000 7fde4414d700 1 --2- 172.21.15.104:0/794724501 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fde3c156f80 0x7fde3c167220 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fde3400cfb0 tx=0x7fde340078c0 comp rx=0 tx=0).stop 2024-08-17T02:23:08.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.810+0000 7fde4414d700 1 -- 172.21.15.104:0/794724501 shutdown_connections 2024-08-17T02:23:08.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.810+0000 7fde4414d700 1 --2- 172.21.15.104:0/794724501 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fde20060860 0x7fde20062d10 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:08.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.810+0000 7fde4414d700 1 --2- 172.21.15.104:0/794724501 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fde3c156f80 0x7fde3c167220 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:08.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.810+0000 7fde4414d700 1 --2- 172.21.15.104:0/794724501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde3c0ace80 0x7fde3c1599d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:08.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.810+0000 7fde4414d700 1 --2- 172.21.15.104:0/794724501 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde3c06f040 0x7fde3c0995c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:08.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.810+0000 7fde4414d700 1 -- 172.21.15.104:0/794724501 >> 172.21.15.104:0/794724501 conn(0x7fde3c066e00 msgr2=0x7fde3c06afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:08.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.810+0000 7fde4414d700 1 -- 172.21.15.104:0/794724501 shutdown_connections 2024-08-17T02:23:08.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.810+0000 7fde4414d700 1 -- 172.21.15.104:0/794724501 wait complete. 2024-08-17T02:23:08.828 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-08-17T02:23:08.829 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:23:08.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.934+0000 7f1da759e700 1 Processor -- start 2024-08-17T02:23:08.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.934+0000 7f1da759e700 1 -- start start 2024-08-17T02:23:08.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.934+0000 7f1da759e700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1da8154900 0x7f1da80b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:08.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.934+0000 7f1da759e700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f1da80cb560 0x7f1da8160ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:08.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.934+0000 7f1da759e700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1da80b1730 con 0x7f1da80b12d0 2024-08-17T02:23:08.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.934+0000 7f1da759e700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1da8068790 con 0x7f1da80cb560 2024-08-17T02:23:08.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.934+0000 7f1da759e700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1da81583f0 con 0x7f1da8154900 2024-08-17T02:23:08.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.934+0000 7f1da5d9b700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f1da80b12d0 0x7f1da80cae50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:33738/0 (socket says 172.21.15.104:33738) 2024-08-17T02:23:08.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.934+0000 7f1da5d9b700 1 -- 172.21.15.104:0/1638056163 learned_addr learned my addr 172.21.15.104:0/1638056163 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:23:08.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.934+0000 7f1da6d9d700 1 --2- 172.21.15.104:0/1638056163 >> v2:172.21.15.104:3300/0 conn(0x7f1da80cb560 0x7f1da8160ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:08.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.934+0000 7f1da659c700 1 --2- 172.21.15.104:0/1638056163 >> v2:172.21.15.117:3300/0 conn(0x7f1da8154900 0x7f1da80b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:08.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.934+0000 7f1da559a700 1 -- 172.21.15.104:0/1638056163 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2281784727 0 0) 0x7f1d9c001110 con 0x7f1da80b12d0 2024-08-17T02:23:08.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.934+0000 7f1da559a700 1 -- 172.21.15.104:0/1638056163 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d90003570 con 0x7f1da80b12d0 2024-08-17T02:23:08.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.934+0000 7f1da6d9d700 1 -- 172.21.15.104:0/1638056163 >> v2:172.21.15.117:3300/0 conn(0x7f1da8154900 msgr2=0x7f1da80b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:08.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.934+0000 7f1da559a700 1 -- 172.21.15.104:0/1638056163 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2426847188 0 0) 0x7f1d90003570 con 0x7f1da80b12d0 2024-08-17T02:23:08.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.934+0000 7f1da6d9d700 1 --2- 172.21.15.104:0/1638056163 >> v2:172.21.15.117:3300/0 conn(0x7f1da8154900 0x7f1da80b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:08.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.934+0000 7f1da6d9d700 1 -- 172.21.15.104:0/1638056163 >> v1:172.21.15.104:6789/0 conn(0x7f1da80b12d0 legacy=0x7f1da80cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:08.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.934+0000 7f1da6d9d700 1 -- 172.21.15.104:0/1638056163 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da80cbaa0 con 0x7f1da80cb560 2024-08-17T02:23:08.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.934+0000 7f1da6d9d700 1 --2- 172.21.15.104:0/1638056163 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1da80cb560 0x7f1da8160ac0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1da8064e60 tx=0x7f1da00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbe73c6324c12d32 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:08.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.934+0000 7f1da559a700 1 -- 172.21.15.104:0/1638056163 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c001600 con 0x7f1da80cb560 2024-08-17T02:23:08.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.934+0000 7f1da559a700 1 -- 172.21.15.104:0/1638056163 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da0011420 con 0x7f1da80cb560 2024-08-17T02:23:08.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.934+0000 7f1da559a700 1 -- 172.21.15.104:0/1638056163 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da00117a0 con 0x7f1da80cb560 2024-08-17T02:23:08.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.934+0000 7f1da759e700 1 -- 172.21.15.104:0/1638056163 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1da80cb560 msgr2=0x7f1da8160ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:08.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.934+0000 7f1da759e700 1 --2- 172.21.15.104:0/1638056163 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1da80cb560 0x7f1da8160ac0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1da8064e60 tx=0x7f1da00091a0 comp rx=0 tx=0).stop 2024-08-17T02:23:08.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.934+0000 7f1da759e700 1 -- 172.21.15.104:0/1638056163 shutdown_connections 2024-08-17T02:23:08.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.934+0000 7f1da759e700 1 --2- 172.21.15.104:0/1638056163 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1da80cb560 0x7f1da8160ac0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:08.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.934+0000 7f1da759e700 1 --2- 172.21.15.104:0/1638056163 >> v2:172.21.15.117:3300/0 conn(0x7f1da8154900 0x7f1da80b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:08.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.934+0000 7f1da759e700 1 -- 172.21.15.104:0/1638056163 >> 172.21.15.104:0/1638056163 conn(0x7f1da80678d0 msgr2=0x7f1da8067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:08.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.934+0000 7f1da759e700 1 -- 172.21.15.104:0/1638056163 shutdown_connections 2024-08-17T02:23:08.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.934+0000 7f1da759e700 1 -- 172.21.15.104:0/1638056163 wait complete. 2024-08-17T02:23:08.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.938+0000 7f1da759e700 1 Processor -- start 2024-08-17T02:23:08.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.938+0000 7f1da759e700 1 -- start start 2024-08-17T02:23:08.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.938+0000 7f1da759e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da80b12d0 0x7f1da8150ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:08.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.938+0000 7f1da759e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1da80cb560 0x7f1da80af050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:08.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.938+0000 7f1da759e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1da8154900 0x7f1da8069f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:08.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.938+0000 7f1da759e700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da8151000 con 0x7f1da8154900 2024-08-17T02:23:08.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.938+0000 7f1da759e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da80af8a0 con 0x7f1da80cb560 2024-08-17T02:23:08.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.938+0000 7f1da759e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da80afb80 con 0x7f1da80b12d0 2024-08-17T02:23:08.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.938+0000 7f1da6d9d700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1da8154900 0x7f1da8069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:08.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.938+0000 7f1da6d9d700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1da8154900 0x7f1da8069f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35220/0 (socket says 172.21.15.104:35220) 2024-08-17T02:23:08.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.938+0000 7f1da6d9d700 1 -- 172.21.15.104:0/3329370398 learned_addr learned my addr 172.21.15.104:0/3329370398 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:08.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.938+0000 7f1da5d9b700 1 --2- 172.21.15.104:0/3329370398 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1da80cb560 0x7f1da80af050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:08.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.938+0000 7f1da659c700 1 --2- 172.21.15.104:0/3329370398 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da80b12d0 0x7f1da8150ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:08.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.938+0000 7f1da6d9d700 1 -- 172.21.15.104:0/3329370398 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da80b12d0 msgr2=0x7f1da8150ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:08.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.938+0000 7f1da6d9d700 1 --2- 172.21.15.104:0/3329370398 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da80b12d0 0x7f1da8150ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:08.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.938+0000 7f1da6d9d700 1 -- 172.21.15.104:0/3329370398 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1da80cb560 msgr2=0x7f1da80af050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:08.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.938+0000 7f1da6d9d700 1 --2- 172.21.15.104:0/3329370398 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1da80cb560 0x7f1da80af050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:08.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.938+0000 7f1da6d9d700 1 -- 172.21.15.104:0/3329370398 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da0009420 con 0x7f1da8154900 2024-08-17T02:23:08.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.938+0000 7f1da6d9d700 1 --2- 172.21.15.104:0/3329370398 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1da8154900 0x7f1da8069f10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1da0002000 tx=0x7f1da0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:08.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.942+0000 7f1d967fc700 1 -- 172.21.15.104:0/3329370398 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da001ccf0 con 0x7f1da8154900 2024-08-17T02:23:08.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.942+0000 7f1d967fc700 1 -- 172.21.15.104:0/3329370398 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da001ce70 con 0x7f1da8154900 2024-08-17T02:23:08.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.942+0000 7f1da759e700 1 -- 172.21.15.104:0/3329370398 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1da80afe60 con 0x7f1da8154900 2024-08-17T02:23:08.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.942+0000 7f1d967fc700 1 -- 172.21.15.104:0/3329370398 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da001a680 con 0x7f1da8154900 2024-08-17T02:23:08.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.942+0000 7f1da759e700 1 -- 172.21.15.104:0/3329370398 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1da80b0420 con 0x7f1da8154900 2024-08-17T02:23:08.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.942+0000 7f1da759e700 1 -- 172.21.15.104:0/3329370398 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1da815aa60 con 0x7f1da8154900 2024-08-17T02:23:08.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.942+0000 7f1d967fc700 1 -- 172.21.15.104:0/3329370398 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1da001aa70 con 0x7f1da8154900 2024-08-17T02:23:08.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.942+0000 7f1d967fc700 1 --2- 172.21.15.104:0/3329370398 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f1d88060860 0x7f1d88062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:08.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.942+0000 7f1d967fc700 1 -- 172.21.15.104:0/3329370398 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1da007e640 con 0x7f1da8154900 2024-08-17T02:23:08.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.942+0000 7f1da659c700 1 --2- 172.21.15.104:0/3329370398 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f1d88060860 0x7f1d88062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:08.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.946+0000 7f1da659c700 1 --2- 172.21.15.104:0/3329370398 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f1d88060860 0x7f1d88062d10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1d98009fd0 tx=0x7f1d9800b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:08.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:08.950+0000 7f1d967fc700 1 -- 172.21.15.104:0/3329370398 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f1da004e9f0 con 0x7f1da8154900 2024-08-17T02:23:09.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.110+0000 7f1da759e700 1 -- 172.21.15.104:0/3329370398 --> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1da80643a0 con 0x7f1d88060860 2024-08-17T02:23:09.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.126+0000 7f1d967fc700 1 -- 172.21.15.104:0/3329370398 <== mgr.4111 v2:172.21.15.117:6832/24084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252713 (secure 0 0 0) 0x7f1da80643a0 con 0x7f1d88060860 2024-08-17T02:23:09.136 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:23:09.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.130+0000 7f1da759e700 1 -- 172.21.15.104:0/3329370398 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f1d88060860 msgr2=0x7f1d88062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:09.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.130+0000 7f1da759e700 1 --2- 172.21.15.104:0/3329370398 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f1d88060860 0x7f1d88062d10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1d98009fd0 tx=0x7f1d9800b040 comp rx=0 tx=0).stop 2024-08-17T02:23:09.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.130+0000 7f1da759e700 1 -- 172.21.15.104:0/3329370398 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1da8154900 msgr2=0x7f1da8069f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:09.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.130+0000 7f1da759e700 1 --2- 172.21.15.104:0/3329370398 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1da8154900 0x7f1da8069f10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1da0002000 tx=0x7f1da0016000 comp rx=0 tx=0).stop 2024-08-17T02:23:09.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.130+0000 7f1da759e700 1 -- 172.21.15.104:0/3329370398 shutdown_connections 2024-08-17T02:23:09.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.130+0000 7f1da759e700 1 --2- 172.21.15.104:0/3329370398 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f1d88060860 0x7f1d88062d10 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:09.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.130+0000 7f1da759e700 1 --2- 172.21.15.104:0/3329370398 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1da8154900 0x7f1da8069f10 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:09.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.130+0000 7f1da759e700 1 --2- 172.21.15.104:0/3329370398 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1da80cb560 0x7f1da80af050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:09.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.130+0000 7f1da759e700 1 --2- 172.21.15.104:0/3329370398 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da80b12d0 0x7f1da8150ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:09.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.130+0000 7f1da759e700 1 -- 172.21.15.104:0/3329370398 >> 172.21.15.104:0/3329370398 conn(0x7f1da80678d0 msgr2=0x7f1da81539e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:09.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.130+0000 7f1da759e700 1 -- 172.21.15.104:0/3329370398 shutdown_connections 2024-08-17T02:23:09.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.130+0000 7f1da759e700 1 -- 172.21.15.104:0/3329370398 wait complete. 2024-08-17T02:23:09.139 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-08-17T02:23:09.152 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-08-17T02:23:08.101694+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":42,"acting":42,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":2386780,"kb_used_data":3720,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752587940,"statfs":{"total":773094113280,"available":770650050560,"internally_reserved":0,"allocated":3809280,"data_stored":2129376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001180"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.111813+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:40.738642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.111204+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:06:05.257382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.113474+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:48:06.171796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.109808+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:32:59.217946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.098901+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.098901+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.115393+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:49:52.717924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.098901+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.112024+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:47:12.840992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.111662+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:42:27.825464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.112115+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:05:16.739251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.098901+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.098901+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.108533+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:53.382969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.110140+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:00:40.234655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.113461+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:30:54.632598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.113679+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:13:24.236218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.098901+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.113464+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:55:36.876547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.113898+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:24:56.230424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.108870+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:24:56.230424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.098901+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.108001+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:12:34.515226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.112789+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:08:17.955266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.098901+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.110393+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:03:48.824519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.098901+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.098901+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.098901+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.098901+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.108691+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:46:05.090766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.112849+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:16:08.488943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":168,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:23:00.250486+0000","last_change":"2024-08-17T02:22:11.967052+0000","last_active":"2024-08-17T02:23:00.250486+0000","last_peered":"2024-08-17T02:23:00.250486+0000","last_clean":"2024-08-17T02:23:00.250486+0000","last_became_active":"2024-08-17T02:22:11.965269+0000","last_became_peered":"2024-08-17T02:22:11.965269+0000","last_unstale":"2024-08-17T02:23:00.250486+0000","last_undegraded":"2024-08-17T02:23:00.250486+0000","last_fullsized":"2024-08-17T02:23:00.250486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:10.930862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:10.930862+0000","last_clean_scrub_stamp":"2024-08-17T02:22:10.930862+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:59:34.931003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":40,"acting":40,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297684,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074156,"statfs":{"total":96636764160,"available":96331935744,"internally_reserved":0,"allocated":327680,"data_stored":118580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509455,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298264,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073576,"statfs":{"total":96636764160,"available":96331341824,"internally_reserved":0,"allocated":921600,"data_stored":708948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]}]},{"osd":4,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297688,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074152,"statfs":{"total":96636764160,"available":96331931648,"internally_reserved":0,"allocated":327680,"data_stored":118580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0780000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297688,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074152,"statfs":{"total":96636764160,"available":96331931648,"internally_reserved":0,"allocated":327680,"data_stored":118580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]}]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297680,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074160,"statfs":{"total":96636764160,"available":96331939840,"internally_reserved":0,"allocated":327680,"data_stored":118580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298260,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073580,"statfs":{"total":96636764160,"available":96331345920,"internally_reserved":0,"allocated":921600,"data_stored":708948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.036}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297680,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074160,"statfs":{"total":96636764160,"available":96331939840,"internally_reserved":0,"allocated":327680,"data_stored":118580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.218}]}]},{"osd":6,"up_from":14,"seq":60129542160,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":301836,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070004,"statfs":{"total":96636764160,"available":96327684096,"internally_reserved":0,"allocated":327680,"data_stored":118580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2190000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0580000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:23:09.157 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:23:09.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.262+0000 7fcf03fff700 1 Processor -- start 2024-08-17T02:23:09.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.262+0000 7fcf03fff700 1 -- start start 2024-08-17T02:23:09.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.266+0000 7fcf03fff700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcf040b0d20 0x7fcf0406df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:09.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.266+0000 7fcf03fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf0406e450 0x7fcf040b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:09.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.266+0000 7fcf03fff700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fcf040b1630 0x7fcf041610f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:09.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.266+0000 7fcf03fff700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf04141a00 con 0x7fcf040b1630 2024-08-17T02:23:09.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.266+0000 7fcf03fff700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf0406e8a0 con 0x7fcf040b0d20 2024-08-17T02:23:09.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.266+0000 7fcf03fff700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf04140b10 con 0x7fcf0406e450 2024-08-17T02:23:09.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.266+0000 7fcf037fe700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fcf040b1630 0x7fcf041610f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:09.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.266+0000 7fcf037fe700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fcf040b1630 0x7fcf041610f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35236/0 (socket says 172.21.15.104:35236) 2024-08-17T02:23:09.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.266+0000 7fcf037fe700 1 -- 172.21.15.104:0/1653703757 learned_addr learned my addr 172.21.15.104:0/1653703757 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:09.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.266+0000 7fcf02ffd700 1 --2- 172.21.15.104:0/1653703757 >> v2:172.21.15.117:3300/0 conn(0x7fcf040b0d20 0x7fcf0406df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:09.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.266+0000 7fcf027fc700 1 --2- 172.21.15.104:0/1653703757 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf0406e450 0x7fcf040b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:09.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.266+0000 7fcf037fe700 1 -- 172.21.15.104:0/1653703757 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf0406e450 msgr2=0x7fcf040b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:09.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.266+0000 7fcf037fe700 1 --2- 172.21.15.104:0/1653703757 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf0406e450 0x7fcf040b10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:09.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.266+0000 7fcf037fe700 1 -- 172.21.15.104:0/1653703757 >> v2:172.21.15.117:3300/0 conn(0x7fcf040b0d20 msgr2=0x7fcf0406df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:09.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.266+0000 7fcf037fe700 1 --2- 172.21.15.104:0/1653703757 >> v2:172.21.15.117:3300/0 conn(0x7fcf040b0d20 0x7fcf0406df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:09.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.266+0000 7fcf037fe700 1 -- 172.21.15.104:0/1653703757 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf04140df0 con 0x7fcf040b1630 2024-08-17T02:23:09.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.266+0000 7fcf02ffd700 1 --2- 172.21.15.104:0/1653703757 >> v2:172.21.15.117:3300/0 conn(0x7fcf040b0d20 0x7fcf0406df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:23:09.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.266+0000 7fcf027fc700 1 --2- 172.21.15.104:0/1653703757 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf0406e450 0x7fcf040b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:23:09.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.266+0000 7fcf037fe700 1 --2- 172.21.15.104:0/1653703757 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf040b1630 0x7fcf041610f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fcf0406bd20 tx=0x7fcefc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a97b21767fba0aca server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:09.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.266+0000 7fcf01ffb700 1 -- 172.21.15.104:0/1653703757 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcefc00e070 con 0x7fcf040b1630 2024-08-17T02:23:09.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.266+0000 7fcf01ffb700 1 -- 172.21.15.104:0/1653703757 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcefc00ba50 con 0x7fcf040b1630 2024-08-17T02:23:09.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.266+0000 7fcf01ffb700 1 -- 172.21.15.104:0/1653703757 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcefc0092e0 con 0x7fcf040b1630 2024-08-17T02:23:09.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.266+0000 7fcf03fff700 1 -- 172.21.15.104:0/1653703757 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf040b1630 msgr2=0x7fcf041610f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:09.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.266+0000 7fcf03fff700 1 --2- 172.21.15.104:0/1653703757 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf040b1630 0x7fcf041610f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fcf0406bd20 tx=0x7fcefc009840 comp rx=0 tx=0).stop 2024-08-17T02:23:09.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.266+0000 7fcf03fff700 1 -- 172.21.15.104:0/1653703757 shutdown_connections 2024-08-17T02:23:09.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.266+0000 7fcf03fff700 1 --2- 172.21.15.104:0/1653703757 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf040b1630 0x7fcf041610f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:09.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.266+0000 7fcf03fff700 1 --2- 172.21.15.104:0/1653703757 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf0406e450 0x7fcf040b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:09.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.266+0000 7fcf03fff700 1 --2- 172.21.15.104:0/1653703757 >> v2:172.21.15.117:3300/0 conn(0x7fcf040b0d20 0x7fcf0406df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:09.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.266+0000 7fcf03fff700 1 -- 172.21.15.104:0/1653703757 >> 172.21.15.104:0/1653703757 conn(0x7fcf040678d0 msgr2=0x7fcf04067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:09.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.266+0000 7fcf03fff700 1 -- 172.21.15.104:0/1653703757 shutdown_connections 2024-08-17T02:23:09.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.266+0000 7fcf03fff700 1 -- 172.21.15.104:0/1653703757 wait complete. 2024-08-17T02:23:09.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.270+0000 7fcf03fff700 1 Processor -- start 2024-08-17T02:23:09.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.270+0000 7fcf03fff700 1 -- start start 2024-08-17T02:23:09.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.270+0000 7fcf03fff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf0406e450 0x7fcf04136050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:09.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.270+0000 7fcf03fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf040b0d20 0x7fcf04141d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:09.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.270+0000 7fcf03fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf040b1630 0x7fcf041422d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:09.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.270+0000 7fcf03fff700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf04154450 con 0x7fcf0406e450 2024-08-17T02:23:09.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.270+0000 7fcf03fff700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf04133860 con 0x7fcf040b1630 2024-08-17T02:23:09.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.270+0000 7fcf03fff700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf04133b40 con 0x7fcf040b0d20 2024-08-17T02:23:09.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.270+0000 7fcf02ffd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf0406e450 0x7fcf04136050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:09.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.270+0000 7fcf02ffd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf0406e450 0x7fcf04136050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35242/0 (socket says 172.21.15.104:35242) 2024-08-17T02:23:09.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.270+0000 7fcf02ffd700 1 -- 172.21.15.104:0/1169621439 learned_addr learned my addr 172.21.15.104:0/1169621439 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:09.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.270+0000 7fcf037fe700 1 --2- 172.21.15.104:0/1169621439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf040b1630 0x7fcf041422d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:09.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.270+0000 7fcf027fc700 1 --2- 172.21.15.104:0/1169621439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf040b0d20 0x7fcf04141d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:09.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.270+0000 7fcf02ffd700 1 -- 172.21.15.104:0/1169621439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf040b0d20 msgr2=0x7fcf04141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:09.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.270+0000 7fcf02ffd700 1 --2- 172.21.15.104:0/1169621439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf040b0d20 0x7fcf04141d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:09.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.270+0000 7fcf02ffd700 1 -- 172.21.15.104:0/1169621439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf040b1630 msgr2=0x7fcf041422d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:09.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.270+0000 7fcf02ffd700 1 --2- 172.21.15.104:0/1169621439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf040b1630 0x7fcf041422d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:09.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.270+0000 7fcf02ffd700 1 -- 172.21.15.104:0/1169621439 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcefc009ae0 con 0x7fcf0406e450 2024-08-17T02:23:09.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.270+0000 7fcf037fe700 1 --2- 172.21.15.104:0/1169621439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf040b1630 0x7fcf041422d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:09.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.270+0000 7fcf02ffd700 1 --2- 172.21.15.104:0/1169621439 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf0406e450 0x7fcf04136050 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fcef400c850 tx=0x7fcef4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:09.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.270+0000 7fcefaffd700 1 -- 172.21.15.104:0/1169621439 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef4011600 con 0x7fcf0406e450 2024-08-17T02:23:09.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.270+0000 7fcefaffd700 1 -- 172.21.15.104:0/1169621439 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef4011760 con 0x7fcf0406e450 2024-08-17T02:23:09.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.270+0000 7fcf03fff700 1 -- 172.21.15.104:0/1169621439 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf04133e20 con 0x7fcf0406e450 2024-08-17T02:23:09.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.270+0000 7fcefaffd700 1 -- 172.21.15.104:0/1169621439 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef4011b00 con 0x7fcf0406e450 2024-08-17T02:23:09.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.270+0000 7fcf03fff700 1 -- 172.21.15.104:0/1169621439 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf04136590 con 0x7fcf0406e450 2024-08-17T02:23:09.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.274+0000 7fcf03fff700 1 -- 172.21.15.104:0/1169621439 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf040643a0 con 0x7fcf0406e450 2024-08-17T02:23:09.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.274+0000 7fcefaffd700 1 -- 172.21.15.104:0/1169621439 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fcef40073b0 con 0x7fcf0406e450 2024-08-17T02:23:09.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.274+0000 7fcefaffd700 1 --2- 172.21.15.104:0/1169621439 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fcee4060860 0x7fcee4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:09.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.274+0000 7fcefaffd700 1 -- 172.21.15.104:0/1169621439 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcef407cf70 con 0x7fcf0406e450 2024-08-17T02:23:09.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.274+0000 7fcf027fc700 1 --2- 172.21.15.104:0/1169621439 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fcee4060860 0x7fcee4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:09.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.274+0000 7fcf027fc700 1 --2- 172.21.15.104:0/1169621439 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fcee4060860 0x7fcee4062d10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcf0415b100 tx=0x7fceec008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:09.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.282+0000 7fcefaffd700 1 -- 172.21.15.104:0/1169621439 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fcef4050db0 con 0x7fcf0406e450 2024-08-17T02:23:09.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.442+0000 7fcf03fff700 1 -- 172.21.15.104:0/1169621439 --> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcf0406f5f0 con 0x7fcee4060860 2024-08-17T02:23:09.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.462+0000 7fcefaffd700 1 -- 172.21.15.104:0/1169621439 <== mgr.4111 v2:172.21.15.117:6832/24084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252713 (secure 0 0 0) 0x7fcf0406f5f0 con 0x7fcee4060860 2024-08-17T02:23:09.470 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:23:09.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.466+0000 7fcf03fff700 1 -- 172.21.15.104:0/1169621439 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fcee4060860 msgr2=0x7fcee4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:09.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.466+0000 7fcf03fff700 1 --2- 172.21.15.104:0/1169621439 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fcee4060860 0x7fcee4062d10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcf0415b100 tx=0x7fceec008040 comp rx=0 tx=0).stop 2024-08-17T02:23:09.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.466+0000 7fcf03fff700 1 -- 172.21.15.104:0/1169621439 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf0406e450 msgr2=0x7fcf04136050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:09.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.466+0000 7fcf03fff700 1 --2- 172.21.15.104:0/1169621439 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf0406e450 0x7fcf04136050 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fcef400c850 tx=0x7fcef4008040 comp rx=0 tx=0).stop 2024-08-17T02:23:09.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.466+0000 7fcf03fff700 1 -- 172.21.15.104:0/1169621439 shutdown_connections 2024-08-17T02:23:09.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.466+0000 7fcf03fff700 1 --2- 172.21.15.104:0/1169621439 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fcee4060860 0x7fcee4062d10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:09.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.466+0000 7fcf03fff700 1 --2- 172.21.15.104:0/1169621439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf040b1630 0x7fcf041422d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:09.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.466+0000 7fcf03fff700 1 --2- 172.21.15.104:0/1169621439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf040b0d20 0x7fcf04141d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:09.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.466+0000 7fcf03fff700 1 --2- 172.21.15.104:0/1169621439 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf0406e450 0x7fcf04136050 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:09.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.466+0000 7fcf03fff700 1 -- 172.21.15.104:0/1169621439 >> 172.21.15.104:0/1169621439 conn(0x7fcf040678d0 msgr2=0x7fcf0415cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:09.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.466+0000 7fcf03fff700 1 -- 172.21.15.104:0/1169621439 shutdown_connections 2024-08-17T02:23:09.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.466+0000 7fcf03fff700 1 -- 172.21.15.104:0/1169621439 wait complete. 2024-08-17T02:23:09.474 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-08-17T02:23:09.486 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-08-17T02:23:08.101694+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":42,"acting":42,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":2386780,"kb_used_data":3720,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752587940,"statfs":{"total":773094113280,"available":770650050560,"internally_reserved":0,"allocated":3809280,"data_stored":2129376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001180"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.111813+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:40.738642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.111204+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:06:05.257382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.113474+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:48:06.171796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.109808+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:32:59.217946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.098901+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.098901+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.115393+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:49:52.717924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.098901+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.112024+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:47:12.840992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.111662+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:42:27.825464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.112115+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:05:16.739251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.098901+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.098901+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.108533+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:53.382969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.110140+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:00:40.234655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.113461+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:30:54.632598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.113679+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:13:24.236218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.098901+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.113464+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:55:36.876547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.113898+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:24:56.230424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.108870+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:24:56.230424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.098901+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.108001+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:12:34.515226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.112789+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:08:17.955266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.098901+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.110393+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:03:48.824519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.098901+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.098901+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.098901+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.098901+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.108691+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:46:05.090766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.112849+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:16:08.488943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":168,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:23:00.250486+0000","last_change":"2024-08-17T02:22:11.967052+0000","last_active":"2024-08-17T02:23:00.250486+0000","last_peered":"2024-08-17T02:23:00.250486+0000","last_clean":"2024-08-17T02:23:00.250486+0000","last_became_active":"2024-08-17T02:22:11.965269+0000","last_became_peered":"2024-08-17T02:22:11.965269+0000","last_unstale":"2024-08-17T02:23:00.250486+0000","last_undegraded":"2024-08-17T02:23:00.250486+0000","last_fullsized":"2024-08-17T02:23:00.250486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:10.930862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:10.930862+0000","last_clean_scrub_stamp":"2024-08-17T02:22:10.930862+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:59:34.931003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":40,"acting":40,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297684,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074156,"statfs":{"total":96636764160,"available":96331935744,"internally_reserved":0,"allocated":327680,"data_stored":118580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509455,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298264,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073576,"statfs":{"total":96636764160,"available":96331341824,"internally_reserved":0,"allocated":921600,"data_stored":708948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]}]},{"osd":4,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297688,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074152,"statfs":{"total":96636764160,"available":96331931648,"internally_reserved":0,"allocated":327680,"data_stored":118580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0780000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297688,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074152,"statfs":{"total":96636764160,"available":96331931648,"internally_reserved":0,"allocated":327680,"data_stored":118580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]}]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297680,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074160,"statfs":{"total":96636764160,"available":96331939840,"internally_reserved":0,"allocated":327680,"data_stored":118580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298260,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073580,"statfs":{"total":96636764160,"available":96331345920,"internally_reserved":0,"allocated":921600,"data_stored":708948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.036}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297680,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074160,"statfs":{"total":96636764160,"available":96331939840,"internally_reserved":0,"allocated":327680,"data_stored":118580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.218}]}]},{"osd":6,"up_from":14,"seq":60129542160,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":301836,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070004,"statfs":{"total":96636764160,"available":96327684096,"internally_reserved":0,"allocated":327680,"data_stored":118580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2190000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0580000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:23:09.493 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:23:09.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.594+0000 7feb9f129700 1 Processor -- start 2024-08-17T02:23:09.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.594+0000 7feb9f129700 1 -- start start 2024-08-17T02:23:09.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.594+0000 7feb9f129700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7feb980b0d20 0x7feb9806df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:09.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.594+0000 7feb9f129700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7feb9806e450 0x7feb980b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:09.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.594+0000 7feb9f129700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb980b1630 0x7feb981610f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:09.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.594+0000 7feb9f129700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb98141a00 con 0x7feb9806e450 2024-08-17T02:23:09.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.594+0000 7feb9f129700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb9806e8a0 con 0x7feb980b0d20 2024-08-17T02:23:09.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.594+0000 7feb9f129700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb98140b10 con 0x7feb980b1630 2024-08-17T02:23:09.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.594+0000 7feb9d926700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7feb9806e450 0x7feb980b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:09.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.594+0000 7feb9d926700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7feb9806e450 0x7feb980b10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35250/0 (socket says 172.21.15.104:35250) 2024-08-17T02:23:09.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.594+0000 7feb9d926700 1 -- 172.21.15.104:0/3804305306 learned_addr learned my addr 172.21.15.104:0/3804305306 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:09.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.594+0000 7feb9e127700 1 --2- 172.21.15.104:0/3804305306 >> v2:172.21.15.117:3300/0 conn(0x7feb980b0d20 0x7feb9806df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:09.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.594+0000 7feb9e928700 1 --2- 172.21.15.104:0/3804305306 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb980b1630 0x7feb981610f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:09.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.594+0000 7feb9d926700 1 -- 172.21.15.104:0/3804305306 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb980b1630 msgr2=0x7feb981610f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:09.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.594+0000 7feb9d926700 1 --2- 172.21.15.104:0/3804305306 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb980b1630 0x7feb981610f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:09.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.594+0000 7feb9d926700 1 -- 172.21.15.104:0/3804305306 >> v2:172.21.15.117:3300/0 conn(0x7feb980b0d20 msgr2=0x7feb9806df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:09.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.594+0000 7feb9d926700 1 --2- 172.21.15.104:0/3804305306 >> v2:172.21.15.117:3300/0 conn(0x7feb980b0d20 0x7feb9806df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:09.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.594+0000 7feb9d926700 1 -- 172.21.15.104:0/3804305306 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb98140df0 con 0x7feb9806e450 2024-08-17T02:23:09.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.594+0000 7feb9d926700 1 --2- 172.21.15.104:0/3804305306 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb9806e450 0x7feb980b10f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7feb9806bd20 tx=0x7feb90009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b4f39884f588d28 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:09.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.594+0000 7feb9d125700 1 -- 172.21.15.104:0/3804305306 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9000e070 con 0x7feb9806e450 2024-08-17T02:23:09.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.594+0000 7feb9d125700 1 -- 172.21.15.104:0/3804305306 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9000ba50 con 0x7feb9806e450 2024-08-17T02:23:09.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.594+0000 7feb9d125700 1 -- 172.21.15.104:0/3804305306 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb900092e0 con 0x7feb9806e450 2024-08-17T02:23:09.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.598+0000 7feb9f129700 1 -- 172.21.15.104:0/3804305306 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb9806e450 msgr2=0x7feb980b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:09.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.598+0000 7feb9f129700 1 --2- 172.21.15.104:0/3804305306 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb9806e450 0x7feb980b10f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7feb9806bd20 tx=0x7feb90009840 comp rx=0 tx=0).stop 2024-08-17T02:23:09.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.598+0000 7feb9f129700 1 -- 172.21.15.104:0/3804305306 shutdown_connections 2024-08-17T02:23:09.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.598+0000 7feb9f129700 1 --2- 172.21.15.104:0/3804305306 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb980b1630 0x7feb981610f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:09.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.598+0000 7feb9f129700 1 --2- 172.21.15.104:0/3804305306 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb9806e450 0x7feb980b10f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:09.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.598+0000 7feb9f129700 1 --2- 172.21.15.104:0/3804305306 >> v2:172.21.15.117:3300/0 conn(0x7feb980b0d20 0x7feb9806df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:09.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.598+0000 7feb9f129700 1 -- 172.21.15.104:0/3804305306 >> 172.21.15.104:0/3804305306 conn(0x7feb980678d0 msgr2=0x7feb98067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:09.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.598+0000 7feb9f129700 1 -- 172.21.15.104:0/3804305306 shutdown_connections 2024-08-17T02:23:09.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.598+0000 7feb9f129700 1 -- 172.21.15.104:0/3804305306 wait complete. 2024-08-17T02:23:09.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.598+0000 7feb9f129700 1 Processor -- start 2024-08-17T02:23:09.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.598+0000 7feb9f129700 1 -- start start 2024-08-17T02:23:09.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.602+0000 7feb9f129700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb9806e450 0x7feb98146a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:09.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.602+0000 7feb9f129700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb980b0d20 0x7feb98171320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:09.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.602+0000 7feb9f129700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb980b1630 0x7feb98171860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:09.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.602+0000 7feb9f129700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb98146140 con 0x7feb9806e450 2024-08-17T02:23:09.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.602+0000 7feb9f129700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb98157d10 con 0x7feb980b1630 2024-08-17T02:23:09.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.602+0000 7feb9f129700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb9816f0b0 con 0x7feb980b0d20 2024-08-17T02:23:09.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.602+0000 7feb9e127700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb9806e450 0x7feb98146a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:09.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.602+0000 7feb9e127700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb9806e450 0x7feb98146a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35256/0 (socket says 172.21.15.104:35256) 2024-08-17T02:23:09.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.602+0000 7feb9e127700 1 -- 172.21.15.104:0/2055558104 learned_addr learned my addr 172.21.15.104:0/2055558104 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:09.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.602+0000 7feb9d926700 1 --2- 172.21.15.104:0/2055558104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb980b0d20 0x7feb98171320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:09.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.602+0000 7feb9e928700 1 --2- 172.21.15.104:0/2055558104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb980b1630 0x7feb98171860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:09.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.602+0000 7feb9e127700 1 -- 172.21.15.104:0/2055558104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb980b0d20 msgr2=0x7feb98171320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:09.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.602+0000 7feb9e127700 1 --2- 172.21.15.104:0/2055558104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb980b0d20 0x7feb98171320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:09.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.602+0000 7feb9e127700 1 -- 172.21.15.104:0/2055558104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb980b1630 msgr2=0x7feb98171860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:09.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.602+0000 7feb9e127700 1 --2- 172.21.15.104:0/2055558104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb980b1630 0x7feb98171860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:09.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.602+0000 7feb9e127700 1 -- 172.21.15.104:0/2055558104 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb90009ae0 con 0x7feb9806e450 2024-08-17T02:23:09.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.602+0000 7feb9e127700 1 --2- 172.21.15.104:0/2055558104 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb9806e450 0x7feb98146a90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7feb8800d860 tx=0x7feb88008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:09.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.602+0000 7feb8e7fc700 1 -- 172.21.15.104:0/2055558104 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb880125f0 con 0x7feb9806e450 2024-08-17T02:23:09.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.602+0000 7feb8e7fc700 1 -- 172.21.15.104:0/2055558104 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb88012750 con 0x7feb9806e450 2024-08-17T02:23:09.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.602+0000 7feb9f129700 1 -- 172.21.15.104:0/2055558104 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb98157470 con 0x7feb9806e450 2024-08-17T02:23:09.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.602+0000 7feb8e7fc700 1 -- 172.21.15.104:0/2055558104 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb88012b10 con 0x7feb9806e450 2024-08-17T02:23:09.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.602+0000 7feb9f129700 1 -- 172.21.15.104:0/2055558104 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb98157a30 con 0x7feb9806e450 2024-08-17T02:23:09.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.606+0000 7feb9f129700 1 -- 172.21.15.104:0/2055558104 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb9806f5f0 con 0x7feb9806e450 2024-08-17T02:23:09.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.606+0000 7feb8e7fc700 1 -- 172.21.15.104:0/2055558104 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7feb8801e460 con 0x7feb9806e450 2024-08-17T02:23:09.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.606+0000 7feb8e7fc700 1 --2- 172.21.15.104:0/2055558104 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7feb7c060860 0x7feb7c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:09.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.606+0000 7feb8e7fc700 1 -- 172.21.15.104:0/2055558104 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7feb8807d160 con 0x7feb9806e450 2024-08-17T02:23:09.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.606+0000 7feb9d926700 1 --2- 172.21.15.104:0/2055558104 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7feb7c060860 0x7feb7c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:09.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.606+0000 7feb9d926700 1 --2- 172.21.15.104:0/2055558104 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7feb7c060860 0x7feb7c062d10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7feb90009880 tx=0x7feb90018000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:09.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.610+0000 7feb8e7fc700 1 -- 172.21.15.104:0/2055558104 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7feb8804d510 con 0x7feb9806e450 2024-08-17T02:23:09.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.770+0000 7feb9f129700 1 -- 172.21.15.104:0/2055558104 --> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feb9806ebc0 con 0x7feb7c060860 2024-08-17T02:23:09.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.786+0000 7feb8e7fc700 1 -- 172.21.15.104:0/2055558104 <== mgr.4111 v2:172.21.15.117:6832/24084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252713 (secure 0 0 0) 0x7feb9806ebc0 con 0x7feb7c060860 2024-08-17T02:23:09.797 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:23:09.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.790+0000 7feb9f129700 1 -- 172.21.15.104:0/2055558104 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7feb7c060860 msgr2=0x7feb7c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:09.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.790+0000 7feb9f129700 1 --2- 172.21.15.104:0/2055558104 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7feb7c060860 0x7feb7c062d10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7feb90009880 tx=0x7feb90018000 comp rx=0 tx=0).stop 2024-08-17T02:23:09.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.790+0000 7feb9f129700 1 -- 172.21.15.104:0/2055558104 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb9806e450 msgr2=0x7feb98146a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:09.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.790+0000 7feb9f129700 1 --2- 172.21.15.104:0/2055558104 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb9806e450 0x7feb98146a90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7feb8800d860 tx=0x7feb88008040 comp rx=0 tx=0).stop 2024-08-17T02:23:09.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.790+0000 7feb9f129700 1 -- 172.21.15.104:0/2055558104 shutdown_connections 2024-08-17T02:23:09.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.790+0000 7feb9f129700 1 --2- 172.21.15.104:0/2055558104 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7feb7c060860 0x7feb7c062d10 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:09.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.790+0000 7feb9f129700 1 --2- 172.21.15.104:0/2055558104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb980b1630 0x7feb98171860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:09.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.790+0000 7feb9f129700 1 --2- 172.21.15.104:0/2055558104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb980b0d20 0x7feb98171320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:09.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.790+0000 7feb9f129700 1 --2- 172.21.15.104:0/2055558104 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb9806e450 0x7feb98146a90 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:09.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.790+0000 7feb9f129700 1 -- 172.21.15.104:0/2055558104 >> 172.21.15.104:0/2055558104 conn(0x7feb980678d0 msgr2=0x7feb9815de30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:09.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.790+0000 7feb9f129700 1 -- 172.21.15.104:0/2055558104 shutdown_connections 2024-08-17T02:23:09.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.790+0000 7feb9f129700 1 -- 172.21.15.104:0/2055558104 wait complete. 2024-08-17T02:23:09.803 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-08-17T02:23:09.810 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-08-17T02:23:08.101694+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":42,"acting":42,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":2386780,"kb_used_data":3720,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752587940,"statfs":{"total":773094113280,"available":770650050560,"internally_reserved":0,"allocated":3809280,"data_stored":2129376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001180"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.111813+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:40.738642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.111204+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:06:05.257382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.113474+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:48:06.171796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.109808+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:32:59.217946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.098901+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.098901+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.115393+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:49:52.717924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.098901+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.112024+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:47:12.840992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.111662+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:42:27.825464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.112115+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:05:16.739251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.098901+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.098901+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.108533+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:53.382969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.110140+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:00:40.234655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.113461+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:30:54.632598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.113679+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:13:24.236218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.098901+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.113464+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:55:36.876547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.113898+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:24:56.230424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.108870+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:24:56.230424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.098901+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.108001+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:12:34.515226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.112789+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:08:17.955266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.098901+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.110393+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:03:48.824519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.098901+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.098901+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.098901+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.098901+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.108691+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:46:05.090766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:23:05.101776+0000","last_change":"2024-08-17T02:23:05.101776+0000","last_active":"2024-08-17T02:23:05.101776+0000","last_peered":"2024-08-17T02:23:05.101776+0000","last_clean":"2024-08-17T02:23:05.101776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:05.101776+0000","last_undegraded":"2024-08-17T02:23:05.101776+0000","last_fullsized":"2024-08-17T02:23:05.101776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:23:04.098901+0000","last_change":"2024-08-17T02:23:04.112849+0000","last_active":"2024-08-17T02:23:04.098901+0000","last_peered":"2024-08-17T02:23:04.098901+0000","last_clean":"2024-08-17T02:23:04.098901+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:23:04.098901+0000","last_undegraded":"2024-08-17T02:23:04.098901+0000","last_fullsized":"2024-08-17T02:23:04.098901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:16:08.488943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":168,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:23:00.250486+0000","last_change":"2024-08-17T02:22:11.967052+0000","last_active":"2024-08-17T02:23:00.250486+0000","last_peered":"2024-08-17T02:23:00.250486+0000","last_clean":"2024-08-17T02:23:00.250486+0000","last_became_active":"2024-08-17T02:22:11.965269+0000","last_became_peered":"2024-08-17T02:22:11.965269+0000","last_unstale":"2024-08-17T02:23:00.250486+0000","last_undegraded":"2024-08-17T02:23:00.250486+0000","last_fullsized":"2024-08-17T02:23:00.250486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:10.930862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:10.930862+0000","last_clean_scrub_stamp":"2024-08-17T02:22:10.930862+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:59:34.931003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":40,"acting":40,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297684,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074156,"statfs":{"total":96636764160,"available":96331935744,"internally_reserved":0,"allocated":327680,"data_stored":118580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509455,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298264,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073576,"statfs":{"total":96636764160,"available":96331341824,"internally_reserved":0,"allocated":921600,"data_stored":708948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]}]},{"osd":4,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297688,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074152,"statfs":{"total":96636764160,"available":96331931648,"internally_reserved":0,"allocated":327680,"data_stored":118580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0780000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297688,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074152,"statfs":{"total":96636764160,"available":96331931648,"internally_reserved":0,"allocated":327680,"data_stored":118580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]}]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297680,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074160,"statfs":{"total":96636764160,"available":96331939840,"internally_reserved":0,"allocated":327680,"data_stored":118580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298260,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073580,"statfs":{"total":96636764160,"available":96331345920,"internally_reserved":0,"allocated":921600,"data_stored":708948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.036}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297680,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074160,"statfs":{"total":96636764160,"available":96331939840,"internally_reserved":0,"allocated":327680,"data_stored":118580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.218}]}]},{"osd":6,"up_from":14,"seq":60129542160,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":301836,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070004,"statfs":{"total":96636764160,"available":96327684096,"internally_reserved":0,"allocated":327680,"data_stored":118580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2190000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0580000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:23:09.814 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2024-08-17T02:23:09.814 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.814 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2024-08-17T02:23:09.815 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.815 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2024-08-17T02:23:09.815 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.815 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2024-08-17T02:23:09.815 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.815 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2024-08-17T02:23:09.815 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.815 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2024-08-17T02:23:09.815 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.815 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2024-08-17T02:23:09.815 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2024-08-17T02:23:09.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2024-08-17T02:23:09.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2024-08-17T02:23:09.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2024-08-17T02:23:09.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2024-08-17T02:23:09.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2024-08-17T02:23:09.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2024-08-17T02:23:09.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2024-08-17T02:23:09.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2024-08-17T02:23:09.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2024-08-17T02:23:09.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2024-08-17T02:23:09.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2024-08-17T02:23:09.818 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2024-08-17T02:23:09.818 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2024-08-17T02:23:09.818 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2024-08-17T02:23:09.818 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2024-08-17T02:23:09.818 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2024-08-17T02:23:09.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2024-08-17T02:23:09.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2024-08-17T02:23:09.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2024-08-17T02:23:09.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2024-08-17T02:23:09.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2024-08-17T02:23:09.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.820 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2024-08-17T02:23:09.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.820 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2024-08-17T02:23:09.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.820 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2024-08-17T02:23:09.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.820 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2024-08-17T02:23:09.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.820 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2024-08-17T02:23:09.821 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:23:04.098901+0000', 'last_change': '2024-08-17T02:23:04.111813+0000', 'last_active': '2024-08-17T02:23:04.098901+0000', 'last_peered': '2024-08-17T02:23:04.098901+0000', 'last_clean': '2024-08-17T02:23:04.098901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:04.098901+0000', 'last_undegraded': '2024-08-17T02:23:04.098901+0000', 'last_fullsized': '2024-08-17T02:23:04.098901+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T12:33:40.738642+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-17T02:23:09.821 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2024-08-17T02:23:09.821 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.821 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2024-08-17T02:23:09.821 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:23:04.098901+0000', 'last_change': '2024-08-17T02:23:04.111204+0000', 'last_active': '2024-08-17T02:23:04.098901+0000', 'last_peered': '2024-08-17T02:23:04.098901+0000', 'last_clean': '2024-08-17T02:23:04.098901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:04.098901+0000', 'last_undegraded': '2024-08-17T02:23:04.098901+0000', 'last_fullsized': '2024-08-17T02:23:04.098901+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T03:06:05.257382+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-08-17T02:23:09.821 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2024-08-17T02:23:09.821 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.821 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2024-08-17T02:23:09.821 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:23:04.098901+0000', 'last_change': '2024-08-17T02:23:04.113474+0000', 'last_active': '2024-08-17T02:23:04.098901+0000', 'last_peered': '2024-08-17T02:23:04.098901+0000', 'last_clean': '2024-08-17T02:23:04.098901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:04.098901+0000', 'last_undegraded': '2024-08-17T02:23:04.098901+0000', 'last_fullsized': '2024-08-17T02:23:04.098901+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T13:48:06.171796+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-17T02:23:09.822 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2024-08-17T02:23:09.822 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.822 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2024-08-17T02:23:09.822 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:23:04.098901+0000', 'last_change': '2024-08-17T02:23:04.109808+0000', 'last_active': '2024-08-17T02:23:04.098901+0000', 'last_peered': '2024-08-17T02:23:04.098901+0000', 'last_clean': '2024-08-17T02:23:04.098901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:04.098901+0000', 'last_undegraded': '2024-08-17T02:23:04.098901+0000', 'last_fullsized': '2024-08-17T02:23:04.098901+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T12:32:59.217946+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-08-17T02:23:09.822 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2024-08-17T02:23:09.822 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.822 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2024-08-17T02:23:09.822 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:04.098901+0000', 'last_change': '2024-08-17T02:23:04.098901+0000', 'last_active': '2024-08-17T02:23:04.098901+0000', 'last_peered': '2024-08-17T02:23:04.098901+0000', 'last_clean': '2024-08-17T02:23:04.098901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:04.098901+0000', 'last_undegraded': '2024-08-17T02:23:04.098901+0000', 'last_fullsized': '2024-08-17T02:23:04.098901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.822 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2024-08-17T02:23:09.822 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.823 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2024-08-17T02:23:09.823 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:04.098901+0000', 'last_change': '2024-08-17T02:23:04.098901+0000', 'last_active': '2024-08-17T02:23:04.098901+0000', 'last_peered': '2024-08-17T02:23:04.098901+0000', 'last_clean': '2024-08-17T02:23:04.098901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:04.098901+0000', 'last_undegraded': '2024-08-17T02:23:04.098901+0000', 'last_fullsized': '2024-08-17T02:23:04.098901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.823 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2024-08-17T02:23:09.823 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.823 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2024-08-17T02:23:09.823 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:23:04.098901+0000', 'last_change': '2024-08-17T02:23:04.115393+0000', 'last_active': '2024-08-17T02:23:04.098901+0000', 'last_peered': '2024-08-17T02:23:04.098901+0000', 'last_clean': '2024-08-17T02:23:04.098901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:04.098901+0000', 'last_undegraded': '2024-08-17T02:23:04.098901+0000', 'last_fullsized': '2024-08-17T02:23:04.098901+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T10:49:52.717924+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-17T02:23:09.823 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2024-08-17T02:23:09.823 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.823 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2024-08-17T02:23:09.823 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:04.098901+0000', 'last_change': '2024-08-17T02:23:04.098901+0000', 'last_active': '2024-08-17T02:23:04.098901+0000', 'last_peered': '2024-08-17T02:23:04.098901+0000', 'last_clean': '2024-08-17T02:23:04.098901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:04.098901+0000', 'last_undegraded': '2024-08-17T02:23:04.098901+0000', 'last_fullsized': '2024-08-17T02:23:04.098901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.824 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2024-08-17T02:23:09.824 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.824 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2024-08-17T02:23:09.824 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:23:04.098901+0000', 'last_change': '2024-08-17T02:23:04.112024+0000', 'last_active': '2024-08-17T02:23:04.098901+0000', 'last_peered': '2024-08-17T02:23:04.098901+0000', 'last_clean': '2024-08-17T02:23:04.098901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:04.098901+0000', 'last_undegraded': '2024-08-17T02:23:04.098901+0000', 'last_fullsized': '2024-08-17T02:23:04.098901+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T09:47:12.840992+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-17T02:23:09.824 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2024-08-17T02:23:09.824 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.824 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2024-08-17T02:23:09.824 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:23:04.098901+0000', 'last_change': '2024-08-17T02:23:04.111662+0000', 'last_active': '2024-08-17T02:23:04.098901+0000', 'last_peered': '2024-08-17T02:23:04.098901+0000', 'last_clean': '2024-08-17T02:23:04.098901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:04.098901+0000', 'last_undegraded': '2024-08-17T02:23:04.098901+0000', 'last_fullsized': '2024-08-17T02:23:04.098901+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T12:42:27.825464+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-17T02:23:09.824 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2024-08-17T02:23:09.825 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.825 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2024-08-17T02:23:09.825 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:23:04.098901+0000', 'last_change': '2024-08-17T02:23:04.112115+0000', 'last_active': '2024-08-17T02:23:04.098901+0000', 'last_peered': '2024-08-17T02:23:04.098901+0000', 'last_clean': '2024-08-17T02:23:04.098901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:04.098901+0000', 'last_undegraded': '2024-08-17T02:23:04.098901+0000', 'last_fullsized': '2024-08-17T02:23:04.098901+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T14:05:16.739251+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-17T02:23:09.825 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2024-08-17T02:23:09.825 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.825 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2024-08-17T02:23:09.825 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:04.098901+0000', 'last_change': '2024-08-17T02:23:04.098901+0000', 'last_active': '2024-08-17T02:23:04.098901+0000', 'last_peered': '2024-08-17T02:23:04.098901+0000', 'last_clean': '2024-08-17T02:23:04.098901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:04.098901+0000', 'last_undegraded': '2024-08-17T02:23:04.098901+0000', 'last_fullsized': '2024-08-17T02:23:04.098901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.825 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2024-08-17T02:23:09.825 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.825 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2024-08-17T02:23:09.826 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:04.098901+0000', 'last_change': '2024-08-17T02:23:04.098901+0000', 'last_active': '2024-08-17T02:23:04.098901+0000', 'last_peered': '2024-08-17T02:23:04.098901+0000', 'last_clean': '2024-08-17T02:23:04.098901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:04.098901+0000', 'last_undegraded': '2024-08-17T02:23:04.098901+0000', 'last_fullsized': '2024-08-17T02:23:04.098901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.826 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2024-08-17T02:23:09.826 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.826 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2024-08-17T02:23:09.826 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:23:04.098901+0000', 'last_change': '2024-08-17T02:23:04.108533+0000', 'last_active': '2024-08-17T02:23:04.098901+0000', 'last_peered': '2024-08-17T02:23:04.098901+0000', 'last_clean': '2024-08-17T02:23:04.098901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:04.098901+0000', 'last_undegraded': '2024-08-17T02:23:04.098901+0000', 'last_fullsized': '2024-08-17T02:23:04.098901+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T05:00:53.382969+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-08-17T02:23:09.826 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2024-08-17T02:23:09.826 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.826 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2024-08-17T02:23:09.826 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:23:04.098901+0000', 'last_change': '2024-08-17T02:23:04.110140+0000', 'last_active': '2024-08-17T02:23:04.098901+0000', 'last_peered': '2024-08-17T02:23:04.098901+0000', 'last_clean': '2024-08-17T02:23:04.098901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:04.098901+0000', 'last_undegraded': '2024-08-17T02:23:04.098901+0000', 'last_fullsized': '2024-08-17T02:23:04.098901+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T14:00:40.234655+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-08-17T02:23:09.826 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2024-08-17T02:23:09.827 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.827 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2024-08-17T02:23:09.827 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:23:04.098901+0000', 'last_change': '2024-08-17T02:23:04.113461+0000', 'last_active': '2024-08-17T02:23:04.098901+0000', 'last_peered': '2024-08-17T02:23:04.098901+0000', 'last_clean': '2024-08-17T02:23:04.098901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:04.098901+0000', 'last_undegraded': '2024-08-17T02:23:04.098901+0000', 'last_fullsized': '2024-08-17T02:23:04.098901+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T09:30:54.632598+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-17T02:23:09.827 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2024-08-17T02:23:09.827 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.827 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2024-08-17T02:23:09.827 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:23:04.098901+0000', 'last_change': '2024-08-17T02:23:04.113679+0000', 'last_active': '2024-08-17T02:23:04.098901+0000', 'last_peered': '2024-08-17T02:23:04.098901+0000', 'last_clean': '2024-08-17T02:23:04.098901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:04.098901+0000', 'last_undegraded': '2024-08-17T02:23:04.098901+0000', 'last_fullsized': '2024-08-17T02:23:04.098901+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T06:13:24.236218+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-17T02:23:09.827 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2024-08-17T02:23:09.827 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.827 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2024-08-17T02:23:09.827 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:04.098901+0000', 'last_change': '2024-08-17T02:23:04.098901+0000', 'last_active': '2024-08-17T02:23:04.098901+0000', 'last_peered': '2024-08-17T02:23:04.098901+0000', 'last_clean': '2024-08-17T02:23:04.098901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:04.098901+0000', 'last_undegraded': '2024-08-17T02:23:04.098901+0000', 'last_fullsized': '2024-08-17T02:23:04.098901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.828 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2024-08-17T02:23:09.828 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.828 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2024-08-17T02:23:09.828 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:23:04.098901+0000', 'last_change': '2024-08-17T02:23:04.113464+0000', 'last_active': '2024-08-17T02:23:04.098901+0000', 'last_peered': '2024-08-17T02:23:04.098901+0000', 'last_clean': '2024-08-17T02:23:04.098901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:04.098901+0000', 'last_undegraded': '2024-08-17T02:23:04.098901+0000', 'last_fullsized': '2024-08-17T02:23:04.098901+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T05:55:36.876547+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-17T02:23:09.828 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2024-08-17T02:23:09.828 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.828 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2024-08-17T02:23:09.828 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:23:04.098901+0000', 'last_change': '2024-08-17T02:23:04.113898+0000', 'last_active': '2024-08-17T02:23:04.098901+0000', 'last_peered': '2024-08-17T02:23:04.098901+0000', 'last_clean': '2024-08-17T02:23:04.098901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:04.098901+0000', 'last_undegraded': '2024-08-17T02:23:04.098901+0000', 'last_fullsized': '2024-08-17T02:23:04.098901+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T05:24:56.230424+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-17T02:23:09.828 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2024-08-17T02:23:09.828 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.829 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2024-08-17T02:23:09.829 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:23:04.098901+0000', 'last_change': '2024-08-17T02:23:04.108870+0000', 'last_active': '2024-08-17T02:23:04.098901+0000', 'last_peered': '2024-08-17T02:23:04.098901+0000', 'last_clean': '2024-08-17T02:23:04.098901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:04.098901+0000', 'last_undegraded': '2024-08-17T02:23:04.098901+0000', 'last_fullsized': '2024-08-17T02:23:04.098901+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T05:24:56.230424+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-17T02:23:09.829 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2024-08-17T02:23:09.829 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.829 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2024-08-17T02:23:09.829 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:04.098901+0000', 'last_change': '2024-08-17T02:23:04.098901+0000', 'last_active': '2024-08-17T02:23:04.098901+0000', 'last_peered': '2024-08-17T02:23:04.098901+0000', 'last_clean': '2024-08-17T02:23:04.098901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:04.098901+0000', 'last_undegraded': '2024-08-17T02:23:04.098901+0000', 'last_fullsized': '2024-08-17T02:23:04.098901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.829 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2024-08-17T02:23:09.829 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.829 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2024-08-17T02:23:09.829 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:23:04.098901+0000', 'last_change': '2024-08-17T02:23:04.108001+0000', 'last_active': '2024-08-17T02:23:04.098901+0000', 'last_peered': '2024-08-17T02:23:04.098901+0000', 'last_clean': '2024-08-17T02:23:04.098901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:04.098901+0000', 'last_undegraded': '2024-08-17T02:23:04.098901+0000', 'last_fullsized': '2024-08-17T02:23:04.098901+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T11:12:34.515226+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-17T02:23:09.830 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2024-08-17T02:23:09.830 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.830 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2024-08-17T02:23:09.830 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:23:04.098901+0000', 'last_change': '2024-08-17T02:23:04.112789+0000', 'last_active': '2024-08-17T02:23:04.098901+0000', 'last_peered': '2024-08-17T02:23:04.098901+0000', 'last_clean': '2024-08-17T02:23:04.098901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:04.098901+0000', 'last_undegraded': '2024-08-17T02:23:04.098901+0000', 'last_fullsized': '2024-08-17T02:23:04.098901+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T14:08:17.955266+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-17T02:23:09.830 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2024-08-17T02:23:09.830 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.830 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2024-08-17T02:23:09.830 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:04.098901+0000', 'last_change': '2024-08-17T02:23:04.098901+0000', 'last_active': '2024-08-17T02:23:04.098901+0000', 'last_peered': '2024-08-17T02:23:04.098901+0000', 'last_clean': '2024-08-17T02:23:04.098901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:04.098901+0000', 'last_undegraded': '2024-08-17T02:23:04.098901+0000', 'last_fullsized': '2024-08-17T02:23:04.098901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.830 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2024-08-17T02:23:09.830 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.830 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2024-08-17T02:23:09.831 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:23:04.098901+0000', 'last_change': '2024-08-17T02:23:04.110393+0000', 'last_active': '2024-08-17T02:23:04.098901+0000', 'last_peered': '2024-08-17T02:23:04.098901+0000', 'last_clean': '2024-08-17T02:23:04.098901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:04.098901+0000', 'last_undegraded': '2024-08-17T02:23:04.098901+0000', 'last_fullsized': '2024-08-17T02:23:04.098901+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T14:03:48.824519+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-17T02:23:09.831 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2024-08-17T02:23:09.831 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.831 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2024-08-17T02:23:09.831 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:04.098901+0000', 'last_change': '2024-08-17T02:23:04.098901+0000', 'last_active': '2024-08-17T02:23:04.098901+0000', 'last_peered': '2024-08-17T02:23:04.098901+0000', 'last_clean': '2024-08-17T02:23:04.098901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:04.098901+0000', 'last_undegraded': '2024-08-17T02:23:04.098901+0000', 'last_fullsized': '2024-08-17T02:23:04.098901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.831 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2024-08-17T02:23:09.831 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.831 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2024-08-17T02:23:09.831 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:04.098901+0000', 'last_change': '2024-08-17T02:23:04.098901+0000', 'last_active': '2024-08-17T02:23:04.098901+0000', 'last_peered': '2024-08-17T02:23:04.098901+0000', 'last_clean': '2024-08-17T02:23:04.098901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:04.098901+0000', 'last_undegraded': '2024-08-17T02:23:04.098901+0000', 'last_fullsized': '2024-08-17T02:23:04.098901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.831 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2024-08-17T02:23:09.831 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.832 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2024-08-17T02:23:09.832 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:04.098901+0000', 'last_change': '2024-08-17T02:23:04.098901+0000', 'last_active': '2024-08-17T02:23:04.098901+0000', 'last_peered': '2024-08-17T02:23:04.098901+0000', 'last_clean': '2024-08-17T02:23:04.098901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:04.098901+0000', 'last_undegraded': '2024-08-17T02:23:04.098901+0000', 'last_fullsized': '2024-08-17T02:23:04.098901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.832 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2024-08-17T02:23:09.832 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.832 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2024-08-17T02:23:09.832 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:04.098901+0000', 'last_change': '2024-08-17T02:23:04.098901+0000', 'last_active': '2024-08-17T02:23:04.098901+0000', 'last_peered': '2024-08-17T02:23:04.098901+0000', 'last_clean': '2024-08-17T02:23:04.098901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:04.098901+0000', 'last_undegraded': '2024-08-17T02:23:04.098901+0000', 'last_fullsized': '2024-08-17T02:23:04.098901+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.832 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2024-08-17T02:23:09.832 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.832 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2024-08-17T02:23:09.832 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:23:04.098901+0000', 'last_change': '2024-08-17T02:23:04.108691+0000', 'last_active': '2024-08-17T02:23:04.098901+0000', 'last_peered': '2024-08-17T02:23:04.098901+0000', 'last_clean': '2024-08-17T02:23:04.098901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:04.098901+0000', 'last_undegraded': '2024-08-17T02:23:04.098901+0000', 'last_fullsized': '2024-08-17T02:23:04.098901+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T09:46:05.090766+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-08-17T02:23:09.833 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2024-08-17T02:23:09.833 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:23:05.101776+0000', 'last_change': '2024-08-17T02:23:05.101776+0000', 'last_active': '2024-08-17T02:23:05.101776+0000', 'last_peered': '2024-08-17T02:23:05.101776+0000', 'last_clean': '2024-08-17T02:23:05.101776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:05.101776+0000', 'last_undegraded': '2024-08-17T02:23:05.101776+0000', 'last_fullsized': '2024-08-17T02:23:05.101776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:05.101776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:23:09.833 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2024-08-17T02:23:09.833 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:23:04.098901+0000', 'last_change': '2024-08-17T02:23:04.112849+0000', 'last_active': '2024-08-17T02:23:04.098901+0000', 'last_peered': '2024-08-17T02:23:04.098901+0000', 'last_clean': '2024-08-17T02:23:04.098901+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:23:04.098901+0000', 'last_undegraded': '2024-08-17T02:23:04.098901+0000', 'last_fullsized': '2024-08-17T02:23:04.098901+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'last_clean_scrub_stamp': '2024-08-17T02:23:04.098901+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T09:16:08.488943+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-17T02:23:09.834 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-08-17T02:23:09.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.934+0000 7fd59b14b700 1 Processor -- start 2024-08-17T02:23:09.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.934+0000 7fd59b14b700 1 -- start start 2024-08-17T02:23:09.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.934+0000 7fd59b14b700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fd594154900 0x7fd5940b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:09.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.934+0000 7fd59b14b700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5940b12d0 0x7fd5940cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:09.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.934+0000 7fd59b14b700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5940cbaa0 con 0x7fd5940cb390 2024-08-17T02:23:09.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.934+0000 7fd59b14b700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd594068790 con 0x7fd594154900 2024-08-17T02:23:09.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.934+0000 7fd59b14b700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5941583f0 con 0x7fd5940b12d0 2024-08-17T02:23:09.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.934+0000 7fd59a149700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fd594154900 0x7fd5940b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:09.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.934+0000 7fd59a94a700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fd5940cb390 0x7fd59406df10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:33744/0 (socket says 172.21.15.104:33744) 2024-08-17T02:23:09.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.938+0000 7fd59a94a700 1 -- 172.21.15.104:0/2222055056 learned_addr learned my addr 172.21.15.104:0/2222055056 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:23:09.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.938+0000 7fd599948700 1 --2- 172.21.15.104:0/2222055056 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5940b12d0 0x7fd5940cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:09.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.938+0000 7fd59a149700 1 -- 172.21.15.104:0/2222055056 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5940b12d0 msgr2=0x7fd5940cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:09.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.938+0000 7fd59a149700 1 --2- 172.21.15.104:0/2222055056 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5940b12d0 0x7fd5940cae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:09.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.938+0000 7fd59a149700 1 -- 172.21.15.104:0/2222055056 >> v1:172.21.15.104:6789/0 conn(0x7fd5940cb390 legacy=0x7fd59406df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:09.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.938+0000 7fd599147700 1 -- 172.21.15.104:0/2222055056 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1643651226 0 0) 0x7fd5940cbaa0 con 0x7fd5940cb390 2024-08-17T02:23:09.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.938+0000 7fd59a149700 1 -- 172.21.15.104:0/2222055056 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5940b1700 con 0x7fd594154900 2024-08-17T02:23:09.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.938+0000 7fd59a149700 1 --2- 172.21.15.104:0/2222055056 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd594154900 0x7fd5940b0d90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd5900098e0 tx=0x7fd5900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea8fe7aaf1293b2b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:09.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.938+0000 7fd599147700 1 -- 172.21.15.104:0/2222055056 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59000b640 con 0x7fd594154900 2024-08-17T02:23:09.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.938+0000 7fd599147700 1 -- 172.21.15.104:0/2222055056 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59000b7a0 con 0x7fd594154900 2024-08-17T02:23:09.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.938+0000 7fd599147700 1 -- 172.21.15.104:0/2222055056 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59000bb40 con 0x7fd594154900 2024-08-17T02:23:09.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.938+0000 7fd59b14b700 1 -- 172.21.15.104:0/2222055056 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd594154900 msgr2=0x7fd5940b0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:09.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.938+0000 7fd59b14b700 1 --2- 172.21.15.104:0/2222055056 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd594154900 0x7fd5940b0d90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd5900098e0 tx=0x7fd5900091a0 comp rx=0 tx=0).stop 2024-08-17T02:23:09.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.938+0000 7fd59b14b700 1 -- 172.21.15.104:0/2222055056 shutdown_connections 2024-08-17T02:23:09.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.938+0000 7fd59b14b700 1 --2- 172.21.15.104:0/2222055056 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5940b12d0 0x7fd5940cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:09.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.938+0000 7fd59b14b700 1 --2- 172.21.15.104:0/2222055056 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd594154900 0x7fd5940b0d90 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:09.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.938+0000 7fd59b14b700 1 -- 172.21.15.104:0/2222055056 >> 172.21.15.104:0/2222055056 conn(0x7fd5940678d0 msgr2=0x7fd594067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:09.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.938+0000 7fd59b14b700 1 -- 172.21.15.104:0/2222055056 shutdown_connections 2024-08-17T02:23:09.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.938+0000 7fd59b14b700 1 -- 172.21.15.104:0/2222055056 wait complete. 2024-08-17T02:23:09.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.938+0000 7fd59b14b700 1 Processor -- start 2024-08-17T02:23:09.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.938+0000 7fd59b14b700 1 -- start start 2024-08-17T02:23:09.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.942+0000 7fd59b14b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5940b12d0 0x7fd5940aabd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:09.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.942+0000 7fd59b14b700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5940cb390 0x7fd59415d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:09.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.942+0000 7fd59b14b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd594154900 0x7fd594168730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:09.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.942+0000 7fd59b14b700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd594151380 con 0x7fd5940b12d0 2024-08-17T02:23:09.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.942+0000 7fd59b14b700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59415a500 con 0x7fd594154900 2024-08-17T02:23:09.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.942+0000 7fd59b14b700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd59415a770 con 0x7fd5940cb390 2024-08-17T02:23:09.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.942+0000 7fd59a149700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5940b12d0 0x7fd5940aabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:09.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.942+0000 7fd599948700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5940cb390 0x7fd59415d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:09.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.942+0000 7fd59a149700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5940b12d0 0x7fd5940aabd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35274/0 (socket says 172.21.15.104:35274) 2024-08-17T02:23:09.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.942+0000 7fd59a149700 1 -- 172.21.15.104:0/4274245517 learned_addr learned my addr 172.21.15.104:0/4274245517 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:09.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.942+0000 7fd59a94a700 1 --2- 172.21.15.104:0/4274245517 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd594154900 0x7fd594168730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:09.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.942+0000 7fd599948700 1 -- 172.21.15.104:0/4274245517 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd594154900 msgr2=0x7fd594168730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:09.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.942+0000 7fd599948700 1 --2- 172.21.15.104:0/4274245517 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd594154900 0x7fd594168730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:09.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.942+0000 7fd599948700 1 -- 172.21.15.104:0/4274245517 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5940b12d0 msgr2=0x7fd5940aabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:09.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.942+0000 7fd599948700 1 --2- 172.21.15.104:0/4274245517 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5940b12d0 0x7fd5940aabd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:09.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.942+0000 7fd599948700 1 -- 172.21.15.104:0/4274245517 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd590009420 con 0x7fd5940cb390 2024-08-17T02:23:09.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.942+0000 7fd59a149700 1 --2- 172.21.15.104:0/4274245517 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5940b12d0 0x7fd5940aabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:09.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.942+0000 7fd599948700 1 --2- 172.21.15.104:0/4274245517 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5940cb390 0x7fd59415d010 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd58400ea50 tx=0x7fd5840091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:09.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.942+0000 7fd58a7fc700 1 -- 172.21.15.104:0/4274245517 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58400ee90 con 0x7fd5940cb390 2024-08-17T02:23:09.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.942+0000 7fd58a7fc700 1 -- 172.21.15.104:0/4274245517 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd58400c7f0 con 0x7fd5940cb390 2024-08-17T02:23:09.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.942+0000 7fd59b14b700 1 -- 172.21.15.104:0/4274245517 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd59415aa50 con 0x7fd5940cb390 2024-08-17T02:23:09.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.942+0000 7fd58a7fc700 1 -- 172.21.15.104:0/4274245517 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58400cb90 con 0x7fd5940cb390 2024-08-17T02:23:09.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.942+0000 7fd59b14b700 1 -- 172.21.15.104:0/4274245517 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5940ab190 con 0x7fd5940cb390 2024-08-17T02:23:09.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.942+0000 7fd59b14b700 1 -- 172.21.15.104:0/4274245517 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd59415af20 con 0x7fd5940cb390 2024-08-17T02:23:09.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.946+0000 7fd58a7fc700 1 -- 172.21.15.104:0/4274245517 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd584013470 con 0x7fd5940cb390 2024-08-17T02:23:09.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.946+0000 7fd58a7fc700 1 --2- 172.21.15.104:0/4274245517 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fd578060890 0x7fd578062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:09.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.946+0000 7fd58a7fc700 1 -- 172.21.15.104:0/4274245517 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd58407cd00 con 0x7fd5940cb390 2024-08-17T02:23:09.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.946+0000 7fd59a149700 1 --2- 172.21.15.104:0/4274245517 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fd578060890 0x7fd578062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:09.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.946+0000 7fd59a149700 1 --2- 172.21.15.104:0/4274245517 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fd578060890 0x7fd578062d40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd590003080 tx=0x7fd590017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:09.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:09.958+0000 7fd58a7fc700 1 -- 172.21.15.104:0/4274245517 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd58404d150 con 0x7fd5940cb390 2024-08-17T02:23:10.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.182+0000 7fd59b14b700 1 -- 172.21.15.104:0/4274245517 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fd5940643a0 con 0x7fd5940cb390 2024-08-17T02:23:10.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.186+0000 7fd58a7fc700 1 -- 172.21.15.104:0/4274245517 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1562 (secure 0 0 0) 0x7fd584050770 con 0x7fd5940cb390 2024-08-17T02:23:10.191 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:23:10.191 INFO:teuthology.orchestra.run.smithi104.stdout:{"fsid":"fd5f7fb8-d34b-49bb-89a8-62b7dad1bc25","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":72,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":34,"num_osds":8,"num_up_osds":8,"osd_up_since":1723861328,"num_in_osds":8,"osd_in_since":1723861319,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592706,"bytes_used":2444496896,"bytes_avail":770649616384,"bytes_total":773094113280,"write_bytes_sec":2219,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":14,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":4965}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-08-17T02:23:10.102697+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-08-17T02:23:10.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.186+0000 7fd59b14b700 1 -- 172.21.15.104:0/4274245517 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fd578060890 msgr2=0x7fd578062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:10.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.186+0000 7fd59b14b700 1 --2- 172.21.15.104:0/4274245517 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fd578060890 0x7fd578062d40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd590003080 tx=0x7fd590017000 comp rx=0 tx=0).stop 2024-08-17T02:23:10.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.186+0000 7fd59b14b700 1 -- 172.21.15.104:0/4274245517 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5940cb390 msgr2=0x7fd59415d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:10.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.186+0000 7fd59b14b700 1 --2- 172.21.15.104:0/4274245517 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5940cb390 0x7fd59415d010 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd58400ea50 tx=0x7fd5840091a0 comp rx=0 tx=0).stop 2024-08-17T02:23:10.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.186+0000 7fd59b14b700 1 -- 172.21.15.104:0/4274245517 shutdown_connections 2024-08-17T02:23:10.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.186+0000 7fd59b14b700 1 --2- 172.21.15.104:0/4274245517 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fd578060890 0x7fd578062d40 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:10.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.186+0000 7fd59b14b700 1 --2- 172.21.15.104:0/4274245517 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd594154900 0x7fd594168730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:10.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.186+0000 7fd59b14b700 1 --2- 172.21.15.104:0/4274245517 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5940cb390 0x7fd59415d010 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:10.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.186+0000 7fd59b14b700 1 --2- 172.21.15.104:0/4274245517 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5940b12d0 0x7fd5940aabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:10.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.186+0000 7fd59b14b700 1 -- 172.21.15.104:0/4274245517 >> 172.21.15.104:0/4274245517 conn(0x7fd5940678d0 msgr2=0x7fd59406e940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:10.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.186+0000 7fd59b14b700 1 -- 172.21.15.104:0/4274245517 shutdown_connections 2024-08-17T02:23:10.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.186+0000 7fd59b14b700 1 -- 172.21.15.104:0/4274245517 wait complete. 2024-08-17T02:23:10.205 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-08-17T02:23:10.205 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:23:10.304 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.298+0000 7f00b7fff700 1 Processor -- start 2024-08-17T02:23:10.304 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.298+0000 7f00b7fff700 1 -- start start 2024-08-17T02:23:10.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.298+0000 7f00b7fff700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f00b8153320 0x7f00b81536f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:10.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.298+0000 7f00b7fff700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f00b815a190 0x7f00b815cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:10.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.298+0000 7f00b7fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00b80ccaa0 0x7f00b80ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:10.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.298+0000 7f00b7fff700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00b80ce430 con 0x7f00b815a190 2024-08-17T02:23:10.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.298+0000 7f00b7fff700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00b80cd440 con 0x7f00b8153320 2024-08-17T02:23:10.307 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.298+0000 7f00b7fff700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b815dbd0 con 0x7f00b80ccaa0 2024-08-17T02:23:10.307 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.298+0000 7f00b67fc700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f00b815a190 0x7f00b815cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:10.307 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.298+0000 7f00b67fc700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f00b815a190 0x7f00b815cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35290/0 (socket says 172.21.15.104:35290) 2024-08-17T02:23:10.307 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.298+0000 7f00b67fc700 1 -- 172.21.15.104:0/4251333017 learned_addr learned my addr 172.21.15.104:0/4251333017 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:10.307 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.298+0000 7f00b6ffd700 1 --2- 172.21.15.104:0/4251333017 >> v2:172.21.15.117:3300/0 conn(0x7f00b8153320 0x7f00b81536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:10.307 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.298+0000 7f00b77fe700 1 --2- 172.21.15.104:0/4251333017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00b80ccaa0 0x7f00b80ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:10.307 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.298+0000 7f00b67fc700 1 -- 172.21.15.104:0/4251333017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00b80ccaa0 msgr2=0x7f00b80ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:10.307 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.298+0000 7f00b67fc700 1 --2- 172.21.15.104:0/4251333017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00b80ccaa0 0x7f00b80ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:10.307 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.298+0000 7f00b67fc700 1 -- 172.21.15.104:0/4251333017 >> v2:172.21.15.117:3300/0 conn(0x7f00b8153320 msgr2=0x7f00b81536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:10.307 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.298+0000 7f00b67fc700 1 --2- 172.21.15.104:0/4251333017 >> v2:172.21.15.117:3300/0 conn(0x7f00b8153320 0x7f00b81536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:10.307 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.298+0000 7f00b67fc700 1 -- 172.21.15.104:0/4251333017 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b815d370 con 0x7f00b815a190 2024-08-17T02:23:10.307 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.302+0000 7f00b67fc700 1 --2- 172.21.15.104:0/4251333017 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f00b815a190 0x7f00b815cc60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f00b80d0cd0 tx=0x7f00a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63fed898d0825465 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:10.308 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.302+0000 7f00b5ffb700 1 -- 172.21.15.104:0/4251333017 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a800b860 con 0x7f00b815a190 2024-08-17T02:23:10.308 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.302+0000 7f00b5ffb700 1 -- 172.21.15.104:0/4251333017 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a800b9c0 con 0x7f00b815a190 2024-08-17T02:23:10.309 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.302+0000 7f00b5ffb700 1 -- 172.21.15.104:0/4251333017 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a800bd60 con 0x7f00b815a190 2024-08-17T02:23:10.309 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.302+0000 7f00b7fff700 1 -- 172.21.15.104:0/4251333017 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f00b815a190 msgr2=0x7f00b815cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:10.309 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.302+0000 7f00b7fff700 1 --2- 172.21.15.104:0/4251333017 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f00b815a190 0x7f00b815cc60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f00b80d0cd0 tx=0x7f00a8009250 comp rx=0 tx=0).stop 2024-08-17T02:23:10.309 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.302+0000 7f00b7fff700 1 -- 172.21.15.104:0/4251333017 shutdown_connections 2024-08-17T02:23:10.309 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.302+0000 7f00b7fff700 1 --2- 172.21.15.104:0/4251333017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00b80ccaa0 0x7f00b80ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:10.309 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.302+0000 7f00b7fff700 1 --2- 172.21.15.104:0/4251333017 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f00b815a190 0x7f00b815cc60 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:10.309 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.302+0000 7f00b7fff700 1 --2- 172.21.15.104:0/4251333017 >> v2:172.21.15.117:3300/0 conn(0x7f00b8153320 0x7f00b81536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:10.309 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.302+0000 7f00b7fff700 1 -- 172.21.15.104:0/4251333017 >> 172.21.15.104:0/4251333017 conn(0x7f00b80d00a0 msgr2=0x7f00b80d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:10.309 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.302+0000 7f00b7fff700 1 -- 172.21.15.104:0/4251333017 shutdown_connections 2024-08-17T02:23:10.309 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.302+0000 7f00b7fff700 1 -- 172.21.15.104:0/4251333017 wait complete. 2024-08-17T02:23:10.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.306+0000 7f00b7fff700 1 Processor -- start 2024-08-17T02:23:10.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.306+0000 7f00b7fff700 1 -- start start 2024-08-17T02:23:10.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.306+0000 7f00b7fff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f00b80ccaa0 0x7f00b80b1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:10.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.306+0000 7f00b7fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00b8153320 0x7f00b80afc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:10.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.306+0000 7f00b7fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00b815a190 0x7f00b8154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:10.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.306+0000 7f00b7fff700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b80b0ce0 con 0x7f00b80ccaa0 2024-08-17T02:23:10.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.306+0000 7f00b7fff700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b80b01a0 con 0x7f00b815a190 2024-08-17T02:23:10.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.306+0000 7f00b7fff700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b80b0440 con 0x7f00b8153320 2024-08-17T02:23:10.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.306+0000 7f00b6ffd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f00b80ccaa0 0x7f00b80b1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:10.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.306+0000 7f00b6ffd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f00b80ccaa0 0x7f00b80b1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35292/0 (socket says 172.21.15.104:35292) 2024-08-17T02:23:10.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.306+0000 7f00b6ffd700 1 -- 172.21.15.104:0/1625664738 learned_addr learned my addr 172.21.15.104:0/1625664738 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:10.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.306+0000 7f00b67fc700 1 --2- 172.21.15.104:0/1625664738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00b8153320 0x7f00b80afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:10.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.306+0000 7f00b77fe700 1 --2- 172.21.15.104:0/1625664738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00b815a190 0x7f00b8154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:10.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.306+0000 7f00b6ffd700 1 -- 172.21.15.104:0/1625664738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00b8153320 msgr2=0x7f00b80afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:10.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.306+0000 7f00b6ffd700 1 --2- 172.21.15.104:0/1625664738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00b8153320 0x7f00b80afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:10.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.306+0000 7f00b6ffd700 1 -- 172.21.15.104:0/1625664738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00b815a190 msgr2=0x7f00b8154bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:10.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.306+0000 7f00b6ffd700 1 --2- 172.21.15.104:0/1625664738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00b815a190 0x7f00b8154bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:10.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.306+0000 7f00b6ffd700 1 -- 172.21.15.104:0/1625664738 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a80094f0 con 0x7f00b80ccaa0 2024-08-17T02:23:10.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.306+0000 7f00b6ffd700 1 --2- 172.21.15.104:0/1625664738 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f00b80ccaa0 0x7f00b80b1c30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f00ac00d890 tx=0x7f00ac008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:10.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.310+0000 7f009effd700 1 -- 172.21.15.104:0/1625664738 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ac0125f0 con 0x7f00b80ccaa0 2024-08-17T02:23:10.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.310+0000 7f009effd700 1 -- 172.21.15.104:0/1625664738 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00ac012750 con 0x7f00b80ccaa0 2024-08-17T02:23:10.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.310+0000 7f00b7fff700 1 -- 172.21.15.104:0/1625664738 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b80b0720 con 0x7f00b80ccaa0 2024-08-17T02:23:10.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.310+0000 7f009effd700 1 -- 172.21.15.104:0/1625664738 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ac012ad0 con 0x7f00b80ccaa0 2024-08-17T02:23:10.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.310+0000 7f00b7fff700 1 -- 172.21.15.104:0/1625664738 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00b80b33c0 con 0x7f00b80ccaa0 2024-08-17T02:23:10.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.310+0000 7f00b7fff700 1 -- 172.21.15.104:0/1625664738 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00b80638f0 con 0x7f00b80ccaa0 2024-08-17T02:23:10.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.310+0000 7f009effd700 1 -- 172.21.15.104:0/1625664738 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f00ac01e460 con 0x7f00b80ccaa0 2024-08-17T02:23:10.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.310+0000 7f009effd700 1 --2- 172.21.15.104:0/1625664738 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f00a4060860 0x7f00a4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:10.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.310+0000 7f009effd700 1 -- 172.21.15.104:0/1625664738 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f00ac07d1d0 con 0x7f00b80ccaa0 2024-08-17T02:23:10.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.310+0000 7f00b67fc700 1 --2- 172.21.15.104:0/1625664738 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f00a4060860 0x7f00a4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:10.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.314+0000 7f00b67fc700 1 --2- 172.21.15.104:0/1625664738 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f00a4060860 0x7f00a4062d10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f00b80d0cd0 tx=0x7f00a8017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:10.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.318+0000 7f009effd700 1 -- 172.21.15.104:0/1625664738 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f00ac04d620 con 0x7f00b80ccaa0 2024-08-17T02:23:10.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.478+0000 7f00b7fff700 1 -- 172.21.15.104:0/1625664738 --> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f00b80cde20 con 0x7f00a4060860 2024-08-17T02:23:10.492 INFO:tasks.ceph.mds.a.smithi104.stderr:2024-08-17T02:23:10.486+0000 7f2106535700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:23:10.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.494+0000 7f009effd700 1 -- 172.21.15.104:0/1625664738 <== mgr.4111 v2:172.21.15.117:6832/24084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264579 (secure 0 0 0) 0x7f00b80cde20 con 0x7f00a4060860 2024-08-17T02:23:10.504 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:23:10.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.498+0000 7f00b7fff700 1 -- 172.21.15.104:0/1625664738 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f00a4060860 msgr2=0x7f00a4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:10.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.498+0000 7f00b7fff700 1 --2- 172.21.15.104:0/1625664738 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f00a4060860 0x7f00a4062d10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f00b80d0cd0 tx=0x7f00a8017000 comp rx=0 tx=0).stop 2024-08-17T02:23:10.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.498+0000 7f00b7fff700 1 -- 172.21.15.104:0/1625664738 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f00b80ccaa0 msgr2=0x7f00b80b1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:10.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.498+0000 7f00b7fff700 1 --2- 172.21.15.104:0/1625664738 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f00b80ccaa0 0x7f00b80b1c30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f00ac00d890 tx=0x7f00ac008040 comp rx=0 tx=0).stop 2024-08-17T02:23:10.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.498+0000 7f00b7fff700 1 -- 172.21.15.104:0/1625664738 shutdown_connections 2024-08-17T02:23:10.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.498+0000 7f00b7fff700 1 --2- 172.21.15.104:0/1625664738 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f00a4060860 0x7f00a4062d10 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:10.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.498+0000 7f00b7fff700 1 --2- 172.21.15.104:0/1625664738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00b815a190 0x7f00b8154bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:10.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.498+0000 7f00b7fff700 1 --2- 172.21.15.104:0/1625664738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00b8153320 0x7f00b80afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:10.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.498+0000 7f00b7fff700 1 --2- 172.21.15.104:0/1625664738 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f00b80ccaa0 0x7f00b80b1c30 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:10.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.498+0000 7f00b7fff700 1 -- 172.21.15.104:0/1625664738 >> 172.21.15.104:0/1625664738 conn(0x7f00b80d00a0 msgr2=0x7f00b815bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:10.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.498+0000 7f00b7fff700 1 -- 172.21.15.104:0/1625664738 shutdown_connections 2024-08-17T02:23:10.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:10.498+0000 7f00b7fff700 1 -- 172.21.15.104:0/1625664738 wait complete. 2024-08-17T02:23:10.508 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-08-17T02:23:10.519 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2024-08-17T02:23:10.102287+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2387204,"kb_used_data":4156,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752587516,"statfs":{"total":773094113280,"available":770649616384,"internally_reserved":0,"allocated":4255744,"data_stored":2328716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.998542"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.157805+0000","last_change":"2024-08-17T02:23:06.152060+0000","last_active":"2024-08-17T02:23:06.157805+0000","last_peered":"2024-08-17T02:23:06.157805+0000","last_clean":"2024-08-17T02:23:06.157805+0000","last_became_active":"2024-08-17T02:23:06.151701+0000","last_became_peered":"2024-08-17T02:23:06.151701+0000","last_unstale":"2024-08-17T02:23:06.157805+0000","last_undegraded":"2024-08-17T02:23:06.157805+0000","last_fullsized":"2024-08-17T02:23:06.157805+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:08:18.958141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.139025+0000","last_change":"2024-08-17T02:23:06.137328+0000","last_active":"2024-08-17T02:23:06.139025+0000","last_peered":"2024-08-17T02:23:06.139025+0000","last_clean":"2024-08-17T02:23:06.139025+0000","last_became_active":"2024-08-17T02:23:06.137060+0000","last_became_peered":"2024-08-17T02:23:06.137060+0000","last_unstale":"2024-08-17T02:23:06.139025+0000","last_undegraded":"2024-08-17T02:23:06.139025+0000","last_fullsized":"2024-08-17T02:23:06.139025+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:55:37.879421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.158275+0000","last_change":"2024-08-17T02:23:06.153699+0000","last_active":"2024-08-17T02:23:06.158275+0000","last_peered":"2024-08-17T02:23:06.158275+0000","last_clean":"2024-08-17T02:23:06.158275+0000","last_became_active":"2024-08-17T02:23:06.153380+0000","last_became_peered":"2024-08-17T02:23:06.153380+0000","last_unstale":"2024-08-17T02:23:06.158275+0000","last_undegraded":"2024-08-17T02:23:06.158275+0000","last_fullsized":"2024-08-17T02:23:06.158275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:46:52.682872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.157157+0000","last_change":"2024-08-17T02:23:06.154878+0000","last_active":"2024-08-17T02:23:06.157157+0000","last_peered":"2024-08-17T02:23:06.157157+0000","last_clean":"2024-08-17T02:23:06.157157+0000","last_became_active":"2024-08-17T02:23:06.152824+0000","last_became_peered":"2024-08-17T02:23:06.152824+0000","last_unstale":"2024-08-17T02:23:06.157157+0000","last_undegraded":"2024-08-17T02:23:06.157157+0000","last_fullsized":"2024-08-17T02:23:06.157157+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:15:11.264748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.145045+0000","last_change":"2024-08-17T02:23:06.143365+0000","last_active":"2024-08-17T02:23:06.145045+0000","last_peered":"2024-08-17T02:23:06.145045+0000","last_clean":"2024-08-17T02:23:06.145045+0000","last_became_active":"2024-08-17T02:23:06.143077+0000","last_became_peered":"2024-08-17T02:23:06.143077+0000","last_unstale":"2024-08-17T02:23:06.145045+0000","last_undegraded":"2024-08-17T02:23:06.145045+0000","last_fullsized":"2024-08-17T02:23:06.145045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:19:04.068186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.146241+0000","last_change":"2024-08-17T02:23:06.143266+0000","last_active":"2024-08-17T02:23:06.146241+0000","last_peered":"2024-08-17T02:23:06.146241+0000","last_clean":"2024-08-17T02:23:06.146241+0000","last_became_active":"2024-08-17T02:23:06.142947+0000","last_became_peered":"2024-08-17T02:23:06.142947+0000","last_unstale":"2024-08-17T02:23:06.146241+0000","last_undegraded":"2024-08-17T02:23:06.146241+0000","last_fullsized":"2024-08-17T02:23:06.146241+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:03:49.827394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.152655+0000","last_change":"2024-08-17T02:23:06.148317+0000","last_active":"2024-08-17T02:23:06.152655+0000","last_peered":"2024-08-17T02:23:06.152655+0000","last_clean":"2024-08-17T02:23:06.152655+0000","last_became_active":"2024-08-17T02:23:06.148007+0000","last_became_peered":"2024-08-17T02:23:06.148007+0000","last_unstale":"2024-08-17T02:23:06.152655+0000","last_undegraded":"2024-08-17T02:23:06.152655+0000","last_fullsized":"2024-08-17T02:23:06.152655+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:16:09.491817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.158608+0000","last_change":"2024-08-17T02:23:06.152531+0000","last_active":"2024-08-17T02:23:06.158608+0000","last_peered":"2024-08-17T02:23:06.158608+0000","last_clean":"2024-08-17T02:23:06.158608+0000","last_became_active":"2024-08-17T02:23:06.152002+0000","last_became_peered":"2024-08-17T02:23:06.152002+0000","last_unstale":"2024-08-17T02:23:06.158608+0000","last_undegraded":"2024-08-17T02:23:06.158608+0000","last_fullsized":"2024-08-17T02:23:06.158608+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:50:24.722399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.143946+0000","last_change":"2024-08-17T02:23:06.142217+0000","last_active":"2024-08-17T02:23:06.143946+0000","last_peered":"2024-08-17T02:23:06.143946+0000","last_clean":"2024-08-17T02:23:06.143946+0000","last_became_active":"2024-08-17T02:23:06.141883+0000","last_became_peered":"2024-08-17T02:23:06.141883+0000","last_unstale":"2024-08-17T02:23:06.143946+0000","last_undegraded":"2024-08-17T02:23:06.143946+0000","last_fullsized":"2024-08-17T02:23:06.143946+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:06:06.260257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.136700+0000","last_change":"2024-08-17T02:23:06.134507+0000","last_active":"2024-08-17T02:23:06.136700+0000","last_peered":"2024-08-17T02:23:06.136700+0000","last_clean":"2024-08-17T02:23:06.136700+0000","last_became_active":"2024-08-17T02:23:06.134278+0000","last_became_peered":"2024-08-17T02:23:06.134278+0000","last_unstale":"2024-08-17T02:23:06.136700+0000","last_undegraded":"2024-08-17T02:23:06.136700+0000","last_fullsized":"2024-08-17T02:23:06.136700+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:42:58.110820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.155323+0000","last_change":"2024-08-17T02:23:06.150462+0000","last_active":"2024-08-17T02:23:06.155323+0000","last_peered":"2024-08-17T02:23:06.155323+0000","last_clean":"2024-08-17T02:23:06.155323+0000","last_became_active":"2024-08-17T02:23:06.149630+0000","last_became_peered":"2024-08-17T02:23:06.149630+0000","last_unstale":"2024-08-17T02:23:06.155323+0000","last_undegraded":"2024-08-17T02:23:06.155323+0000","last_fullsized":"2024-08-17T02:23:06.155323+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:01.633704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.157979+0000","last_change":"2024-08-17T02:23:06.154365+0000","last_active":"2024-08-17T02:23:06.157979+0000","last_peered":"2024-08-17T02:23:06.157979+0000","last_clean":"2024-08-17T02:23:06.157979+0000","last_became_active":"2024-08-17T02:23:06.154055+0000","last_became_peered":"2024-08-17T02:23:06.154055+0000","last_unstale":"2024-08-17T02:23:06.157979+0000","last_undegraded":"2024-08-17T02:23:06.157979+0000","last_fullsized":"2024-08-17T02:23:06.157979+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:50:27.957673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.153678+0000","last_change":"2024-08-17T02:23:06.149989+0000","last_active":"2024-08-17T02:23:06.153678+0000","last_peered":"2024-08-17T02:23:06.153678+0000","last_clean":"2024-08-17T02:23:06.153678+0000","last_became_active":"2024-08-17T02:23:06.149682+0000","last_became_peered":"2024-08-17T02:23:06.149682+0000","last_unstale":"2024-08-17T02:23:06.153678+0000","last_undegraded":"2024-08-17T02:23:06.153678+0000","last_fullsized":"2024-08-17T02:23:06.153678+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:01:44.542693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.143943+0000","last_change":"2024-08-17T02:23:06.138133+0000","last_active":"2024-08-17T02:23:06.143943+0000","last_peered":"2024-08-17T02:23:06.143943+0000","last_clean":"2024-08-17T02:23:06.143943+0000","last_became_active":"2024-08-17T02:23:06.137254+0000","last_became_peered":"2024-08-17T02:23:06.137254+0000","last_unstale":"2024-08-17T02:23:06.143943+0000","last_undegraded":"2024-08-17T02:23:06.143943+0000","last_fullsized":"2024-08-17T02:23:06.143943+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:16:09.491817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.160776+0000","last_change":"2024-08-17T02:23:06.155935+0000","last_active":"2024-08-17T02:23:06.160776+0000","last_peered":"2024-08-17T02:23:06.160776+0000","last_clean":"2024-08-17T02:23:06.160776+0000","last_became_active":"2024-08-17T02:23:06.155612+0000","last_became_peered":"2024-08-17T02:23:06.155612+0000","last_unstale":"2024-08-17T02:23:06.160776+0000","last_undegraded":"2024-08-17T02:23:06.160776+0000","last_fullsized":"2024-08-17T02:23:06.160776+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:55:37.879421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.162372+0000","last_change":"2024-08-17T02:23:06.156796+0000","last_active":"2024-08-17T02:23:06.162372+0000","last_peered":"2024-08-17T02:23:06.162372+0000","last_clean":"2024-08-17T02:23:06.162372+0000","last_became_active":"2024-08-17T02:23:06.156503+0000","last_became_peered":"2024-08-17T02:23:06.156503+0000","last_unstale":"2024-08-17T02:23:06.162372+0000","last_undegraded":"2024-08-17T02:23:06.162372+0000","last_fullsized":"2024-08-17T02:23:06.162372+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:15:47.325801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.158758+0000","last_change":"2024-08-17T02:23:06.151910+0000","last_active":"2024-08-17T02:23:06.158758+0000","last_peered":"2024-08-17T02:23:06.158758+0000","last_clean":"2024-08-17T02:23:06.158758+0000","last_became_active":"2024-08-17T02:23:06.148961+0000","last_became_peered":"2024-08-17T02:23:06.148961+0000","last_unstale":"2024-08-17T02:23:06.158758+0000","last_undegraded":"2024-08-17T02:23:06.158758+0000","last_fullsized":"2024-08-17T02:23:06.158758+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:28:40.221408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.146639+0000","last_change":"2024-08-17T02:23:06.143817+0000","last_active":"2024-08-17T02:23:06.146639+0000","last_peered":"2024-08-17T02:23:06.146639+0000","last_clean":"2024-08-17T02:23:06.146639+0000","last_became_active":"2024-08-17T02:23:06.143532+0000","last_became_peered":"2024-08-17T02:23:06.143532+0000","last_unstale":"2024-08-17T02:23:06.146639+0000","last_undegraded":"2024-08-17T02:23:06.146639+0000","last_fullsized":"2024-08-17T02:23:06.146639+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:42:28.828338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.146765+0000","last_change":"2024-08-17T02:23:06.145322+0000","last_active":"2024-08-17T02:23:06.146765+0000","last_peered":"2024-08-17T02:23:06.146765+0000","last_clean":"2024-08-17T02:23:06.146765+0000","last_became_active":"2024-08-17T02:23:06.145042+0000","last_became_peered":"2024-08-17T02:23:06.145042+0000","last_unstale":"2024-08-17T02:23:06.146765+0000","last_undegraded":"2024-08-17T02:23:06.146765+0000","last_fullsized":"2024-08-17T02:23:06.146765+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:24:57.233299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.160279+0000","last_change":"2024-08-17T02:23:06.158176+0000","last_active":"2024-08-17T02:23:06.160279+0000","last_peered":"2024-08-17T02:23:06.160279+0000","last_clean":"2024-08-17T02:23:06.160279+0000","last_became_active":"2024-08-17T02:23:06.157917+0000","last_became_peered":"2024-08-17T02:23:06.157917+0000","last_unstale":"2024-08-17T02:23:06.160279+0000","last_undegraded":"2024-08-17T02:23:06.160279+0000","last_fullsized":"2024-08-17T02:23:06.160279+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:52:06.730764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.158454+0000","last_change":"2024-08-17T02:23:06.150935+0000","last_active":"2024-08-17T02:23:06.158454+0000","last_peered":"2024-08-17T02:23:06.158454+0000","last_clean":"2024-08-17T02:23:06.158454+0000","last_became_active":"2024-08-17T02:23:06.150618+0000","last_became_peered":"2024-08-17T02:23:06.150618+0000","last_unstale":"2024-08-17T02:23:06.158454+0000","last_undegraded":"2024-08-17T02:23:06.158454+0000","last_fullsized":"2024-08-17T02:23:06.158454+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:16:09.491817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.154646+0000","last_change":"2024-08-17T02:23:06.150646+0000","last_active":"2024-08-17T02:23:06.154646+0000","last_peered":"2024-08-17T02:23:06.154646+0000","last_clean":"2024-08-17T02:23:06.154646+0000","last_became_active":"2024-08-17T02:23:06.150176+0000","last_became_peered":"2024-08-17T02:23:06.150176+0000","last_unstale":"2024-08-17T02:23:06.154646+0000","last_undegraded":"2024-08-17T02:23:06.154646+0000","last_fullsized":"2024-08-17T02:23:06.154646+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:55:37.879421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.149734+0000","last_change":"2024-08-17T02:23:06.145958+0000","last_active":"2024-08-17T02:23:06.149734+0000","last_peered":"2024-08-17T02:23:06.149734+0000","last_clean":"2024-08-17T02:23:06.149734+0000","last_became_active":"2024-08-17T02:23:06.145672+0000","last_became_peered":"2024-08-17T02:23:06.145672+0000","last_unstale":"2024-08-17T02:23:06.149734+0000","last_undegraded":"2024-08-17T02:23:06.149734+0000","last_fullsized":"2024-08-17T02:23:06.149734+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:51.598952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.158590+0000","last_change":"2024-08-17T02:23:06.152318+0000","last_active":"2024-08-17T02:23:06.158590+0000","last_peered":"2024-08-17T02:23:06.158590+0000","last_clean":"2024-08-17T02:23:06.158590+0000","last_became_active":"2024-08-17T02:23:06.151688+0000","last_became_peered":"2024-08-17T02:23:06.151688+0000","last_unstale":"2024-08-17T02:23:06.158590+0000","last_undegraded":"2024-08-17T02:23:06.158590+0000","last_fullsized":"2024-08-17T02:23:06.158590+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:42:58.110820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.159687+0000","last_change":"2024-08-17T02:23:06.158449+0000","last_active":"2024-08-17T02:23:06.159687+0000","last_peered":"2024-08-17T02:23:06.159687+0000","last_clean":"2024-08-17T02:23:06.159687+0000","last_became_active":"2024-08-17T02:23:06.158082+0000","last_became_peered":"2024-08-17T02:23:06.158082+0000","last_unstale":"2024-08-17T02:23:06.159687+0000","last_undegraded":"2024-08-17T02:23:06.159687+0000","last_fullsized":"2024-08-17T02:23:06.159687+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:39:15.225920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.152265+0000","last_change":"2024-08-17T02:23:06.144058+0000","last_active":"2024-08-17T02:23:06.152265+0000","last_peered":"2024-08-17T02:23:06.152265+0000","last_clean":"2024-08-17T02:23:06.152265+0000","last_became_active":"2024-08-17T02:23:06.143742+0000","last_became_peered":"2024-08-17T02:23:06.143742+0000","last_unstale":"2024-08-17T02:23:06.152265+0000","last_undegraded":"2024-08-17T02:23:06.152265+0000","last_fullsized":"2024-08-17T02:23:06.152265+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:19:46.037200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.153867+0000","last_change":"2024-08-17T02:23:06.150609+0000","last_active":"2024-08-17T02:23:06.153867+0000","last_peered":"2024-08-17T02:23:06.153867+0000","last_clean":"2024-08-17T02:23:06.153867+0000","last_became_active":"2024-08-17T02:23:06.150350+0000","last_became_peered":"2024-08-17T02:23:06.150350+0000","last_unstale":"2024-08-17T02:23:06.153867+0000","last_undegraded":"2024-08-17T02:23:06.153867+0000","last_fullsized":"2024-08-17T02:23:06.153867+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:43.814412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.160595+0000","last_change":"2024-08-17T02:23:06.152813+0000","last_active":"2024-08-17T02:23:06.160595+0000","last_peered":"2024-08-17T02:23:06.160595+0000","last_clean":"2024-08-17T02:23:06.160595+0000","last_became_active":"2024-08-17T02:23:06.152533+0000","last_became_peered":"2024-08-17T02:23:06.152533+0000","last_unstale":"2024-08-17T02:23:06.160595+0000","last_undegraded":"2024-08-17T02:23:06.160595+0000","last_fullsized":"2024-08-17T02:23:06.160595+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:19:04.068186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.160769+0000","last_change":"2024-08-17T02:23:06.155870+0000","last_active":"2024-08-17T02:23:06.160769+0000","last_peered":"2024-08-17T02:23:06.160769+0000","last_clean":"2024-08-17T02:23:06.160769+0000","last_became_active":"2024-08-17T02:23:06.151995+0000","last_became_peered":"2024-08-17T02:23:06.151995+0000","last_unstale":"2024-08-17T02:23:06.160769+0000","last_undegraded":"2024-08-17T02:23:06.160769+0000","last_fullsized":"2024-08-17T02:23:06.160769+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:05:17.742125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.163471+0000","last_change":"2024-08-17T02:23:06.158354+0000","last_active":"2024-08-17T02:23:06.163471+0000","last_peered":"2024-08-17T02:23:06.163471+0000","last_clean":"2024-08-17T02:23:06.163471+0000","last_became_active":"2024-08-17T02:23:06.158056+0000","last_became_peered":"2024-08-17T02:23:06.158056+0000","last_unstale":"2024-08-17T02:23:06.163471+0000","last_undegraded":"2024-08-17T02:23:06.163471+0000","last_fullsized":"2024-08-17T02:23:06.163471+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:41.741517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.150767+0000","last_change":"2024-08-17T02:23:06.146400+0000","last_active":"2024-08-17T02:23:06.150767+0000","last_peered":"2024-08-17T02:23:06.150767+0000","last_clean":"2024-08-17T02:23:06.150767+0000","last_became_active":"2024-08-17T02:23:06.146018+0000","last_became_peered":"2024-08-17T02:23:06.146018+0000","last_unstale":"2024-08-17T02:23:06.150767+0000","last_undegraded":"2024-08-17T02:23:06.150767+0000","last_fullsized":"2024-08-17T02:23:06.150767+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:56:35.760215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.145959+0000","last_change":"2024-08-17T02:23:06.140156+0000","last_active":"2024-08-17T02:23:06.145959+0000","last_peered":"2024-08-17T02:23:06.145959+0000","last_clean":"2024-08-17T02:23:06.145959+0000","last_became_active":"2024-08-17T02:23:06.139805+0000","last_became_peered":"2024-08-17T02:23:06.139805+0000","last_unstale":"2024-08-17T02:23:06.145959+0000","last_undegraded":"2024-08-17T02:23:06.145959+0000","last_fullsized":"2024-08-17T02:23:06.145959+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:47:27.588293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.156134+0000","last_change":"2024-08-17T02:23:06.151809+0000","last_active":"2024-08-17T02:23:06.156134+0000","last_peered":"2024-08-17T02:23:06.156134+0000","last_clean":"2024-08-17T02:23:06.156134+0000","last_became_active":"2024-08-17T02:23:06.151504+0000","last_became_peered":"2024-08-17T02:23:06.151504+0000","last_unstale":"2024-08-17T02:23:06.156134+0000","last_undegraded":"2024-08-17T02:23:06.156134+0000","last_fullsized":"2024-08-17T02:23:06.156134+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:44:33.447512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.149550+0000","last_change":"2024-08-17T02:23:05.127510+0000","last_active":"2024-08-17T02:23:06.149550+0000","last_peered":"2024-08-17T02:23:06.149550+0000","last_clean":"2024-08-17T02:23:06.149550+0000","last_became_active":"2024-08-17T02:23:05.127256+0000","last_became_peered":"2024-08-17T02:23:05.127256+0000","last_unstale":"2024-08-17T02:23:06.149550+0000","last_undegraded":"2024-08-17T02:23:06.149550+0000","last_fullsized":"2024-08-17T02:23:06.149550+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:42.811537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.150569+0000","last_change":"2024-08-17T02:23:06.142236+0000","last_active":"2024-08-17T02:23:06.150569+0000","last_peered":"2024-08-17T02:23:06.150569+0000","last_clean":"2024-08-17T02:23:06.150569+0000","last_became_active":"2024-08-17T02:23:06.141250+0000","last_became_peered":"2024-08-17T02:23:06.141250+0000","last_unstale":"2024-08-17T02:23:06.150569+0000","last_undegraded":"2024-08-17T02:23:06.150569+0000","last_fullsized":"2024-08-17T02:23:06.150569+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:41.741517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.152184+0000","last_change":"2024-08-17T02:23:05.132289+0000","last_active":"2024-08-17T02:23:06.152184+0000","last_peered":"2024-08-17T02:23:06.152184+0000","last_clean":"2024-08-17T02:23:06.152184+0000","last_became_active":"2024-08-17T02:23:05.131983+0000","last_became_peered":"2024-08-17T02:23:05.131983+0000","last_unstale":"2024-08-17T02:23:06.152184+0000","last_undegraded":"2024-08-17T02:23:06.152184+0000","last_fullsized":"2024-08-17T02:23:06.152184+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:07:23.619301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.157836+0000","last_change":"2024-08-17T02:23:06.152248+0000","last_active":"2024-08-17T02:23:06.157836+0000","last_peered":"2024-08-17T02:23:06.157836+0000","last_clean":"2024-08-17T02:23:06.157836+0000","last_became_active":"2024-08-17T02:23:06.151319+0000","last_became_peered":"2024-08-17T02:23:06.151319+0000","last_unstale":"2024-08-17T02:23:06.157836+0000","last_undegraded":"2024-08-17T02:23:06.157836+0000","last_fullsized":"2024-08-17T02:23:06.157836+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:43.814412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.156036+0000","last_change":"2024-08-17T02:23:05.132350+0000","last_active":"2024-08-17T02:23:06.156036+0000","last_peered":"2024-08-17T02:23:06.156036+0000","last_clean":"2024-08-17T02:23:06.156036+0000","last_became_active":"2024-08-17T02:23:05.132091+0000","last_became_peered":"2024-08-17T02:23:05.132091+0000","last_unstale":"2024-08-17T02:23:06.156036+0000","last_undegraded":"2024-08-17T02:23:06.156036+0000","last_fullsized":"2024-08-17T02:23:06.156036+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:17:50.941899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.150875+0000","last_change":"2024-08-17T02:23:06.144826+0000","last_active":"2024-08-17T02:23:06.150875+0000","last_peered":"2024-08-17T02:23:06.150875+0000","last_clean":"2024-08-17T02:23:06.150875+0000","last_became_active":"2024-08-17T02:23:06.144300+0000","last_became_peered":"2024-08-17T02:23:06.144300+0000","last_unstale":"2024-08-17T02:23:06.150875+0000","last_undegraded":"2024-08-17T02:23:06.150875+0000","last_fullsized":"2024-08-17T02:23:06.150875+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:56:45.045355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.154991+0000","last_change":"2024-08-17T02:23:05.133629+0000","last_active":"2024-08-17T02:23:06.154991+0000","last_peered":"2024-08-17T02:23:06.154991+0000","last_clean":"2024-08-17T02:23:06.154991+0000","last_became_active":"2024-08-17T02:23:05.132024+0000","last_became_peered":"2024-08-17T02:23:05.132024+0000","last_unstale":"2024-08-17T02:23:06.154991+0000","last_undegraded":"2024-08-17T02:23:06.154991+0000","last_fullsized":"2024-08-17T02:23:06.154991+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:24:56.230424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.146076+0000","last_change":"2024-08-17T02:23:06.144970+0000","last_active":"2024-08-17T02:23:06.146076+0000","last_peered":"2024-08-17T02:23:06.146076+0000","last_clean":"2024-08-17T02:23:06.146076+0000","last_became_active":"2024-08-17T02:23:06.144678+0000","last_became_peered":"2024-08-17T02:23:06.144678+0000","last_unstale":"2024-08-17T02:23:06.146076+0000","last_undegraded":"2024-08-17T02:23:06.146076+0000","last_fullsized":"2024-08-17T02:23:06.146076+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:00:41.237529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.153262+0000","last_change":"2024-08-17T02:23:05.132943+0000","last_active":"2024-08-17T02:23:06.153262+0000","last_peered":"2024-08-17T02:23:06.153262+0000","last_clean":"2024-08-17T02:23:06.153262+0000","last_became_active":"2024-08-17T02:23:05.132687+0000","last_became_peered":"2024-08-17T02:23:05.132687+0000","last_unstale":"2024-08-17T02:23:06.153262+0000","last_undegraded":"2024-08-17T02:23:06.153262+0000","last_fullsized":"2024-08-17T02:23:06.153262+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:53.382969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.150854+0000","last_change":"2024-08-17T02:23:06.146821+0000","last_active":"2024-08-17T02:23:06.150854+0000","last_peered":"2024-08-17T02:23:06.150854+0000","last_clean":"2024-08-17T02:23:06.150854+0000","last_became_active":"2024-08-17T02:23:06.146563+0000","last_became_peered":"2024-08-17T02:23:06.146563+0000","last_unstale":"2024-08-17T02:23:06.150854+0000","last_undegraded":"2024-08-17T02:23:06.150854+0000","last_fullsized":"2024-08-17T02:23:06.150854+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:15:47.325801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.155625+0000","last_change":"2024-08-17T02:23:05.130615+0000","last_active":"2024-08-17T02:23:06.155625+0000","last_peered":"2024-08-17T02:23:06.155625+0000","last_clean":"2024-08-17T02:23:06.155625+0000","last_became_active":"2024-08-17T02:23:05.130154+0000","last_became_peered":"2024-08-17T02:23:05.130154+0000","last_unstale":"2024-08-17T02:23:06.155625+0000","last_undegraded":"2024-08-17T02:23:06.155625+0000","last_fullsized":"2024-08-17T02:23:06.155625+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:00:40.234655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.158277+0000","last_change":"2024-08-17T02:23:06.154376+0000","last_active":"2024-08-17T02:23:06.158277+0000","last_peered":"2024-08-17T02:23:06.158277+0000","last_clean":"2024-08-17T02:23:06.158277+0000","last_became_active":"2024-08-17T02:23:06.154088+0000","last_became_peered":"2024-08-17T02:23:06.154088+0000","last_unstale":"2024-08-17T02:23:06.158277+0000","last_undegraded":"2024-08-17T02:23:06.158277+0000","last_fullsized":"2024-08-17T02:23:06.158277+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:00:46.078945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.133735+0000","last_change":"2024-08-17T02:23:05.131354+0000","last_active":"2024-08-17T02:23:06.133735+0000","last_peered":"2024-08-17T02:23:06.133735+0000","last_clean":"2024-08-17T02:23:06.133735+0000","last_became_active":"2024-08-17T02:23:05.131068+0000","last_became_peered":"2024-08-17T02:23:05.131068+0000","last_unstale":"2024-08-17T02:23:06.133735+0000","last_undegraded":"2024-08-17T02:23:06.133735+0000","last_fullsized":"2024-08-17T02:23:06.133735+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:43:24.352695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.155935+0000","last_change":"2024-08-17T02:23:06.151915+0000","last_active":"2024-08-17T02:23:06.155935+0000","last_peered":"2024-08-17T02:23:06.155935+0000","last_clean":"2024-08-17T02:23:06.155935+0000","last_became_active":"2024-08-17T02:23:06.151610+0000","last_became_peered":"2024-08-17T02:23:06.151610+0000","last_unstale":"2024-08-17T02:23:06.155935+0000","last_undegraded":"2024-08-17T02:23:06.155935+0000","last_fullsized":"2024-08-17T02:23:06.155935+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:55:37.879421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.137519+0000","last_change":"2024-08-17T02:23:05.134552+0000","last_active":"2024-08-17T02:23:06.137519+0000","last_peered":"2024-08-17T02:23:06.137519+0000","last_clean":"2024-08-17T02:23:06.137519+0000","last_became_active":"2024-08-17T02:23:05.134226+0000","last_became_peered":"2024-08-17T02:23:05.134226+0000","last_unstale":"2024-08-17T02:23:06.137519+0000","last_undegraded":"2024-08-17T02:23:06.137519+0000","last_fullsized":"2024-08-17T02:23:06.137519+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:46:51.679997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.152727+0000","last_change":"2024-08-17T02:23:06.146714+0000","last_active":"2024-08-17T02:23:06.152727+0000","last_peered":"2024-08-17T02:23:06.152727+0000","last_clean":"2024-08-17T02:23:06.152727+0000","last_became_active":"2024-08-17T02:23:06.146469+0000","last_became_peered":"2024-08-17T02:23:06.146469+0000","last_unstale":"2024-08-17T02:23:06.152727+0000","last_undegraded":"2024-08-17T02:23:06.152727+0000","last_fullsized":"2024-08-17T02:23:06.152727+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:56:31.082425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.131254+0000","last_change":"2024-08-17T02:23:05.129495+0000","last_active":"2024-08-17T02:23:06.131254+0000","last_peered":"2024-08-17T02:23:06.131254+0000","last_clean":"2024-08-17T02:23:06.131254+0000","last_became_active":"2024-08-17T02:23:05.129217+0000","last_became_peered":"2024-08-17T02:23:05.129217+0000","last_unstale":"2024-08-17T02:23:06.131254+0000","last_undegraded":"2024-08-17T02:23:06.131254+0000","last_fullsized":"2024-08-17T02:23:06.131254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:28:34.650180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.141190+0000","last_change":"2024-08-17T02:23:06.135396+0000","last_active":"2024-08-17T02:23:06.141190+0000","last_peered":"2024-08-17T02:23:06.141190+0000","last_clean":"2024-08-17T02:23:06.141190+0000","last_became_active":"2024-08-17T02:23:06.135067+0000","last_became_peered":"2024-08-17T02:23:06.135067+0000","last_unstale":"2024-08-17T02:23:06.141190+0000","last_undegraded":"2024-08-17T02:23:06.141190+0000","last_fullsized":"2024-08-17T02:23:06.141190+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:43.814412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.129571+0000","last_change":"2024-08-17T02:23:05.127494+0000","last_active":"2024-08-17T02:23:06.129571+0000","last_peered":"2024-08-17T02:23:06.129571+0000","last_clean":"2024-08-17T02:23:06.129571+0000","last_became_active":"2024-08-17T02:23:05.127161+0000","last_became_peered":"2024-08-17T02:23:05.127161+0000","last_unstale":"2024-08-17T02:23:06.129571+0000","last_undegraded":"2024-08-17T02:23:06.129571+0000","last_fullsized":"2024-08-17T02:23:06.129571+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:18:08.446121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.151951+0000","last_change":"2024-08-17T02:23:06.147086+0000","last_active":"2024-08-17T02:23:06.151951+0000","last_peered":"2024-08-17T02:23:06.151951+0000","last_clean":"2024-08-17T02:23:06.151951+0000","last_became_active":"2024-08-17T02:23:06.144662+0000","last_became_peered":"2024-08-17T02:23:06.144662+0000","last_unstale":"2024-08-17T02:23:06.151951+0000","last_undegraded":"2024-08-17T02:23:06.151951+0000","last_fullsized":"2024-08-17T02:23:06.151951+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:49:10.344944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.150330+0000","last_change":"2024-08-17T02:23:05.130614+0000","last_active":"2024-08-17T02:23:06.150330+0000","last_peered":"2024-08-17T02:23:06.150330+0000","last_clean":"2024-08-17T02:23:06.150330+0000","last_became_active":"2024-08-17T02:23:05.130337+0000","last_became_peered":"2024-08-17T02:23:05.130337+0000","last_unstale":"2024-08-17T02:23:06.150330+0000","last_undegraded":"2024-08-17T02:23:06.150330+0000","last_fullsized":"2024-08-17T02:23:06.150330+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:42:57.107946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.155301+0000","last_change":"2024-08-17T02:23:06.149918+0000","last_active":"2024-08-17T02:23:06.155301+0000","last_peered":"2024-08-17T02:23:06.155301+0000","last_clean":"2024-08-17T02:23:06.155301+0000","last_became_active":"2024-08-17T02:23:06.149065+0000","last_became_peered":"2024-08-17T02:23:06.149065+0000","last_unstale":"2024-08-17T02:23:06.155301+0000","last_undegraded":"2024-08-17T02:23:06.155301+0000","last_fullsized":"2024-08-17T02:23:06.155301+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:42:31.935493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.161117+0000","last_change":"2024-08-17T02:23:05.135231+0000","last_active":"2024-08-17T02:23:06.161117+0000","last_peered":"2024-08-17T02:23:06.161117+0000","last_clean":"2024-08-17T02:23:06.161117+0000","last_became_active":"2024-08-17T02:23:05.134929+0000","last_became_peered":"2024-08-17T02:23:05.134929+0000","last_unstale":"2024-08-17T02:23:06.161117+0000","last_undegraded":"2024-08-17T02:23:06.161117+0000","last_fullsized":"2024-08-17T02:23:06.161117+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:30:51.222253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.150199+0000","last_change":"2024-08-17T02:23:06.148431+0000","last_active":"2024-08-17T02:23:06.150199+0000","last_peered":"2024-08-17T02:23:06.150199+0000","last_clean":"2024-08-17T02:23:06.150199+0000","last_became_active":"2024-08-17T02:23:06.147783+0000","last_became_peered":"2024-08-17T02:23:06.147783+0000","last_unstale":"2024-08-17T02:23:06.150199+0000","last_undegraded":"2024-08-17T02:23:06.150199+0000","last_fullsized":"2024-08-17T02:23:06.150199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:47:06.427349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.156635+0000","last_change":"2024-08-17T02:23:05.131953+0000","last_active":"2024-08-17T02:23:06.156635+0000","last_peered":"2024-08-17T02:23:06.156635+0000","last_clean":"2024-08-17T02:23:06.156635+0000","last_became_active":"2024-08-17T02:23:05.131229+0000","last_became_peered":"2024-08-17T02:23:05.131229+0000","last_unstale":"2024-08-17T02:23:06.156635+0000","last_undegraded":"2024-08-17T02:23:06.156635+0000","last_fullsized":"2024-08-17T02:23:06.156635+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:32:59.217946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.152662+0000","last_change":"2024-08-17T02:23:06.151547+0000","last_active":"2024-08-17T02:23:06.152662+0000","last_peered":"2024-08-17T02:23:06.152662+0000","last_clean":"2024-08-17T02:23:06.152662+0000","last_became_active":"2024-08-17T02:23:06.151233+0000","last_became_peered":"2024-08-17T02:23:06.151233+0000","last_unstale":"2024-08-17T02:23:06.152662+0000","last_undegraded":"2024-08-17T02:23:06.152662+0000","last_fullsized":"2024-08-17T02:23:06.152662+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:59:45.844926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.131655+0000","last_change":"2024-08-17T02:23:05.130294+0000","last_active":"2024-08-17T02:23:06.131655+0000","last_peered":"2024-08-17T02:23:06.131655+0000","last_clean":"2024-08-17T02:23:06.131655+0000","last_became_active":"2024-08-17T02:23:05.127751+0000","last_became_peered":"2024-08-17T02:23:05.127751+0000","last_unstale":"2024-08-17T02:23:06.131655+0000","last_undegraded":"2024-08-17T02:23:06.131655+0000","last_fullsized":"2024-08-17T02:23:06.131655+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:50:26.954799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.151429+0000","last_change":"2024-08-17T02:23:06.142494+0000","last_active":"2024-08-17T02:23:06.151429+0000","last_peered":"2024-08-17T02:23:06.151429+0000","last_clean":"2024-08-17T02:23:06.151429+0000","last_became_active":"2024-08-17T02:23:06.141443+0000","last_became_peered":"2024-08-17T02:23:06.141443+0000","last_unstale":"2024-08-17T02:23:06.151429+0000","last_undegraded":"2024-08-17T02:23:06.151429+0000","last_fullsized":"2024-08-17T02:23:06.151429+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:05:17.742125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.127919+0000","last_change":"2024-08-17T02:23:05.129835+0000","last_active":"2024-08-17T02:23:06.127919+0000","last_peered":"2024-08-17T02:23:06.127919+0000","last_clean":"2024-08-17T02:23:06.127919+0000","last_became_active":"2024-08-17T02:23:05.129466+0000","last_became_peered":"2024-08-17T02:23:05.129466+0000","last_unstale":"2024-08-17T02:23:06.127919+0000","last_undegraded":"2024-08-17T02:23:06.127919+0000","last_fullsized":"2024-08-17T02:23:06.127919+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:03:48.824519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.147221+0000","last_change":"2024-08-17T02:23:06.142071+0000","last_active":"2024-08-17T02:23:06.147221+0000","last_peered":"2024-08-17T02:23:06.147221+0000","last_clean":"2024-08-17T02:23:06.147221+0000","last_became_active":"2024-08-17T02:23:06.141767+0000","last_became_peered":"2024-08-17T02:23:06.141767+0000","last_unstale":"2024-08-17T02:23:06.147221+0000","last_undegraded":"2024-08-17T02:23:06.147221+0000","last_fullsized":"2024-08-17T02:23:06.147221+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:58.019950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.157601+0000","last_change":"2024-08-17T02:23:05.131707+0000","last_active":"2024-08-17T02:23:06.157601+0000","last_peered":"2024-08-17T02:23:06.157601+0000","last_clean":"2024-08-17T02:23:06.157601+0000","last_became_active":"2024-08-17T02:23:05.131283+0000","last_became_peered":"2024-08-17T02:23:05.131283+0000","last_unstale":"2024-08-17T02:23:06.157601+0000","last_undegraded":"2024-08-17T02:23:06.157601+0000","last_fullsized":"2024-08-17T02:23:06.157601+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:39:51.833007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.147942+0000","last_change":"2024-08-17T02:23:06.140986+0000","last_active":"2024-08-17T02:23:06.147942+0000","last_peered":"2024-08-17T02:23:06.147942+0000","last_clean":"2024-08-17T02:23:06.147942+0000","last_became_active":"2024-08-17T02:23:06.140706+0000","last_became_peered":"2024-08-17T02:23:06.140706+0000","last_unstale":"2024-08-17T02:23:06.147942+0000","last_undegraded":"2024-08-17T02:23:06.147942+0000","last_fullsized":"2024-08-17T02:23:06.147942+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:53:27.361531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.152246+0000","last_change":"2024-08-17T02:23:05.134848+0000","last_active":"2024-08-17T02:23:06.152246+0000","last_peered":"2024-08-17T02:23:06.152246+0000","last_clean":"2024-08-17T02:23:06.152246+0000","last_became_active":"2024-08-17T02:23:05.134528+0000","last_became_peered":"2024-08-17T02:23:05.134528+0000","last_unstale":"2024-08-17T02:23:06.152246+0000","last_undegraded":"2024-08-17T02:23:06.152246+0000","last_fullsized":"2024-08-17T02:23:06.152246+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:00:45.076071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.158365+0000","last_change":"2024-08-17T02:23:06.154517+0000","last_active":"2024-08-17T02:23:06.158365+0000","last_peered":"2024-08-17T02:23:06.158365+0000","last_clean":"2024-08-17T02:23:06.158365+0000","last_became_active":"2024-08-17T02:23:06.154215+0000","last_became_peered":"2024-08-17T02:23:06.154215+0000","last_unstale":"2024-08-17T02:23:06.158365+0000","last_undegraded":"2024-08-17T02:23:06.158365+0000","last_fullsized":"2024-08-17T02:23:06.158365+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:11:55.605296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.156724+0000","last_change":"2024-08-17T02:23:05.131655+0000","last_active":"2024-08-17T02:23:06.156724+0000","last_peered":"2024-08-17T02:23:06.156724+0000","last_clean":"2024-08-17T02:23:06.156724+0000","last_became_active":"2024-08-17T02:23:05.131377+0000","last_became_peered":"2024-08-17T02:23:05.131377+0000","last_unstale":"2024-08-17T02:23:06.156724+0000","last_undegraded":"2024-08-17T02:23:06.156724+0000","last_fullsized":"2024-08-17T02:23:06.156724+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:11:54.602422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.151602+0000","last_change":"2024-08-17T02:23:06.148729+0000","last_active":"2024-08-17T02:23:06.151602+0000","last_peered":"2024-08-17T02:23:06.151602+0000","last_clean":"2024-08-17T02:23:06.151602+0000","last_became_active":"2024-08-17T02:23:06.148414+0000","last_became_peered":"2024-08-17T02:23:06.148414+0000","last_unstale":"2024-08-17T02:23:06.151602+0000","last_undegraded":"2024-08-17T02:23:06.151602+0000","last_fullsized":"2024-08-17T02:23:06.151602+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:42:58.110820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.148970+0000","last_change":"2024-08-17T02:23:05.125731+0000","last_active":"2024-08-17T02:23:06.148970+0000","last_peered":"2024-08-17T02:23:06.148970+0000","last_clean":"2024-08-17T02:23:06.148970+0000","last_became_active":"2024-08-17T02:23:05.125289+0000","last_became_peered":"2024-08-17T02:23:05.125289+0000","last_unstale":"2024-08-17T02:23:06.148970+0000","last_undegraded":"2024-08-17T02:23:06.148970+0000","last_fullsized":"2024-08-17T02:23:06.148970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:59:44.842051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.159518+0000","last_change":"2024-08-17T02:23:06.157822+0000","last_active":"2024-08-17T02:23:06.159518+0000","last_peered":"2024-08-17T02:23:06.159518+0000","last_clean":"2024-08-17T02:23:06.159518+0000","last_became_active":"2024-08-17T02:23:06.157520+0000","last_became_peered":"2024-08-17T02:23:06.157520+0000","last_unstale":"2024-08-17T02:23:06.159518+0000","last_undegraded":"2024-08-17T02:23:06.159518+0000","last_fullsized":"2024-08-17T02:23:06.159518+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:07:24.622175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.146931+0000","last_change":"2024-08-17T02:23:05.132323+0000","last_active":"2024-08-17T02:23:06.146931+0000","last_peered":"2024-08-17T02:23:06.146931+0000","last_clean":"2024-08-17T02:23:06.146931+0000","last_became_active":"2024-08-17T02:23:05.132033+0000","last_became_peered":"2024-08-17T02:23:05.132033+0000","last_unstale":"2024-08-17T02:23:06.146931+0000","last_undegraded":"2024-08-17T02:23:06.146931+0000","last_fullsized":"2024-08-17T02:23:06.146931+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:03:48.824519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.156002+0000","last_change":"2024-08-17T02:23:06.151167+0000","last_active":"2024-08-17T02:23:06.156002+0000","last_peered":"2024-08-17T02:23:06.156002+0000","last_clean":"2024-08-17T02:23:06.156002+0000","last_became_active":"2024-08-17T02:23:06.150722+0000","last_became_peered":"2024-08-17T02:23:06.150722+0000","last_unstale":"2024-08-17T02:23:06.156002+0000","last_undegraded":"2024-08-17T02:23:06.156002+0000","last_fullsized":"2024-08-17T02:23:06.156002+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:05:51.704819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.149829+0000","last_change":"2024-08-17T02:23:05.132954+0000","last_active":"2024-08-17T02:23:06.149829+0000","last_peered":"2024-08-17T02:23:06.149829+0000","last_clean":"2024-08-17T02:23:06.149829+0000","last_became_active":"2024-08-17T02:23:05.132643+0000","last_became_peered":"2024-08-17T02:23:05.132643+0000","last_unstale":"2024-08-17T02:23:06.149829+0000","last_undegraded":"2024-08-17T02:23:06.149829+0000","last_fullsized":"2024-08-17T02:23:06.149829+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:51:42.042652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.145011+0000","last_change":"2024-08-17T02:23:06.142172+0000","last_active":"2024-08-17T02:23:06.145011+0000","last_peered":"2024-08-17T02:23:06.145011+0000","last_clean":"2024-08-17T02:23:06.145011+0000","last_became_active":"2024-08-17T02:23:06.141823+0000","last_became_peered":"2024-08-17T02:23:06.141823+0000","last_unstale":"2024-08-17T02:23:06.145011+0000","last_undegraded":"2024-08-17T02:23:06.145011+0000","last_fullsized":"2024-08-17T02:23:06.145011+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:16:09.491817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.140388+0000","last_change":"2024-08-17T02:23:05.131606+0000","last_active":"2024-08-17T02:23:06.140388+0000","last_peered":"2024-08-17T02:23:06.140388+0000","last_clean":"2024-08-17T02:23:06.140388+0000","last_became_active":"2024-08-17T02:23:05.131339+0000","last_became_peered":"2024-08-17T02:23:05.131339+0000","last_unstale":"2024-08-17T02:23:06.140388+0000","last_undegraded":"2024-08-17T02:23:06.140388+0000","last_fullsized":"2024-08-17T02:23:06.140388+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:46:05.090766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.153570+0000","last_change":"2024-08-17T02:23:06.150303+0000","last_active":"2024-08-17T02:23:06.153570+0000","last_peered":"2024-08-17T02:23:06.153570+0000","last_clean":"2024-08-17T02:23:06.153570+0000","last_became_active":"2024-08-17T02:23:06.150005+0000","last_became_peered":"2024-08-17T02:23:06.150005+0000","last_unstale":"2024-08-17T02:23:06.153570+0000","last_undegraded":"2024-08-17T02:23:06.153570+0000","last_fullsized":"2024-08-17T02:23:06.153570+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:36:37.616414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.134215+0000","last_change":"2024-08-17T02:23:05.122172+0000","last_active":"2024-08-17T02:23:06.134215+0000","last_peered":"2024-08-17T02:23:06.134215+0000","last_clean":"2024-08-17T02:23:06.134215+0000","last_became_active":"2024-08-17T02:23:05.121899+0000","last_became_peered":"2024-08-17T02:23:05.121899+0000","last_unstale":"2024-08-17T02:23:06.134215+0000","last_undegraded":"2024-08-17T02:23:06.134215+0000","last_fullsized":"2024-08-17T02:23:06.134215+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:30:54.632598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.160932+0000","last_change":"2024-08-17T02:23:06.157189+0000","last_active":"2024-08-17T02:23:06.160932+0000","last_peered":"2024-08-17T02:23:06.160932+0000","last_clean":"2024-08-17T02:23:06.160932+0000","last_became_active":"2024-08-17T02:23:06.156895+0000","last_became_peered":"2024-08-17T02:23:06.156895+0000","last_unstale":"2024-08-17T02:23:06.160932+0000","last_undegraded":"2024-08-17T02:23:06.160932+0000","last_fullsized":"2024-08-17T02:23:06.160932+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:54.385844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.127402+0000","last_change":"2024-08-17T02:23:05.125262+0000","last_active":"2024-08-17T02:23:06.127402+0000","last_peered":"2024-08-17T02:23:06.127402+0000","last_clean":"2024-08-17T02:23:06.127402+0000","last_became_active":"2024-08-17T02:23:05.124970+0000","last_became_peered":"2024-08-17T02:23:05.124970+0000","last_unstale":"2024-08-17T02:23:06.127402+0000","last_undegraded":"2024-08-17T02:23:06.127402+0000","last_fullsized":"2024-08-17T02:23:06.127402+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:50:23.719525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.156607+0000","last_change":"2024-08-17T02:23:06.150526+0000","last_active":"2024-08-17T02:23:06.156607+0000","last_peered":"2024-08-17T02:23:06.156607+0000","last_clean":"2024-08-17T02:23:06.156607+0000","last_became_active":"2024-08-17T02:23:06.150009+0000","last_became_peered":"2024-08-17T02:23:06.150009+0000","last_unstale":"2024-08-17T02:23:06.156607+0000","last_undegraded":"2024-08-17T02:23:06.156607+0000","last_fullsized":"2024-08-17T02:23:06.156607+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:50:27.957673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.149092+0000","last_change":"2024-08-17T02:23:05.129474+0000","last_active":"2024-08-17T02:23:06.149092+0000","last_peered":"2024-08-17T02:23:06.149092+0000","last_clean":"2024-08-17T02:23:06.149092+0000","last_became_active":"2024-08-17T02:23:05.129170+0000","last_became_peered":"2024-08-17T02:23:05.129170+0000","last_unstale":"2024-08-17T02:23:06.149092+0000","last_undegraded":"2024-08-17T02:23:06.149092+0000","last_fullsized":"2024-08-17T02:23:06.149092+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:42:07.721958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.155170+0000","last_change":"2024-08-17T02:23:06.149745+0000","last_active":"2024-08-17T02:23:06.155170+0000","last_peered":"2024-08-17T02:23:06.155170+0000","last_clean":"2024-08-17T02:23:06.155170+0000","last_became_active":"2024-08-17T02:23:06.149330+0000","last_became_peered":"2024-08-17T02:23:06.149330+0000","last_unstale":"2024-08-17T02:23:06.155170+0000","last_undegraded":"2024-08-17T02:23:06.155170+0000","last_fullsized":"2024-08-17T02:23:06.155170+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:23:18.846223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:23:07.153421+0000","last_change":"2024-08-17T02:23:05.127273+0000","last_active":"2024-08-17T02:23:07.153421+0000","last_peered":"2024-08-17T02:23:07.153421+0000","last_clean":"2024-08-17T02:23:07.153421+0000","last_became_active":"2024-08-17T02:23:05.126965+0000","last_became_peered":"2024-08-17T02:23:05.126965+0000","last_unstale":"2024-08-17T02:23:07.153421+0000","last_undegraded":"2024-08-17T02:23:07.153421+0000","last_fullsized":"2024-08-17T02:23:07.153421+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:56:34.757340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.156757+0000","last_change":"2024-08-17T02:23:06.150877+0000","last_active":"2024-08-17T02:23:06.156757+0000","last_peered":"2024-08-17T02:23:06.156757+0000","last_clean":"2024-08-17T02:23:06.156757+0000","last_became_active":"2024-08-17T02:23:06.150526+0000","last_became_peered":"2024-08-17T02:23:06.150526+0000","last_unstale":"2024-08-17T02:23:06.156757+0000","last_undegraded":"2024-08-17T02:23:06.156757+0000","last_fullsized":"2024-08-17T02:23:06.156757+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:51:43.045526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.141078+0000","last_change":"2024-08-17T02:23:05.132667+0000","last_active":"2024-08-17T02:23:06.141078+0000","last_peered":"2024-08-17T02:23:06.141078+0000","last_clean":"2024-08-17T02:23:06.141078+0000","last_became_active":"2024-08-17T02:23:05.132411+0000","last_became_peered":"2024-08-17T02:23:05.132411+0000","last_unstale":"2024-08-17T02:23:06.141078+0000","last_undegraded":"2024-08-17T02:23:06.141078+0000","last_fullsized":"2024-08-17T02:23:06.141078+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:17:04.568520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.151374+0000","last_change":"2024-08-17T02:23:06.147442+0000","last_active":"2024-08-17T02:23:06.151374+0000","last_peered":"2024-08-17T02:23:06.151374+0000","last_clean":"2024-08-17T02:23:06.151374+0000","last_became_active":"2024-08-17T02:23:06.147114+0000","last_became_peered":"2024-08-17T02:23:06.147114+0000","last_unstale":"2024-08-17T02:23:06.151374+0000","last_undegraded":"2024-08-17T02:23:06.151374+0000","last_fullsized":"2024-08-17T02:23:06.151374+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:43.814412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.140878+0000","last_change":"2024-08-17T02:23:05.130065+0000","last_active":"2024-08-17T02:23:06.140878+0000","last_peered":"2024-08-17T02:23:06.140878+0000","last_clean":"2024-08-17T02:23:06.140878+0000","last_became_active":"2024-08-17T02:23:05.129826+0000","last_became_peered":"2024-08-17T02:23:05.129826+0000","last_unstale":"2024-08-17T02:23:06.140878+0000","last_undegraded":"2024-08-17T02:23:06.140878+0000","last_fullsized":"2024-08-17T02:23:06.140878+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:42:30.234703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.150880+0000","last_change":"2024-08-17T02:23:06.144436+0000","last_active":"2024-08-17T02:23:06.150880+0000","last_peered":"2024-08-17T02:23:06.150880+0000","last_clean":"2024-08-17T02:23:06.150880+0000","last_became_active":"2024-08-17T02:23:06.144140+0000","last_became_peered":"2024-08-17T02:23:06.144140+0000","last_unstale":"2024-08-17T02:23:06.150880+0000","last_undegraded":"2024-08-17T02:23:06.150880+0000","last_fullsized":"2024-08-17T02:23:06.150880+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:50:24.722399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.140266+0000","last_change":"2024-08-17T02:23:05.131949+0000","last_active":"2024-08-17T02:23:06.140266+0000","last_peered":"2024-08-17T02:23:06.140266+0000","last_clean":"2024-08-17T02:23:06.140266+0000","last_became_active":"2024-08-17T02:23:05.131611+0000","last_became_peered":"2024-08-17T02:23:05.131611+0000","last_unstale":"2024-08-17T02:23:06.140266+0000","last_undegraded":"2024-08-17T02:23:06.140266+0000","last_fullsized":"2024-08-17T02:23:06.140266+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:10.662004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.150919+0000","last_change":"2024-08-17T02:23:06.146737+0000","last_active":"2024-08-17T02:23:06.150919+0000","last_peered":"2024-08-17T02:23:06.150919+0000","last_clean":"2024-08-17T02:23:06.150919+0000","last_became_active":"2024-08-17T02:23:06.142863+0000","last_became_peered":"2024-08-17T02:23:06.142863+0000","last_unstale":"2024-08-17T02:23:06.150919+0000","last_undegraded":"2024-08-17T02:23:06.150919+0000","last_fullsized":"2024-08-17T02:23:06.150919+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:37:35.128994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.140730+0000","last_change":"2024-08-17T02:23:05.131675+0000","last_active":"2024-08-17T02:23:06.140730+0000","last_peered":"2024-08-17T02:23:06.140730+0000","last_clean":"2024-08-17T02:23:06.140730+0000","last_became_active":"2024-08-17T02:23:05.131361+0000","last_became_peered":"2024-08-17T02:23:05.131361+0000","last_unstale":"2024-08-17T02:23:06.140730+0000","last_undegraded":"2024-08-17T02:23:06.140730+0000","last_fullsized":"2024-08-17T02:23:06.140730+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:00:45.076071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.147242+0000","last_change":"2024-08-17T02:23:06.142270+0000","last_active":"2024-08-17T02:23:06.147242+0000","last_peered":"2024-08-17T02:23:06.147242+0000","last_clean":"2024-08-17T02:23:06.147242+0000","last_became_active":"2024-08-17T02:23:06.141822+0000","last_became_peered":"2024-08-17T02:23:06.141822+0000","last_unstale":"2024-08-17T02:23:06.147242+0000","last_undegraded":"2024-08-17T02:23:06.147242+0000","last_fullsized":"2024-08-17T02:23:06.147242+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:34:03.634969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.128145+0000","last_change":"2024-08-17T02:23:05.132314+0000","last_active":"2024-08-17T02:23:06.128145+0000","last_peered":"2024-08-17T02:23:06.128145+0000","last_clean":"2024-08-17T02:23:06.128145+0000","last_became_active":"2024-08-17T02:23:05.131156+0000","last_became_peered":"2024-08-17T02:23:05.131156+0000","last_unstale":"2024-08-17T02:23:06.128145+0000","last_undegraded":"2024-08-17T02:23:06.128145+0000","last_fullsized":"2024-08-17T02:23:06.128145+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:46:51.679997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.160806+0000","last_change":"2024-08-17T02:23:06.156023+0000","last_active":"2024-08-17T02:23:06.160806+0000","last_peered":"2024-08-17T02:23:06.160806+0000","last_clean":"2024-08-17T02:23:06.160806+0000","last_became_active":"2024-08-17T02:23:06.155695+0000","last_became_peered":"2024-08-17T02:23:06.155695+0000","last_unstale":"2024-08-17T02:23:06.160806+0000","last_undegraded":"2024-08-17T02:23:06.160806+0000","last_fullsized":"2024-08-17T02:23:06.160806+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:08:18.958141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.129184+0000","last_change":"2024-08-17T02:23:05.125549+0000","last_active":"2024-08-17T02:23:06.129184+0000","last_peered":"2024-08-17T02:23:06.129184+0000","last_clean":"2024-08-17T02:23:06.129184+0000","last_became_active":"2024-08-17T02:23:05.124923+0000","last_became_peered":"2024-08-17T02:23:05.124923+0000","last_unstale":"2024-08-17T02:23:06.129184+0000","last_undegraded":"2024-08-17T02:23:06.129184+0000","last_fullsized":"2024-08-17T02:23:06.129184+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:19:03.065311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":171,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.134630+0000","last_change":"2024-08-17T02:22:11.967052+0000","last_active":"2024-08-17T02:23:06.134630+0000","last_peered":"2024-08-17T02:23:06.134630+0000","last_clean":"2024-08-17T02:23:06.134630+0000","last_became_active":"2024-08-17T02:22:11.965269+0000","last_became_peered":"2024-08-17T02:22:11.965269+0000","last_unstale":"2024-08-17T02:23:06.134630+0000","last_undegraded":"2024-08-17T02:23:06.134630+0000","last_fullsized":"2024-08-17T02:23:06.134630+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:10.930862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:10.930862+0000","last_clean_scrub_stamp":"2024-08-17T02:22:10.930862+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:59:34.931003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297736,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074104,"statfs":{"total":96636764160,"available":96331882496,"internally_reserved":0,"allocated":380928,"data_stored":143721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]}]},{"osd":5,"up_from":15,"seq":64424509456,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298312,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073528,"statfs":{"total":96636764160,"available":96331292672,"internally_reserved":0,"allocated":974848,"data_stored":734637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.244}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2909999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509456,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297740,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074100,"statfs":{"total":96636764160,"available":96331878400,"internally_reserved":0,"allocated":393216,"data_stored":145273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0940000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297740,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074100,"statfs":{"total":96636764160,"available":96331878400,"internally_reserved":0,"allocated":393216,"data_stored":144463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]}]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297736,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074104,"statfs":{"total":96636764160,"available":96331882496,"internally_reserved":0,"allocated":380928,"data_stored":143733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]}]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298312,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073528,"statfs":{"total":96636764160,"available":96331292672,"internally_reserved":0,"allocated":974848,"data_stored":734137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]}]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297736,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074104,"statfs":{"total":96636764160,"available":96331882496,"internally_reserved":0,"allocated":380928,"data_stored":143789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3460000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.244}]}]},{"osd":6,"up_from":14,"seq":60129542161,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301892,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069948,"statfs":{"total":96636764160,"available":96327626752,"internally_reserved":0,"allocated":376832,"data_stored":138963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:23:13.525 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:23:13.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.634+0000 7f1a4ade5700 1 Processor -- start 2024-08-17T02:23:13.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.634+0000 7f1a4ade5700 1 -- start start 2024-08-17T02:23:13.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.634+0000 7f1a4ade5700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1a44154900 0x7f1a440b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:13.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.634+0000 7f1a4ade5700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f1a440b12d0 0x7f1a440cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:13.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.634+0000 7f1a4ade5700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a440b1730 con 0x7f1a440cb390 2024-08-17T02:23:13.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.634+0000 7f1a4ade5700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a44068790 con 0x7f1a440b12d0 2024-08-17T02:23:13.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.634+0000 7f1a4ade5700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a441583f0 con 0x7f1a44154900 2024-08-17T02:23:13.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.638+0000 7f1a495e2700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f1a440b12d0 0x7f1a440cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:13.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.638+0000 7f1a495e2700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f1a440b12d0 0x7f1a440cae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35294/0 (socket says 172.21.15.104:35294) 2024-08-17T02:23:13.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.638+0000 7f1a495e2700 1 -- 172.21.15.104:0/4078319486 learned_addr learned my addr 172.21.15.104:0/4078319486 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:13.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.638+0000 7f1a49de3700 1 --2- 172.21.15.104:0/4078319486 >> v2:172.21.15.117:3300/0 conn(0x7f1a44154900 0x7f1a440b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:13.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.638+0000 7f1a48de1700 1 -- 172.21.15.104:0/4078319486 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3504454567 0 0) 0x7f1a3c001490 con 0x7f1a440cb390 2024-08-17T02:23:13.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.638+0000 7f1a48de1700 1 -- 172.21.15.104:0/4078319486 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a30003570 con 0x7f1a440cb390 2024-08-17T02:23:13.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.638+0000 7f1a495e2700 1 -- 172.21.15.104:0/4078319486 >> v2:172.21.15.117:3300/0 conn(0x7f1a44154900 msgr2=0x7f1a440b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:13.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.638+0000 7f1a495e2700 1 --2- 172.21.15.104:0/4078319486 >> v2:172.21.15.117:3300/0 conn(0x7f1a44154900 0x7f1a440b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:13.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.638+0000 7f1a495e2700 1 -- 172.21.15.104:0/4078319486 >> v1:172.21.15.104:6789/0 conn(0x7f1a440cb390 legacy=0x7f1a4406df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:13.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.638+0000 7f1a495e2700 1 -- 172.21.15.104:0/4078319486 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a440cbaa0 con 0x7f1a440b12d0 2024-08-17T02:23:13.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.638+0000 7f1a495e2700 1 --2- 172.21.15.104:0/4078319486 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1a440b12d0 0x7f1a440cae50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1a44064e60 tx=0x7f1a34009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbb47708db177574 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:13.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.638+0000 7f1a48de1700 1 -- 172.21.15.104:0/4078319486 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3400b640 con 0x7f1a440b12d0 2024-08-17T02:23:13.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.638+0000 7f1a48de1700 1 -- 172.21.15.104:0/4078319486 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3400b7a0 con 0x7f1a440b12d0 2024-08-17T02:23:13.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.638+0000 7f1a48de1700 1 -- 172.21.15.104:0/4078319486 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3400bb60 con 0x7f1a440b12d0 2024-08-17T02:23:13.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.638+0000 7f1a4ade5700 1 -- 172.21.15.104:0/4078319486 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1a440b12d0 msgr2=0x7f1a440cae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:13.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.638+0000 7f1a4ade5700 1 --2- 172.21.15.104:0/4078319486 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1a440b12d0 0x7f1a440cae50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1a44064e60 tx=0x7f1a34009250 comp rx=0 tx=0).stop 2024-08-17T02:23:13.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.638+0000 7f1a4ade5700 1 -- 172.21.15.104:0/4078319486 shutdown_connections 2024-08-17T02:23:13.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.638+0000 7f1a4ade5700 1 --2- 172.21.15.104:0/4078319486 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1a440b12d0 0x7f1a440cae50 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:13.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.638+0000 7f1a4ade5700 1 --2- 172.21.15.104:0/4078319486 >> v2:172.21.15.117:3300/0 conn(0x7f1a44154900 0x7f1a440b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:13.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.638+0000 7f1a4ade5700 1 -- 172.21.15.104:0/4078319486 >> 172.21.15.104:0/4078319486 conn(0x7f1a440678d0 msgr2=0x7f1a44067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:13.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.638+0000 7f1a4ade5700 1 -- 172.21.15.104:0/4078319486 shutdown_connections 2024-08-17T02:23:13.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.638+0000 7f1a4ade5700 1 -- 172.21.15.104:0/4078319486 wait complete. 2024-08-17T02:23:13.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.642+0000 7f1a4ade5700 1 Processor -- start 2024-08-17T02:23:13.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.642+0000 7f1a4ade5700 1 -- start start 2024-08-17T02:23:13.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.642+0000 7f1a4ade5700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1a440b12d0 0x7f1a44166fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:13.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.642+0000 7f1a4ade5700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a440cb390 0x7f1a4406ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:13.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.642+0000 7f1a4ade5700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a44154900 0x7f1a4406e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:13.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.642+0000 7f1a4ade5700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a440a63f0 con 0x7f1a440b12d0 2024-08-17T02:23:13.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.642+0000 7f1a4ade5700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a44167500 con 0x7f1a44154900 2024-08-17T02:23:13.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.642+0000 7f1a4ade5700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a440a6110 con 0x7f1a440cb390 2024-08-17T02:23:13.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.642+0000 7f1a49de3700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1a440b12d0 0x7f1a44166fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:13.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.642+0000 7f1a49de3700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1a440b12d0 0x7f1a44166fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35296/0 (socket says 172.21.15.104:35296) 2024-08-17T02:23:13.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.642+0000 7f1a49de3700 1 -- 172.21.15.104:0/2504069960 learned_addr learned my addr 172.21.15.104:0/2504069960 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:13.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.642+0000 7f1a4a5e4700 1 --2- 172.21.15.104:0/2504069960 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a44154900 0x7f1a4406e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:13.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.642+0000 7f1a495e2700 1 --2- 172.21.15.104:0/2504069960 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a440cb390 0x7f1a4406ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:13.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.642+0000 7f1a49de3700 1 -- 172.21.15.104:0/2504069960 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a440cb390 msgr2=0x7f1a4406ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:13.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.642+0000 7f1a49de3700 1 --2- 172.21.15.104:0/2504069960 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a440cb390 0x7f1a4406ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:13.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.642+0000 7f1a49de3700 1 -- 172.21.15.104:0/2504069960 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a44154900 msgr2=0x7f1a4406e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:13.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.642+0000 7f1a49de3700 1 --2- 172.21.15.104:0/2504069960 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a44154900 0x7f1a4406e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:13.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.642+0000 7f1a49de3700 1 -- 172.21.15.104:0/2504069960 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a340094f0 con 0x7f1a440b12d0 2024-08-17T02:23:13.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.642+0000 7f1a4a5e4700 1 --2- 172.21.15.104:0/2504069960 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a44154900 0x7f1a4406e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:13.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.642+0000 7f1a49de3700 1 --2- 172.21.15.104:0/2504069960 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1a440b12d0 0x7f1a44166fc0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1a4000ec80 tx=0x7f1a400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:13.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.642+0000 7f1a39ffb700 1 -- 172.21.15.104:0/2504069960 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4000c9d0 con 0x7f1a440b12d0 2024-08-17T02:23:13.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.642+0000 7f1a39ffb700 1 -- 172.21.15.104:0/2504069960 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4000cb30 con 0x7f1a440b12d0 2024-08-17T02:23:13.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.642+0000 7f1a4ade5700 1 -- 172.21.15.104:0/2504069960 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a440a7280 con 0x7f1a440b12d0 2024-08-17T02:23:13.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.642+0000 7f1a39ffb700 1 -- 172.21.15.104:0/2504069960 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a40013470 con 0x7f1a440b12d0 2024-08-17T02:23:13.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.642+0000 7f1a4ade5700 1 -- 172.21.15.104:0/2504069960 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a440a7840 con 0x7f1a440b12d0 2024-08-17T02:23:13.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.642+0000 7f1a4ade5700 1 -- 172.21.15.104:0/2504069960 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a440643a0 con 0x7f1a440b12d0 2024-08-17T02:23:13.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.646+0000 7f1a39ffb700 1 -- 172.21.15.104:0/2504069960 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1a40013820 con 0x7f1a440b12d0 2024-08-17T02:23:13.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.646+0000 7f1a39ffb700 1 --2- 172.21.15.104:0/2504069960 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f1a28060860 0x7f1a28062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:13.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.646+0000 7f1a39ffb700 1 -- 172.21.15.104:0/2504069960 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1a4007cf10 con 0x7f1a440b12d0 2024-08-17T02:23:13.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.646+0000 7f1a495e2700 1 --2- 172.21.15.104:0/2504069960 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f1a28060860 0x7f1a28062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:13.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.646+0000 7f1a495e2700 1 --2- 172.21.15.104:0/2504069960 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f1a28060860 0x7f1a28062d10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1a44064e60 tx=0x7f1a34017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:13.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.654+0000 7f1a39ffb700 1 -- 172.21.15.104:0/2504069960 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f1a4004d360 con 0x7f1a440b12d0 2024-08-17T02:23:13.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.814+0000 7f1a4ade5700 1 -- 172.21.15.104:0/2504069960 --> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1a4406f5f0 con 0x7f1a28060860 2024-08-17T02:23:13.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.834+0000 7f1a39ffb700 1 -- 172.21.15.104:0/2504069960 <== mgr.4111 v2:172.21.15.117:6832/24084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264579 (secure 0 0 0) 0x7f1a4406f5f0 con 0x7f1a28060860 2024-08-17T02:23:13.842 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:23:13.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.838+0000 7f1a4ade5700 1 -- 172.21.15.104:0/2504069960 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f1a28060860 msgr2=0x7f1a28062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:13.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.838+0000 7f1a4ade5700 1 --2- 172.21.15.104:0/2504069960 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f1a28060860 0x7f1a28062d10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1a44064e60 tx=0x7f1a34017000 comp rx=0 tx=0).stop 2024-08-17T02:23:13.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.838+0000 7f1a4ade5700 1 -- 172.21.15.104:0/2504069960 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1a440b12d0 msgr2=0x7f1a44166fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:13.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.838+0000 7f1a4ade5700 1 --2- 172.21.15.104:0/2504069960 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1a440b12d0 0x7f1a44166fc0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1a4000ec80 tx=0x7f1a400091a0 comp rx=0 tx=0).stop 2024-08-17T02:23:13.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.838+0000 7f1a4ade5700 1 -- 172.21.15.104:0/2504069960 shutdown_connections 2024-08-17T02:23:13.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.838+0000 7f1a4ade5700 1 --2- 172.21.15.104:0/2504069960 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f1a28060860 0x7f1a28062d10 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:13.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.838+0000 7f1a4ade5700 1 --2- 172.21.15.104:0/2504069960 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a44154900 0x7f1a4406e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:13.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.838+0000 7f1a4ade5700 1 --2- 172.21.15.104:0/2504069960 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a440cb390 0x7f1a4406ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:13.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.838+0000 7f1a4ade5700 1 --2- 172.21.15.104:0/2504069960 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1a440b12d0 0x7f1a44166fc0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:13.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.838+0000 7f1a4ade5700 1 -- 172.21.15.104:0/2504069960 >> 172.21.15.104:0/2504069960 conn(0x7f1a440678d0 msgr2=0x7f1a44068f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:13.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.838+0000 7f1a4ade5700 1 -- 172.21.15.104:0/2504069960 shutdown_connections 2024-08-17T02:23:13.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.838+0000 7f1a4ade5700 1 -- 172.21.15.104:0/2504069960 wait complete. 2024-08-17T02:23:13.846 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-08-17T02:23:13.859 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-08-17T02:23:12.103217+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2387204,"kb_used_data":4156,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752587516,"statfs":{"total":773094113280,"available":770649616384,"internally_reserved":0,"allocated":4255744,"data_stored":2328716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.995452"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.157805+0000","last_change":"2024-08-17T02:23:06.152060+0000","last_active":"2024-08-17T02:23:06.157805+0000","last_peered":"2024-08-17T02:23:06.157805+0000","last_clean":"2024-08-17T02:23:06.157805+0000","last_became_active":"2024-08-17T02:23:06.151701+0000","last_became_peered":"2024-08-17T02:23:06.151701+0000","last_unstale":"2024-08-17T02:23:06.157805+0000","last_undegraded":"2024-08-17T02:23:06.157805+0000","last_fullsized":"2024-08-17T02:23:06.157805+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:08:18.958141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.139025+0000","last_change":"2024-08-17T02:23:06.137328+0000","last_active":"2024-08-17T02:23:06.139025+0000","last_peered":"2024-08-17T02:23:06.139025+0000","last_clean":"2024-08-17T02:23:06.139025+0000","last_became_active":"2024-08-17T02:23:06.137060+0000","last_became_peered":"2024-08-17T02:23:06.137060+0000","last_unstale":"2024-08-17T02:23:06.139025+0000","last_undegraded":"2024-08-17T02:23:06.139025+0000","last_fullsized":"2024-08-17T02:23:06.139025+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:55:37.879421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.158275+0000","last_change":"2024-08-17T02:23:06.153699+0000","last_active":"2024-08-17T02:23:06.158275+0000","last_peered":"2024-08-17T02:23:06.158275+0000","last_clean":"2024-08-17T02:23:06.158275+0000","last_became_active":"2024-08-17T02:23:06.153380+0000","last_became_peered":"2024-08-17T02:23:06.153380+0000","last_unstale":"2024-08-17T02:23:06.158275+0000","last_undegraded":"2024-08-17T02:23:06.158275+0000","last_fullsized":"2024-08-17T02:23:06.158275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:46:52.682872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.157157+0000","last_change":"2024-08-17T02:23:06.154878+0000","last_active":"2024-08-17T02:23:06.157157+0000","last_peered":"2024-08-17T02:23:06.157157+0000","last_clean":"2024-08-17T02:23:06.157157+0000","last_became_active":"2024-08-17T02:23:06.152824+0000","last_became_peered":"2024-08-17T02:23:06.152824+0000","last_unstale":"2024-08-17T02:23:06.157157+0000","last_undegraded":"2024-08-17T02:23:06.157157+0000","last_fullsized":"2024-08-17T02:23:06.157157+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:15:11.264748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.145045+0000","last_change":"2024-08-17T02:23:06.143365+0000","last_active":"2024-08-17T02:23:06.145045+0000","last_peered":"2024-08-17T02:23:06.145045+0000","last_clean":"2024-08-17T02:23:06.145045+0000","last_became_active":"2024-08-17T02:23:06.143077+0000","last_became_peered":"2024-08-17T02:23:06.143077+0000","last_unstale":"2024-08-17T02:23:06.145045+0000","last_undegraded":"2024-08-17T02:23:06.145045+0000","last_fullsized":"2024-08-17T02:23:06.145045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:19:04.068186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.146241+0000","last_change":"2024-08-17T02:23:06.143266+0000","last_active":"2024-08-17T02:23:06.146241+0000","last_peered":"2024-08-17T02:23:06.146241+0000","last_clean":"2024-08-17T02:23:06.146241+0000","last_became_active":"2024-08-17T02:23:06.142947+0000","last_became_peered":"2024-08-17T02:23:06.142947+0000","last_unstale":"2024-08-17T02:23:06.146241+0000","last_undegraded":"2024-08-17T02:23:06.146241+0000","last_fullsized":"2024-08-17T02:23:06.146241+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:03:49.827394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.152655+0000","last_change":"2024-08-17T02:23:06.148317+0000","last_active":"2024-08-17T02:23:06.152655+0000","last_peered":"2024-08-17T02:23:06.152655+0000","last_clean":"2024-08-17T02:23:06.152655+0000","last_became_active":"2024-08-17T02:23:06.148007+0000","last_became_peered":"2024-08-17T02:23:06.148007+0000","last_unstale":"2024-08-17T02:23:06.152655+0000","last_undegraded":"2024-08-17T02:23:06.152655+0000","last_fullsized":"2024-08-17T02:23:06.152655+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:16:09.491817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.158608+0000","last_change":"2024-08-17T02:23:06.152531+0000","last_active":"2024-08-17T02:23:06.158608+0000","last_peered":"2024-08-17T02:23:06.158608+0000","last_clean":"2024-08-17T02:23:06.158608+0000","last_became_active":"2024-08-17T02:23:06.152002+0000","last_became_peered":"2024-08-17T02:23:06.152002+0000","last_unstale":"2024-08-17T02:23:06.158608+0000","last_undegraded":"2024-08-17T02:23:06.158608+0000","last_fullsized":"2024-08-17T02:23:06.158608+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:50:24.722399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.143946+0000","last_change":"2024-08-17T02:23:06.142217+0000","last_active":"2024-08-17T02:23:06.143946+0000","last_peered":"2024-08-17T02:23:06.143946+0000","last_clean":"2024-08-17T02:23:06.143946+0000","last_became_active":"2024-08-17T02:23:06.141883+0000","last_became_peered":"2024-08-17T02:23:06.141883+0000","last_unstale":"2024-08-17T02:23:06.143946+0000","last_undegraded":"2024-08-17T02:23:06.143946+0000","last_fullsized":"2024-08-17T02:23:06.143946+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:06:06.260257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.136700+0000","last_change":"2024-08-17T02:23:06.134507+0000","last_active":"2024-08-17T02:23:06.136700+0000","last_peered":"2024-08-17T02:23:06.136700+0000","last_clean":"2024-08-17T02:23:06.136700+0000","last_became_active":"2024-08-17T02:23:06.134278+0000","last_became_peered":"2024-08-17T02:23:06.134278+0000","last_unstale":"2024-08-17T02:23:06.136700+0000","last_undegraded":"2024-08-17T02:23:06.136700+0000","last_fullsized":"2024-08-17T02:23:06.136700+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:42:58.110820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.155323+0000","last_change":"2024-08-17T02:23:06.150462+0000","last_active":"2024-08-17T02:23:06.155323+0000","last_peered":"2024-08-17T02:23:06.155323+0000","last_clean":"2024-08-17T02:23:06.155323+0000","last_became_active":"2024-08-17T02:23:06.149630+0000","last_became_peered":"2024-08-17T02:23:06.149630+0000","last_unstale":"2024-08-17T02:23:06.155323+0000","last_undegraded":"2024-08-17T02:23:06.155323+0000","last_fullsized":"2024-08-17T02:23:06.155323+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:01.633704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.157979+0000","last_change":"2024-08-17T02:23:06.154365+0000","last_active":"2024-08-17T02:23:06.157979+0000","last_peered":"2024-08-17T02:23:06.157979+0000","last_clean":"2024-08-17T02:23:06.157979+0000","last_became_active":"2024-08-17T02:23:06.154055+0000","last_became_peered":"2024-08-17T02:23:06.154055+0000","last_unstale":"2024-08-17T02:23:06.157979+0000","last_undegraded":"2024-08-17T02:23:06.157979+0000","last_fullsized":"2024-08-17T02:23:06.157979+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:50:27.957673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.153678+0000","last_change":"2024-08-17T02:23:06.149989+0000","last_active":"2024-08-17T02:23:06.153678+0000","last_peered":"2024-08-17T02:23:06.153678+0000","last_clean":"2024-08-17T02:23:06.153678+0000","last_became_active":"2024-08-17T02:23:06.149682+0000","last_became_peered":"2024-08-17T02:23:06.149682+0000","last_unstale":"2024-08-17T02:23:06.153678+0000","last_undegraded":"2024-08-17T02:23:06.153678+0000","last_fullsized":"2024-08-17T02:23:06.153678+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:01:44.542693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.143943+0000","last_change":"2024-08-17T02:23:06.138133+0000","last_active":"2024-08-17T02:23:06.143943+0000","last_peered":"2024-08-17T02:23:06.143943+0000","last_clean":"2024-08-17T02:23:06.143943+0000","last_became_active":"2024-08-17T02:23:06.137254+0000","last_became_peered":"2024-08-17T02:23:06.137254+0000","last_unstale":"2024-08-17T02:23:06.143943+0000","last_undegraded":"2024-08-17T02:23:06.143943+0000","last_fullsized":"2024-08-17T02:23:06.143943+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:16:09.491817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.160776+0000","last_change":"2024-08-17T02:23:06.155935+0000","last_active":"2024-08-17T02:23:06.160776+0000","last_peered":"2024-08-17T02:23:06.160776+0000","last_clean":"2024-08-17T02:23:06.160776+0000","last_became_active":"2024-08-17T02:23:06.155612+0000","last_became_peered":"2024-08-17T02:23:06.155612+0000","last_unstale":"2024-08-17T02:23:06.160776+0000","last_undegraded":"2024-08-17T02:23:06.160776+0000","last_fullsized":"2024-08-17T02:23:06.160776+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:55:37.879421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.162372+0000","last_change":"2024-08-17T02:23:06.156796+0000","last_active":"2024-08-17T02:23:06.162372+0000","last_peered":"2024-08-17T02:23:06.162372+0000","last_clean":"2024-08-17T02:23:06.162372+0000","last_became_active":"2024-08-17T02:23:06.156503+0000","last_became_peered":"2024-08-17T02:23:06.156503+0000","last_unstale":"2024-08-17T02:23:06.162372+0000","last_undegraded":"2024-08-17T02:23:06.162372+0000","last_fullsized":"2024-08-17T02:23:06.162372+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:15:47.325801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.158758+0000","last_change":"2024-08-17T02:23:06.151910+0000","last_active":"2024-08-17T02:23:06.158758+0000","last_peered":"2024-08-17T02:23:06.158758+0000","last_clean":"2024-08-17T02:23:06.158758+0000","last_became_active":"2024-08-17T02:23:06.148961+0000","last_became_peered":"2024-08-17T02:23:06.148961+0000","last_unstale":"2024-08-17T02:23:06.158758+0000","last_undegraded":"2024-08-17T02:23:06.158758+0000","last_fullsized":"2024-08-17T02:23:06.158758+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:28:40.221408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.146639+0000","last_change":"2024-08-17T02:23:06.143817+0000","last_active":"2024-08-17T02:23:06.146639+0000","last_peered":"2024-08-17T02:23:06.146639+0000","last_clean":"2024-08-17T02:23:06.146639+0000","last_became_active":"2024-08-17T02:23:06.143532+0000","last_became_peered":"2024-08-17T02:23:06.143532+0000","last_unstale":"2024-08-17T02:23:06.146639+0000","last_undegraded":"2024-08-17T02:23:06.146639+0000","last_fullsized":"2024-08-17T02:23:06.146639+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:42:28.828338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.146765+0000","last_change":"2024-08-17T02:23:06.145322+0000","last_active":"2024-08-17T02:23:06.146765+0000","last_peered":"2024-08-17T02:23:06.146765+0000","last_clean":"2024-08-17T02:23:06.146765+0000","last_became_active":"2024-08-17T02:23:06.145042+0000","last_became_peered":"2024-08-17T02:23:06.145042+0000","last_unstale":"2024-08-17T02:23:06.146765+0000","last_undegraded":"2024-08-17T02:23:06.146765+0000","last_fullsized":"2024-08-17T02:23:06.146765+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:24:57.233299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.160279+0000","last_change":"2024-08-17T02:23:06.158176+0000","last_active":"2024-08-17T02:23:06.160279+0000","last_peered":"2024-08-17T02:23:06.160279+0000","last_clean":"2024-08-17T02:23:06.160279+0000","last_became_active":"2024-08-17T02:23:06.157917+0000","last_became_peered":"2024-08-17T02:23:06.157917+0000","last_unstale":"2024-08-17T02:23:06.160279+0000","last_undegraded":"2024-08-17T02:23:06.160279+0000","last_fullsized":"2024-08-17T02:23:06.160279+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:52:06.730764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.158454+0000","last_change":"2024-08-17T02:23:06.150935+0000","last_active":"2024-08-17T02:23:06.158454+0000","last_peered":"2024-08-17T02:23:06.158454+0000","last_clean":"2024-08-17T02:23:06.158454+0000","last_became_active":"2024-08-17T02:23:06.150618+0000","last_became_peered":"2024-08-17T02:23:06.150618+0000","last_unstale":"2024-08-17T02:23:06.158454+0000","last_undegraded":"2024-08-17T02:23:06.158454+0000","last_fullsized":"2024-08-17T02:23:06.158454+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:16:09.491817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.154646+0000","last_change":"2024-08-17T02:23:06.150646+0000","last_active":"2024-08-17T02:23:06.154646+0000","last_peered":"2024-08-17T02:23:06.154646+0000","last_clean":"2024-08-17T02:23:06.154646+0000","last_became_active":"2024-08-17T02:23:06.150176+0000","last_became_peered":"2024-08-17T02:23:06.150176+0000","last_unstale":"2024-08-17T02:23:06.154646+0000","last_undegraded":"2024-08-17T02:23:06.154646+0000","last_fullsized":"2024-08-17T02:23:06.154646+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:55:37.879421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.149734+0000","last_change":"2024-08-17T02:23:06.145958+0000","last_active":"2024-08-17T02:23:06.149734+0000","last_peered":"2024-08-17T02:23:06.149734+0000","last_clean":"2024-08-17T02:23:06.149734+0000","last_became_active":"2024-08-17T02:23:06.145672+0000","last_became_peered":"2024-08-17T02:23:06.145672+0000","last_unstale":"2024-08-17T02:23:06.149734+0000","last_undegraded":"2024-08-17T02:23:06.149734+0000","last_fullsized":"2024-08-17T02:23:06.149734+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:51.598952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.158590+0000","last_change":"2024-08-17T02:23:06.152318+0000","last_active":"2024-08-17T02:23:06.158590+0000","last_peered":"2024-08-17T02:23:06.158590+0000","last_clean":"2024-08-17T02:23:06.158590+0000","last_became_active":"2024-08-17T02:23:06.151688+0000","last_became_peered":"2024-08-17T02:23:06.151688+0000","last_unstale":"2024-08-17T02:23:06.158590+0000","last_undegraded":"2024-08-17T02:23:06.158590+0000","last_fullsized":"2024-08-17T02:23:06.158590+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:42:58.110820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.159687+0000","last_change":"2024-08-17T02:23:06.158449+0000","last_active":"2024-08-17T02:23:06.159687+0000","last_peered":"2024-08-17T02:23:06.159687+0000","last_clean":"2024-08-17T02:23:06.159687+0000","last_became_active":"2024-08-17T02:23:06.158082+0000","last_became_peered":"2024-08-17T02:23:06.158082+0000","last_unstale":"2024-08-17T02:23:06.159687+0000","last_undegraded":"2024-08-17T02:23:06.159687+0000","last_fullsized":"2024-08-17T02:23:06.159687+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:39:15.225920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.152265+0000","last_change":"2024-08-17T02:23:06.144058+0000","last_active":"2024-08-17T02:23:06.152265+0000","last_peered":"2024-08-17T02:23:06.152265+0000","last_clean":"2024-08-17T02:23:06.152265+0000","last_became_active":"2024-08-17T02:23:06.143742+0000","last_became_peered":"2024-08-17T02:23:06.143742+0000","last_unstale":"2024-08-17T02:23:06.152265+0000","last_undegraded":"2024-08-17T02:23:06.152265+0000","last_fullsized":"2024-08-17T02:23:06.152265+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:19:46.037200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.153867+0000","last_change":"2024-08-17T02:23:06.150609+0000","last_active":"2024-08-17T02:23:06.153867+0000","last_peered":"2024-08-17T02:23:06.153867+0000","last_clean":"2024-08-17T02:23:06.153867+0000","last_became_active":"2024-08-17T02:23:06.150350+0000","last_became_peered":"2024-08-17T02:23:06.150350+0000","last_unstale":"2024-08-17T02:23:06.153867+0000","last_undegraded":"2024-08-17T02:23:06.153867+0000","last_fullsized":"2024-08-17T02:23:06.153867+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:43.814412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.160595+0000","last_change":"2024-08-17T02:23:06.152813+0000","last_active":"2024-08-17T02:23:06.160595+0000","last_peered":"2024-08-17T02:23:06.160595+0000","last_clean":"2024-08-17T02:23:06.160595+0000","last_became_active":"2024-08-17T02:23:06.152533+0000","last_became_peered":"2024-08-17T02:23:06.152533+0000","last_unstale":"2024-08-17T02:23:06.160595+0000","last_undegraded":"2024-08-17T02:23:06.160595+0000","last_fullsized":"2024-08-17T02:23:06.160595+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:19:04.068186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.160769+0000","last_change":"2024-08-17T02:23:06.155870+0000","last_active":"2024-08-17T02:23:06.160769+0000","last_peered":"2024-08-17T02:23:06.160769+0000","last_clean":"2024-08-17T02:23:06.160769+0000","last_became_active":"2024-08-17T02:23:06.151995+0000","last_became_peered":"2024-08-17T02:23:06.151995+0000","last_unstale":"2024-08-17T02:23:06.160769+0000","last_undegraded":"2024-08-17T02:23:06.160769+0000","last_fullsized":"2024-08-17T02:23:06.160769+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:05:17.742125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.163471+0000","last_change":"2024-08-17T02:23:06.158354+0000","last_active":"2024-08-17T02:23:06.163471+0000","last_peered":"2024-08-17T02:23:06.163471+0000","last_clean":"2024-08-17T02:23:06.163471+0000","last_became_active":"2024-08-17T02:23:06.158056+0000","last_became_peered":"2024-08-17T02:23:06.158056+0000","last_unstale":"2024-08-17T02:23:06.163471+0000","last_undegraded":"2024-08-17T02:23:06.163471+0000","last_fullsized":"2024-08-17T02:23:06.163471+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:41.741517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.150767+0000","last_change":"2024-08-17T02:23:06.146400+0000","last_active":"2024-08-17T02:23:06.150767+0000","last_peered":"2024-08-17T02:23:06.150767+0000","last_clean":"2024-08-17T02:23:06.150767+0000","last_became_active":"2024-08-17T02:23:06.146018+0000","last_became_peered":"2024-08-17T02:23:06.146018+0000","last_unstale":"2024-08-17T02:23:06.150767+0000","last_undegraded":"2024-08-17T02:23:06.150767+0000","last_fullsized":"2024-08-17T02:23:06.150767+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:56:35.760215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.145959+0000","last_change":"2024-08-17T02:23:06.140156+0000","last_active":"2024-08-17T02:23:06.145959+0000","last_peered":"2024-08-17T02:23:06.145959+0000","last_clean":"2024-08-17T02:23:06.145959+0000","last_became_active":"2024-08-17T02:23:06.139805+0000","last_became_peered":"2024-08-17T02:23:06.139805+0000","last_unstale":"2024-08-17T02:23:06.145959+0000","last_undegraded":"2024-08-17T02:23:06.145959+0000","last_fullsized":"2024-08-17T02:23:06.145959+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:47:27.588293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.156134+0000","last_change":"2024-08-17T02:23:06.151809+0000","last_active":"2024-08-17T02:23:06.156134+0000","last_peered":"2024-08-17T02:23:06.156134+0000","last_clean":"2024-08-17T02:23:06.156134+0000","last_became_active":"2024-08-17T02:23:06.151504+0000","last_became_peered":"2024-08-17T02:23:06.151504+0000","last_unstale":"2024-08-17T02:23:06.156134+0000","last_undegraded":"2024-08-17T02:23:06.156134+0000","last_fullsized":"2024-08-17T02:23:06.156134+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:44:33.447512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.149550+0000","last_change":"2024-08-17T02:23:05.127510+0000","last_active":"2024-08-17T02:23:06.149550+0000","last_peered":"2024-08-17T02:23:06.149550+0000","last_clean":"2024-08-17T02:23:06.149550+0000","last_became_active":"2024-08-17T02:23:05.127256+0000","last_became_peered":"2024-08-17T02:23:05.127256+0000","last_unstale":"2024-08-17T02:23:06.149550+0000","last_undegraded":"2024-08-17T02:23:06.149550+0000","last_fullsized":"2024-08-17T02:23:06.149550+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:42.811537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.150569+0000","last_change":"2024-08-17T02:23:06.142236+0000","last_active":"2024-08-17T02:23:06.150569+0000","last_peered":"2024-08-17T02:23:06.150569+0000","last_clean":"2024-08-17T02:23:06.150569+0000","last_became_active":"2024-08-17T02:23:06.141250+0000","last_became_peered":"2024-08-17T02:23:06.141250+0000","last_unstale":"2024-08-17T02:23:06.150569+0000","last_undegraded":"2024-08-17T02:23:06.150569+0000","last_fullsized":"2024-08-17T02:23:06.150569+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:41.741517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.152184+0000","last_change":"2024-08-17T02:23:05.132289+0000","last_active":"2024-08-17T02:23:06.152184+0000","last_peered":"2024-08-17T02:23:06.152184+0000","last_clean":"2024-08-17T02:23:06.152184+0000","last_became_active":"2024-08-17T02:23:05.131983+0000","last_became_peered":"2024-08-17T02:23:05.131983+0000","last_unstale":"2024-08-17T02:23:06.152184+0000","last_undegraded":"2024-08-17T02:23:06.152184+0000","last_fullsized":"2024-08-17T02:23:06.152184+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:07:23.619301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.157836+0000","last_change":"2024-08-17T02:23:06.152248+0000","last_active":"2024-08-17T02:23:06.157836+0000","last_peered":"2024-08-17T02:23:06.157836+0000","last_clean":"2024-08-17T02:23:06.157836+0000","last_became_active":"2024-08-17T02:23:06.151319+0000","last_became_peered":"2024-08-17T02:23:06.151319+0000","last_unstale":"2024-08-17T02:23:06.157836+0000","last_undegraded":"2024-08-17T02:23:06.157836+0000","last_fullsized":"2024-08-17T02:23:06.157836+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:43.814412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.156036+0000","last_change":"2024-08-17T02:23:05.132350+0000","last_active":"2024-08-17T02:23:06.156036+0000","last_peered":"2024-08-17T02:23:06.156036+0000","last_clean":"2024-08-17T02:23:06.156036+0000","last_became_active":"2024-08-17T02:23:05.132091+0000","last_became_peered":"2024-08-17T02:23:05.132091+0000","last_unstale":"2024-08-17T02:23:06.156036+0000","last_undegraded":"2024-08-17T02:23:06.156036+0000","last_fullsized":"2024-08-17T02:23:06.156036+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:17:50.941899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.150875+0000","last_change":"2024-08-17T02:23:06.144826+0000","last_active":"2024-08-17T02:23:06.150875+0000","last_peered":"2024-08-17T02:23:06.150875+0000","last_clean":"2024-08-17T02:23:06.150875+0000","last_became_active":"2024-08-17T02:23:06.144300+0000","last_became_peered":"2024-08-17T02:23:06.144300+0000","last_unstale":"2024-08-17T02:23:06.150875+0000","last_undegraded":"2024-08-17T02:23:06.150875+0000","last_fullsized":"2024-08-17T02:23:06.150875+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:56:45.045355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.154991+0000","last_change":"2024-08-17T02:23:05.133629+0000","last_active":"2024-08-17T02:23:06.154991+0000","last_peered":"2024-08-17T02:23:06.154991+0000","last_clean":"2024-08-17T02:23:06.154991+0000","last_became_active":"2024-08-17T02:23:05.132024+0000","last_became_peered":"2024-08-17T02:23:05.132024+0000","last_unstale":"2024-08-17T02:23:06.154991+0000","last_undegraded":"2024-08-17T02:23:06.154991+0000","last_fullsized":"2024-08-17T02:23:06.154991+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:24:56.230424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.146076+0000","last_change":"2024-08-17T02:23:06.144970+0000","last_active":"2024-08-17T02:23:06.146076+0000","last_peered":"2024-08-17T02:23:06.146076+0000","last_clean":"2024-08-17T02:23:06.146076+0000","last_became_active":"2024-08-17T02:23:06.144678+0000","last_became_peered":"2024-08-17T02:23:06.144678+0000","last_unstale":"2024-08-17T02:23:06.146076+0000","last_undegraded":"2024-08-17T02:23:06.146076+0000","last_fullsized":"2024-08-17T02:23:06.146076+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:00:41.237529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.153262+0000","last_change":"2024-08-17T02:23:05.132943+0000","last_active":"2024-08-17T02:23:06.153262+0000","last_peered":"2024-08-17T02:23:06.153262+0000","last_clean":"2024-08-17T02:23:06.153262+0000","last_became_active":"2024-08-17T02:23:05.132687+0000","last_became_peered":"2024-08-17T02:23:05.132687+0000","last_unstale":"2024-08-17T02:23:06.153262+0000","last_undegraded":"2024-08-17T02:23:06.153262+0000","last_fullsized":"2024-08-17T02:23:06.153262+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:53.382969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.150854+0000","last_change":"2024-08-17T02:23:06.146821+0000","last_active":"2024-08-17T02:23:06.150854+0000","last_peered":"2024-08-17T02:23:06.150854+0000","last_clean":"2024-08-17T02:23:06.150854+0000","last_became_active":"2024-08-17T02:23:06.146563+0000","last_became_peered":"2024-08-17T02:23:06.146563+0000","last_unstale":"2024-08-17T02:23:06.150854+0000","last_undegraded":"2024-08-17T02:23:06.150854+0000","last_fullsized":"2024-08-17T02:23:06.150854+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:15:47.325801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.155625+0000","last_change":"2024-08-17T02:23:05.130615+0000","last_active":"2024-08-17T02:23:06.155625+0000","last_peered":"2024-08-17T02:23:06.155625+0000","last_clean":"2024-08-17T02:23:06.155625+0000","last_became_active":"2024-08-17T02:23:05.130154+0000","last_became_peered":"2024-08-17T02:23:05.130154+0000","last_unstale":"2024-08-17T02:23:06.155625+0000","last_undegraded":"2024-08-17T02:23:06.155625+0000","last_fullsized":"2024-08-17T02:23:06.155625+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:00:40.234655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.158277+0000","last_change":"2024-08-17T02:23:06.154376+0000","last_active":"2024-08-17T02:23:06.158277+0000","last_peered":"2024-08-17T02:23:06.158277+0000","last_clean":"2024-08-17T02:23:06.158277+0000","last_became_active":"2024-08-17T02:23:06.154088+0000","last_became_peered":"2024-08-17T02:23:06.154088+0000","last_unstale":"2024-08-17T02:23:06.158277+0000","last_undegraded":"2024-08-17T02:23:06.158277+0000","last_fullsized":"2024-08-17T02:23:06.158277+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:00:46.078945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.133735+0000","last_change":"2024-08-17T02:23:05.131354+0000","last_active":"2024-08-17T02:23:06.133735+0000","last_peered":"2024-08-17T02:23:06.133735+0000","last_clean":"2024-08-17T02:23:06.133735+0000","last_became_active":"2024-08-17T02:23:05.131068+0000","last_became_peered":"2024-08-17T02:23:05.131068+0000","last_unstale":"2024-08-17T02:23:06.133735+0000","last_undegraded":"2024-08-17T02:23:06.133735+0000","last_fullsized":"2024-08-17T02:23:06.133735+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:43:24.352695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.155935+0000","last_change":"2024-08-17T02:23:06.151915+0000","last_active":"2024-08-17T02:23:06.155935+0000","last_peered":"2024-08-17T02:23:06.155935+0000","last_clean":"2024-08-17T02:23:06.155935+0000","last_became_active":"2024-08-17T02:23:06.151610+0000","last_became_peered":"2024-08-17T02:23:06.151610+0000","last_unstale":"2024-08-17T02:23:06.155935+0000","last_undegraded":"2024-08-17T02:23:06.155935+0000","last_fullsized":"2024-08-17T02:23:06.155935+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:55:37.879421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.137519+0000","last_change":"2024-08-17T02:23:05.134552+0000","last_active":"2024-08-17T02:23:06.137519+0000","last_peered":"2024-08-17T02:23:06.137519+0000","last_clean":"2024-08-17T02:23:06.137519+0000","last_became_active":"2024-08-17T02:23:05.134226+0000","last_became_peered":"2024-08-17T02:23:05.134226+0000","last_unstale":"2024-08-17T02:23:06.137519+0000","last_undegraded":"2024-08-17T02:23:06.137519+0000","last_fullsized":"2024-08-17T02:23:06.137519+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:46:51.679997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.152727+0000","last_change":"2024-08-17T02:23:06.146714+0000","last_active":"2024-08-17T02:23:06.152727+0000","last_peered":"2024-08-17T02:23:06.152727+0000","last_clean":"2024-08-17T02:23:06.152727+0000","last_became_active":"2024-08-17T02:23:06.146469+0000","last_became_peered":"2024-08-17T02:23:06.146469+0000","last_unstale":"2024-08-17T02:23:06.152727+0000","last_undegraded":"2024-08-17T02:23:06.152727+0000","last_fullsized":"2024-08-17T02:23:06.152727+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:56:31.082425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.131254+0000","last_change":"2024-08-17T02:23:05.129495+0000","last_active":"2024-08-17T02:23:06.131254+0000","last_peered":"2024-08-17T02:23:06.131254+0000","last_clean":"2024-08-17T02:23:06.131254+0000","last_became_active":"2024-08-17T02:23:05.129217+0000","last_became_peered":"2024-08-17T02:23:05.129217+0000","last_unstale":"2024-08-17T02:23:06.131254+0000","last_undegraded":"2024-08-17T02:23:06.131254+0000","last_fullsized":"2024-08-17T02:23:06.131254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:28:34.650180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.141190+0000","last_change":"2024-08-17T02:23:06.135396+0000","last_active":"2024-08-17T02:23:06.141190+0000","last_peered":"2024-08-17T02:23:06.141190+0000","last_clean":"2024-08-17T02:23:06.141190+0000","last_became_active":"2024-08-17T02:23:06.135067+0000","last_became_peered":"2024-08-17T02:23:06.135067+0000","last_unstale":"2024-08-17T02:23:06.141190+0000","last_undegraded":"2024-08-17T02:23:06.141190+0000","last_fullsized":"2024-08-17T02:23:06.141190+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:43.814412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.129571+0000","last_change":"2024-08-17T02:23:05.127494+0000","last_active":"2024-08-17T02:23:06.129571+0000","last_peered":"2024-08-17T02:23:06.129571+0000","last_clean":"2024-08-17T02:23:06.129571+0000","last_became_active":"2024-08-17T02:23:05.127161+0000","last_became_peered":"2024-08-17T02:23:05.127161+0000","last_unstale":"2024-08-17T02:23:06.129571+0000","last_undegraded":"2024-08-17T02:23:06.129571+0000","last_fullsized":"2024-08-17T02:23:06.129571+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:18:08.446121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.151951+0000","last_change":"2024-08-17T02:23:06.147086+0000","last_active":"2024-08-17T02:23:06.151951+0000","last_peered":"2024-08-17T02:23:06.151951+0000","last_clean":"2024-08-17T02:23:06.151951+0000","last_became_active":"2024-08-17T02:23:06.144662+0000","last_became_peered":"2024-08-17T02:23:06.144662+0000","last_unstale":"2024-08-17T02:23:06.151951+0000","last_undegraded":"2024-08-17T02:23:06.151951+0000","last_fullsized":"2024-08-17T02:23:06.151951+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:49:10.344944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.150330+0000","last_change":"2024-08-17T02:23:05.130614+0000","last_active":"2024-08-17T02:23:06.150330+0000","last_peered":"2024-08-17T02:23:06.150330+0000","last_clean":"2024-08-17T02:23:06.150330+0000","last_became_active":"2024-08-17T02:23:05.130337+0000","last_became_peered":"2024-08-17T02:23:05.130337+0000","last_unstale":"2024-08-17T02:23:06.150330+0000","last_undegraded":"2024-08-17T02:23:06.150330+0000","last_fullsized":"2024-08-17T02:23:06.150330+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:42:57.107946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.155301+0000","last_change":"2024-08-17T02:23:06.149918+0000","last_active":"2024-08-17T02:23:06.155301+0000","last_peered":"2024-08-17T02:23:06.155301+0000","last_clean":"2024-08-17T02:23:06.155301+0000","last_became_active":"2024-08-17T02:23:06.149065+0000","last_became_peered":"2024-08-17T02:23:06.149065+0000","last_unstale":"2024-08-17T02:23:06.155301+0000","last_undegraded":"2024-08-17T02:23:06.155301+0000","last_fullsized":"2024-08-17T02:23:06.155301+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:42:31.935493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.161117+0000","last_change":"2024-08-17T02:23:05.135231+0000","last_active":"2024-08-17T02:23:06.161117+0000","last_peered":"2024-08-17T02:23:06.161117+0000","last_clean":"2024-08-17T02:23:06.161117+0000","last_became_active":"2024-08-17T02:23:05.134929+0000","last_became_peered":"2024-08-17T02:23:05.134929+0000","last_unstale":"2024-08-17T02:23:06.161117+0000","last_undegraded":"2024-08-17T02:23:06.161117+0000","last_fullsized":"2024-08-17T02:23:06.161117+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:30:51.222253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.150199+0000","last_change":"2024-08-17T02:23:06.148431+0000","last_active":"2024-08-17T02:23:06.150199+0000","last_peered":"2024-08-17T02:23:06.150199+0000","last_clean":"2024-08-17T02:23:06.150199+0000","last_became_active":"2024-08-17T02:23:06.147783+0000","last_became_peered":"2024-08-17T02:23:06.147783+0000","last_unstale":"2024-08-17T02:23:06.150199+0000","last_undegraded":"2024-08-17T02:23:06.150199+0000","last_fullsized":"2024-08-17T02:23:06.150199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:47:06.427349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.156635+0000","last_change":"2024-08-17T02:23:05.131953+0000","last_active":"2024-08-17T02:23:06.156635+0000","last_peered":"2024-08-17T02:23:06.156635+0000","last_clean":"2024-08-17T02:23:06.156635+0000","last_became_active":"2024-08-17T02:23:05.131229+0000","last_became_peered":"2024-08-17T02:23:05.131229+0000","last_unstale":"2024-08-17T02:23:06.156635+0000","last_undegraded":"2024-08-17T02:23:06.156635+0000","last_fullsized":"2024-08-17T02:23:06.156635+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:32:59.217946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.152662+0000","last_change":"2024-08-17T02:23:06.151547+0000","last_active":"2024-08-17T02:23:06.152662+0000","last_peered":"2024-08-17T02:23:06.152662+0000","last_clean":"2024-08-17T02:23:06.152662+0000","last_became_active":"2024-08-17T02:23:06.151233+0000","last_became_peered":"2024-08-17T02:23:06.151233+0000","last_unstale":"2024-08-17T02:23:06.152662+0000","last_undegraded":"2024-08-17T02:23:06.152662+0000","last_fullsized":"2024-08-17T02:23:06.152662+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:59:45.844926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.131655+0000","last_change":"2024-08-17T02:23:05.130294+0000","last_active":"2024-08-17T02:23:06.131655+0000","last_peered":"2024-08-17T02:23:06.131655+0000","last_clean":"2024-08-17T02:23:06.131655+0000","last_became_active":"2024-08-17T02:23:05.127751+0000","last_became_peered":"2024-08-17T02:23:05.127751+0000","last_unstale":"2024-08-17T02:23:06.131655+0000","last_undegraded":"2024-08-17T02:23:06.131655+0000","last_fullsized":"2024-08-17T02:23:06.131655+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:50:26.954799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.151429+0000","last_change":"2024-08-17T02:23:06.142494+0000","last_active":"2024-08-17T02:23:06.151429+0000","last_peered":"2024-08-17T02:23:06.151429+0000","last_clean":"2024-08-17T02:23:06.151429+0000","last_became_active":"2024-08-17T02:23:06.141443+0000","last_became_peered":"2024-08-17T02:23:06.141443+0000","last_unstale":"2024-08-17T02:23:06.151429+0000","last_undegraded":"2024-08-17T02:23:06.151429+0000","last_fullsized":"2024-08-17T02:23:06.151429+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:05:17.742125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.127919+0000","last_change":"2024-08-17T02:23:05.129835+0000","last_active":"2024-08-17T02:23:06.127919+0000","last_peered":"2024-08-17T02:23:06.127919+0000","last_clean":"2024-08-17T02:23:06.127919+0000","last_became_active":"2024-08-17T02:23:05.129466+0000","last_became_peered":"2024-08-17T02:23:05.129466+0000","last_unstale":"2024-08-17T02:23:06.127919+0000","last_undegraded":"2024-08-17T02:23:06.127919+0000","last_fullsized":"2024-08-17T02:23:06.127919+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:03:48.824519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.147221+0000","last_change":"2024-08-17T02:23:06.142071+0000","last_active":"2024-08-17T02:23:06.147221+0000","last_peered":"2024-08-17T02:23:06.147221+0000","last_clean":"2024-08-17T02:23:06.147221+0000","last_became_active":"2024-08-17T02:23:06.141767+0000","last_became_peered":"2024-08-17T02:23:06.141767+0000","last_unstale":"2024-08-17T02:23:06.147221+0000","last_undegraded":"2024-08-17T02:23:06.147221+0000","last_fullsized":"2024-08-17T02:23:06.147221+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:58.019950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.157601+0000","last_change":"2024-08-17T02:23:05.131707+0000","last_active":"2024-08-17T02:23:06.157601+0000","last_peered":"2024-08-17T02:23:06.157601+0000","last_clean":"2024-08-17T02:23:06.157601+0000","last_became_active":"2024-08-17T02:23:05.131283+0000","last_became_peered":"2024-08-17T02:23:05.131283+0000","last_unstale":"2024-08-17T02:23:06.157601+0000","last_undegraded":"2024-08-17T02:23:06.157601+0000","last_fullsized":"2024-08-17T02:23:06.157601+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:39:51.833007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.147942+0000","last_change":"2024-08-17T02:23:06.140986+0000","last_active":"2024-08-17T02:23:06.147942+0000","last_peered":"2024-08-17T02:23:06.147942+0000","last_clean":"2024-08-17T02:23:06.147942+0000","last_became_active":"2024-08-17T02:23:06.140706+0000","last_became_peered":"2024-08-17T02:23:06.140706+0000","last_unstale":"2024-08-17T02:23:06.147942+0000","last_undegraded":"2024-08-17T02:23:06.147942+0000","last_fullsized":"2024-08-17T02:23:06.147942+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:53:27.361531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.152246+0000","last_change":"2024-08-17T02:23:05.134848+0000","last_active":"2024-08-17T02:23:06.152246+0000","last_peered":"2024-08-17T02:23:06.152246+0000","last_clean":"2024-08-17T02:23:06.152246+0000","last_became_active":"2024-08-17T02:23:05.134528+0000","last_became_peered":"2024-08-17T02:23:05.134528+0000","last_unstale":"2024-08-17T02:23:06.152246+0000","last_undegraded":"2024-08-17T02:23:06.152246+0000","last_fullsized":"2024-08-17T02:23:06.152246+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:00:45.076071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.158365+0000","last_change":"2024-08-17T02:23:06.154517+0000","last_active":"2024-08-17T02:23:06.158365+0000","last_peered":"2024-08-17T02:23:06.158365+0000","last_clean":"2024-08-17T02:23:06.158365+0000","last_became_active":"2024-08-17T02:23:06.154215+0000","last_became_peered":"2024-08-17T02:23:06.154215+0000","last_unstale":"2024-08-17T02:23:06.158365+0000","last_undegraded":"2024-08-17T02:23:06.158365+0000","last_fullsized":"2024-08-17T02:23:06.158365+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:11:55.605296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.156724+0000","last_change":"2024-08-17T02:23:05.131655+0000","last_active":"2024-08-17T02:23:06.156724+0000","last_peered":"2024-08-17T02:23:06.156724+0000","last_clean":"2024-08-17T02:23:06.156724+0000","last_became_active":"2024-08-17T02:23:05.131377+0000","last_became_peered":"2024-08-17T02:23:05.131377+0000","last_unstale":"2024-08-17T02:23:06.156724+0000","last_undegraded":"2024-08-17T02:23:06.156724+0000","last_fullsized":"2024-08-17T02:23:06.156724+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:11:54.602422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.151602+0000","last_change":"2024-08-17T02:23:06.148729+0000","last_active":"2024-08-17T02:23:06.151602+0000","last_peered":"2024-08-17T02:23:06.151602+0000","last_clean":"2024-08-17T02:23:06.151602+0000","last_became_active":"2024-08-17T02:23:06.148414+0000","last_became_peered":"2024-08-17T02:23:06.148414+0000","last_unstale":"2024-08-17T02:23:06.151602+0000","last_undegraded":"2024-08-17T02:23:06.151602+0000","last_fullsized":"2024-08-17T02:23:06.151602+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:42:58.110820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.148970+0000","last_change":"2024-08-17T02:23:05.125731+0000","last_active":"2024-08-17T02:23:06.148970+0000","last_peered":"2024-08-17T02:23:06.148970+0000","last_clean":"2024-08-17T02:23:06.148970+0000","last_became_active":"2024-08-17T02:23:05.125289+0000","last_became_peered":"2024-08-17T02:23:05.125289+0000","last_unstale":"2024-08-17T02:23:06.148970+0000","last_undegraded":"2024-08-17T02:23:06.148970+0000","last_fullsized":"2024-08-17T02:23:06.148970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:59:44.842051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.159518+0000","last_change":"2024-08-17T02:23:06.157822+0000","last_active":"2024-08-17T02:23:06.159518+0000","last_peered":"2024-08-17T02:23:06.159518+0000","last_clean":"2024-08-17T02:23:06.159518+0000","last_became_active":"2024-08-17T02:23:06.157520+0000","last_became_peered":"2024-08-17T02:23:06.157520+0000","last_unstale":"2024-08-17T02:23:06.159518+0000","last_undegraded":"2024-08-17T02:23:06.159518+0000","last_fullsized":"2024-08-17T02:23:06.159518+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:07:24.622175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.146931+0000","last_change":"2024-08-17T02:23:05.132323+0000","last_active":"2024-08-17T02:23:06.146931+0000","last_peered":"2024-08-17T02:23:06.146931+0000","last_clean":"2024-08-17T02:23:06.146931+0000","last_became_active":"2024-08-17T02:23:05.132033+0000","last_became_peered":"2024-08-17T02:23:05.132033+0000","last_unstale":"2024-08-17T02:23:06.146931+0000","last_undegraded":"2024-08-17T02:23:06.146931+0000","last_fullsized":"2024-08-17T02:23:06.146931+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:03:48.824519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.156002+0000","last_change":"2024-08-17T02:23:06.151167+0000","last_active":"2024-08-17T02:23:06.156002+0000","last_peered":"2024-08-17T02:23:06.156002+0000","last_clean":"2024-08-17T02:23:06.156002+0000","last_became_active":"2024-08-17T02:23:06.150722+0000","last_became_peered":"2024-08-17T02:23:06.150722+0000","last_unstale":"2024-08-17T02:23:06.156002+0000","last_undegraded":"2024-08-17T02:23:06.156002+0000","last_fullsized":"2024-08-17T02:23:06.156002+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:05:51.704819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.149829+0000","last_change":"2024-08-17T02:23:05.132954+0000","last_active":"2024-08-17T02:23:06.149829+0000","last_peered":"2024-08-17T02:23:06.149829+0000","last_clean":"2024-08-17T02:23:06.149829+0000","last_became_active":"2024-08-17T02:23:05.132643+0000","last_became_peered":"2024-08-17T02:23:05.132643+0000","last_unstale":"2024-08-17T02:23:06.149829+0000","last_undegraded":"2024-08-17T02:23:06.149829+0000","last_fullsized":"2024-08-17T02:23:06.149829+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:51:42.042652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.145011+0000","last_change":"2024-08-17T02:23:06.142172+0000","last_active":"2024-08-17T02:23:06.145011+0000","last_peered":"2024-08-17T02:23:06.145011+0000","last_clean":"2024-08-17T02:23:06.145011+0000","last_became_active":"2024-08-17T02:23:06.141823+0000","last_became_peered":"2024-08-17T02:23:06.141823+0000","last_unstale":"2024-08-17T02:23:06.145011+0000","last_undegraded":"2024-08-17T02:23:06.145011+0000","last_fullsized":"2024-08-17T02:23:06.145011+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:16:09.491817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.140388+0000","last_change":"2024-08-17T02:23:05.131606+0000","last_active":"2024-08-17T02:23:06.140388+0000","last_peered":"2024-08-17T02:23:06.140388+0000","last_clean":"2024-08-17T02:23:06.140388+0000","last_became_active":"2024-08-17T02:23:05.131339+0000","last_became_peered":"2024-08-17T02:23:05.131339+0000","last_unstale":"2024-08-17T02:23:06.140388+0000","last_undegraded":"2024-08-17T02:23:06.140388+0000","last_fullsized":"2024-08-17T02:23:06.140388+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:46:05.090766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.153570+0000","last_change":"2024-08-17T02:23:06.150303+0000","last_active":"2024-08-17T02:23:06.153570+0000","last_peered":"2024-08-17T02:23:06.153570+0000","last_clean":"2024-08-17T02:23:06.153570+0000","last_became_active":"2024-08-17T02:23:06.150005+0000","last_became_peered":"2024-08-17T02:23:06.150005+0000","last_unstale":"2024-08-17T02:23:06.153570+0000","last_undegraded":"2024-08-17T02:23:06.153570+0000","last_fullsized":"2024-08-17T02:23:06.153570+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:36:37.616414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.134215+0000","last_change":"2024-08-17T02:23:05.122172+0000","last_active":"2024-08-17T02:23:06.134215+0000","last_peered":"2024-08-17T02:23:06.134215+0000","last_clean":"2024-08-17T02:23:06.134215+0000","last_became_active":"2024-08-17T02:23:05.121899+0000","last_became_peered":"2024-08-17T02:23:05.121899+0000","last_unstale":"2024-08-17T02:23:06.134215+0000","last_undegraded":"2024-08-17T02:23:06.134215+0000","last_fullsized":"2024-08-17T02:23:06.134215+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:30:54.632598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.160932+0000","last_change":"2024-08-17T02:23:06.157189+0000","last_active":"2024-08-17T02:23:06.160932+0000","last_peered":"2024-08-17T02:23:06.160932+0000","last_clean":"2024-08-17T02:23:06.160932+0000","last_became_active":"2024-08-17T02:23:06.156895+0000","last_became_peered":"2024-08-17T02:23:06.156895+0000","last_unstale":"2024-08-17T02:23:06.160932+0000","last_undegraded":"2024-08-17T02:23:06.160932+0000","last_fullsized":"2024-08-17T02:23:06.160932+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:54.385844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.127402+0000","last_change":"2024-08-17T02:23:05.125262+0000","last_active":"2024-08-17T02:23:06.127402+0000","last_peered":"2024-08-17T02:23:06.127402+0000","last_clean":"2024-08-17T02:23:06.127402+0000","last_became_active":"2024-08-17T02:23:05.124970+0000","last_became_peered":"2024-08-17T02:23:05.124970+0000","last_unstale":"2024-08-17T02:23:06.127402+0000","last_undegraded":"2024-08-17T02:23:06.127402+0000","last_fullsized":"2024-08-17T02:23:06.127402+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:50:23.719525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.156607+0000","last_change":"2024-08-17T02:23:06.150526+0000","last_active":"2024-08-17T02:23:06.156607+0000","last_peered":"2024-08-17T02:23:06.156607+0000","last_clean":"2024-08-17T02:23:06.156607+0000","last_became_active":"2024-08-17T02:23:06.150009+0000","last_became_peered":"2024-08-17T02:23:06.150009+0000","last_unstale":"2024-08-17T02:23:06.156607+0000","last_undegraded":"2024-08-17T02:23:06.156607+0000","last_fullsized":"2024-08-17T02:23:06.156607+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:50:27.957673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.149092+0000","last_change":"2024-08-17T02:23:05.129474+0000","last_active":"2024-08-17T02:23:06.149092+0000","last_peered":"2024-08-17T02:23:06.149092+0000","last_clean":"2024-08-17T02:23:06.149092+0000","last_became_active":"2024-08-17T02:23:05.129170+0000","last_became_peered":"2024-08-17T02:23:05.129170+0000","last_unstale":"2024-08-17T02:23:06.149092+0000","last_undegraded":"2024-08-17T02:23:06.149092+0000","last_fullsized":"2024-08-17T02:23:06.149092+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:42:07.721958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.155170+0000","last_change":"2024-08-17T02:23:06.149745+0000","last_active":"2024-08-17T02:23:06.155170+0000","last_peered":"2024-08-17T02:23:06.155170+0000","last_clean":"2024-08-17T02:23:06.155170+0000","last_became_active":"2024-08-17T02:23:06.149330+0000","last_became_peered":"2024-08-17T02:23:06.149330+0000","last_unstale":"2024-08-17T02:23:06.155170+0000","last_undegraded":"2024-08-17T02:23:06.155170+0000","last_fullsized":"2024-08-17T02:23:06.155170+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:23:18.846223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:23:07.153421+0000","last_change":"2024-08-17T02:23:05.127273+0000","last_active":"2024-08-17T02:23:07.153421+0000","last_peered":"2024-08-17T02:23:07.153421+0000","last_clean":"2024-08-17T02:23:07.153421+0000","last_became_active":"2024-08-17T02:23:05.126965+0000","last_became_peered":"2024-08-17T02:23:05.126965+0000","last_unstale":"2024-08-17T02:23:07.153421+0000","last_undegraded":"2024-08-17T02:23:07.153421+0000","last_fullsized":"2024-08-17T02:23:07.153421+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:56:34.757340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.156757+0000","last_change":"2024-08-17T02:23:06.150877+0000","last_active":"2024-08-17T02:23:06.156757+0000","last_peered":"2024-08-17T02:23:06.156757+0000","last_clean":"2024-08-17T02:23:06.156757+0000","last_became_active":"2024-08-17T02:23:06.150526+0000","last_became_peered":"2024-08-17T02:23:06.150526+0000","last_unstale":"2024-08-17T02:23:06.156757+0000","last_undegraded":"2024-08-17T02:23:06.156757+0000","last_fullsized":"2024-08-17T02:23:06.156757+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:51:43.045526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.141078+0000","last_change":"2024-08-17T02:23:05.132667+0000","last_active":"2024-08-17T02:23:06.141078+0000","last_peered":"2024-08-17T02:23:06.141078+0000","last_clean":"2024-08-17T02:23:06.141078+0000","last_became_active":"2024-08-17T02:23:05.132411+0000","last_became_peered":"2024-08-17T02:23:05.132411+0000","last_unstale":"2024-08-17T02:23:06.141078+0000","last_undegraded":"2024-08-17T02:23:06.141078+0000","last_fullsized":"2024-08-17T02:23:06.141078+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:17:04.568520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.151374+0000","last_change":"2024-08-17T02:23:06.147442+0000","last_active":"2024-08-17T02:23:06.151374+0000","last_peered":"2024-08-17T02:23:06.151374+0000","last_clean":"2024-08-17T02:23:06.151374+0000","last_became_active":"2024-08-17T02:23:06.147114+0000","last_became_peered":"2024-08-17T02:23:06.147114+0000","last_unstale":"2024-08-17T02:23:06.151374+0000","last_undegraded":"2024-08-17T02:23:06.151374+0000","last_fullsized":"2024-08-17T02:23:06.151374+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:43.814412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.140878+0000","last_change":"2024-08-17T02:23:05.130065+0000","last_active":"2024-08-17T02:23:06.140878+0000","last_peered":"2024-08-17T02:23:06.140878+0000","last_clean":"2024-08-17T02:23:06.140878+0000","last_became_active":"2024-08-17T02:23:05.129826+0000","last_became_peered":"2024-08-17T02:23:05.129826+0000","last_unstale":"2024-08-17T02:23:06.140878+0000","last_undegraded":"2024-08-17T02:23:06.140878+0000","last_fullsized":"2024-08-17T02:23:06.140878+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:42:30.234703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.150880+0000","last_change":"2024-08-17T02:23:06.144436+0000","last_active":"2024-08-17T02:23:06.150880+0000","last_peered":"2024-08-17T02:23:06.150880+0000","last_clean":"2024-08-17T02:23:06.150880+0000","last_became_active":"2024-08-17T02:23:06.144140+0000","last_became_peered":"2024-08-17T02:23:06.144140+0000","last_unstale":"2024-08-17T02:23:06.150880+0000","last_undegraded":"2024-08-17T02:23:06.150880+0000","last_fullsized":"2024-08-17T02:23:06.150880+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:50:24.722399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.140266+0000","last_change":"2024-08-17T02:23:05.131949+0000","last_active":"2024-08-17T02:23:06.140266+0000","last_peered":"2024-08-17T02:23:06.140266+0000","last_clean":"2024-08-17T02:23:06.140266+0000","last_became_active":"2024-08-17T02:23:05.131611+0000","last_became_peered":"2024-08-17T02:23:05.131611+0000","last_unstale":"2024-08-17T02:23:06.140266+0000","last_undegraded":"2024-08-17T02:23:06.140266+0000","last_fullsized":"2024-08-17T02:23:06.140266+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:10.662004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.150919+0000","last_change":"2024-08-17T02:23:06.146737+0000","last_active":"2024-08-17T02:23:06.150919+0000","last_peered":"2024-08-17T02:23:06.150919+0000","last_clean":"2024-08-17T02:23:06.150919+0000","last_became_active":"2024-08-17T02:23:06.142863+0000","last_became_peered":"2024-08-17T02:23:06.142863+0000","last_unstale":"2024-08-17T02:23:06.150919+0000","last_undegraded":"2024-08-17T02:23:06.150919+0000","last_fullsized":"2024-08-17T02:23:06.150919+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:37:35.128994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.140730+0000","last_change":"2024-08-17T02:23:05.131675+0000","last_active":"2024-08-17T02:23:06.140730+0000","last_peered":"2024-08-17T02:23:06.140730+0000","last_clean":"2024-08-17T02:23:06.140730+0000","last_became_active":"2024-08-17T02:23:05.131361+0000","last_became_peered":"2024-08-17T02:23:05.131361+0000","last_unstale":"2024-08-17T02:23:06.140730+0000","last_undegraded":"2024-08-17T02:23:06.140730+0000","last_fullsized":"2024-08-17T02:23:06.140730+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:00:45.076071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.147242+0000","last_change":"2024-08-17T02:23:06.142270+0000","last_active":"2024-08-17T02:23:06.147242+0000","last_peered":"2024-08-17T02:23:06.147242+0000","last_clean":"2024-08-17T02:23:06.147242+0000","last_became_active":"2024-08-17T02:23:06.141822+0000","last_became_peered":"2024-08-17T02:23:06.141822+0000","last_unstale":"2024-08-17T02:23:06.147242+0000","last_undegraded":"2024-08-17T02:23:06.147242+0000","last_fullsized":"2024-08-17T02:23:06.147242+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:34:03.634969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.128145+0000","last_change":"2024-08-17T02:23:05.132314+0000","last_active":"2024-08-17T02:23:06.128145+0000","last_peered":"2024-08-17T02:23:06.128145+0000","last_clean":"2024-08-17T02:23:06.128145+0000","last_became_active":"2024-08-17T02:23:05.131156+0000","last_became_peered":"2024-08-17T02:23:05.131156+0000","last_unstale":"2024-08-17T02:23:06.128145+0000","last_undegraded":"2024-08-17T02:23:06.128145+0000","last_fullsized":"2024-08-17T02:23:06.128145+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:46:51.679997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.160806+0000","last_change":"2024-08-17T02:23:06.156023+0000","last_active":"2024-08-17T02:23:06.160806+0000","last_peered":"2024-08-17T02:23:06.160806+0000","last_clean":"2024-08-17T02:23:06.160806+0000","last_became_active":"2024-08-17T02:23:06.155695+0000","last_became_peered":"2024-08-17T02:23:06.155695+0000","last_unstale":"2024-08-17T02:23:06.160806+0000","last_undegraded":"2024-08-17T02:23:06.160806+0000","last_fullsized":"2024-08-17T02:23:06.160806+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:05.101776+0000","last_clean_scrub_stamp":"2024-08-17T02:23:05.101776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:08:18.958141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.129184+0000","last_change":"2024-08-17T02:23:05.125549+0000","last_active":"2024-08-17T02:23:06.129184+0000","last_peered":"2024-08-17T02:23:06.129184+0000","last_clean":"2024-08-17T02:23:06.129184+0000","last_became_active":"2024-08-17T02:23:05.124923+0000","last_became_peered":"2024-08-17T02:23:05.124923+0000","last_unstale":"2024-08-17T02:23:06.129184+0000","last_undegraded":"2024-08-17T02:23:06.129184+0000","last_fullsized":"2024-08-17T02:23:06.129184+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:23:04.098901+0000","last_clean_scrub_stamp":"2024-08-17T02:23:04.098901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:19:03.065311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":171,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:23:06.134630+0000","last_change":"2024-08-17T02:22:11.967052+0000","last_active":"2024-08-17T02:23:06.134630+0000","last_peered":"2024-08-17T02:23:06.134630+0000","last_clean":"2024-08-17T02:23:06.134630+0000","last_became_active":"2024-08-17T02:22:11.965269+0000","last_became_peered":"2024-08-17T02:22:11.965269+0000","last_unstale":"2024-08-17T02:23:06.134630+0000","last_undegraded":"2024-08-17T02:23:06.134630+0000","last_fullsized":"2024-08-17T02:23:06.134630+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:10.930862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:10.930862+0000","last_clean_scrub_stamp":"2024-08-17T02:22:10.930862+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:59:34.931003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297736,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074104,"statfs":{"total":96636764160,"available":96331882496,"internally_reserved":0,"allocated":380928,"data_stored":143721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]}]},{"osd":5,"up_from":15,"seq":64424509456,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298312,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073528,"statfs":{"total":96636764160,"available":96331292672,"internally_reserved":0,"allocated":974848,"data_stored":734637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.244}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2909999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509456,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297740,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074100,"statfs":{"total":96636764160,"available":96331878400,"internally_reserved":0,"allocated":393216,"data_stored":145273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0940000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297740,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074100,"statfs":{"total":96636764160,"available":96331878400,"internally_reserved":0,"allocated":393216,"data_stored":144463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]}]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297736,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074104,"statfs":{"total":96636764160,"available":96331882496,"internally_reserved":0,"allocated":380928,"data_stored":143733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]}]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298312,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073528,"statfs":{"total":96636764160,"available":96331292672,"internally_reserved":0,"allocated":974848,"data_stored":734137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]}]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297736,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074104,"statfs":{"total":96636764160,"available":96331882496,"internally_reserved":0,"allocated":380928,"data_stored":143789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3460000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.244}]}]},{"osd":6,"up_from":14,"seq":60129542161,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301892,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069948,"statfs":{"total":96636764160,"available":96327626752,"internally_reserved":0,"allocated":376832,"data_stored":138963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:23:13.865 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-08-17T02:23:13.866 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-08-17T02:23:13.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.978+0000 7f04fe567700 1 Processor -- start 2024-08-17T02:23:13.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.978+0000 7f04fe567700 1 -- start start 2024-08-17T02:23:13.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.982+0000 7f04fe567700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f04f80af360 0x7f04f80ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:13.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.982+0000 7f04fe567700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f04f80c6030 0x7f04f80ced20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:13.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.982+0000 7f04fe567700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04f80cb8f0 con 0x7f04f80af730 2024-08-17T02:23:13.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.982+0000 7f04fe567700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04f80cf360 con 0x7f04f80af360 2024-08-17T02:23:13.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.982+0000 7f04fe567700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04f80cc460 con 0x7f04f80c6030 2024-08-17T02:23:13.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.982+0000 7f04ef7fe700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f04f80af730 0x7f04f80ce610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:33764/0 (socket says 172.21.15.104:33764) 2024-08-17T02:23:13.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.982+0000 7f04ef7fe700 1 -- 172.21.15.104:0/1753882965 learned_addr learned my addr 172.21.15.104:0/1753882965 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:23:13.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.982+0000 7f04f7fff700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f04f80af360 0x7f04f80ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:13.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.982+0000 7f04fcb04700 1 --2- 172.21.15.104:0/1753882965 >> v2:172.21.15.117:3300/0 conn(0x7f04f80c6030 0x7f04f80ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:13.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.982+0000 7f04f77fe700 1 -- 172.21.15.104:0/1753882965 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2752130517 0 0) 0x7f04e0001290 con 0x7f04f80af730 2024-08-17T02:23:13.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.982+0000 7f04f77fe700 1 -- 172.21.15.104:0/1753882965 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04d8003570 con 0x7f04f80af730 2024-08-17T02:23:13.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.982+0000 7f04f77fe700 1 -- 172.21.15.104:0/1753882965 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2977732297 0 0) 0x7f04d8003570 con 0x7f04f80af730 2024-08-17T02:23:13.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.982+0000 7f04f7fff700 1 -- 172.21.15.104:0/1753882965 >> v2:172.21.15.117:3300/0 conn(0x7f04f80c6030 msgr2=0x7f04f80ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:13.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.982+0000 7f04f7fff700 1 --2- 172.21.15.104:0/1753882965 >> v2:172.21.15.117:3300/0 conn(0x7f04f80c6030 0x7f04f80ced20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:13.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.982+0000 7f04f7fff700 1 -- 172.21.15.104:0/1753882965 >> v1:172.21.15.104:6789/0 conn(0x7f04f80af730 legacy=0x7f04f80ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:13.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.982+0000 7f04f7fff700 1 -- 172.21.15.104:0/1753882965 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f80cbb30 con 0x7f04f80af360 2024-08-17T02:23:13.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.982+0000 7f04f7fff700 1 --2- 172.21.15.104:0/1753882965 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04f80af360 0x7f04f80ccc60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f04f80701f0 tx=0x7f04e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b22a11c70ada47 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:13.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.982+0000 7f04f77fe700 1 -- 172.21.15.104:0/1753882965 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e0001780 con 0x7f04f80af360 2024-08-17T02:23:13.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.982+0000 7f04f77fe700 1 -- 172.21.15.104:0/1753882965 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e8011420 con 0x7f04f80af360 2024-08-17T02:23:13.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.982+0000 7f04f77fe700 1 -- 172.21.15.104:0/1753882965 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e80117c0 con 0x7f04f80af360 2024-08-17T02:23:13.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.986+0000 7f04fe567700 1 -- 172.21.15.104:0/1753882965 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04f80af360 msgr2=0x7f04f80ccc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:13.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.986+0000 7f04fe567700 1 --2- 172.21.15.104:0/1753882965 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04f80af360 0x7f04f80ccc60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f04f80701f0 tx=0x7f04e80091a0 comp rx=0 tx=0).stop 2024-08-17T02:23:13.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.986+0000 7f04fe567700 1 -- 172.21.15.104:0/1753882965 shutdown_connections 2024-08-17T02:23:13.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.986+0000 7f04fe567700 1 --2- 172.21.15.104:0/1753882965 >> v2:172.21.15.117:3300/0 conn(0x7f04f80c6030 0x7f04f80ced20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:13.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.986+0000 7f04fe567700 1 --2- 172.21.15.104:0/1753882965 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04f80af360 0x7f04f80ccc60 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:13.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.986+0000 7f04fe567700 1 -- 172.21.15.104:0/1753882965 >> 172.21.15.104:0/1753882965 conn(0x7f04f80994e0 msgr2=0x7f04f80675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:13.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.986+0000 7f04fe567700 1 -- 172.21.15.104:0/1753882965 shutdown_connections 2024-08-17T02:23:13.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.986+0000 7f04fe567700 1 -- 172.21.15.104:0/1753882965 wait complete. 2024-08-17T02:23:13.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.986+0000 7f04fe567700 1 Processor -- start 2024-08-17T02:23:13.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.986+0000 7f04fe567700 1 -- start start 2024-08-17T02:23:13.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.990+0000 7f04fe567700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04f80af360 0x7f04f8155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:13.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.990+0000 7f04fe567700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04f80af730 0x7f04f80b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:13.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.990+0000 7f04fe567700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04f80c6030 0x7f04f81573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:13.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.990+0000 7f04fe567700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f80b57b0 con 0x7f04f80af730 2024-08-17T02:23:13.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.990+0000 7f04fe567700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f80b5c40 con 0x7f04f80af360 2024-08-17T02:23:13.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.990+0000 7f04fe567700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f80b4ba0 con 0x7f04f80c6030 2024-08-17T02:23:13.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.990+0000 7f04ef7fe700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04f80af730 0x7f04f80b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:13.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.990+0000 7f04ef7fe700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04f80af730 0x7f04f80b40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35306/0 (socket says 172.21.15.104:35306) 2024-08-17T02:23:13.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.990+0000 7f04ef7fe700 1 -- 172.21.15.104:0/1276441136 learned_addr learned my addr 172.21.15.104:0/1276441136 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:13.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.990+0000 7f04f7fff700 1 --2- 172.21.15.104:0/1276441136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04f80af360 0x7f04f8155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:13.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.990+0000 7f04fcb04700 1 --2- 172.21.15.104:0/1276441136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04f80c6030 0x7f04f81573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:13.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.990+0000 7f04ef7fe700 1 -- 172.21.15.104:0/1276441136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04f80c6030 msgr2=0x7f04f81573d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:13.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.990+0000 7f04ef7fe700 1 --2- 172.21.15.104:0/1276441136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04f80c6030 0x7f04f81573d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:13.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.990+0000 7f04ef7fe700 1 -- 172.21.15.104:0/1276441136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04f80af360 msgr2=0x7f04f8155b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:13.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.990+0000 7f04ef7fe700 1 --2- 172.21.15.104:0/1276441136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04f80af360 0x7f04f8155b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:13.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.990+0000 7f04ef7fe700 1 -- 172.21.15.104:0/1276441136 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e8009420 con 0x7f04f80af730 2024-08-17T02:23:13.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.990+0000 7f04fcb04700 1 --2- 172.21.15.104:0/1276441136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04f80c6030 0x7f04f81573d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:13.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.990+0000 7f04f7fff700 1 --2- 172.21.15.104:0/1276441136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04f80af360 0x7f04f8155b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:13.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.990+0000 7f04ef7fe700 1 --2- 172.21.15.104:0/1276441136 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04f80af730 0x7f04f80b40e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f04e0002ee0 tx=0x7f04e00015d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:13.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.990+0000 7f04f4ff9700 1 -- 172.21.15.104:0/1276441136 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e0007300 con 0x7f04f80af730 2024-08-17T02:23:13.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.990+0000 7f04f4ff9700 1 -- 172.21.15.104:0/1276441136 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e0007460 con 0x7f04f80af730 2024-08-17T02:23:13.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.990+0000 7f04fe567700 1 -- 172.21.15.104:0/1276441136 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04f80b4e80 con 0x7f04f80af730 2024-08-17T02:23:13.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.990+0000 7f04f4ff9700 1 -- 172.21.15.104:0/1276441136 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e00057f0 con 0x7f04f80af730 2024-08-17T02:23:13.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.990+0000 7f04fe567700 1 -- 172.21.15.104:0/1276441136 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04f80b5440 con 0x7f04f80af730 2024-08-17T02:23:13.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.994+0000 7f04fe567700 1 -- 172.21.15.104:0/1276441136 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04f80b5960 con 0x7f04f80af730 2024-08-17T02:23:14.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.994+0000 7f04f4ff9700 1 -- 172.21.15.104:0/1276441136 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f04e0005be0 con 0x7f04f80af730 2024-08-17T02:23:14.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.994+0000 7f04f4ff9700 1 --2- 172.21.15.104:0/1276441136 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f04dc060860 0x7f04dc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:14.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.994+0000 7f04f4ff9700 1 -- 172.21.15.104:0/1276441136 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f04e007c7d0 con 0x7f04f80af730 2024-08-17T02:23:14.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.994+0000 7f04f7fff700 1 --2- 172.21.15.104:0/1276441136 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f04dc060860 0x7f04dc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:14.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:13.994+0000 7f04f7fff700 1 --2- 172.21.15.104:0/1276441136 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f04dc060860 0x7f04dc062d10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f04f80701f0 tx=0x7f04e8016000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:14.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.002+0000 7f04f4ff9700 1 -- 172.21.15.104:0/1276441136 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f04f80b5960 con 0x7f04f80af730 2024-08-17T02:23:14.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.226+0000 7f04fe567700 1 -- 172.21.15.104:0/1276441136 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f04f80cb8f0 con 0x7f04f80af730 2024-08-17T02:23:14.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.230+0000 7f04f4ff9700 1 -- 172.21.15.104:0/1276441136 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7f04f80cb8f0 con 0x7f04f80af730 2024-08-17T02:23:14.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.234+0000 7f04fe567700 1 -- 172.21.15.104:0/1276441136 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f04dc060860 msgr2=0x7f04dc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:14.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.234+0000 7f04fe567700 1 --2- 172.21.15.104:0/1276441136 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f04dc060860 0x7f04dc062d10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f04f80701f0 tx=0x7f04e8016000 comp rx=0 tx=0).stop 2024-08-17T02:23:14.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.234+0000 7f04fe567700 1 -- 172.21.15.104:0/1276441136 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04f80af730 msgr2=0x7f04f80b40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:14.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.234+0000 7f04fe567700 1 --2- 172.21.15.104:0/1276441136 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04f80af730 0x7f04f80b40e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f04e0002ee0 tx=0x7f04e00015d0 comp rx=0 tx=0).stop 2024-08-17T02:23:14.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.234+0000 7f04fe567700 1 -- 172.21.15.104:0/1276441136 shutdown_connections 2024-08-17T02:23:14.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.234+0000 7f04fe567700 1 --2- 172.21.15.104:0/1276441136 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f04dc060860 0x7f04dc062d10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:14.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.234+0000 7f04fe567700 1 --2- 172.21.15.104:0/1276441136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04f80c6030 0x7f04f81573d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:14.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.234+0000 7f04fe567700 1 --2- 172.21.15.104:0/1276441136 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04f80af730 0x7f04f80b40e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:14.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.234+0000 7f04fe567700 1 --2- 172.21.15.104:0/1276441136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04f80af360 0x7f04f8155b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:14.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.234+0000 7f04fe567700 1 -- 172.21.15.104:0/1276441136 >> 172.21.15.104:0/1276441136 conn(0x7f04f80994e0 msgr2=0x7f04f8069170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:14.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.238+0000 7f04fe567700 1 -- 172.21.15.104:0/1276441136 shutdown_connections 2024-08-17T02:23:14.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.238+0000 7f04fe567700 1 -- 172.21.15.104:0/1276441136 wait complete. 2024-08-17T02:23:14.244 INFO:teuthology.orchestra.run.smithi104.stderr:updated caps for client.0 2024-08-17T02:23:14.257 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:23:14.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.350+0000 7f15262fb700 1 Processor -- start 2024-08-17T02:23:14.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.350+0000 7f15262fb700 1 -- start start 2024-08-17T02:23:14.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.354+0000 7f15262fb700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f15200d0010 0x7f15200d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:14.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.354+0000 7f15262fb700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f152015cea0 0x7f152015d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:14.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.354+0000 7f15262fb700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15200cf190 con 0x7f1520159040 2024-08-17T02:23:14.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.354+0000 7f15262fb700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15200d09a0 con 0x7f15200d0010 2024-08-17T02:23:14.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.354+0000 7f15262fb700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15200ce5e0 con 0x7f152015cea0 2024-08-17T02:23:14.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.354+0000 7f1525afa700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f152015cea0 0x7f152015d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:14.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.354+0000 7f1524af8700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f15200d0010 0x7f15200d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:14.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.354+0000 7f1525afa700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f152015cea0 0x7f152015d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.104:33468/0 (socket says 172.21.15.104:33468) 2024-08-17T02:23:14.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.354+0000 7f1524af8700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f15200d0010 0x7f15200d0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.104:37792/0 (socket says 172.21.15.104:37792) 2024-08-17T02:23:14.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.354+0000 7f1525afa700 1 -- 172.21.15.104:0/4226624197 learned_addr learned my addr 172.21.15.104:0/4226624197 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:14.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.354+0000 7f15252f9700 1 --1- 172.21.15.104:0/4226624197 >> v1:172.21.15.117:6789/0 conn(0x7f1520159040 0x7f15200cf620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.104:51650/0 (socket says 172.21.15.104:51650) 2024-08-17T02:23:14.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.354+0000 7f1525afa700 1 -- 172.21.15.104:0/4226624197 >> v2:172.21.15.117:3300/0 conn(0x7f15200d0010 msgr2=0x7f15200d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:14.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.354+0000 7f1525afa700 1 --2- 172.21.15.104:0/4226624197 >> v2:172.21.15.117:3300/0 conn(0x7f15200d0010 0x7f15200d0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:14.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.354+0000 7f1525afa700 1 -- 172.21.15.104:0/4226624197 >> v1:172.21.15.117:6789/0 conn(0x7f1520159040 legacy=0x7f15200cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:14.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.354+0000 7f1525afa700 1 -- 172.21.15.104:0/4226624197 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15200ce860 con 0x7f152015cea0 2024-08-17T02:23:14.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.354+0000 7f1525afa700 1 --2- 172.21.15.104:0/4226624197 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f152015cea0 0x7f152015d320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1518009f20 tx=0x7f1518009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8279cb9c8a68421e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:14.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.354+0000 7f1517fff700 1 -- 172.21.15.104:0/4226624197 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151800e070 con 0x7f152015cea0 2024-08-17T02:23:14.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.354+0000 7f1517fff700 1 -- 172.21.15.104:0/4226624197 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151800b9d0 con 0x7f152015cea0 2024-08-17T02:23:14.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.354+0000 7f1517fff700 1 -- 172.21.15.104:0/4226624197 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15180092e0 con 0x7f152015cea0 2024-08-17T02:23:14.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.354+0000 7f15262fb700 1 -- 172.21.15.104:0/4226624197 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f152015cea0 msgr2=0x7f152015d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:14.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.354+0000 7f15262fb700 1 --2- 172.21.15.104:0/4226624197 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f152015cea0 0x7f152015d320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1518009f20 tx=0x7f1518009840 comp rx=0 tx=0).stop 2024-08-17T02:23:14.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.354+0000 7f15262fb700 1 -- 172.21.15.104:0/4226624197 shutdown_connections 2024-08-17T02:23:14.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.354+0000 7f15262fb700 1 --2- 172.21.15.104:0/4226624197 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f152015cea0 0x7f152015d320 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:14.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.354+0000 7f15262fb700 1 --2- 172.21.15.104:0/4226624197 >> v2:172.21.15.117:3300/0 conn(0x7f15200d0010 0x7f15200d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:14.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.354+0000 7f15262fb700 1 -- 172.21.15.104:0/4226624197 >> 172.21.15.104:0/4226624197 conn(0x7f1520068250 msgr2=0x7f1520068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:14.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.354+0000 7f15262fb700 1 -- 172.21.15.104:0/4226624197 shutdown_connections 2024-08-17T02:23:14.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.354+0000 7f15262fb700 1 -- 172.21.15.104:0/4226624197 wait complete. 2024-08-17T02:23:14.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.358+0000 7f15262fb700 1 Processor -- start 2024-08-17T02:23:14.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.358+0000 7f15262fb700 1 -- start start 2024-08-17T02:23:14.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.358+0000 7f15262fb700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15200d0010 0x7f1520151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:14.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.358+0000 7f15262fb700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1520159040 0x7f1520157b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:14.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.358+0000 7f15262fb700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f152015cea0 0x7f15201580c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:14.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.358+0000 7f15262fb700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15200b2700 con 0x7f1520159040 2024-08-17T02:23:14.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.358+0000 7f15262fb700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15200b1af0 con 0x7f15200d0010 2024-08-17T02:23:14.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.358+0000 7f15262fb700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15200b1dd0 con 0x7f152015cea0 2024-08-17T02:23:14.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.358+0000 7f1524af8700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1520159040 0x7f1520157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:14.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.358+0000 7f1524af8700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1520159040 0x7f1520157b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35320/0 (socket says 172.21.15.104:35320) 2024-08-17T02:23:14.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.358+0000 7f1524af8700 1 -- 172.21.15.104:0/2467646195 learned_addr learned my addr 172.21.15.104:0/2467646195 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:14.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.362+0000 7f1525afa700 1 --2- 172.21.15.104:0/2467646195 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f152015cea0 0x7f15201580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:14.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.362+0000 7f15252f9700 1 --2- 172.21.15.104:0/2467646195 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15200d0010 0x7f1520151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:14.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.362+0000 7f1524af8700 1 -- 172.21.15.104:0/2467646195 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f152015cea0 msgr2=0x7f15201580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:14.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.362+0000 7f1524af8700 1 --2- 172.21.15.104:0/2467646195 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f152015cea0 0x7f15201580c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:14.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.362+0000 7f1524af8700 1 -- 172.21.15.104:0/2467646195 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15200d0010 msgr2=0x7f1520151cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:14.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.362+0000 7f1524af8700 1 --2- 172.21.15.104:0/2467646195 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15200d0010 0x7f1520151cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:14.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.362+0000 7f1524af8700 1 -- 172.21.15.104:0/2467646195 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1518009ae0 con 0x7f1520159040 2024-08-17T02:23:14.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.362+0000 7f1524af8700 1 --2- 172.21.15.104:0/2467646195 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1520159040 0x7f1520157b80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f151c00e930 tx=0x7f151c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:14.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.362+0000 7f15157fa700 1 -- 172.21.15.104:0/2467646195 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c013680 con 0x7f1520159040 2024-08-17T02:23:14.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.362+0000 7f15157fa700 1 -- 172.21.15.104:0/2467646195 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151c0137e0 con 0x7f1520159040 2024-08-17T02:23:14.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.362+0000 7f15262fb700 1 -- 172.21.15.104:0/2467646195 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15200b20b0 con 0x7f1520159040 2024-08-17T02:23:14.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.362+0000 7f15157fa700 1 -- 172.21.15.104:0/2467646195 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c013b80 con 0x7f1520159040 2024-08-17T02:23:14.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.362+0000 7f15262fb700 1 -- 172.21.15.104:0/2467646195 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1520152200 con 0x7f1520159040 2024-08-17T02:23:14.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.362+0000 7f15262fb700 1 -- 172.21.15.104:0/2467646195 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1520169860 con 0x7f1520159040 2024-08-17T02:23:14.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.362+0000 7f15157fa700 1 -- 172.21.15.104:0/2467646195 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f151c00c3e0 con 0x7f1520159040 2024-08-17T02:23:14.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.366+0000 7f15157fa700 1 --2- 172.21.15.104:0/2467646195 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f1504060860 0x7f1504062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:14.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.366+0000 7f15157fa700 1 -- 172.21.15.104:0/2467646195 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f151c07cca0 con 0x7f1520159040 2024-08-17T02:23:14.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.366+0000 7f15252f9700 1 --2- 172.21.15.104:0/2467646195 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f1504060860 0x7f1504062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:14.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.366+0000 7f15252f9700 1 --2- 172.21.15.104:0/2467646195 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f1504060860 0x7f1504062d10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1510004fd0 tx=0x7f1510007eb0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:14.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.374+0000 7f15157fa700 1 -- 172.21.15.104:0/2467646195 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f151c04d0f0 con 0x7f1520159040 2024-08-17T02:23:14.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.574+0000 7f15262fb700 1 -- 172.21.15.104:0/2467646195 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f15200b2530 con 0x7f1520159040 2024-08-17T02:23:14.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.574+0000 7f15157fa700 1 -- 172.21.15.104:0/2467646195 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f151c050710 con 0x7f1520159040 2024-08-17T02:23:14.581 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:23:14.581 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/3848434798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3848434798},{"type":"v1","addr":"172.21.15.117:6836","nonce":3848434798}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4894,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1461239637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1461239637},{"type":"v1","addr":"172.21.15.117:6837","nonce":1461239637}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4959,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/4148924116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":4148924116},{"type":"v1","addr":"172.21.15.104:6833","nonce":4148924116}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:23:05.468383+0000","modified":"2024-08-17T02:23:08.148034+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4965},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4965":{"gid":4965,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/38993094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":38993094},{"type":"v1","addr":"172.21.15.104:6835","nonce":38993094}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-08-17T02:23:14.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.578+0000 7f15262fb700 1 -- 172.21.15.104:0/2467646195 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f1504060860 msgr2=0x7f1504062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:14.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.578+0000 7f15262fb700 1 --2- 172.21.15.104:0/2467646195 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f1504060860 0x7f1504062d10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1510004fd0 tx=0x7f1510007eb0 comp rx=0 tx=0).stop 2024-08-17T02:23:14.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.578+0000 7f15262fb700 1 -- 172.21.15.104:0/2467646195 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1520159040 msgr2=0x7f1520157b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:14.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.578+0000 7f15262fb700 1 --2- 172.21.15.104:0/2467646195 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1520159040 0x7f1520157b80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f151c00e930 tx=0x7f151c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:23:14.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.578+0000 7f15262fb700 1 -- 172.21.15.104:0/2467646195 shutdown_connections 2024-08-17T02:23:14.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.578+0000 7f15262fb700 1 --2- 172.21.15.104:0/2467646195 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f1504060860 0x7f1504062d10 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:14.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.578+0000 7f15262fb700 1 --2- 172.21.15.104:0/2467646195 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f152015cea0 0x7f15201580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:14.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.578+0000 7f15262fb700 1 --2- 172.21.15.104:0/2467646195 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1520159040 0x7f1520157b80 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:14.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.578+0000 7f15262fb700 1 --2- 172.21.15.104:0/2467646195 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15200d0010 0x7f1520151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:14.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.578+0000 7f15262fb700 1 -- 172.21.15.104:0/2467646195 >> 172.21.15.104:0/2467646195 conn(0x7f1520068250 msgr2=0x7f1520156990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:14.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.578+0000 7f15262fb700 1 -- 172.21.15.104:0/2467646195 shutdown_connections 2024-08-17T02:23:14.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:14.578+0000 7f15262fb700 1 -- 172.21.15.104:0/2467646195 wait complete. 2024-08-17T02:23:14.585 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 14 2024-08-17T02:23:14.998 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-17T02:23:05.468383+0000', 'modified': '2024-08-17T02:23:08.148034+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4965}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4965': {'gid': 4965, 'name': 'a', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.104:6835/38993094', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.104:6834', 'nonce': 38993094}, {'type': 'v1', 'addr': '172.21.15.104:6835', 'nonce': 38993094}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-08-17T02:23:14.999 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-17T02:23:14.999 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-08-17T02:23:15.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.110+0000 7f58ce2af700 1 Processor -- start 2024-08-17T02:23:15.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.110+0000 7f58ce2af700 1 -- start start 2024-08-17T02:23:15.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.110+0000 7f58ce2af700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58c806e9d0 0x7f58c806eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.110+0000 7f58ce2af700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f58c80ab540 0x7f58c80b1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.110+0000 7f58ce2af700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58c80aba70 con 0x7f58c806df10 2024-08-17T02:23:15.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.110+0000 7f58ce2af700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58c80abd50 con 0x7f58c80ab540 2024-08-17T02:23:15.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.110+0000 7f58ce2af700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c80ac030 con 0x7f58c806e9d0 2024-08-17T02:23:15.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.110+0000 7f58cd2ad700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58c806e9d0 0x7f58c806eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.110+0000 7f58ccaac700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f58c80ab540 0x7f58c80b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.110+0000 7f58cdaae700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f58c806df10 0x7f58c8155010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.104:51662/0 (socket says 172.21.15.104:51662) 2024-08-17T02:23:15.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.110+0000 7f58cdaae700 1 -- 172.21.15.104:0/3511493457 learned_addr learned my addr 172.21.15.104:0/3511493457 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:23:15.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.114+0000 7f58cd2ad700 1 -- 172.21.15.104:0/3511493457 >> v2:172.21.15.117:3300/0 conn(0x7f58c80ab540 msgr2=0x7f58c80b1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:15.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.114+0000 7f58cd2ad700 1 --2- 172.21.15.104:0/3511493457 >> v2:172.21.15.117:3300/0 conn(0x7f58c80ab540 0x7f58c80b1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.114+0000 7f58cd2ad700 1 -- 172.21.15.104:0/3511493457 >> v1:172.21.15.117:6789/0 conn(0x7f58c806df10 legacy=0x7f58c8155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:15.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.114+0000 7f58bbfff700 1 -- 172.21.15.104:0/3511493457 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 969454288 0 0) 0x7f58c80aba70 con 0x7f58c806df10 2024-08-17T02:23:15.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.114+0000 7f58cd2ad700 1 -- 172.21.15.104:0/3511493457 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c80ac310 con 0x7f58c806e9d0 2024-08-17T02:23:15.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.114+0000 7f58ccaac700 1 --2- 172.21.15.104:0/3511493457 >> v2:172.21.15.117:3300/0 conn(0x7f58c80ab540 0x7f58c80b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:15.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.114+0000 7f58cd2ad700 1 --2- 172.21.15.104:0/3511493457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58c806e9d0 0x7f58c806eda0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f58bc0098e0 tx=0x7f58bc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8deb2d335e1ec881 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:15.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.114+0000 7f58bbfff700 1 -- 172.21.15.104:0/3511493457 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58bc00b640 con 0x7f58c806e9d0 2024-08-17T02:23:15.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.114+0000 7f58bbfff700 1 -- 172.21.15.104:0/3511493457 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58bc00b7a0 con 0x7f58c806e9d0 2024-08-17T02:23:15.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.114+0000 7f58bbfff700 1 -- 172.21.15.104:0/3511493457 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58bc00bb40 con 0x7f58c806e9d0 2024-08-17T02:23:15.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.114+0000 7f58ce2af700 1 -- 172.21.15.104:0/3511493457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58c806e9d0 msgr2=0x7f58c806eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:15.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.114+0000 7f58ce2af700 1 --2- 172.21.15.104:0/3511493457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58c806e9d0 0x7f58c806eda0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f58bc0098e0 tx=0x7f58bc0091a0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.114+0000 7f58ce2af700 1 -- 172.21.15.104:0/3511493457 shutdown_connections 2024-08-17T02:23:15.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.114+0000 7f58ce2af700 1 --2- 172.21.15.104:0/3511493457 >> v2:172.21.15.117:3300/0 conn(0x7f58c80ab540 0x7f58c80b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.114+0000 7f58ce2af700 1 --2- 172.21.15.104:0/3511493457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58c806e9d0 0x7f58c806eda0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.114+0000 7f58ce2af700 1 -- 172.21.15.104:0/3511493457 >> 172.21.15.104:0/3511493457 conn(0x7f58c80678d0 msgr2=0x7f58c8067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:15.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.114+0000 7f58ce2af700 1 -- 172.21.15.104:0/3511493457 shutdown_connections 2024-08-17T02:23:15.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.114+0000 7f58ce2af700 1 -- 172.21.15.104:0/3511493457 wait complete. 2024-08-17T02:23:15.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.118+0000 7f58ce2af700 1 Processor -- start 2024-08-17T02:23:15.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.118+0000 7f58ce2af700 1 -- start start 2024-08-17T02:23:15.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.118+0000 7f58ce2af700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f58c806df10 0x7f58c80aaf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.118+0000 7f58ce2af700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58c806e9d0 0x7f58c81360a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.118+0000 7f58ce2af700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58c80ab540 0x7f58c81354f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.118+0000 7f58ce2af700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c81365e0 con 0x7f58c806df10 2024-08-17T02:23:15.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.118+0000 7f58ce2af700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c8136880 con 0x7f58c806e9d0 2024-08-17T02:23:15.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.118+0000 7f58ce2af700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c8136b60 con 0x7f58c80ab540 2024-08-17T02:23:15.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.118+0000 7f58cd2ad700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f58c806df10 0x7f58c80aaf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.118+0000 7f58cd2ad700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f58c806df10 0x7f58c80aaf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35328/0 (socket says 172.21.15.104:35328) 2024-08-17T02:23:15.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.118+0000 7f58cd2ad700 1 -- 172.21.15.104:0/1921938146 learned_addr learned my addr 172.21.15.104:0/1921938146 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:15.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.118+0000 7f58cdaae700 1 --2- 172.21.15.104:0/1921938146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58c80ab540 0x7f58c81354f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.118+0000 7f58ccaac700 1 --2- 172.21.15.104:0/1921938146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58c806e9d0 0x7f58c81360a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.118+0000 7f58cd2ad700 1 -- 172.21.15.104:0/1921938146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58c80ab540 msgr2=0x7f58c81354f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:15.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.118+0000 7f58cd2ad700 1 --2- 172.21.15.104:0/1921938146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58c80ab540 0x7f58c81354f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.118+0000 7f58cd2ad700 1 -- 172.21.15.104:0/1921938146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58c806e9d0 msgr2=0x7f58c81360a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:15.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.118+0000 7f58cd2ad700 1 --2- 172.21.15.104:0/1921938146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58c806e9d0 0x7f58c81360a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.118+0000 7f58cd2ad700 1 -- 172.21.15.104:0/1921938146 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c4009a20 con 0x7f58c806df10 2024-08-17T02:23:15.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.118+0000 7f58cd2ad700 1 --2- 172.21.15.104:0/1921938146 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f58c806df10 0x7f58c80aaf50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f58c80ac170 tx=0x7f58bc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:15.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.118+0000 7f58b97fa700 1 -- 172.21.15.104:0/1921938146 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58bc00bb20 con 0x7f58c806df10 2024-08-17T02:23:15.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.118+0000 7f58b97fa700 1 -- 172.21.15.104:0/1921938146 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58bc000c90 con 0x7f58c806df10 2024-08-17T02:23:15.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.118+0000 7f58b97fa700 1 -- 172.21.15.104:0/1921938146 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58bc011650 con 0x7f58c806df10 2024-08-17T02:23:15.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.118+0000 7f58ce2af700 1 -- 172.21.15.104:0/1921938146 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58bc009420 con 0x7f58c806df10 2024-08-17T02:23:15.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.118+0000 7f58ce2af700 1 -- 172.21.15.104:0/1921938146 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58c8137120 con 0x7f58c806df10 2024-08-17T02:23:15.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.122+0000 7f58b97fa700 1 -- 172.21.15.104:0/1921938146 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f58bc011a00 con 0x7f58c806df10 2024-08-17T02:23:15.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.122+0000 7f58b97fa700 1 --2- 172.21.15.104:0/1921938146 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f58ac060860 0x7f58ac062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.122+0000 7f58b97fa700 1 -- 172.21.15.104:0/1921938146 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f58bc07e1c0 con 0x7f58c806df10 2024-08-17T02:23:15.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.122+0000 7f58ccaac700 1 --2- 172.21.15.104:0/1921938146 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f58ac060860 0x7f58ac062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.122+0000 7f58ccaac700 1 --2- 172.21.15.104:0/1921938146 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f58ac060860 0x7f58ac062d10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f58c80adc50 tx=0x7f58c400b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:15.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.126+0000 7f58d17c0740 1 Processor -- start 2024-08-17T02:23:15.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.126+0000 7f58d17c0740 1 -- start start 2024-08-17T02:23:15.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.126+0000 7f58d17c0740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x26ffae0 0x29331d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.126+0000 7f58d17c0740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x26ff710 0x2933710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.126+0000 7f58d17c0740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x274a790 0x2936ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.126+0000 7f58d17c0740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x28abba0 con 0x274a790 2024-08-17T02:23:15.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.126+0000 7f58d17c0740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x28a7b40 con 0x26ff710 2024-08-17T02:23:15.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.126+0000 7f58d17c0740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x286d0a0 con 0x26ffae0 2024-08-17T02:23:15.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.126+0000 7f58cdaae700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x274a790 0x2936ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.126+0000 7f58ccaac700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x26ff710 0x2933710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.126+0000 7f58cd2ad700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x26ffae0 0x29331d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.126+0000 7f58cdaae700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x274a790 0x2936ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35332/0 (socket says 172.21.15.104:35332) 2024-08-17T02:23:15.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.126+0000 7f58cdaae700 1 -- 172.21.15.104:0/3816203037 learned_addr learned my addr 172.21.15.104:0/3816203037 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:15.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.126+0000 7f58cdaae700 1 -- 172.21.15.104:0/3816203037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x26ffae0 msgr2=0x29331d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:15.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.126+0000 7f58cdaae700 1 --2- 172.21.15.104:0/3816203037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x26ffae0 0x29331d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.126+0000 7f58cdaae700 1 -- 172.21.15.104:0/3816203037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x26ff710 msgr2=0x2933710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:15.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.126+0000 7f58cdaae700 1 --2- 172.21.15.104:0/3816203037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x26ff710 0x2933710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.126+0000 7f58cdaae700 1 -- 172.21.15.104:0/3816203037 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x274b9e0 con 0x274a790 2024-08-17T02:23:15.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.126+0000 7f58cdaae700 1 --2- 172.21.15.104:0/3816203037 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x274a790 0x2936ca0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f58c0004f80 tx=0x7f58c0007cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3689a9ecb5c020c0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:15.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.130+0000 7f58b27fc700 1 -- 172.21.15.104:0/3816203037 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c0001590 con 0x274a790 2024-08-17T02:23:15.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.130+0000 7f58b27fc700 1 -- 172.21.15.104:0/3816203037 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c00016f0 con 0x274a790 2024-08-17T02:23:15.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.130+0000 7f58b27fc700 1 -- 172.21.15.104:0/3816203037 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c0001a90 con 0x274a790 2024-08-17T02:23:15.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.130+0000 7f58d17c0740 1 -- 172.21.15.104:0/3816203037 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x274a790 msgr2=0x2936ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:15.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.130+0000 7f58d17c0740 1 --2- 172.21.15.104:0/3816203037 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x274a790 0x2936ca0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f58c0004f80 tx=0x7f58c0007cd0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.130+0000 7f58d17c0740 1 -- 172.21.15.104:0/3816203037 shutdown_connections 2024-08-17T02:23:15.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.130+0000 7f58d17c0740 1 --2- 172.21.15.104:0/3816203037 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x274a790 0x2936ca0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.130+0000 7f58d17c0740 1 --2- 172.21.15.104:0/3816203037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x26ff710 0x2933710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.130+0000 7f58d17c0740 1 --2- 172.21.15.104:0/3816203037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x26ffae0 0x29331d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.130+0000 7f58d17c0740 1 -- 172.21.15.104:0/3816203037 >> 172.21.15.104:0/3816203037 conn(0x26ffeb0 msgr2=0x29390f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:15.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.130+0000 7f58d17c0740 1 -- 172.21.15.104:0/3816203037 shutdown_connections 2024-08-17T02:23:15.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.130+0000 7f58d17c0740 1 -- 172.21.15.104:0/3816203037 wait complete. 2024-08-17T02:23:15.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.130+0000 7f58d17c0740 1 -- start start 2024-08-17T02:23:15.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.130+0000 7f58d17c0740 1 Processor -- start 2024-08-17T02:23:15.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.134+0000 7f58d17c0740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x26ff710 0x2981060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.134+0000 7f58d17c0740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x26ffae0 0x29815a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.134+0000 7f58d17c0740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x274a790 0x2961480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.134+0000 7f58d17c0740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x286cd40 con 0x274a790 2024-08-17T02:23:15.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.134+0000 7f58d17c0740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x2845970 con 0x26ff710 2024-08-17T02:23:15.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.134+0000 7f58d17c0740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x27c1ef0 con 0x26ffae0 2024-08-17T02:23:15.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.134+0000 7f58d17c0740 10 client.0 _ll_register_callbacks cb 0x2849f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:23:15.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.134+0000 7f58cdaae700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x274a790 0x2961480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.134+0000 7f58cd2ad700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x26ff710 0x2981060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.134+0000 7f58cdaae700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x274a790 0x2961480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35334/0 (socket says 172.21.15.104:35334) 2024-08-17T02:23:15.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.134+0000 7f58cdaae700 1 -- 172.21.15.104:0/3770068183 learned_addr learned my addr 172.21.15.104:0/3770068183 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:15.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.134+0000 7f58ccaac700 1 --2- 172.21.15.104:0/3770068183 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x26ffae0 0x29815a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.134+0000 7f58cdaae700 1 -- 172.21.15.104:0/3770068183 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x26ffae0 msgr2=0x29815a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:15.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.134+0000 7f58cdaae700 1 --2- 172.21.15.104:0/3770068183 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x26ffae0 0x29815a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.134+0000 7f58cdaae700 1 -- 172.21.15.104:0/3770068183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x26ff710 msgr2=0x2981060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:15.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.134+0000 7f58cdaae700 1 --2- 172.21.15.104:0/3770068183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x26ff710 0x2981060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.134+0000 7f58cdaae700 1 -- 172.21.15.104:0/3770068183 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58c0004bb0 con 0x274a790 2024-08-17T02:23:15.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.134+0000 7f58cdaae700 1 --2- 172.21.15.104:0/3770068183 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x274a790 0x2961480 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f58c0004fd0 tx=0x7f58c0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7c0cdbaa705a75 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:15.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.134+0000 7f58a77fe700 10 client.0 ms_handle_connect on v2:172.21.15.104:3300/0 2024-08-17T02:23:15.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.134+0000 7f58a77fe700 1 -- 172.21.15.104:0/3770068183 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c001d710 con 0x274a790 2024-08-17T02:23:15.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.134+0000 7f58a77fe700 1 -- 172.21.15.104:0/3770068183 <== mon.0 v2:172.21.15.104:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f58c001d870 con 0x274a790 2024-08-17T02:23:15.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.134+0000 7f58d17c0740 1 -- 172.21.15.104:0/3770068183 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x270d260 con 0x274a790 2024-08-17T02:23:15.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.134+0000 7f58a77fe700 1 -- 172.21.15.104:0/3770068183 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58c001dc60 con 0x274a790 2024-08-17T02:23:15.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.134+0000 7f58d17c0740 10 client.5163 fetch_fsmap learned FSMap version 14 2024-08-17T02:23:15.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.134+0000 7f58d17c0740 1 -- 172.21.15.104:0/3770068183 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x2875370 con 0x274a790 2024-08-17T02:23:15.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.134+0000 7f58a77fe700 1 -- 172.21.15.104:0/3770068183 <== mon.0 v2:172.21.15.104:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x270d260 con 0x274a790 2024-08-17T02:23:15.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.134+0000 7f58a77fe700 1 -- 172.21.15.104:0/3770068183 <== mon.0 v2:172.21.15.104:3300/0 5 ==== fsmap(e 14) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f58c0012070 con 0x274a790 2024-08-17T02:23:15.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.134+0000 7f58d17c0740 10 client.5163 fetch_fsmap finished waiting for FSMap version 14 2024-08-17T02:23:15.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.134+0000 7f58d17c0740 10 client.5163 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-17T02:23:15.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.134+0000 7f58d17c0740 20 client.5163 populate_metadata read hostname 'smithi104' 2024-08-17T02:23:15.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.134+0000 7f58d17c0740 1 --2- 172.21.15.104:0/3770068183 >> [v2:172.21.15.104:6834/38993094,v1:172.21.15.104:6835/38993094] conn(0x298a1f0 0x298c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.134+0000 7f58d17c0740 4 client.5163 mds_command: new command op to 4965 tid=0[{"prefix": "get_command_descriptions"}] 2024-08-17T02:23:15.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.134+0000 7f58d17c0740 1 -- 172.21.15.104:0/3770068183 --> [v2:172.21.15.104:6834/38993094,v1:172.21.15.104:6835/38993094] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x27574e0 con 0x298a1f0 2024-08-17T02:23:15.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.134+0000 7f58cd2ad700 1 --2- 172.21.15.104:0/3770068183 >> [v2:172.21.15.104:6834/38993094,v1:172.21.15.104:6835/38993094] conn(0x298a1f0 0x298c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.134+0000 7f58cd2ad700 1 --2- 172.21.15.104:0/3770068183 >> [v2:172.21.15.104:6834/38993094,v1:172.21.15.104:6835/38993094] conn(0x298a1f0 0x298c5d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d68032d59b2ec1f server_cookie=77924c10ed3872cf in_seq=0 out_seq=0 2024-08-17T02:23:15.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.134+0000 7f58a77fe700 10 client.5163 ms_handle_connect on v2:172.21.15.104:6834/38993094 2024-08-17T02:23:15.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.138+0000 7f58a77fe700 1 -- 172.21.15.104:0/3770068183 <== mds.0 v2:172.21.15.104:6834/38993094 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17536 (crc 0 0 0) 0x27574e0 con 0x298a1f0 2024-08-17T02:23:15.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.138+0000 7f58a77fe700 10 client.5163 handle_command_reply: tid=0 2024-08-17T02:23:15.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.138+0000 7f58d17c0740 1 client.5163 shutdown 2024-08-17T02:23:15.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.138+0000 7f58d17c0740 1 -- 172.21.15.104:0/3770068183 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x274a790 msgr2=0x2961480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:15.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.138+0000 7f58d17c0740 1 --2- 172.21.15.104:0/3770068183 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x274a790 0x2961480 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f58c0004fd0 tx=0x7f58c0018000 comp rx=0 tx=0).stop 2024-08-17T02:23:15.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.138+0000 7f58d17c0740 1 -- 172.21.15.104:0/3770068183 shutdown_connections 2024-08-17T02:23:15.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.138+0000 7f58d17c0740 1 --2- 172.21.15.104:0/3770068183 >> [v2:172.21.15.104:6834/38993094,v1:172.21.15.104:6835/38993094] conn(0x298a1f0 0x298c5d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.138+0000 7f58d17c0740 1 --2- 172.21.15.104:0/3770068183 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x274a790 0x2961480 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.138+0000 7f58a77fe700 0 client.5163 ms_handle_reset on v2:172.21.15.104:6834/38993094 2024-08-17T02:23:15.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.138+0000 7f58d17c0740 1 --2- 172.21.15.104:0/3770068183 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x26ffae0 0x29815a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.138+0000 7f58d17c0740 1 --2- 172.21.15.104:0/3770068183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x26ff710 0x2981060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.138+0000 7f58d17c0740 1 -- 172.21.15.104:0/3770068183 >> 172.21.15.104:0/3770068183 conn(0x26ffeb0 msgr2=0x2931930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:15.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.138+0000 7f58d17c0740 1 -- 172.21.15.104:0/3770068183 shutdown_connections 2024-08-17T02:23:15.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.138+0000 7f58d17c0740 1 -- 172.21.15.104:0/3770068183 wait complete. 2024-08-17T02:23:15.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.138+0000 7f58d17c0740 20 client.5163 trim_cache size 0 max 16384 2024-08-17T02:23:15.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.158+0000 7f58d17c0740 1 Processor -- start 2024-08-17T02:23:15.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.158+0000 7f58d17c0740 1 -- start start 2024-08-17T02:23:15.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.158+0000 7f58d17c0740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x26ff710 0x29d1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.158+0000 7f58d17c0740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x26ffae0 0x29383c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.158+0000 7f58d17c0740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x274a790 0x2938900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.158+0000 7f58d17c0740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x28aa200 con 0x26ff710 2024-08-17T02:23:15.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.158+0000 7f58d17c0740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x27787c0 con 0x274a790 2024-08-17T02:23:15.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.158+0000 7f58d17c0740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x2856140 con 0x26ffae0 2024-08-17T02:23:15.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.158+0000 7f58cd2ad700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x26ff710 0x29d1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.158+0000 7f58ccaac700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x26ffae0 0x29383c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.158+0000 7f58cdaae700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x274a790 0x2938900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.158+0000 7f58ccaac700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x26ffae0 0x29383c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.104:33518/0 (socket says 172.21.15.104:33518) 2024-08-17T02:23:15.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.158+0000 7f58cd2ad700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x26ff710 0x29d1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35342/0 (socket says 172.21.15.104:35342) 2024-08-17T02:23:15.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.158+0000 7f58ccaac700 1 -- 172.21.15.104:0/3820112842 learned_addr learned my addr 172.21.15.104:0/3820112842 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:15.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.158+0000 7f58ccaac700 1 -- 172.21.15.104:0/3820112842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x274a790 msgr2=0x2938900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:15.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.158+0000 7f58ccaac700 1 --2- 172.21.15.104:0/3820112842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x274a790 0x2938900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.158+0000 7f58ccaac700 1 -- 172.21.15.104:0/3820112842 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x26ff710 msgr2=0x29d1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:15.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.158+0000 7f58ccaac700 1 --2- 172.21.15.104:0/3820112842 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x26ff710 0x29d1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.158+0000 7f58ccaac700 1 -- 172.21.15.104:0/3820112842 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x285bd80 con 0x26ffae0 2024-08-17T02:23:15.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.158+0000 7f58cdaae700 1 --2- 172.21.15.104:0/3820112842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x274a790 0x2938900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:15.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.162+0000 7f58ccaac700 1 --2- 172.21.15.104:0/3820112842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x26ffae0 0x29383c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f58c4015990 tx=0x7f58c4016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7de5822855f42297 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:15.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.162+0000 7f58b2ffd700 1 -- 172.21.15.104:0/3820112842 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c400e040 con 0x26ffae0 2024-08-17T02:23:15.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.162+0000 7f58b2ffd700 1 -- 172.21.15.104:0/3820112842 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c400f040 con 0x26ffae0 2024-08-17T02:23:15.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.162+0000 7f58b2ffd700 1 -- 172.21.15.104:0/3820112842 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c4017900 con 0x26ffae0 2024-08-17T02:23:15.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.162+0000 7f58d17c0740 1 -- 172.21.15.104:0/3820112842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x26ffae0 msgr2=0x29383c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:15.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.162+0000 7f58d17c0740 1 --2- 172.21.15.104:0/3820112842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x26ffae0 0x29383c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f58c4015990 tx=0x7f58c4016000 comp rx=0 tx=0).stop 2024-08-17T02:23:15.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.162+0000 7f58d17c0740 1 -- 172.21.15.104:0/3820112842 shutdown_connections 2024-08-17T02:23:15.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.162+0000 7f58d17c0740 1 --2- 172.21.15.104:0/3820112842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x274a790 0x2938900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.162+0000 7f58d17c0740 1 --2- 172.21.15.104:0/3820112842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x26ffae0 0x29383c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.162+0000 7f58d17c0740 1 --2- 172.21.15.104:0/3820112842 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x26ff710 0x29d1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.162+0000 7f58d17c0740 1 -- 172.21.15.104:0/3820112842 >> 172.21.15.104:0/3820112842 conn(0x26ffeb0 msgr2=0x2936ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:15.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.162+0000 7f58d17c0740 1 -- 172.21.15.104:0/3820112842 shutdown_connections 2024-08-17T02:23:15.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.162+0000 7f58d17c0740 1 -- 172.21.15.104:0/3820112842 wait complete. 2024-08-17T02:23:15.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.162+0000 7f58d17c0740 1 -- start start 2024-08-17T02:23:15.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.162+0000 7f58d17c0740 1 Processor -- start 2024-08-17T02:23:15.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.162+0000 7f58d17c0740 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x26ff710 0x29d82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.162+0000 7f58d17c0740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x26ffae0 0x29d8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.162+0000 7f58d17c0740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x274a790 0x295ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.162+0000 7f58d17c0740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x28a69d0 con 0x26ffae0 2024-08-17T02:23:15.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.162+0000 7f58d17c0740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x28a3650 con 0x274a790 2024-08-17T02:23:15.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.162+0000 7f58d17c0740 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x28a5500 con 0x26ff710 2024-08-17T02:23:15.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.162+0000 7f58d17c0740 10 client.0 _ll_register_callbacks cb 0x26cb9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:23:15.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.162+0000 7f58ccaac700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x26ffae0 0x29d8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.162+0000 7f58ccaac700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x26ffae0 0x29d8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35354/0 (socket says 172.21.15.104:35354) 2024-08-17T02:23:15.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.162+0000 7f58ccaac700 1 -- 172.21.15.104:0/1002261181 learned_addr learned my addr 172.21.15.104:0/1002261181 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:15.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.162+0000 7f58cdaae700 1 --2- 172.21.15.104:0/1002261181 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x274a790 0x295ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.162+0000 7f58cd2ad700 1 --2- 172.21.15.104:0/1002261181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x26ff710 0x29d82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.166+0000 7f58ccaac700 1 -- 172.21.15.104:0/1002261181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x26ff710 msgr2=0x29d82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:15.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.166+0000 7f58ccaac700 1 --2- 172.21.15.104:0/1002261181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x26ff710 0x29d82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.166+0000 7f58ccaac700 1 -- 172.21.15.104:0/1002261181 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x274a790 msgr2=0x295ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:15.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.166+0000 7f58ccaac700 1 --2- 172.21.15.104:0/1002261181 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x274a790 0x295ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.166+0000 7f58ccaac700 1 -- 172.21.15.104:0/1002261181 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x2875370 con 0x26ffae0 2024-08-17T02:23:15.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.166+0000 7f58cd2ad700 1 --2- 172.21.15.104:0/1002261181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x26ff710 0x29d82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:15.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.166+0000 7f58cdaae700 1 --2- 172.21.15.104:0/1002261181 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x274a790 0x295ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:15.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.166+0000 7f58ccaac700 1 --2- 172.21.15.104:0/1002261181 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x26ffae0 0x29d8810 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x2851760 tx=0x7f58c401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b942001254c7aa server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:15.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.166+0000 7f58a77fe700 10 client.0 ms_handle_connect on v2:172.21.15.104:3300/0 2024-08-17T02:23:15.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.166+0000 7f58a77fe700 1 -- 172.21.15.104:0/1002261181 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c400e040 con 0x26ffae0 2024-08-17T02:23:15.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.166+0000 7f58a77fe700 1 -- 172.21.15.104:0/1002261181 <== mon.0 v2:172.21.15.104:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f58c4025470 con 0x26ffae0 2024-08-17T02:23:15.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.166+0000 7f58d17c0740 1 -- 172.21.15.104:0/1002261181 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f58c00016f0 con 0x26ffae0 2024-08-17T02:23:15.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.166+0000 7f58a77fe700 1 -- 172.21.15.104:0/1002261181 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58c4025840 con 0x26ffae0 2024-08-17T02:23:15.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.166+0000 7f58d17c0740 10 client.5169 fetch_fsmap learned FSMap version 14 2024-08-17T02:23:15.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.166+0000 7f58d17c0740 1 -- 172.21.15.104:0/1002261181 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x7f58c40156c0 con 0x26ffae0 2024-08-17T02:23:15.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.166+0000 7f58a77fe700 1 -- 172.21.15.104:0/1002261181 <== mon.0 v2:172.21.15.104:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c00016f0 con 0x26ffae0 2024-08-17T02:23:15.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.166+0000 7f58a77fe700 1 -- 172.21.15.104:0/1002261181 <== mon.0 v2:172.21.15.104:3300/0 5 ==== fsmap(e 14) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f58c40259a0 con 0x26ffae0 2024-08-17T02:23:15.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.166+0000 7f58d17c0740 10 client.5169 fetch_fsmap finished waiting for FSMap version 14 2024-08-17T02:23:15.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.166+0000 7f58d17c0740 10 client.5169 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-17T02:23:15.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.166+0000 7f58d17c0740 20 client.5169 populate_metadata read hostname 'smithi104' 2024-08-17T02:23:15.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.166+0000 7f58d17c0740 1 --2- 172.21.15.104:0/1002261181 >> [v2:172.21.15.104:6834/38993094,v1:172.21.15.104:6835/38993094] conn(0x295f6b0 0x295fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.166+0000 7f58d17c0740 4 client.5169 mds_command: new command op to 4965 tid=0[{"prefix": "status"}] 2024-08-17T02:23:15.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.166+0000 7f58d17c0740 1 -- 172.21.15.104:0/1002261181 --> [v2:172.21.15.104:6834/38993094,v1:172.21.15.104:6835/38993094] -- command(tid 0: {"prefix": "status"}) v1 -- 0x277c260 con 0x295f6b0 2024-08-17T02:23:15.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.166+0000 7f58cd2ad700 1 --2- 172.21.15.104:0/1002261181 >> [v2:172.21.15.104:6834/38993094,v1:172.21.15.104:6835/38993094] conn(0x295f6b0 0x295fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.166+0000 7f58a77fe700 10 client.5169 ms_handle_connect on v2:172.21.15.104:6834/38993094 2024-08-17T02:23:15.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.166+0000 7f58cd2ad700 1 --2- 172.21.15.104:0/1002261181 >> [v2:172.21.15.104:6834/38993094,v1:172.21.15.104:6835/38993094] conn(0x295f6b0 0x295fa80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4874ce4eb7571f1c server_cookie=7269643380bf0efd in_seq=0 out_seq=0 2024-08-17T02:23:15.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.166+0000 7f58a77fe700 1 -- 172.21.15.104:0/1002261181 <== mds.0 v2:172.21.15.104:6834/38993094 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x277c260 con 0x295f6b0 2024-08-17T02:23:15.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.166+0000 7f58a77fe700 10 client.5169 handle_command_reply: tid=0 2024-08-17T02:23:15.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.166+0000 7f58d17c0740 1 client.5169 shutdown 2024-08-17T02:23:15.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.166+0000 7f58d17c0740 1 -- 172.21.15.104:0/1002261181 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x26ffae0 msgr2=0x29d8810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:15.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.166+0000 7f58d17c0740 1 --2- 172.21.15.104:0/1002261181 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x26ffae0 0x29d8810 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x2851760 tx=0x7f58c401a000 comp rx=0 tx=0).stop 2024-08-17T02:23:15.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.166+0000 7f58d17c0740 1 -- 172.21.15.104:0/1002261181 shutdown_connections 2024-08-17T02:23:15.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.166+0000 7f58d17c0740 1 --2- 172.21.15.104:0/1002261181 >> [v2:172.21.15.104:6834/38993094,v1:172.21.15.104:6835/38993094] conn(0x295f6b0 0x295fa80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.166+0000 7f58d17c0740 1 --2- 172.21.15.104:0/1002261181 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x274a790 0x295ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.166+0000 7f58d17c0740 1 --2- 172.21.15.104:0/1002261181 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x26ffae0 0x29d8810 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.166+0000 7f58d17c0740 1 --2- 172.21.15.104:0/1002261181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x26ff710 0x29d82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.166+0000 7f58d17c0740 1 -- 172.21.15.104:0/1002261181 >> 172.21.15.104:0/1002261181 conn(0x26ffeb0 msgr2=0x2937530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:15.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.166+0000 7f58a77fe700 0 client.5169 ms_handle_reset on v2:172.21.15.104:6834/38993094 2024-08-17T02:23:15.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.166+0000 7f58d17c0740 1 -- 172.21.15.104:0/1002261181 shutdown_connections 2024-08-17T02:23:15.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.170+0000 7f58d17c0740 1 -- 172.21.15.104:0/1002261181 wait complete. 2024-08-17T02:23:15.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.170+0000 7f58d17c0740 20 client.5169 trim_cache size 0 max 16384 2024-08-17T02:23:15.180 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-08-17T02:23:15.180 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_fsid": "fd5f7fb8-d34b-49bb-89a8-62b7dad1bc25", 2024-08-17T02:23:15.180 INFO:teuthology.orchestra.run.smithi104.stdout: "whoami": 0, 2024-08-17T02:23:15.180 INFO:teuthology.orchestra.run.smithi104.stdout: "id": 4965, 2024-08-17T02:23:15.180 INFO:teuthology.orchestra.run.smithi104.stdout: "want_state": "up:active", 2024-08-17T02:23:15.180 INFO:teuthology.orchestra.run.smithi104.stdout: "state": "up:active", 2024-08-17T02:23:15.180 INFO:teuthology.orchestra.run.smithi104.stdout: "fs_name": "cephfs", 2024-08-17T02:23:15.180 INFO:teuthology.orchestra.run.smithi104.stdout: "rank_uptime": 9.0516830390000003, 2024-08-17T02:23:15.180 INFO:teuthology.orchestra.run.smithi104.stdout: "mdsmap_epoch": 14, 2024-08-17T02:23:15.180 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_epoch": 34, 2024-08-17T02:23:15.181 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_epoch_barrier": 34, 2024-08-17T02:23:15.181 INFO:teuthology.orchestra.run.smithi104.stdout: "uptime": 16.588342818000001 2024-08-17T02:23:15.181 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-08-17T02:23:15.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.170+0000 7f58ce2af700 1 -- 172.21.15.104:0/1921938146 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f58ac060860 msgr2=0x7f58ac062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:15.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.170+0000 7f58ce2af700 1 --2- 172.21.15.104:0/1921938146 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f58ac060860 0x7f58ac062d10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f58c80adc50 tx=0x7f58c400b040 comp rx=0 tx=0).stop 2024-08-17T02:23:15.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.170+0000 7f58ce2af700 1 -- 172.21.15.104:0/1921938146 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f58c806df10 msgr2=0x7f58c80aaf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:15.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.170+0000 7f58ce2af700 1 --2- 172.21.15.104:0/1921938146 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f58c806df10 0x7f58c80aaf50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f58c80ac170 tx=0x7f58bc017000 comp rx=0 tx=0).stop 2024-08-17T02:23:15.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.170+0000 7f58ce2af700 1 -- 172.21.15.104:0/1921938146 shutdown_connections 2024-08-17T02:23:15.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.170+0000 7f58ce2af700 1 --2- 172.21.15.104:0/1921938146 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f58ac060860 0x7f58ac062d10 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.170+0000 7f58ce2af700 1 --2- 172.21.15.104:0/1921938146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58c80ab540 0x7f58c81354f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.170+0000 7f58ce2af700 1 --2- 172.21.15.104:0/1921938146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58c806e9d0 0x7f58c81360a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.170+0000 7f58ce2af700 1 --2- 172.21.15.104:0/1921938146 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f58c806df10 0x7f58c80aaf50 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.170+0000 7f58ce2af700 1 -- 172.21.15.104:0/1921938146 >> 172.21.15.104:0/1921938146 conn(0x7f58c80678d0 msgr2=0x7f58c8152a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:15.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.170+0000 7f58ce2af700 1 -- 172.21.15.104:0/1921938146 shutdown_connections 2024-08-17T02:23:15.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.170+0000 7f58ce2af700 1 -- 172.21.15.104:0/1921938146 wait complete. 2024-08-17T02:23:15.191 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:23:15.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.290+0000 7f26121b3700 1 Processor -- start 2024-08-17T02:23:15.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.290+0000 7f26121b3700 1 -- start start 2024-08-17T02:23:15.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.290+0000 7f26121b3700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f260c159040 0x7f260c0cf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.290+0000 7f26121b3700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f260c0d0010 0x7f260c0d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.290+0000 7f26121b3700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f260c0cf190 con 0x7f260c15cea0 2024-08-17T02:23:15.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.290+0000 7f26121b3700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f260c15d9f0 con 0x7f260c159040 2024-08-17T02:23:15.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.290+0000 7f26121b3700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f260c0d09a0 con 0x7f260c0d0010 2024-08-17T02:23:15.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.290+0000 7f26111b1700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f260c159040 0x7f260c0cf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.290+0000 7f26111b1700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f260c159040 0x7f260c0cf620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35358/0 (socket says 172.21.15.104:35358) 2024-08-17T02:23:15.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.290+0000 7f26111b1700 1 -- 172.21.15.104:0/217612621 learned_addr learned my addr 172.21.15.104:0/217612621 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:15.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.290+0000 7f26109b0700 1 --2- 172.21.15.104:0/217612621 >> v2:172.21.15.117:3300/0 conn(0x7f260c0d0010 0x7f260c0d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.290+0000 7f26111b1700 1 -- 172.21.15.104:0/217612621 >> v2:172.21.15.117:3300/0 conn(0x7f260c0d0010 msgr2=0x7f260c0d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:15.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.290+0000 7f26111b1700 1 --2- 172.21.15.104:0/217612621 >> v2:172.21.15.117:3300/0 conn(0x7f260c0d0010 0x7f260c0d0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.290+0000 7f26111b1700 1 -- 172.21.15.104:0/217612621 >> v1:172.21.15.117:6789/0 conn(0x7f260c15cea0 legacy=0x7f260c15d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:15.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.290+0000 7f26111b1700 1 -- 172.21.15.104:0/217612621 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260c0ce5e0 con 0x7f260c159040 2024-08-17T02:23:15.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.290+0000 7f26109b0700 1 --2- 172.21.15.104:0/217612621 >> v2:172.21.15.117:3300/0 conn(0x7f260c0d0010 0x7f260c0d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:15.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.290+0000 7f26111b1700 1 --2- 172.21.15.104:0/217612621 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f260c159040 0x7f260c0cf620 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f260c067ef0 tx=0x7f25fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c242cf56d76c8a41 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:15.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.290+0000 7f2603fff700 1 -- 172.21.15.104:0/217612621 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25fc00b860 con 0x7f260c159040 2024-08-17T02:23:15.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.290+0000 7f2603fff700 1 -- 172.21.15.104:0/217612621 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25fc00b9c0 con 0x7f260c159040 2024-08-17T02:23:15.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.290+0000 7f2603fff700 1 -- 172.21.15.104:0/217612621 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25fc00bd60 con 0x7f260c159040 2024-08-17T02:23:15.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.294+0000 7f26121b3700 1 -- 172.21.15.104:0/217612621 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f260c159040 msgr2=0x7f260c0cf620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:15.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.294+0000 7f26121b3700 1 --2- 172.21.15.104:0/217612621 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f260c159040 0x7f260c0cf620 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f260c067ef0 tx=0x7f25fc009250 comp rx=0 tx=0).stop 2024-08-17T02:23:15.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.294+0000 7f26121b3700 1 -- 172.21.15.104:0/217612621 shutdown_connections 2024-08-17T02:23:15.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.294+0000 7f26121b3700 1 --2- 172.21.15.104:0/217612621 >> v2:172.21.15.117:3300/0 conn(0x7f260c0d0010 0x7f260c0d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.294+0000 7f26121b3700 1 --2- 172.21.15.104:0/217612621 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f260c159040 0x7f260c0cf620 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.294+0000 7f26121b3700 1 -- 172.21.15.104:0/217612621 >> 172.21.15.104:0/217612621 conn(0x7f260c068250 msgr2=0x7f260c068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:15.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.294+0000 7f26121b3700 1 -- 172.21.15.104:0/217612621 shutdown_connections 2024-08-17T02:23:15.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.294+0000 7f26121b3700 1 -- 172.21.15.104:0/217612621 wait complete. 2024-08-17T02:23:15.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.294+0000 7f26121b3700 1 Processor -- start 2024-08-17T02:23:15.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.294+0000 7f26121b3700 1 -- start start 2024-08-17T02:23:15.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.294+0000 7f26121b3700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f260c0d0010 0x7f260c143f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.294+0000 7f26121b3700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f260c159040 0x7f260c0b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.294+0000 7f26121b3700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f260c15cea0 0x7f260c0b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.294+0000 7f26121b3700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260c0a8410 con 0x7f260c0d0010 2024-08-17T02:23:15.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.294+0000 7f26121b3700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260c0a88a0 con 0x7f260c15cea0 2024-08-17T02:23:15.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.294+0000 7f26121b3700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f260c0a7800 con 0x7f260c159040 2024-08-17T02:23:15.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.294+0000 7f26111b1700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f260c0d0010 0x7f260c143f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.303 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.294+0000 7f26111b1700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f260c0d0010 0x7f260c143f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35364/0 (socket says 172.21.15.104:35364) 2024-08-17T02:23:15.303 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.294+0000 7f26111b1700 1 -- 172.21.15.104:0/103846796 learned_addr learned my addr 172.21.15.104:0/103846796 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:15.303 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.294+0000 7f26109b0700 1 --2- 172.21.15.104:0/103846796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f260c159040 0x7f260c0b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.303 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.294+0000 7f26119b2700 1 --2- 172.21.15.104:0/103846796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f260c15cea0 0x7f260c0b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.303 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.294+0000 7f26111b1700 1 -- 172.21.15.104:0/103846796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f260c159040 msgr2=0x7f260c0b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:15.303 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.294+0000 7f26111b1700 1 --2- 172.21.15.104:0/103846796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f260c159040 0x7f260c0b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.303 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.294+0000 7f26111b1700 1 -- 172.21.15.104:0/103846796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f260c15cea0 msgr2=0x7f260c0b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:15.303 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.294+0000 7f26111b1700 1 --2- 172.21.15.104:0/103846796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f260c15cea0 0x7f260c0b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.303 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.294+0000 7f26111b1700 1 -- 172.21.15.104:0/103846796 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25fc0094f0 con 0x7f260c0d0010 2024-08-17T02:23:15.303 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.298+0000 7f26111b1700 1 --2- 172.21.15.104:0/103846796 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f260c0d0010 0x7f260c143f70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f25fc009290 tx=0x7f25fc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:15.304 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.298+0000 7f26017fa700 1 -- 172.21.15.104:0/103846796 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25fc011e60 con 0x7f260c0d0010 2024-08-17T02:23:15.304 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.298+0000 7f26017fa700 1 -- 172.21.15.104:0/103846796 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25fc01f070 con 0x7f260c0d0010 2024-08-17T02:23:15.304 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.298+0000 7f26121b3700 1 -- 172.21.15.104:0/103846796 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f260c0a7ae0 con 0x7f260c0d0010 2024-08-17T02:23:15.304 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.298+0000 7f26017fa700 1 -- 172.21.15.104:0/103846796 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25fc01a870 con 0x7f260c0d0010 2024-08-17T02:23:15.304 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.298+0000 7f26121b3700 1 -- 172.21.15.104:0/103846796 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f260c0a80a0 con 0x7f260c0d0010 2024-08-17T02:23:15.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.298+0000 7f26121b3700 1 -- 172.21.15.104:0/103846796 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f260c0643a0 con 0x7f260c0d0010 2024-08-17T02:23:15.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.298+0000 7f26017fa700 1 -- 172.21.15.104:0/103846796 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f25fc01abe0 con 0x7f260c0d0010 2024-08-17T02:23:15.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.298+0000 7f26017fa700 1 --2- 172.21.15.104:0/103846796 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f25f0060890 0x7f25f0062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:15.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.298+0000 7f26017fa700 1 -- 172.21.15.104:0/103846796 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f25fc021070 con 0x7f260c0d0010 2024-08-17T02:23:15.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.302+0000 7f26109b0700 1 --2- 172.21.15.104:0/103846796 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f25f0060890 0x7f25f0062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:15.307 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.302+0000 7f26109b0700 1 --2- 172.21.15.104:0/103846796 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f25f0060890 0x7f25f0062d40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2608006f00 tx=0x7f2608008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:15.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.306+0000 7f26017fa700 1 -- 172.21.15.104:0/103846796 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f25fc04ee10 con 0x7f260c0d0010 2024-08-17T02:23:15.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.510+0000 7f26121b3700 1 -- 172.21.15.104:0/103846796 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f260c0b3480 con 0x7f260c0d0010 2024-08-17T02:23:15.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.510+0000 7f26017fa700 1 -- 172.21.15.104:0/103846796 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+73 (secure 0 0 0) 0x7f25fc02b070 con 0x7f260c0d0010 2024-08-17T02:23:15.516 INFO:teuthology.orchestra.run.smithi104.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:23:15.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.514+0000 7f26121b3700 1 -- 172.21.15.104:0/103846796 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f25f0060890 msgr2=0x7f25f0062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:15.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.514+0000 7f26121b3700 1 --2- 172.21.15.104:0/103846796 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f25f0060890 0x7f25f0062d40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2608006f00 tx=0x7f2608008040 comp rx=0 tx=0).stop 2024-08-17T02:23:15.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.514+0000 7f26121b3700 1 -- 172.21.15.104:0/103846796 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f260c0d0010 msgr2=0x7f260c143f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:15.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.514+0000 7f26121b3700 1 --2- 172.21.15.104:0/103846796 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f260c0d0010 0x7f260c143f70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f25fc009290 tx=0x7f25fc017000 comp rx=0 tx=0).stop 2024-08-17T02:23:15.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.514+0000 7f26121b3700 1 -- 172.21.15.104:0/103846796 shutdown_connections 2024-08-17T02:23:15.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.514+0000 7f26121b3700 1 --2- 172.21.15.104:0/103846796 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f25f0060890 0x7f25f0062d40 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.514+0000 7f26121b3700 1 --2- 172.21.15.104:0/103846796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f260c15cea0 0x7f260c0b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.514+0000 7f26121b3700 1 --2- 172.21.15.104:0/103846796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f260c159040 0x7f260c0b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.514+0000 7f26121b3700 1 --2- 172.21.15.104:0/103846796 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f260c0d0010 0x7f260c143f70 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:15.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.514+0000 7f26121b3700 1 -- 172.21.15.104:0/103846796 >> 172.21.15.104:0/103846796 conn(0x7f260c068250 msgr2=0x7f260c068620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:15.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.514+0000 7f26121b3700 1 -- 172.21.15.104:0/103846796 shutdown_connections 2024-08-17T02:23:15.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:15.514+0000 7f26121b3700 1 -- 172.21.15.104:0/103846796 wait complete. 2024-08-17T02:23:15.530 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:23:15.530 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:23:15.530 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi104.front.sepia.ceph.com 2024-08-17T02:23:15.530 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-17T02:23:15.531 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-17T02:23:15.531 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:23:15.531 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:23:15.531 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:23:15.531 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:23:15.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:15.531 DEBUG:teuthology.orchestra.run.smithi104:> ip addr 2024-08-17T02:23:15.539 INFO:teuthology.orchestra.run.smithi104.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:23:15.539 INFO:teuthology.orchestra.run.smithi104.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:23:15.539 INFO:teuthology.orchestra.run.smithi104.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:23:15.539 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:15.539 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 ::1/128 scope host 2024-08-17T02:23:15.539 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:15.540 INFO:teuthology.orchestra.run.smithi104.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:23:15.540 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1c brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:15.540 INFO:teuthology.orchestra.run.smithi104.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:23:15.540 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1d brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:15.540 INFO:teuthology.orchestra.run.smithi104.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:23:15.540 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:88 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:15.540 INFO:teuthology.orchestra.run.smithi104.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:23:15.540 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:89 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:15.540 INFO:teuthology.orchestra.run.smithi104.stdout: inet 172.21.15.104/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-08-17T02:23:15.540 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft 42547sec preferred_lft 42547sec 2024-08-17T02:23:15.540 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::ec4:7aff:fe8f:ce89/64 scope link 2024-08-17T02:23:15.540 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:15.540 INFO:teuthology.orchestra.run.smithi104.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-17T02:23:15.540 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 02:42:50:27:da:d0 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:15.540 INFO:teuthology.orchestra.run.smithi104.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-17T02:23:15.541 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:15.541 INFO:teuthology.orchestra.run.smithi104.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:23:15.541 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 4a:65:00:52:94:09 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:15.541 INFO:teuthology.orchestra.run.smithi104.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:23:15.541 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:15.541 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::35:b5ff:fe2c:9902/64 scope link 2024-08-17T02:23:15.541 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:15.541 INFO:teuthology.orchestra.run.smithi104.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:23:15.541 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether be:82:c8:2b:c8:f8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:23:15.541 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::bc82:c8ff:fe2b:c8f8/64 scope link 2024-08-17T02:23:15.541 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:15.541 INFO:teuthology.orchestra.run.smithi104.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:23:15.541 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 4a:65:00:52:94:09 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:23:15.541 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::4865:ff:fe52:9409/64 scope link 2024-08-17T02:23:15.542 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:15.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:15.542 DEBUG:teuthology.orchestra.run.smithi104:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:23:15.596 INFO:teuthology.orchestra.run.smithi104.stdout:1 2024-08-17T02:23:15.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:15.598 DEBUG:teuthology.orchestra.run.smithi104:> route 2024-08-17T02:23:15.607 INFO:teuthology.orchestra.run.smithi104.stdout:Kernel IP routing table 2024-08-17T02:23:15.607 INFO:teuthology.orchestra.run.smithi104.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:23:15.607 INFO:teuthology.orchestra.run.smithi104.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-08-17T02:23:15.608 INFO:teuthology.orchestra.run.smithi104.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:23:15.608 INFO:teuthology.orchestra.run.smithi104.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-17T02:23:15.608 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-08-17T02:23:15.608 INFO:teuthology.orchestra.run.smithi104.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-17T02:23:15.608 INFO:teuthology.orchestra.run.smithi104.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:23:15.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:15.608 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec bash -c ' 2024-08-17T02:23:15.608 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-08-17T02:23:15.609 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:23:15.609 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:23:15.609 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:23:15.609 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-08-17T02:23:15.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:15.647 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2024-08-17T02:23:15.698 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-17T02:23:15.698 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:23:15.698 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:23:15.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:15.699 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set brx.0 up 2024-08-17T02:23:15.715 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-08-17T02:23:15.715 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:23:15.715 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-17T02:23:15.765 INFO:teuthology.orchestra.run.smithi104.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:23:15.765 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:23:15.765 DEBUG:teuthology.orchestra.run.smithi104:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:23:15.771 DEBUG:teuthology.orchestra.run.smithi104:> sudo modprobe fuse 2024-08-17T02:23:15.787 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:23:15.787 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:23:15.848 INFO:teuthology.orchestra.run.smithi104.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:23:15.849 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:23:15.849 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:23:15.849 DEBUG:teuthology.orchestra.run.smithi104:> ls /sys/fs/fuse/connections 2024-08-17T02:23:15.856 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-17T02:23:15.856 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-08-17T02:23:15.858 DEBUG:teuthology.orchestra.run.smithi104:> sudo modprobe fuse 2024-08-17T02:23:15.875 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:23:15.875 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:23:15.884 INFO:teuthology.orchestra.run.smithi104.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:23:15.885 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:23:15.885 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:23:15.886 DEBUG:teuthology.orchestra.run.smithi104:> ls /sys/fs/fuse/connections 2024-08-17T02:23:15.942 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi104.stderr:2024-08-17T02:23:15.934+0000 7ff5ebe85380 -1 init, newargv = 0x557c784b45d0 newargc=15 2024-08-17T02:23:15.942 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi104.stderr:ceph-fuse[33515]: starting ceph client 2024-08-17T02:23:15.950 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi104.stderr:ceph-fuse[33515]: starting fuse 2024-08-17T02:23:16.991 DEBUG:teuthology.orchestra.run.smithi104:> sudo modprobe fuse 2024-08-17T02:23:17.010 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:23:17.011 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:23:17.027 INFO:teuthology.orchestra.run.smithi104.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:23:17.027 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:23:17.028 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:23:17.028 DEBUG:teuthology.orchestra.run.smithi104:> ls /sys/fs/fuse/connections 2024-08-17T02:23:17.036 INFO:teuthology.orchestra.run.smithi104.stdout:52 2024-08-17T02:23:17.036 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-08-17T02:23:17.036 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-08-17T02:23:17.036 DEBUG:teuthology.orchestra.run.smithi104:> import glob 2024-08-17T02:23:17.036 DEBUG:teuthology.orchestra.run.smithi104:> import re 2024-08-17T02:23:17.036 DEBUG:teuthology.orchestra.run.smithi104:> import os 2024-08-17T02:23:17.037 DEBUG:teuthology.orchestra.run.smithi104:> import subprocess 2024-08-17T02:23:17.037 DEBUG:teuthology.orchestra.run.smithi104:> 2024-08-17T02:23:17.037 DEBUG:teuthology.orchestra.run.smithi104:> def _find_admin_socket(client_name): 2024-08-17T02:23:17.037 DEBUG:teuthology.orchestra.run.smithi104:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-08-17T02:23:17.037 DEBUG:teuthology.orchestra.run.smithi104:> files = glob.glob(asok_path) 2024-08-17T02:23:17.037 DEBUG:teuthology.orchestra.run.smithi104:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-08-17T02:23:17.037 DEBUG:teuthology.orchestra.run.smithi104:> 2024-08-17T02:23:17.037 DEBUG:teuthology.orchestra.run.smithi104:> # Given a non-glob path, it better be there 2024-08-17T02:23:17.037 DEBUG:teuthology.orchestra.run.smithi104:> if "*" not in asok_path: 2024-08-17T02:23:17.037 DEBUG:teuthology.orchestra.run.smithi104:> assert(len(files) == 1) 2024-08-17T02:23:17.037 DEBUG:teuthology.orchestra.run.smithi104:> return files[0] 2024-08-17T02:23:17.037 DEBUG:teuthology.orchestra.run.smithi104:> 2024-08-17T02:23:17.037 DEBUG:teuthology.orchestra.run.smithi104:> for f in files: 2024-08-17T02:23:17.037 DEBUG:teuthology.orchestra.run.smithi104:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-17T02:23:17.038 DEBUG:teuthology.orchestra.run.smithi104:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-17T02:23:17.038 DEBUG:teuthology.orchestra.run.smithi104:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-17T02:23:17.038 DEBUG:teuthology.orchestra.run.smithi104:> contents = proc_f.read() 2024-08-17T02:23:17.038 DEBUG:teuthology.orchestra.run.smithi104:> if mountpoint in contents: 2024-08-17T02:23:17.038 DEBUG:teuthology.orchestra.run.smithi104:> return f 2024-08-17T02:23:17.038 DEBUG:teuthology.orchestra.run.smithi104:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-17T02:23:17.038 DEBUG:teuthology.orchestra.run.smithi104:> 2024-08-17T02:23:17.038 DEBUG:teuthology.orchestra.run.smithi104:> print(_find_admin_socket("client.0")) 2024-08-17T02:23:17.038 DEBUG:teuthology.orchestra.run.smithi104:> ' 2024-08-17T02:23:17.117 INFO:teuthology.orchestra.run.smithi104.stdout:/var/run/ceph/ceph-client.0.33515.asok 2024-08-17T02:23:17.302 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.33515.asok 2024-08-17T02:23:17.302 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:23:17.303 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.33515.asok status 2024-08-17T02:23:17.448 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-08-17T02:23:17.448 INFO:teuthology.orchestra.run.smithi104.stdout: "metadata": { 2024-08-17T02:23:17.448 INFO:teuthology.orchestra.run.smithi104.stdout: "ceph_sha1": "2577e8139c6b8786f9d6d6ea21b8da9244b9260e", 2024-08-17T02:23:17.448 INFO:teuthology.orchestra.run.smithi104.stdout: "ceph_version": "ceph version 17.2.7-1375-g2577e813 (2577e8139c6b8786f9d6d6ea21b8da9244b9260e) quincy (stable)", 2024-08-17T02:23:17.448 INFO:teuthology.orchestra.run.smithi104.stdout: "entity_id": "0", 2024-08-17T02:23:17.448 INFO:teuthology.orchestra.run.smithi104.stdout: "hostname": "smithi104", 2024-08-17T02:23:17.448 INFO:teuthology.orchestra.run.smithi104.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-08-17T02:23:17.448 INFO:teuthology.orchestra.run.smithi104.stdout: "pid": "33515", 2024-08-17T02:23:17.448 INFO:teuthology.orchestra.run.smithi104.stdout: "root": "/" 2024-08-17T02:23:17.448 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-08-17T02:23:17.449 INFO:teuthology.orchestra.run.smithi104.stdout: "dentry_count": 0, 2024-08-17T02:23:17.449 INFO:teuthology.orchestra.run.smithi104.stdout: "dentry_pinned_count": 0, 2024-08-17T02:23:17.449 INFO:teuthology.orchestra.run.smithi104.stdout: "id": 5181, 2024-08-17T02:23:17.449 INFO:teuthology.orchestra.run.smithi104.stdout: "inst": { 2024-08-17T02:23:17.449 INFO:teuthology.orchestra.run.smithi104.stdout: "name": { 2024-08-17T02:23:17.449 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "client", 2024-08-17T02:23:17.449 INFO:teuthology.orchestra.run.smithi104.stdout: "num": 5181 2024-08-17T02:23:17.449 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-08-17T02:23:17.449 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": { 2024-08-17T02:23:17.449 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-08-17T02:23:17.449 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "192.168.0.1:0", 2024-08-17T02:23:17.449 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1697705852 2024-08-17T02:23:17.449 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-08-17T02:23:17.450 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-08-17T02:23:17.450 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": { 2024-08-17T02:23:17.450 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-08-17T02:23:17.450 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "192.168.0.1:0", 2024-08-17T02:23:17.450 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1697705852 2024-08-17T02:23:17.450 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-08-17T02:23:17.450 INFO:teuthology.orchestra.run.smithi104.stdout: "inst_str": "client.5181 192.168.0.1:0/1697705852", 2024-08-17T02:23:17.450 INFO:teuthology.orchestra.run.smithi104.stdout: "addr_str": "192.168.0.1:0/1697705852", 2024-08-17T02:23:17.450 INFO:teuthology.orchestra.run.smithi104.stdout: "inode_count": 1, 2024-08-17T02:23:17.450 INFO:teuthology.orchestra.run.smithi104.stdout: "mds_epoch": 14, 2024-08-17T02:23:17.450 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_epoch": 34, 2024-08-17T02:23:17.451 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_epoch_barrier": 0, 2024-08-17T02:23:17.451 INFO:teuthology.orchestra.run.smithi104.stdout: "blocklisted": false, 2024-08-17T02:23:17.451 INFO:teuthology.orchestra.run.smithi104.stdout: "fs_name": "cephfs" 2024-08-17T02:23:17.451 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-08-17T02:23:17.457 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:23:17.457 DEBUG:teuthology.orchestra.run.smithi104:> stat --file-system '--printf=%T 2024-08-17T02:23:17.457 DEBUG:teuthology.orchestra.run.smithi104:> ' -- /home/ubuntu/cephtest/mnt.0 2024-08-17T02:23:17.465 INFO:teuthology.orchestra.run.smithi104.stdout:fuseblk 2024-08-17T02:23:17.465 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-08-17T02:23:17.465 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:23:17.466 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:23:17.483 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:23:17.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.650+0000 7f4236783700 1 Processor -- start 2024-08-17T02:23:17.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.650+0000 7f4236783700 1 -- start start 2024-08-17T02:23:17.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.650+0000 7f4236783700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42300af030 0x7f42300a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:17.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.650+0000 7f4236783700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f42300a9260 0x7f42300b0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:17.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.650+0000 7f4236783700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42300b0270 con 0x7f423015d540 2024-08-17T02:23:17.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.650+0000 7f4236783700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42300af480 con 0x7f42300a9260 2024-08-17T02:23:17.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.650+0000 7f4236783700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42300af660 con 0x7f42300af030 2024-08-17T02:23:17.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.650+0000 7f4234d20700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f42300a9260 0x7f42300b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:17.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.650+0000 7f4234d20700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f42300a9260 0x7f42300b0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51840/0 (socket says 172.21.15.104:51840) 2024-08-17T02:23:17.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.650+0000 7f4234d20700 1 -- 172.21.15.104:0/2038682094 learned_addr learned my addr 172.21.15.104:0/2038682094 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:17.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.650+0000 7f422f7fe700 1 --2- 172.21.15.104:0/2038682094 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42300af030 0x7f42300a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:17.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.650+0000 7f422effd700 1 -- 172.21.15.104:0/2038682094 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2244797451 0 0) 0x7f42300b0270 con 0x7f423015d540 2024-08-17T02:23:17.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.650+0000 7f422f7fe700 1 -- 172.21.15.104:0/2038682094 >> v2:172.21.15.104:3300/0 conn(0x7f42300a9260 msgr2=0x7f42300b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:17.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.650+0000 7f422f7fe700 1 --2- 172.21.15.104:0/2038682094 >> v2:172.21.15.104:3300/0 conn(0x7f42300a9260 0x7f42300b0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:17.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.650+0000 7f422f7fe700 1 -- 172.21.15.104:0/2038682094 >> v1:172.21.15.117:6789/0 conn(0x7f423015d540 legacy=0x7f423006e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:17.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.650+0000 7f422f7fe700 1 -- 172.21.15.104:0/2038682094 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42300af940 con 0x7f42300af030 2024-08-17T02:23:17.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.650+0000 7f4234d20700 1 --2- 172.21.15.104:0/2038682094 >> v2:172.21.15.104:3300/0 conn(0x7f42300a9260 0x7f42300b0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:17.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.650+0000 7f422f7fe700 1 --2- 172.21.15.104:0/2038682094 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42300af030 0x7f42300a8d20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f42200098e0 tx=0x7f42200091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be5c2b2430baf681 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:17.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.650+0000 7f422effd700 1 -- 172.21.15.104:0/2038682094 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422000b640 con 0x7f42300af030 2024-08-17T02:23:17.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.650+0000 7f422effd700 1 -- 172.21.15.104:0/2038682094 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422000b7a0 con 0x7f42300af030 2024-08-17T02:23:17.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.650+0000 7f422effd700 1 -- 172.21.15.104:0/2038682094 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422000bb40 con 0x7f42300af030 2024-08-17T02:23:17.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.650+0000 7f4236783700 1 -- 172.21.15.104:0/2038682094 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42300af030 msgr2=0x7f42300a8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:17.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.650+0000 7f4236783700 1 --2- 172.21.15.104:0/2038682094 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42300af030 0x7f42300a8d20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f42200098e0 tx=0x7f42200091a0 comp rx=0 tx=0).stop 2024-08-17T02:23:17.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.654+0000 7f4236783700 1 -- 172.21.15.104:0/2038682094 shutdown_connections 2024-08-17T02:23:17.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.654+0000 7f4236783700 1 --2- 172.21.15.104:0/2038682094 >> v2:172.21.15.104:3300/0 conn(0x7f42300a9260 0x7f42300b0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:17.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.654+0000 7f4236783700 1 --2- 172.21.15.104:0/2038682094 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42300af030 0x7f42300a8d20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:17.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.654+0000 7f4236783700 1 -- 172.21.15.104:0/2038682094 >> 172.21.15.104:0/2038682094 conn(0x7f4230066e00 msgr2=0x7f4230067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:17.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.654+0000 7f4236783700 1 -- 172.21.15.104:0/2038682094 shutdown_connections 2024-08-17T02:23:17.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.654+0000 7f4236783700 1 -- 172.21.15.104:0/2038682094 wait complete. 2024-08-17T02:23:17.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.654+0000 7f4236783700 1 Processor -- start 2024-08-17T02:23:17.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.654+0000 7f4236783700 1 -- start start 2024-08-17T02:23:17.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.658+0000 7f4236783700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42300a9260 0x7f4230159120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:17.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.658+0000 7f4236783700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42300af030 0x7f42300aae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:17.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.658+0000 7f4236783700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f423015d540 0x7f4230098b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:17.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.658+0000 7f4236783700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423015da80 con 0x7f42300af030 2024-08-17T02:23:17.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.658+0000 7f4236783700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4230098670 con 0x7f423015d540 2024-08-17T02:23:17.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.658+0000 7f4236783700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4230098370 con 0x7f42300a9260 2024-08-17T02:23:17.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.658+0000 7f422f7fe700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42300af030 0x7f42300aae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:17.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.658+0000 7f422f7fe700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42300af030 0x7f42300aae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51852/0 (socket says 172.21.15.104:51852) 2024-08-17T02:23:17.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.658+0000 7f422f7fe700 1 -- 172.21.15.104:0/2630944006 learned_addr learned my addr 172.21.15.104:0/2630944006 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:17.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.658+0000 7f422ffff700 1 --2- 172.21.15.104:0/2630944006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42300a9260 0x7f4230159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:17.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.658+0000 7f4234d20700 1 --2- 172.21.15.104:0/2630944006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f423015d540 0x7f4230098b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:17.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.658+0000 7f422f7fe700 1 -- 172.21.15.104:0/2630944006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42300a9260 msgr2=0x7f4230159120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:17.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.658+0000 7f422f7fe700 1 --2- 172.21.15.104:0/2630944006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42300a9260 0x7f4230159120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:17.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.658+0000 7f422f7fe700 1 -- 172.21.15.104:0/2630944006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f423015d540 msgr2=0x7f4230098b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:17.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.658+0000 7f422f7fe700 1 --2- 172.21.15.104:0/2630944006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f423015d540 0x7f4230098b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:17.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.658+0000 7f422f7fe700 1 -- 172.21.15.104:0/2630944006 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4228009ae0 con 0x7f42300af030 2024-08-17T02:23:17.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.658+0000 7f422f7fe700 1 --2- 172.21.15.104:0/2630944006 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42300af030 0x7f42300aae20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4220009f80 tx=0x7f4220017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:17.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.658+0000 7f4217fff700 1 -- 172.21.15.104:0/2630944006 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422000bb20 con 0x7f42300af030 2024-08-17T02:23:17.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.658+0000 7f4217fff700 1 -- 172.21.15.104:0/2630944006 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4220000c90 con 0x7f42300af030 2024-08-17T02:23:17.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.658+0000 7f4236783700 1 -- 172.21.15.104:0/2630944006 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4220009420 con 0x7f42300af030 2024-08-17T02:23:17.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.658+0000 7f4217fff700 1 -- 172.21.15.104:0/2630944006 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4220011630 con 0x7f42300af030 2024-08-17T02:23:17.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.658+0000 7f4236783700 1 -- 172.21.15.104:0/2630944006 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42300ad4d0 con 0x7f42300af030 2024-08-17T02:23:17.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.658+0000 7f4236783700 1 -- 172.21.15.104:0/2630944006 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4230098800 con 0x7f42300af030 2024-08-17T02:23:17.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.662+0000 7f4217fff700 1 -- 172.21.15.104:0/2630944006 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f42200119a0 con 0x7f42300af030 2024-08-17T02:23:17.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.662+0000 7f4217fff700 1 --2- 172.21.15.104:0/2630944006 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f421c060860 0x7f421c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:17.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.662+0000 7f4217fff700 1 -- 172.21.15.104:0/2630944006 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f422007de40 con 0x7f42300af030 2024-08-17T02:23:17.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.662+0000 7f422ffff700 1 --2- 172.21.15.104:0/2630944006 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f421c060860 0x7f421c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:17.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.662+0000 7f422ffff700 1 --2- 172.21.15.104:0/2630944006 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f421c060860 0x7f421c062d10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4224003a40 tx=0x7f4224007ec0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:17.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.670+0000 7f4217fff700 1 -- 172.21.15.104:0/2630944006 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f422004e290 con 0x7f42300af030 2024-08-17T02:23:17.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.870+0000 7f4236783700 1 -- 172.21.15.104:0/2630944006 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f42300645c0 con 0x7f42300af030 2024-08-17T02:23:17.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.870+0000 7f4217fff700 1 -- 172.21.15.104:0/2630944006 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+73 (secure 0 0 0) 0x7f42200518b0 con 0x7f42300af030 2024-08-17T02:23:17.877 INFO:teuthology.orchestra.run.smithi104.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:23:17.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.874+0000 7f4236783700 1 -- 172.21.15.104:0/2630944006 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f421c060860 msgr2=0x7f421c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:17.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.874+0000 7f4236783700 1 --2- 172.21.15.104:0/2630944006 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f421c060860 0x7f421c062d10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4224003a40 tx=0x7f4224007ec0 comp rx=0 tx=0).stop 2024-08-17T02:23:17.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.874+0000 7f4236783700 1 -- 172.21.15.104:0/2630944006 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42300af030 msgr2=0x7f42300aae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:17.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.874+0000 7f4236783700 1 --2- 172.21.15.104:0/2630944006 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42300af030 0x7f42300aae20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4220009f80 tx=0x7f4220017000 comp rx=0 tx=0).stop 2024-08-17T02:23:17.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.874+0000 7f4236783700 1 -- 172.21.15.104:0/2630944006 shutdown_connections 2024-08-17T02:23:17.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.874+0000 7f4236783700 1 --2- 172.21.15.104:0/2630944006 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f421c060860 0x7f421c062d10 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:17.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.874+0000 7f4236783700 1 --2- 172.21.15.104:0/2630944006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f423015d540 0x7f4230098b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:17.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.874+0000 7f4236783700 1 --2- 172.21.15.104:0/2630944006 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42300af030 0x7f42300aae20 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:17.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.874+0000 7f4236783700 1 --2- 172.21.15.104:0/2630944006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42300a9260 0x7f4230159120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:17.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.874+0000 7f4236783700 1 -- 172.21.15.104:0/2630944006 >> 172.21.15.104:0/2630944006 conn(0x7f4230066e00 msgr2=0x7f42300addd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:17.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.874+0000 7f4236783700 1 -- 172.21.15.104:0/2630944006 shutdown_connections 2024-08-17T02:23:17.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:17.874+0000 7f4236783700 1 -- 172.21.15.104:0/2630944006 wait complete. 2024-08-17T02:23:17.890 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:23:17.890 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:23:17.890 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2024-08-17T02:23:17.890 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-17T02:23:17.891 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-17T02:23:17.891 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:23:17.891 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:23:17.891 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:23:17.891 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:23:17.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:17.891 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2024-08-17T02:23:17.899 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:23:17.900 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:23:17.900 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:23:17.900 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:17.900 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2024-08-17T02:23:17.900 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:17.900 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:23:17.900 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:17.900 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:23:17.900 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:17.900 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:23:17.900 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:17.900 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:23:17.901 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:17.901 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-08-17T02:23:17.901 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 42545sec preferred_lft 42545sec 2024-08-17T02:23:17.901 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ec4:7aff:fe8f:4463/64 scope link 2024-08-17T02:23:17.901 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:17.901 INFO:teuthology.orchestra.run.smithi117.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-17T02:23:17.901 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 02:42:ac:19:64:9e brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:17.901 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-17T02:23:17.901 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:17.901 INFO:teuthology.orchestra.run.smithi117.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:23:17.901 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 9a:e7:01:f6:58:c9 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:23:17.901 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:23:17.901 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:17.901 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::7468:93ff:fe47:9753/64 scope link 2024-08-17T02:23:17.902 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:17.902 INFO:teuthology.orchestra.run.smithi117.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:23:17.902 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether fa:89:18:75:99:18 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:23:17.902 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::f889:18ff:fe75:9918/64 scope link 2024-08-17T02:23:17.902 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:17.902 INFO:teuthology.orchestra.run.smithi117.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:23:17.902 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 9a:e7:01:f6:58:c9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:23:17.902 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::98e7:1ff:fef6:58c9/64 scope link 2024-08-17T02:23:17.902 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:23:17.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:17.903 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:23:17.962 INFO:teuthology.orchestra.run.smithi117.stdout:1 2024-08-17T02:23:17.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:17.963 DEBUG:teuthology.orchestra.run.smithi117:> route 2024-08-17T02:23:17.972 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2024-08-17T02:23:17.972 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:23:17.972 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-08-17T02:23:17.972 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:23:17.972 INFO:teuthology.orchestra.run.smithi117.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-17T02:23:17.972 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-08-17T02:23:17.972 INFO:teuthology.orchestra.run.smithi117.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-17T02:23:17.972 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:23:17.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:17.973 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2024-08-17T02:23:17.973 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-08-17T02:23:17.973 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:23:17.973 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:23:17.973 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:23:17.973 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-08-17T02:23:18.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:18.011 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2024-08-17T02:23:18.059 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-08-17T02:23:18.060 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:23:18.060 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:23:18.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:23:18.060 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.0 up 2024-08-17T02:23:18.077 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-08-17T02:23:18.078 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:23:18.078 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-17T02:23:18.083 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:23:18.083 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:23:18.083 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:23:18.089 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2024-08-17T02:23:18.104 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:23:18.104 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:23:18.166 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:23:18.167 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:23:18.167 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:23:18.168 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2024-08-17T02:23:18.174 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-17T02:23:18.174 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-08-17T02:23:18.177 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2024-08-17T02:23:18.192 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:23:18.192 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:23:18.247 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:23:18.248 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:23:18.249 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:23:18.249 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2024-08-17T02:23:18.255 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:2024-08-17T02:23:18.253+0000 7f7001c54380 -1 init, newargv = 0x5636fdc90a50 newargc=15 2024-08-17T02:23:18.256 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[30169]: starting ceph client 2024-08-17T02:23:18.264 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[30169]: starting fuse 2024-08-17T02:23:19.356 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2024-08-17T02:23:19.374 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:23:19.374 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:23:19.432 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:23:19.433 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:23:19.434 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:23:19.434 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2024-08-17T02:23:19.438 INFO:teuthology.orchestra.run.smithi117.stdout:52 2024-08-17T02:23:19.438 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-08-17T02:23:19.438 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-08-17T02:23:19.439 DEBUG:teuthology.orchestra.run.smithi117:> import glob 2024-08-17T02:23:19.439 DEBUG:teuthology.orchestra.run.smithi117:> import re 2024-08-17T02:23:19.439 DEBUG:teuthology.orchestra.run.smithi117:> import os 2024-08-17T02:23:19.439 DEBUG:teuthology.orchestra.run.smithi117:> import subprocess 2024-08-17T02:23:19.439 DEBUG:teuthology.orchestra.run.smithi117:> 2024-08-17T02:23:19.439 DEBUG:teuthology.orchestra.run.smithi117:> def _find_admin_socket(client_name): 2024-08-17T02:23:19.439 DEBUG:teuthology.orchestra.run.smithi117:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-08-17T02:23:19.439 DEBUG:teuthology.orchestra.run.smithi117:> files = glob.glob(asok_path) 2024-08-17T02:23:19.439 DEBUG:teuthology.orchestra.run.smithi117:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-08-17T02:23:19.439 DEBUG:teuthology.orchestra.run.smithi117:> 2024-08-17T02:23:19.439 DEBUG:teuthology.orchestra.run.smithi117:> # Given a non-glob path, it better be there 2024-08-17T02:23:19.439 DEBUG:teuthology.orchestra.run.smithi117:> if "*" not in asok_path: 2024-08-17T02:23:19.439 DEBUG:teuthology.orchestra.run.smithi117:> assert(len(files) == 1) 2024-08-17T02:23:19.439 DEBUG:teuthology.orchestra.run.smithi117:> return files[0] 2024-08-17T02:23:19.440 DEBUG:teuthology.orchestra.run.smithi117:> 2024-08-17T02:23:19.440 DEBUG:teuthology.orchestra.run.smithi117:> for f in files: 2024-08-17T02:23:19.440 DEBUG:teuthology.orchestra.run.smithi117:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-17T02:23:19.440 DEBUG:teuthology.orchestra.run.smithi117:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-17T02:23:19.440 DEBUG:teuthology.orchestra.run.smithi117:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-17T02:23:19.440 DEBUG:teuthology.orchestra.run.smithi117:> contents = proc_f.read() 2024-08-17T02:23:19.440 DEBUG:teuthology.orchestra.run.smithi117:> if mountpoint in contents: 2024-08-17T02:23:19.440 DEBUG:teuthology.orchestra.run.smithi117:> return f 2024-08-17T02:23:19.440 DEBUG:teuthology.orchestra.run.smithi117:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-17T02:23:19.440 DEBUG:teuthology.orchestra.run.smithi117:> 2024-08-17T02:23:19.440 DEBUG:teuthology.orchestra.run.smithi117:> print(_find_admin_socket("client.1")) 2024-08-17T02:23:19.441 DEBUG:teuthology.orchestra.run.smithi117:> ' 2024-08-17T02:23:19.523 INFO:teuthology.orchestra.run.smithi117.stdout:/var/run/ceph/ceph-client.1.30169.asok 2024-08-17T02:23:19.705 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.30169.asok 2024-08-17T02:23:19.705 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:23:19.705 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.30169.asok status 2024-08-17T02:23:19.803 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-08-17T02:23:19.803 INFO:teuthology.orchestra.run.smithi117.stdout: "metadata": { 2024-08-17T02:23:19.803 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_sha1": "2577e8139c6b8786f9d6d6ea21b8da9244b9260e", 2024-08-17T02:23:19.803 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_version": "ceph version 17.2.7-1375-g2577e813 (2577e8139c6b8786f9d6d6ea21b8da9244b9260e) quincy (stable)", 2024-08-17T02:23:19.803 INFO:teuthology.orchestra.run.smithi117.stdout: "entity_id": "1", 2024-08-17T02:23:19.803 INFO:teuthology.orchestra.run.smithi117.stdout: "hostname": "smithi117", 2024-08-17T02:23:19.803 INFO:teuthology.orchestra.run.smithi117.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-08-17T02:23:19.803 INFO:teuthology.orchestra.run.smithi117.stdout: "pid": "30169", 2024-08-17T02:23:19.804 INFO:teuthology.orchestra.run.smithi117.stdout: "root": "/" 2024-08-17T02:23:19.804 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-08-17T02:23:19.804 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_count": 0, 2024-08-17T02:23:19.804 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_pinned_count": 0, 2024-08-17T02:23:19.804 INFO:teuthology.orchestra.run.smithi117.stdout: "id": 4868, 2024-08-17T02:23:19.804 INFO:teuthology.orchestra.run.smithi117.stdout: "inst": { 2024-08-17T02:23:19.804 INFO:teuthology.orchestra.run.smithi117.stdout: "name": { 2024-08-17T02:23:19.804 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "client", 2024-08-17T02:23:19.804 INFO:teuthology.orchestra.run.smithi117.stdout: "num": 4868 2024-08-17T02:23:19.804 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-08-17T02:23:19.804 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2024-08-17T02:23:19.804 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2024-08-17T02:23:19.804 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2024-08-17T02:23:19.804 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 3380676980 2024-08-17T02:23:19.805 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-08-17T02:23:19.805 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-08-17T02:23:19.805 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2024-08-17T02:23:19.805 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2024-08-17T02:23:19.805 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2024-08-17T02:23:19.805 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 3380676980 2024-08-17T02:23:19.805 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-08-17T02:23:19.805 INFO:teuthology.orchestra.run.smithi117.stdout: "inst_str": "client.4868 192.168.0.1:0/3380676980", 2024-08-17T02:23:19.805 INFO:teuthology.orchestra.run.smithi117.stdout: "addr_str": "192.168.0.1:0/3380676980", 2024-08-17T02:23:19.805 INFO:teuthology.orchestra.run.smithi117.stdout: "inode_count": 1, 2024-08-17T02:23:19.805 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_epoch": 14, 2024-08-17T02:23:19.805 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch": 34, 2024-08-17T02:23:19.805 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch_barrier": 0, 2024-08-17T02:23:19.805 INFO:teuthology.orchestra.run.smithi117.stdout: "blocklisted": false, 2024-08-17T02:23:19.806 INFO:teuthology.orchestra.run.smithi117.stdout: "fs_name": "cephfs" 2024-08-17T02:23:19.806 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-08-17T02:23:19.812 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:23:19.812 DEBUG:teuthology.orchestra.run.smithi117:> stat --file-system '--printf=%T 2024-08-17T02:23:19.812 DEBUG:teuthology.orchestra.run.smithi117:> ' -- /home/ubuntu/cephtest/mnt.1 2024-08-17T02:23:19.818 INFO:teuthology.orchestra.run.smithi117.stdout:fuseblk 2024-08-17T02:23:19.819 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-08-17T02:23:19.819 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:23:19.819 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:23:19.830 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-08-17T02:23:19.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.946+0000 7f86c0697700 1 Processor -- start 2024-08-17T02:23:19.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.946+0000 7f86c0697700 1 -- start start 2024-08-17T02:23:19.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.946+0000 7f86c0697700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86b80cf2e0 0x7f86b80cf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:19.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.946+0000 7f86c0697700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86b80d09c0 con 0x7f86b80ca850 2024-08-17T02:23:19.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.950+0000 7f86c0697700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86b815aab0 con 0x7f86b8159500 2024-08-17T02:23:19.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.950+0000 7f86c0697700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86b80d0c10 con 0x7f86b80cf2e0 2024-08-17T02:23:19.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.950+0000 7f86bec34700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f86b80ca850 0x7f86b80cac90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:38990/0 (socket says 172.21.15.104:38990) 2024-08-17T02:23:19.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.950+0000 7f86bec34700 1 -- 172.21.15.104:0/669163488 learned_addr learned my addr 172.21.15.104:0/669163488 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:23:19.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.950+0000 7f86bdc32700 1 --2- 172.21.15.104:0/669163488 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86b80cf2e0 0x7f86b80cf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:19.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.950+0000 7f86bd431700 1 -- 172.21.15.104:0/669163488 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4059636694 0 0) 0x7f86b80d09c0 con 0x7f86b80ca850 2024-08-17T02:23:19.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.950+0000 7f86bd431700 1 -- 172.21.15.104:0/669163488 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86a4003570 con 0x7f86b80ca850 2024-08-17T02:23:19.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.950+0000 7f86bd431700 1 -- 172.21.15.104:0/669163488 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1602482791 0 0) 0x7f86b815aab0 con 0x7f86b8159500 2024-08-17T02:23:19.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.950+0000 7f86bd431700 1 -- 172.21.15.104:0/669163488 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86b80d09c0 con 0x7f86b8159500 2024-08-17T02:23:19.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.950+0000 7f86bdc32700 1 -- 172.21.15.104:0/669163488 >> v1:172.21.15.117:6789/0 conn(0x7f86b8159500 legacy=0x7f86b80cebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:19.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.950+0000 7f86bd431700 1 -- 172.21.15.104:0/669163488 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 325307749 0 0) 0x7f86a4003570 con 0x7f86b80ca850 2024-08-17T02:23:19.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.950+0000 7f86bdc32700 1 -- 172.21.15.104:0/669163488 >> v1:172.21.15.104:6789/0 conn(0x7f86b80ca850 legacy=0x7f86b80cac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:19.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.950+0000 7f86bdc32700 1 -- 172.21.15.104:0/669163488 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b80d0ef0 con 0x7f86b80cf2e0 2024-08-17T02:23:19.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.950+0000 7f86bdc32700 1 --2- 172.21.15.104:0/669163488 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86b80cf2e0 0x7f86b80cf6f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f86b4009910 tx=0x7f86b40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8caa45634abc1372 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:19.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.950+0000 7f86bd431700 1 -- 172.21.15.104:0/669163488 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b4011630 con 0x7f86b80cf2e0 2024-08-17T02:23:19.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.950+0000 7f86bd431700 1 -- 172.21.15.104:0/669163488 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b4011790 con 0x7f86b80cf2e0 2024-08-17T02:23:19.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.950+0000 7f86bd431700 1 -- 172.21.15.104:0/669163488 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b4011b10 con 0x7f86b80cf2e0 2024-08-17T02:23:19.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.950+0000 7f86c0697700 1 -- 172.21.15.104:0/669163488 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86b80cf2e0 msgr2=0x7f86b80cf6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:19.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.950+0000 7f86c0697700 1 --2- 172.21.15.104:0/669163488 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86b80cf2e0 0x7f86b80cf6f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f86b4009910 tx=0x7f86b40091a0 comp rx=0 tx=0).stop 2024-08-17T02:23:19.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.950+0000 7f86c0697700 1 -- 172.21.15.104:0/669163488 shutdown_connections 2024-08-17T02:23:19.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.950+0000 7f86c0697700 1 --2- 172.21.15.104:0/669163488 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86b80cf2e0 0x7f86b80cf6f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:19.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.950+0000 7f86c0697700 1 -- 172.21.15.104:0/669163488 >> 172.21.15.104:0/669163488 conn(0x7f86b8067590 msgr2=0x7f86b80d02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:19.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.950+0000 7f86c0697700 1 -- 172.21.15.104:0/669163488 shutdown_connections 2024-08-17T02:23:19.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.950+0000 7f86c0697700 1 -- 172.21.15.104:0/669163488 wait complete. 2024-08-17T02:23:19.960 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:23:19.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.954+0000 7f86c0697700 1 Processor -- start 2024-08-17T02:23:19.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.954+0000 7f86c0697700 1 -- start start 2024-08-17T02:23:19.963 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:23:19.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.958+0000 7f86c0697700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86b80ca850 0x7f86b80c6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:19.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.958+0000 7f86c0697700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86b80cf2e0 0x7f86b8157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:19.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.958+0000 7f86c0697700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86b8159500 0x7f86b80c46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:19.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.958+0000 7f86c0697700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b80c4e90 con 0x7f86b8159500 2024-08-17T02:23:19.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.958+0000 7f86c0697700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b81570c0 con 0x7f86b80ca850 2024-08-17T02:23:19.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.958+0000 7f86c0697700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86b80c4c30 con 0x7f86b80cf2e0 2024-08-17T02:23:19.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.958+0000 7f86bec34700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86b8159500 0x7f86b80c46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:19.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.958+0000 7f86bec34700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86b8159500 0x7f86b80c46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51862/0 (socket says 172.21.15.104:51862) 2024-08-17T02:23:19.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.958+0000 7f86bec34700 1 -- 172.21.15.104:0/3044617112 learned_addr learned my addr 172.21.15.104:0/3044617112 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:19.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.958+0000 7f86be433700 1 --2- 172.21.15.104:0/3044617112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86b80ca850 0x7f86b80c6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:19.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.958+0000 7f86bdc32700 1 --2- 172.21.15.104:0/3044617112 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86b80cf2e0 0x7f86b8157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:19.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.958+0000 7f86bec34700 1 -- 172.21.15.104:0/3044617112 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86b80cf2e0 msgr2=0x7f86b8157550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:19.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.958+0000 7f86bec34700 1 --2- 172.21.15.104:0/3044617112 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86b80cf2e0 0x7f86b8157550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:19.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.958+0000 7f86bec34700 1 -- 172.21.15.104:0/3044617112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86b80ca850 msgr2=0x7f86b80c6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:19.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.958+0000 7f86bec34700 1 --2- 172.21.15.104:0/3044617112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86b80ca850 0x7f86b80c6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:19.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.958+0000 7f86bec34700 1 -- 172.21.15.104:0/3044617112 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b4009420 con 0x7f86b8159500 2024-08-17T02:23:19.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.958+0000 7f86be433700 1 --2- 172.21.15.104:0/3044617112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86b80ca850 0x7f86b80c6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:19.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.958+0000 7f86bec34700 1 --2- 172.21.15.104:0/3044617112 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86b8159500 0x7f86b80c46f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f86b000c840 tx=0x7f86b0001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:19.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.958+0000 7f86ae7fc700 1 -- 172.21.15.104:0/3044617112 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b0004dc0 con 0x7f86b8159500 2024-08-17T02:23:19.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.958+0000 7f86ae7fc700 1 -- 172.21.15.104:0/3044617112 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b0007150 con 0x7f86b8159500 2024-08-17T02:23:19.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.958+0000 7f86ae7fc700 1 -- 172.21.15.104:0/3044617112 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b0007510 con 0x7f86b8159500 2024-08-17T02:23:19.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.958+0000 7f86c0697700 1 -- 172.21.15.104:0/3044617112 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86b8156790 con 0x7f86b8159500 2024-08-17T02:23:19.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.958+0000 7f86c0697700 1 -- 172.21.15.104:0/3044617112 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86b8156d50 con 0x7f86b8159500 2024-08-17T02:23:19.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.958+0000 7f86c0697700 1 -- 172.21.15.104:0/3044617112 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86b80638f0 con 0x7f86b8159500 2024-08-17T02:23:19.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.958+0000 7f86ae7fc700 1 -- 172.21.15.104:0/3044617112 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f86b00078c0 con 0x7f86b8159500 2024-08-17T02:23:19.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.962+0000 7f86ae7fc700 1 --2- 172.21.15.104:0/3044617112 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f869c060860 0x7f869c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:19.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.962+0000 7f86ae7fc700 1 -- 172.21.15.104:0/3044617112 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f86b007c480 con 0x7f86b8159500 2024-08-17T02:23:19.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.962+0000 7f86be433700 1 --2- 172.21.15.104:0/3044617112 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f869c060860 0x7f869c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:19.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.962+0000 7f86be433700 1 --2- 172.21.15.104:0/3044617112 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f869c060860 0x7f869c062d10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f86a8003990 tx=0x7f86a8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:19.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:19.966+0000 7f86ae7fc700 1 -- 172.21.15.104:0/3044617112 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f86b004c8f0 con 0x7f86b8159500 2024-08-17T02:23:20.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.170+0000 7f86c0697700 1 -- 172.21.15.104:0/3044617112 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f86b8157200 con 0x7f86b8159500 2024-08-17T02:23:20.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.206+0000 7f86ae7fc700 1 -- 172.21.15.104:0/3044617112 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v15) v1 ==== 136+0+0 (secure 0 0 0) 0x7f86b004ff10 con 0x7f86b8159500 2024-08-17T02:23:20.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.210+0000 7f86c0697700 1 -- 172.21.15.104:0/3044617112 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f869c060860 msgr2=0x7f869c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:20.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.210+0000 7f86c0697700 1 --2- 172.21.15.104:0/3044617112 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f869c060860 0x7f869c062d10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f86a8003990 tx=0x7f86a8009040 comp rx=0 tx=0).stop 2024-08-17T02:23:20.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.210+0000 7f86c0697700 1 -- 172.21.15.104:0/3044617112 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86b8159500 msgr2=0x7f86b80c46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:20.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.210+0000 7f86c0697700 1 --2- 172.21.15.104:0/3044617112 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86b8159500 0x7f86b80c46f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f86b000c840 tx=0x7f86b0001640 comp rx=0 tx=0).stop 2024-08-17T02:23:20.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.210+0000 7f86c0697700 1 -- 172.21.15.104:0/3044617112 shutdown_connections 2024-08-17T02:23:20.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.210+0000 7f86c0697700 1 --2- 172.21.15.104:0/3044617112 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f869c060860 0x7f869c062d10 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:20.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.210+0000 7f86c0697700 1 --2- 172.21.15.104:0/3044617112 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86b8159500 0x7f86b80c46f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:20.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.210+0000 7f86c0697700 1 --2- 172.21.15.104:0/3044617112 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86b80cf2e0 0x7f86b8157550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:20.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.210+0000 7f86c0697700 1 --2- 172.21.15.104:0/3044617112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86b80ca850 0x7f86b80c6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:20.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.210+0000 7f86c0697700 1 -- 172.21.15.104:0/3044617112 >> 172.21.15.104:0/3044617112 conn(0x7f86b8067590 msgr2=0x7f86b80cbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:20.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.210+0000 7f86c0697700 1 -- 172.21.15.104:0/3044617112 shutdown_connections 2024-08-17T02:23:20.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.210+0000 7f86c0697700 1 -- 172.21.15.104:0/3044617112 wait complete. 2024-08-17T02:23:20.231 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-08-17T02:23:20.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.330+0000 7fa4c2a82700 1 Processor -- start 2024-08-17T02:23:20.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.330+0000 7fa4c2a82700 1 -- start start 2024-08-17T02:23:20.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.334+0000 7fa4c2a82700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa4bc155d20 0x7fa4bc0b0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:20.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.334+0000 7fa4c2a82700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4bc0ad7c0 0x7fa4bc0aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:20.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.334+0000 7fa4c2a82700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4bc0af2b0 con 0x7fa4bc06df10 2024-08-17T02:23:20.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.334+0000 7fa4c2a82700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4bc0adc10 con 0x7fa4bc155d20 2024-08-17T02:23:20.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.334+0000 7fa4c2a82700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc0af590 con 0x7fa4bc0ad7c0 2024-08-17T02:23:20.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.334+0000 7fa4c1a80700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa4bc155d20 0x7fa4bc0b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:20.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.334+0000 7fa4c2281700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fa4bc06df10 0x7fa4bc1599c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:38996/0 (socket says 172.21.15.104:38996) 2024-08-17T02:23:20.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.334+0000 7fa4c2281700 1 -- 172.21.15.104:0/573636548 learned_addr learned my addr 172.21.15.104:0/573636548 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:23:20.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.334+0000 7fa4c127f700 1 --2- 172.21.15.104:0/573636548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4bc0ad7c0 0x7fa4bc0aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:20.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.334+0000 7fa4c1a80700 1 -- 172.21.15.104:0/573636548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4bc0ad7c0 msgr2=0x7fa4bc0aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:20.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.334+0000 7fa4c1a80700 1 --2- 172.21.15.104:0/573636548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4bc0ad7c0 0x7fa4bc0aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:20.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.334+0000 7fa4c1a80700 1 -- 172.21.15.104:0/573636548 >> v1:172.21.15.104:6789/0 conn(0x7fa4bc06df10 legacy=0x7fa4bc1599c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:20.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.334+0000 7fa4c1a80700 1 -- 172.21.15.104:0/573636548 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4bc0af870 con 0x7fa4bc155d20 2024-08-17T02:23:20.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.334+0000 7fa4c127f700 1 --2- 172.21.15.104:0/573636548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4bc0ad7c0 0x7fa4bc0aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:20.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.334+0000 7fa4c0a7e700 1 -- 172.21.15.104:0/573636548 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3692461233 0 0) 0x7fa4bc0af2b0 con 0x7fa4bc06df10 2024-08-17T02:23:20.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.334+0000 7fa4c1a80700 1 --2- 172.21.15.104:0/573636548 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4bc155d20 0x7fa4bc0b0350 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa4b00098e0 tx=0x7fa4b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7af37d5ea38ba0d3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:20.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.334+0000 7fa4c0a7e700 1 -- 172.21.15.104:0/573636548 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b0009e80 con 0x7fa4bc155d20 2024-08-17T02:23:20.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.334+0000 7fa4c0a7e700 1 -- 172.21.15.104:0/573636548 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b000b860 con 0x7fa4bc155d20 2024-08-17T02:23:20.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.334+0000 7fa4c0a7e700 1 -- 172.21.15.104:0/573636548 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b000bbe0 con 0x7fa4bc155d20 2024-08-17T02:23:20.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.334+0000 7fa4c2a82700 1 -- 172.21.15.104:0/573636548 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4bc155d20 msgr2=0x7fa4bc0b0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:20.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.334+0000 7fa4c2a82700 1 --2- 172.21.15.104:0/573636548 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4bc155d20 0x7fa4bc0b0350 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa4b00098e0 tx=0x7fa4b00091a0 comp rx=0 tx=0).stop 2024-08-17T02:23:20.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.334+0000 7fa4c2a82700 1 -- 172.21.15.104:0/573636548 shutdown_connections 2024-08-17T02:23:20.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.334+0000 7fa4c2a82700 1 --2- 172.21.15.104:0/573636548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4bc0ad7c0 0x7fa4bc0aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:20.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.334+0000 7fa4c2a82700 1 --2- 172.21.15.104:0/573636548 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4bc155d20 0x7fa4bc0b0350 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:20.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.334+0000 7fa4c2a82700 1 -- 172.21.15.104:0/573636548 >> 172.21.15.104:0/573636548 conn(0x7fa4bc0678d0 msgr2=0x7fa4bc067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:20.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.334+0000 7fa4c2a82700 1 -- 172.21.15.104:0/573636548 shutdown_connections 2024-08-17T02:23:20.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.334+0000 7fa4c2a82700 1 -- 172.21.15.104:0/573636548 wait complete. 2024-08-17T02:23:20.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.338+0000 7fa4c2a82700 1 Processor -- start 2024-08-17T02:23:20.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.338+0000 7fa4c2a82700 1 -- start start 2024-08-17T02:23:20.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.338+0000 7fa4c2a82700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4bc06df10 0x7fa4bc158bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:20.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.338+0000 7fa4c2a82700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4bc0ad7c0 0x7fa4bc141e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:20.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.338+0000 7fa4c2a82700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4bc155d20 0x7fa4bc15baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:20.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.338+0000 7fa4c2a82700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc15d130 con 0x7fa4bc06df10 2024-08-17T02:23:20.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.338+0000 7fa4c2a82700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc15d410 con 0x7fa4bc155d20 2024-08-17T02:23:20.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.338+0000 7fa4c2a82700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc15d6f0 con 0x7fa4bc0ad7c0 2024-08-17T02:23:20.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.338+0000 7fa4c1a80700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4bc06df10 0x7fa4bc158bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:20.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.338+0000 7fa4c1a80700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4bc06df10 0x7fa4bc158bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51886/0 (socket says 172.21.15.104:51886) 2024-08-17T02:23:20.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.338+0000 7fa4c1a80700 1 -- 172.21.15.104:0/3779592234 learned_addr learned my addr 172.21.15.104:0/3779592234 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:20.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.338+0000 7fa4c2281700 1 --2- 172.21.15.104:0/3779592234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4bc155d20 0x7fa4bc15baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:20.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.338+0000 7fa4c127f700 1 --2- 172.21.15.104:0/3779592234 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4bc0ad7c0 0x7fa4bc141e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:20.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.342+0000 7fa4c1a80700 1 -- 172.21.15.104:0/3779592234 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4bc0ad7c0 msgr2=0x7fa4bc141e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:20.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.342+0000 7fa4c1a80700 1 --2- 172.21.15.104:0/3779592234 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4bc0ad7c0 0x7fa4bc141e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:20.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.342+0000 7fa4c1a80700 1 -- 172.21.15.104:0/3779592234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4bc155d20 msgr2=0x7fa4bc15baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:20.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.342+0000 7fa4c1a80700 1 --2- 172.21.15.104:0/3779592234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4bc155d20 0x7fa4bc15baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:20.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.342+0000 7fa4c1a80700 1 -- 172.21.15.104:0/3779592234 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b0009420 con 0x7fa4bc06df10 2024-08-17T02:23:20.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.342+0000 7fa4c2281700 1 --2- 172.21.15.104:0/3779592234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4bc155d20 0x7fa4bc15baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:20.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.342+0000 7fa4c1a80700 1 --2- 172.21.15.104:0/3779592234 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4bc06df10 0x7fa4bc158bd0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc06c2d0 tx=0x7fa4b0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:20.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.342+0000 7fa4adffb700 1 -- 172.21.15.104:0/3779592234 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b000bbe0 con 0x7fa4bc06df10 2024-08-17T02:23:20.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.342+0000 7fa4adffb700 1 -- 172.21.15.104:0/3779592234 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b0011420 con 0x7fa4bc06df10 2024-08-17T02:23:20.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.342+0000 7fa4c2a82700 1 -- 172.21.15.104:0/3779592234 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4bc15d9d0 con 0x7fa4bc06df10 2024-08-17T02:23:20.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.342+0000 7fa4adffb700 1 -- 172.21.15.104:0/3779592234 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b00117c0 con 0x7fa4bc06df10 2024-08-17T02:23:20.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.342+0000 7fa4c2a82700 1 -- 172.21.15.104:0/3779592234 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4bc159110 con 0x7fa4bc06df10 2024-08-17T02:23:20.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.342+0000 7fa4c2a82700 1 -- 172.21.15.104:0/3779592234 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4bc0643a0 con 0x7fa4bc06df10 2024-08-17T02:23:20.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.342+0000 7fa4adffb700 1 -- 172.21.15.104:0/3779592234 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa4b0011bf0 con 0x7fa4bc06df10 2024-08-17T02:23:20.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.342+0000 7fa4adffb700 1 --2- 172.21.15.104:0/3779592234 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fa4a0060860 0x7fa4a0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:20.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.342+0000 7fa4adffb700 1 -- 172.21.15.104:0/3779592234 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa4b007e550 con 0x7fa4bc06df10 2024-08-17T02:23:20.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.342+0000 7fa4c127f700 1 --2- 172.21.15.104:0/3779592234 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fa4a0060860 0x7fa4a0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:20.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.346+0000 7fa4c127f700 1 --2- 172.21.15.104:0/3779592234 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fa4a0060860 0x7fa4a0062d10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8006f00 tx=0x7fa4b8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:20.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.350+0000 7fa4adffb700 1 -- 172.21.15.104:0/3779592234 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa4b004e9a0 con 0x7fa4bc06df10 2024-08-17T02:23:20.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.538+0000 7fa4c2a82700 1 -- 172.21.15.104:0/3779592234 --> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fa4bc06f5f0 con 0x7fa4a0060860 2024-08-17T02:23:20.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.542+0000 7fa4adffb700 1 -- 172.21.15.104:0/3779592234 <== mgr.4111 v2:172.21.15.117:6832/24084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fa4bc06f5f0 con 0x7fa4a0060860 2024-08-17T02:23:20.548 INFO:teuthology.orchestra.run.smithi104.stdout:[ 2024-08-17T02:23:20.548 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-08-17T02:23:20.548 INFO:teuthology.orchestra.run.smithi104.stdout: "name": "cephfs" 2024-08-17T02:23:20.548 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-08-17T02:23:20.548 INFO:teuthology.orchestra.run.smithi104.stdout:] 2024-08-17T02:23:20.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.542+0000 7fa4c2a82700 1 -- 172.21.15.104:0/3779592234 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fa4a0060860 msgr2=0x7fa4a0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:20.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.542+0000 7fa4c2a82700 1 --2- 172.21.15.104:0/3779592234 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fa4a0060860 0x7fa4a0062d10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8006f00 tx=0x7fa4b8008040 comp rx=0 tx=0).stop 2024-08-17T02:23:20.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.542+0000 7fa4c2a82700 1 -- 172.21.15.104:0/3779592234 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4bc06df10 msgr2=0x7fa4bc158bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:20.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.542+0000 7fa4c2a82700 1 --2- 172.21.15.104:0/3779592234 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4bc06df10 0x7fa4bc158bd0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc06c2d0 tx=0x7fa4b0017000 comp rx=0 tx=0).stop 2024-08-17T02:23:20.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.542+0000 7fa4c2a82700 1 -- 172.21.15.104:0/3779592234 shutdown_connections 2024-08-17T02:23:20.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.542+0000 7fa4c2a82700 1 --2- 172.21.15.104:0/3779592234 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fa4a0060860 0x7fa4a0062d10 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:20.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.542+0000 7fa4c2a82700 1 --2- 172.21.15.104:0/3779592234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4bc155d20 0x7fa4bc15baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:20.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.542+0000 7fa4c2a82700 1 --2- 172.21.15.104:0/3779592234 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4bc0ad7c0 0x7fa4bc141e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:20.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.542+0000 7fa4c2a82700 1 --2- 172.21.15.104:0/3779592234 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4bc06df10 0x7fa4bc158bd0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:20.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.542+0000 7fa4c2a82700 1 -- 172.21.15.104:0/3779592234 >> 172.21.15.104:0/3779592234 conn(0x7fa4bc0678d0 msgr2=0x7fa4bc0ae040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:20.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.546+0000 7fa4c2a82700 1 -- 172.21.15.104:0/3779592234 shutdown_connections 2024-08-17T02:23:20.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.546+0000 7fa4c2a82700 1 -- 172.21.15.104:0/3779592234 wait complete. 2024-08-17T02:23:20.562 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-17T02:23:20.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.666+0000 7fa074c58700 1 Processor -- start 2024-08-17T02:23:20.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.666+0000 7fa074c58700 1 -- start start 2024-08-17T02:23:20.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.670+0000 7fa074c58700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa0700686a0 0x7fa070068b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:20.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.670+0000 7fa074c58700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa070155670 0x7fa070155af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:20.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.670+0000 7fa074c58700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0700ae490 con 0x7fa0701552a0 2024-08-17T02:23:20.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.670+0000 7fa074c58700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0700ae920 con 0x7fa070155670 2024-08-17T02:23:20.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.670+0000 7fa074c58700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0700af040 con 0x7fa0700686a0 2024-08-17T02:23:20.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.670+0000 7fa06ffff700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa070155670 0x7fa070155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:20.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.670+0000 7fa06ffff700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa070155670 0x7fa070155af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51902/0 (socket says 172.21.15.104:51902) 2024-08-17T02:23:20.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.670+0000 7fa06ffff700 1 -- 172.21.15.104:0/474638745 learned_addr learned my addr 172.21.15.104:0/474638745 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:20.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.670+0000 7fa067fff700 1 --2- 172.21.15.104:0/474638745 >> v2:172.21.15.117:3300/0 conn(0x7fa0700686a0 0x7fa070068b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:20.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.670+0000 7fa06ffff700 1 -- 172.21.15.104:0/474638745 >> v2:172.21.15.117:3300/0 conn(0x7fa0700686a0 msgr2=0x7fa070068b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:20.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.670+0000 7fa06ffff700 1 --2- 172.21.15.104:0/474638745 >> v2:172.21.15.117:3300/0 conn(0x7fa0700686a0 0x7fa070068b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:20.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.670+0000 7fa06ffff700 1 -- 172.21.15.104:0/474638745 >> v1:172.21.15.117:6789/0 conn(0x7fa0701552a0 legacy=0x7fa0700b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:20.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.670+0000 7fa06ffff700 1 -- 172.21.15.104:0/474638745 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0700ad880 con 0x7fa070155670 2024-08-17T02:23:20.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.670+0000 7fa06ffff700 1 --2- 172.21.15.104:0/474638745 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa070155670 0x7fa070155af0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa07006d2a0 tx=0x7fa06800a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=186c52ccfdaf30f6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:20.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.670+0000 7fa06effd700 1 -- 172.21.15.104:0/474638745 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06800f070 con 0x7fa070155670 2024-08-17T02:23:20.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.670+0000 7fa06effd700 1 -- 172.21.15.104:0/474638745 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06800a2e0 con 0x7fa070155670 2024-08-17T02:23:20.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.670+0000 7fa06effd700 1 -- 172.21.15.104:0/474638745 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06800cd50 con 0x7fa070155670 2024-08-17T02:23:20.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.674+0000 7fa074c58700 1 -- 172.21.15.104:0/474638745 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa070155670 msgr2=0x7fa070155af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:20.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.674+0000 7fa074c58700 1 --2- 172.21.15.104:0/474638745 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa070155670 0x7fa070155af0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa07006d2a0 tx=0x7fa06800a950 comp rx=0 tx=0).stop 2024-08-17T02:23:20.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.674+0000 7fa074c58700 1 -- 172.21.15.104:0/474638745 shutdown_connections 2024-08-17T02:23:20.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.674+0000 7fa074c58700 1 --2- 172.21.15.104:0/474638745 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa070155670 0x7fa070155af0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:20.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.674+0000 7fa074c58700 1 --2- 172.21.15.104:0/474638745 >> v2:172.21.15.117:3300/0 conn(0x7fa0700686a0 0x7fa070068b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:20.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.674+0000 7fa074c58700 1 -- 172.21.15.104:0/474638745 >> 172.21.15.104:0/474638745 conn(0x7fa07006e350 msgr2=0x7fa07006b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:20.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.674+0000 7fa074c58700 1 -- 172.21.15.104:0/474638745 shutdown_connections 2024-08-17T02:23:20.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.674+0000 7fa074c58700 1 -- 172.21.15.104:0/474638745 wait complete. 2024-08-17T02:23:20.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.674+0000 7fa074c58700 1 Processor -- start 2024-08-17T02:23:20.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.674+0000 7fa074c58700 1 -- start start 2024-08-17T02:23:20.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.674+0000 7fa074c58700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0700686a0 0x7fa0700a7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:20.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.674+0000 7fa074c58700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0701552a0 0x7fa0700c9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:20.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.674+0000 7fa074c58700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa070155670 0x7fa070166750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:20.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.674+0000 7fa074c58700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa070169800 con 0x7fa070155670 2024-08-17T02:23:20.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.674+0000 7fa074c58700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0700c9c60 con 0x7fa0700686a0 2024-08-17T02:23:20.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.674+0000 7fa074c58700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0701694b0 con 0x7fa0701552a0 2024-08-17T02:23:20.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.674+0000 7fa06ffff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa070155670 0x7fa070166750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:20.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.674+0000 7fa06ffff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa070155670 0x7fa070166750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51918/0 (socket says 172.21.15.104:51918) 2024-08-17T02:23:20.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.674+0000 7fa06ffff700 1 -- 172.21.15.104:0/565854872 learned_addr learned my addr 172.21.15.104:0/565854872 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:20.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.674+0000 7fa067fff700 1 --2- 172.21.15.104:0/565854872 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0701552a0 0x7fa0700c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:20.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.674+0000 7fa06f7fe700 1 --2- 172.21.15.104:0/565854872 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0700686a0 0x7fa0700a7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:20.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.678+0000 7fa06ffff700 1 -- 172.21.15.104:0/565854872 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0701552a0 msgr2=0x7fa0700c9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:20.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.678+0000 7fa06ffff700 1 --2- 172.21.15.104:0/565854872 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0701552a0 0x7fa0700c9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:20.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.678+0000 7fa06ffff700 1 -- 172.21.15.104:0/565854872 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0700686a0 msgr2=0x7fa0700a7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:20.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.678+0000 7fa06ffff700 1 --2- 172.21.15.104:0/565854872 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0700686a0 0x7fa0700a7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:20.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.678+0000 7fa06ffff700 1 -- 172.21.15.104:0/565854872 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa06800abf0 con 0x7fa070155670 2024-08-17T02:23:20.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.678+0000 7fa06ffff700 1 --2- 172.21.15.104:0/565854872 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa070155670 0x7fa070166750 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa06800af00 tx=0x7fa068019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:20.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.678+0000 7fa0677fe700 1 -- 172.21.15.104:0/565854872 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0680082a0 con 0x7fa070155670 2024-08-17T02:23:20.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.678+0000 7fa0677fe700 1 -- 172.21.15.104:0/565854872 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06800ce80 con 0x7fa070155670 2024-08-17T02:23:20.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.678+0000 7fa074c58700 1 -- 172.21.15.104:0/565854872 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0700c9f00 con 0x7fa070155670 2024-08-17T02:23:20.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.678+0000 7fa0677fe700 1 -- 172.21.15.104:0/565854872 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06801d690 con 0x7fa070155670 2024-08-17T02:23:20.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.678+0000 7fa074c58700 1 -- 172.21.15.104:0/565854872 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0700ca4c0 con 0x7fa070155670 2024-08-17T02:23:20.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.678+0000 7fa074c58700 1 -- 172.21.15.104:0/565854872 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa070169970 con 0x7fa070155670 2024-08-17T02:23:20.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.678+0000 7fa0677fe700 1 -- 172.21.15.104:0/565854872 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa068003040 con 0x7fa070155670 2024-08-17T02:23:20.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.678+0000 7fa0677fe700 1 --2- 172.21.15.104:0/565854872 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fa050060860 0x7fa050062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:20.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.682+0000 7fa0677fe700 1 -- 172.21.15.104:0/565854872 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa06807e720 con 0x7fa070155670 2024-08-17T02:23:20.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.682+0000 7fa06f7fe700 1 --2- 172.21.15.104:0/565854872 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fa050060860 0x7fa050062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:20.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.682+0000 7fa06f7fe700 1 --2- 172.21.15.104:0/565854872 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fa050060860 0x7fa050062d10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa060003a80 tx=0x7fa060007ec0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:20.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.686+0000 7fa0677fe700 1 -- 172.21.15.104:0/565854872 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa06804eb70 con 0x7fa070155670 2024-08-17T02:23:20.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.850+0000 7fa074c58700 1 -- 172.21.15.104:0/565854872 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa0700638f0 con 0x7fa070155670 2024-08-17T02:23:20.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.854+0000 7fa0677fe700 1 -- 172.21.15.104:0/565854872 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa068052190 con 0x7fa070155670 2024-08-17T02:23:20.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.854+0000 7fa074c58700 1 -- 172.21.15.104:0/565854872 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fa050060860 msgr2=0x7fa050062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:20.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.854+0000 7fa074c58700 1 --2- 172.21.15.104:0/565854872 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fa050060860 0x7fa050062d10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa060003a80 tx=0x7fa060007ec0 comp rx=0 tx=0).stop 2024-08-17T02:23:20.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.854+0000 7fa074c58700 1 -- 172.21.15.104:0/565854872 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa070155670 msgr2=0x7fa070166750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:20.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.854+0000 7fa074c58700 1 --2- 172.21.15.104:0/565854872 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa070155670 0x7fa070166750 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa06800af00 tx=0x7fa068019000 comp rx=0 tx=0).stop 2024-08-17T02:23:20.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.854+0000 7fa074c58700 1 -- 172.21.15.104:0/565854872 shutdown_connections 2024-08-17T02:23:20.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.854+0000 7fa074c58700 1 --2- 172.21.15.104:0/565854872 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fa050060860 0x7fa050062d10 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:20.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.854+0000 7fa074c58700 1 --2- 172.21.15.104:0/565854872 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa070155670 0x7fa070166750 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:20.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.854+0000 7fa074c58700 1 --2- 172.21.15.104:0/565854872 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0701552a0 0x7fa0700c9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:20.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.854+0000 7fa074c58700 1 --2- 172.21.15.104:0/565854872 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0700686a0 0x7fa0700a7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:20.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.854+0000 7fa074c58700 1 -- 172.21.15.104:0/565854872 >> 172.21.15.104:0/565854872 conn(0x7fa07006e350 msgr2=0x7fa0700c58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:20.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.854+0000 7fa074c58700 1 -- 172.21.15.104:0/565854872 shutdown_connections 2024-08-17T02:23:20.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.854+0000 7fa074c58700 1 -- 172.21.15.104:0/565854872 wait complete. 2024-08-17T02:23:20.873 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create volume_0000000000188090 2024-08-17T02:23:20.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.978+0000 7f1361e3e700 1 Processor -- start 2024-08-17T02:23:20.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.978+0000 7f1361e3e700 1 -- start start 2024-08-17T02:23:20.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.982+0000 7f1361e3e700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f135c06f350 0x7f135c0b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:20.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.982+0000 7f1361e3e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f135c153cb0 0x7f135c159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:20.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.982+0000 7f1361e3e700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f135c0b0ad0 con 0x7f135c1538e0 2024-08-17T02:23:20.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.982+0000 7f1361e3e700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f135c15a940 con 0x7f135c06f350 2024-08-17T02:23:20.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.982+0000 7f1361e3e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f135c0b01a0 con 0x7f135c153cb0 2024-08-17T02:23:20.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.982+0000 7f135bfff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f135c153cb0 0x7f135c159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:20.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.982+0000 7f1352ffd700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f135c06f350 0x7f135c0b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:20.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.982+0000 7f1352ffd700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f135c06f350 0x7f135c0b0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.104:36608/0 (socket says 172.21.15.104:36608) 2024-08-17T02:23:20.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.982+0000 7f135bfff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f135c153cb0 0x7f135c159bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.104:38436/0 (socket says 172.21.15.104:38436) 2024-08-17T02:23:20.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.982+0000 7f1352ffd700 1 -- 172.21.15.104:0/3131845786 learned_addr learned my addr 172.21.15.104:0/3131845786 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:20.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.982+0000 7f135b7fe700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f135c1538e0 0x7f135c06ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.104:45924/0 (socket says 172.21.15.104:45924) 2024-08-17T02:23:20.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.982+0000 7f135bfff700 1 -- 172.21.15.104:0/3131845786 >> v2:172.21.15.117:3300/0 conn(0x7f135c06f350 msgr2=0x7f135c0b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:20.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.982+0000 7f135bfff700 1 --2- 172.21.15.104:0/3131845786 >> v2:172.21.15.117:3300/0 conn(0x7f135c06f350 0x7f135c0b0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:20.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.982+0000 7f135bfff700 1 -- 172.21.15.104:0/3131845786 >> v1:172.21.15.117:6789/0 conn(0x7f135c1538e0 legacy=0x7f135c06ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:20.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.982+0000 7f135bfff700 1 -- 172.21.15.104:0/3131845786 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f135c0b0480 con 0x7f135c153cb0 2024-08-17T02:23:20.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.982+0000 7f1352ffd700 1 --2- 172.21.15.104:0/3131845786 >> v2:172.21.15.117:3300/0 conn(0x7f135c06f350 0x7f135c0b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:20.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.982+0000 7f135bfff700 1 --2- 172.21.15.104:0/3131845786 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f135c153cb0 0x7f135c159bd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1354009e60 tx=0x7f1354009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f29e8dff44958f6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:20.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.982+0000 7f135affd700 1 -- 172.21.15.104:0/3131845786 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135400e070 con 0x7f135c153cb0 2024-08-17T02:23:20.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.982+0000 7f135affd700 1 -- 172.21.15.104:0/3131845786 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135400bb60 con 0x7f135c153cb0 2024-08-17T02:23:20.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.982+0000 7f135affd700 1 -- 172.21.15.104:0/3131845786 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1354012430 con 0x7f135c153cb0 2024-08-17T02:23:20.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.982+0000 7f1361e3e700 1 -- 172.21.15.104:0/3131845786 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f135c153cb0 msgr2=0x7f135c159bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:20.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.982+0000 7f1361e3e700 1 --2- 172.21.15.104:0/3131845786 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f135c153cb0 0x7f135c159bd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1354009e60 tx=0x7f1354009780 comp rx=0 tx=0).stop 2024-08-17T02:23:20.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.982+0000 7f1361e3e700 1 -- 172.21.15.104:0/3131845786 shutdown_connections 2024-08-17T02:23:20.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.982+0000 7f1361e3e700 1 --2- 172.21.15.104:0/3131845786 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f135c153cb0 0x7f135c159bd0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:20.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.982+0000 7f1361e3e700 1 --2- 172.21.15.104:0/3131845786 >> v2:172.21.15.117:3300/0 conn(0x7f135c06f350 0x7f135c0b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:20.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.982+0000 7f1361e3e700 1 -- 172.21.15.104:0/3131845786 >> 172.21.15.104:0/3131845786 conn(0x7f135c066e00 msgr2=0x7f135c067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:20.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.982+0000 7f1361e3e700 1 -- 172.21.15.104:0/3131845786 shutdown_connections 2024-08-17T02:23:20.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.982+0000 7f1361e3e700 1 -- 172.21.15.104:0/3131845786 wait complete. 2024-08-17T02:23:20.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.986+0000 7f1361e3e700 1 Processor -- start 2024-08-17T02:23:20.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.986+0000 7f1361e3e700 1 -- start start 2024-08-17T02:23:20.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.986+0000 7f1361e3e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f135c06f350 0x7f135c099090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:20.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.986+0000 7f1361e3e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f135c1538e0 0x7f135c098690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:20.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.986+0000 7f1361e3e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f135c153cb0 0x7f135c151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:20.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.986+0000 7f1361e3e700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135c098d90 con 0x7f135c06f350 2024-08-17T02:23:20.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.986+0000 7f1361e3e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135c0c8b50 con 0x7f135c153cb0 2024-08-17T02:23:20.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.986+0000 7f1361e3e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f135c0c8df0 con 0x7f135c1538e0 2024-08-17T02:23:20.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.990+0000 7f135b7fe700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f135c06f350 0x7f135c099090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:20.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.990+0000 7f135b7fe700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f135c06f350 0x7f135c099090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51924/0 (socket says 172.21.15.104:51924) 2024-08-17T02:23:20.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.990+0000 7f135b7fe700 1 -- 172.21.15.104:0/3997771133 learned_addr learned my addr 172.21.15.104:0/3997771133 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:20.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.990+0000 7f135bfff700 1 --2- 172.21.15.104:0/3997771133 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f135c153cb0 0x7f135c151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:20.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.990+0000 7f1352ffd700 1 --2- 172.21.15.104:0/3997771133 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f135c1538e0 0x7f135c098690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:20.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.990+0000 7f135b7fe700 1 -- 172.21.15.104:0/3997771133 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f135c1538e0 msgr2=0x7f135c098690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:20.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.990+0000 7f135b7fe700 1 --2- 172.21.15.104:0/3997771133 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f135c1538e0 0x7f135c098690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:20.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.990+0000 7f135b7fe700 1 -- 172.21.15.104:0/3997771133 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f135c153cb0 msgr2=0x7f135c151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:20.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.990+0000 7f135b7fe700 1 --2- 172.21.15.104:0/3997771133 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f135c153cb0 0x7f135c151200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:20.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.990+0000 7f135b7fe700 1 -- 172.21.15.104:0/3997771133 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13440094f0 con 0x7f135c06f350 2024-08-17T02:23:20.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.990+0000 7f135b7fe700 1 --2- 172.21.15.104:0/3997771133 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f135c06f350 0x7f135c099090 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f134c00c7c0 tx=0x7f134c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:20.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.990+0000 7f1353fff700 1 -- 172.21.15.104:0/3997771133 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134c005a70 con 0x7f135c06f350 2024-08-17T02:23:20.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.990+0000 7f1353fff700 1 -- 172.21.15.104:0/3997771133 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f134c005bd0 con 0x7f135c06f350 2024-08-17T02:23:20.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.990+0000 7f1361e3e700 1 -- 172.21.15.104:0/3997771133 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1354009a20 con 0x7f135c06f350 2024-08-17T02:23:20.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.990+0000 7f1353fff700 1 -- 172.21.15.104:0/3997771133 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134c0070d0 con 0x7f135c06f350 2024-08-17T02:23:20.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.990+0000 7f1361e3e700 1 -- 172.21.15.104:0/3997771133 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f135c0c93b0 con 0x7f135c06f350 2024-08-17T02:23:21.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.990+0000 7f1361e3e700 1 -- 172.21.15.104:0/3997771133 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f135c0645c0 con 0x7f135c06f350 2024-08-17T02:23:21.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.994+0000 7f1353fff700 1 -- 172.21.15.104:0/3997771133 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f134c007440 con 0x7f135c06f350 2024-08-17T02:23:21.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.994+0000 7f1353fff700 1 --2- 172.21.15.104:0/3997771133 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f133c060860 0x7f133c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:21.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.994+0000 7f1353fff700 1 -- 172.21.15.104:0/3997771133 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f134c07c030 con 0x7f135c06f350 2024-08-17T02:23:21.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.994+0000 7f1352ffd700 1 --2- 172.21.15.104:0/3997771133 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f133c060860 0x7f133c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:21.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:20.994+0000 7f1352ffd700 1 --2- 172.21.15.104:0/3997771133 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f133c060860 0x7f133c062d10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1344006d20 tx=0x7f1344009250 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:21.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:21.002+0000 7f1353fff700 1 -- 172.21.15.104:0/3997771133 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f134c04c480 con 0x7f135c06f350 2024-08-17T02:23:21.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:21.194+0000 7f1361e3e700 1 -- 172.21.15.104:0/3997771133 --> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "volume_0000000000188090", "target": ["mon-mgr", ""]}) v1 -- 0x7f135c06d7c0 con 0x7f133c060860 2024-08-17T02:23:23.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.306+0000 7f1353fff700 1 -- 172.21.15.104:0/3997771133 <== mgr.4111 v2:172.21.15.117:6832/24084 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) v1 ==== 60+0+0 (secure 0 0 0) 0x7f135c06d7c0 con 0x7f133c060860 2024-08-17T02:23:23.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.310+0000 7f1361e3e700 1 -- 172.21.15.104:0/3997771133 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f133c060860 msgr2=0x7f133c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:23.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.310+0000 7f1361e3e700 1 --2- 172.21.15.104:0/3997771133 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f133c060860 0x7f133c062d10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1344006d20 tx=0x7f1344009250 comp rx=0 tx=0).stop 2024-08-17T02:23:23.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.310+0000 7f1361e3e700 1 -- 172.21.15.104:0/3997771133 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f135c06f350 msgr2=0x7f135c099090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:23.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.310+0000 7f1361e3e700 1 --2- 172.21.15.104:0/3997771133 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f135c06f350 0x7f135c099090 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f134c00c7c0 tx=0x7f134c007f70 comp rx=0 tx=0).stop 2024-08-17T02:23:23.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.310+0000 7f1361e3e700 1 -- 172.21.15.104:0/3997771133 shutdown_connections 2024-08-17T02:23:23.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.310+0000 7f1361e3e700 1 --2- 172.21.15.104:0/3997771133 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f133c060860 0x7f133c062d10 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:23.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.310+0000 7f1361e3e700 1 --2- 172.21.15.104:0/3997771133 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f135c153cb0 0x7f135c151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:23.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.310+0000 7f1361e3e700 1 --2- 172.21.15.104:0/3997771133 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f135c1538e0 0x7f135c098690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:23.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.310+0000 7f1361e3e700 1 --2- 172.21.15.104:0/3997771133 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f135c06f350 0x7f135c099090 secure :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f134c00c7c0 tx=0x7f134c007f70 comp rx=0 tx=0).stop 2024-08-17T02:23:23.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.310+0000 7f1361e3e700 1 -- 172.21.15.104:0/3997771133 >> 172.21.15.104:0/3997771133 conn(0x7f135c066e00 msgr2=0x7f135c0af6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:23.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.314+0000 7f1361e3e700 1 -- 172.21.15.104:0/3997771133 shutdown_connections 2024-08-17T02:23:23.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.314+0000 7f1361e3e700 1 -- 172.21.15.104:0/3997771133 wait complete. 2024-08-17T02:23:23.322 INFO:teuthology.orchestra.run.smithi104.stderr:Volume created successfully (no MDS daemons created) 2024-08-17T02:23:23.335 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-08-17T02:23:23.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.430+0000 7f09ad1c3700 1 Processor -- start 2024-08-17T02:23:23.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.430+0000 7f09ad1c3700 1 -- start start 2024-08-17T02:23:23.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.430+0000 7f09ad1c3700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f09a8155d80 0x7f09a80aeee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:23.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.430+0000 7f09ad1c3700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09a80af420 0x7f09a80acb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:23.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.430+0000 7f09ad1c3700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f09a80ad090 0x7f09a81599d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:23.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.430+0000 7f09ad1c3700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09a80af850 con 0x7f09a8155d80 2024-08-17T02:23:23.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.430+0000 7f09ad1c3700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09a80ad8a0 con 0x7f09a80ad090 2024-08-17T02:23:23.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.430+0000 7f09ad1c3700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a80adb80 con 0x7f09a80af420 2024-08-17T02:23:23.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.430+0000 7f09a7fff700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f09a8155d80 0x7f09a80aeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:23.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.430+0000 7f09a7fff700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f09a8155d80 0x7f09a80aeee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51936/0 (socket says 172.21.15.104:51936) 2024-08-17T02:23:23.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.430+0000 7f09a7fff700 1 -- 172.21.15.104:0/3996016829 learned_addr learned my addr 172.21.15.104:0/3996016829 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:23.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.430+0000 7f09a77fe700 1 --2- 172.21.15.104:0/3996016829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09a80af420 0x7f09a80acb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:23.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.430+0000 7f09ac9c2700 1 --2- 172.21.15.104:0/3996016829 >> v2:172.21.15.117:3300/0 conn(0x7f09a80ad090 0x7f09a81599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:23.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.430+0000 7f09a7fff700 1 -- 172.21.15.104:0/3996016829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09a80af420 msgr2=0x7f09a80acb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:23.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.430+0000 7f09a7fff700 1 --2- 172.21.15.104:0/3996016829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09a80af420 0x7f09a80acb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:23.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.430+0000 7f09a7fff700 1 -- 172.21.15.104:0/3996016829 >> v2:172.21.15.117:3300/0 conn(0x7f09a80ad090 msgr2=0x7f09a81599d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:23.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.430+0000 7f09a7fff700 1 --2- 172.21.15.104:0/3996016829 >> v2:172.21.15.117:3300/0 conn(0x7f09a80ad090 0x7f09a81599d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:23.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.430+0000 7f09a7fff700 1 -- 172.21.15.104:0/3996016829 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a80ade60 con 0x7f09a8155d80 2024-08-17T02:23:23.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.430+0000 7f09a7fff700 1 --2- 172.21.15.104:0/3996016829 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09a8155d80 0x7f09a80aeee0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f09a80af9f0 tx=0x7f0998009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6425b385bdc4e40f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:23.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.430+0000 7f09a6ffd700 1 -- 172.21.15.104:0/3996016829 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099800b820 con 0x7f09a8155d80 2024-08-17T02:23:23.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.434+0000 7f09a6ffd700 1 -- 172.21.15.104:0/3996016829 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f099800b980 con 0x7f09a8155d80 2024-08-17T02:23:23.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.434+0000 7f09a6ffd700 1 -- 172.21.15.104:0/3996016829 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099800bd40 con 0x7f09a8155d80 2024-08-17T02:23:23.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.434+0000 7f09ad1c3700 1 -- 172.21.15.104:0/3996016829 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09a8155d80 msgr2=0x7f09a80aeee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:23.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.434+0000 7f09ad1c3700 1 --2- 172.21.15.104:0/3996016829 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09a8155d80 0x7f09a80aeee0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f09a80af9f0 tx=0x7f0998009250 comp rx=0 tx=0).stop 2024-08-17T02:23:23.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.434+0000 7f09ad1c3700 1 -- 172.21.15.104:0/3996016829 shutdown_connections 2024-08-17T02:23:23.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.434+0000 7f09ad1c3700 1 --2- 172.21.15.104:0/3996016829 >> v2:172.21.15.117:3300/0 conn(0x7f09a80ad090 0x7f09a81599d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:23.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.434+0000 7f09ad1c3700 1 --2- 172.21.15.104:0/3996016829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09a80af420 0x7f09a80acb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:23.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.434+0000 7f09ad1c3700 1 --2- 172.21.15.104:0/3996016829 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09a8155d80 0x7f09a80aeee0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:23.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.434+0000 7f09ad1c3700 1 -- 172.21.15.104:0/3996016829 >> 172.21.15.104:0/3996016829 conn(0x7f09a806e070 msgr2=0x7f09a80b1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:23.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.434+0000 7f09ad1c3700 1 -- 172.21.15.104:0/3996016829 shutdown_connections 2024-08-17T02:23:23.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.434+0000 7f09ad1c3700 1 -- 172.21.15.104:0/3996016829 wait complete. 2024-08-17T02:23:23.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.434+0000 7f09ad1c3700 1 Processor -- start 2024-08-17T02:23:23.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.434+0000 7f09ad1c3700 1 -- start start 2024-08-17T02:23:23.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.438+0000 7f09ad1c3700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09a80ad090 0x7f09a8158db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:23.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.438+0000 7f09ad1c3700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09a80af420 0x7f09a806ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:23.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.438+0000 7f09ad1c3700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09a8155d80 0x7f09a8147630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:23.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.438+0000 7f09ad1c3700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a815a930 con 0x7f09a80af420 2024-08-17T02:23:23.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.438+0000 7f09ad1c3700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a8159d20 con 0x7f09a80ad090 2024-08-17T02:23:23.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.438+0000 7f09ad1c3700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a815a000 con 0x7f09a8155d80 2024-08-17T02:23:23.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.438+0000 7f09a77fe700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09a80af420 0x7f09a806ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:23.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.438+0000 7f09a77fe700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09a80af420 0x7f09a806ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51944/0 (socket says 172.21.15.104:51944) 2024-08-17T02:23:23.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.438+0000 7f09a77fe700 1 -- 172.21.15.104:0/2661247988 learned_addr learned my addr 172.21.15.104:0/2661247988 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:23.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.438+0000 7f09a7fff700 1 --2- 172.21.15.104:0/2661247988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09a80ad090 0x7f09a8158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:23.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.438+0000 7f09ac9c2700 1 --2- 172.21.15.104:0/2661247988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09a8155d80 0x7f09a8147630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:23.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.438+0000 7f09a77fe700 1 -- 172.21.15.104:0/2661247988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09a8155d80 msgr2=0x7f09a8147630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:23.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.438+0000 7f09a77fe700 1 --2- 172.21.15.104:0/2661247988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09a8155d80 0x7f09a8147630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:23.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.438+0000 7f09a77fe700 1 -- 172.21.15.104:0/2661247988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09a80ad090 msgr2=0x7f09a8158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:23.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.438+0000 7f09a77fe700 1 --2- 172.21.15.104:0/2661247988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09a80ad090 0x7f09a8158db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:23.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.438+0000 7f09a77fe700 1 -- 172.21.15.104:0/2661247988 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09980094f0 con 0x7f09a80af420 2024-08-17T02:23:23.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.438+0000 7f09a77fe700 1 --2- 172.21.15.104:0/2661247988 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09a80af420 0x7f09a806ae50 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f099c00d890 tx=0x7f099c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:23.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.438+0000 7f098ffff700 1 -- 172.21.15.104:0/2661247988 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099c0125f0 con 0x7f09a80af420 2024-08-17T02:23:23.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.438+0000 7f098ffff700 1 -- 172.21.15.104:0/2661247988 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f099c012770 con 0x7f09a80af420 2024-08-17T02:23:23.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.438+0000 7f09ad1c3700 1 -- 172.21.15.104:0/2661247988 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09a815a2e0 con 0x7f09a80af420 2024-08-17T02:23:23.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.438+0000 7f098ffff700 1 -- 172.21.15.104:0/2661247988 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099c012b30 con 0x7f09a80af420 2024-08-17T02:23:23.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.438+0000 7f09ad1c3700 1 -- 172.21.15.104:0/2661247988 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09a815adc0 con 0x7f09a80af420 2024-08-17T02:23:23.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.438+0000 7f09ad1c3700 1 -- 172.21.15.104:0/2661247988 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09a80638f0 con 0x7f09a80af420 2024-08-17T02:23:23.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.442+0000 7f098ffff700 1 -- 172.21.15.104:0/2661247988 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f099c01e460 con 0x7f09a80af420 2024-08-17T02:23:23.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.442+0000 7f098ffff700 1 --2- 172.21.15.104:0/2661247988 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f0994060860 0x7f0994062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:23.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.442+0000 7f098ffff700 1 -- 172.21.15.104:0/2661247988 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f099c07d5a0 con 0x7f09a80af420 2024-08-17T02:23:23.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.442+0000 7f09a7fff700 1 --2- 172.21.15.104:0/2661247988 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f0994060860 0x7f0994062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:23.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.442+0000 7f09a7fff700 1 --2- 172.21.15.104:0/2661247988 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f0994060860 0x7f0994062d10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f09a80af9f0 tx=0x7f0998016000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:23.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.450+0000 7f098ffff700 1 -- 172.21.15.104:0/2661247988 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f099c051060 con 0x7f09a80af420 2024-08-17T02:23:23.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.638+0000 7f09ad1c3700 1 -- 172.21.15.104:0/2661247988 --> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f09a81552c0 con 0x7f0994060860 2024-08-17T02:23:23.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.642+0000 7f098ffff700 1 -- 172.21.15.104:0/2661247988 <== mgr.4111 v2:172.21.15.117:6832/24084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+96 (secure 0 0 0) 0x7f09a81552c0 con 0x7f0994060860 2024-08-17T02:23:23.647 INFO:teuthology.orchestra.run.smithi104.stdout:[ 2024-08-17T02:23:23.647 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-08-17T02:23:23.647 INFO:teuthology.orchestra.run.smithi104.stdout: "name": "cephfs" 2024-08-17T02:23:23.647 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-08-17T02:23:23.648 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-08-17T02:23:23.648 INFO:teuthology.orchestra.run.smithi104.stdout: "name": "volume_0000000000188090" 2024-08-17T02:23:23.648 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-08-17T02:23:23.648 INFO:teuthology.orchestra.run.smithi104.stdout:] 2024-08-17T02:23:23.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.642+0000 7f09ad1c3700 1 -- 172.21.15.104:0/2661247988 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f0994060860 msgr2=0x7f0994062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:23.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.642+0000 7f09ad1c3700 1 --2- 172.21.15.104:0/2661247988 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f0994060860 0x7f0994062d10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f09a80af9f0 tx=0x7f0998016000 comp rx=0 tx=0).stop 2024-08-17T02:23:23.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.642+0000 7f09ad1c3700 1 -- 172.21.15.104:0/2661247988 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09a80af420 msgr2=0x7f09a806ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:23.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.642+0000 7f09ad1c3700 1 --2- 172.21.15.104:0/2661247988 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09a80af420 0x7f09a806ae50 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f099c00d890 tx=0x7f099c008040 comp rx=0 tx=0).stop 2024-08-17T02:23:23.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.642+0000 7f09ad1c3700 1 -- 172.21.15.104:0/2661247988 shutdown_connections 2024-08-17T02:23:23.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.642+0000 7f09ad1c3700 1 --2- 172.21.15.104:0/2661247988 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f0994060860 0x7f0994062d10 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:23.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.642+0000 7f09ad1c3700 1 --2- 172.21.15.104:0/2661247988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09a8155d80 0x7f09a8147630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:23.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.642+0000 7f09ad1c3700 1 --2- 172.21.15.104:0/2661247988 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09a80af420 0x7f09a806ae50 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:23.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.642+0000 7f09ad1c3700 1 --2- 172.21.15.104:0/2661247988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09a80ad090 0x7f09a8158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:23.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.642+0000 7f09ad1c3700 1 -- 172.21.15.104:0/2661247988 >> 172.21.15.104:0/2661247988 conn(0x7f09a806e070 msgr2=0x7f09a80b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:23.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.642+0000 7f09ad1c3700 1 -- 172.21.15.104:0/2661247988 shutdown_connections 2024-08-17T02:23:23.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.642+0000 7f09ad1c3700 1 -- 172.21.15.104:0/2661247988 wait complete. 2024-08-17T02:23:23.662 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool ls detail --format=json 2024-08-17T02:23:23.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.770+0000 7f0f15979700 1 Processor -- start 2024-08-17T02:23:23.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.770+0000 7f0f15979700 1 -- start start 2024-08-17T02:23:23.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.770+0000 7f0f15979700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f101514d0 0x7f0f1006ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:23.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.770+0000 7f0f15979700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f0f101574f0 0x7f0f10157960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:23.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.770+0000 7f0f15979700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f1006e010 con 0x7f0f100b0d90 2024-08-17T02:23:23.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.770+0000 7f0f15979700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f1006efa0 con 0x7f0f101574f0 2024-08-17T02:23:23.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.770+0000 7f0f15979700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f10157fb0 con 0x7f0f101514d0 2024-08-17T02:23:23.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.774+0000 7f0f07fff700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f0f101574f0 0x7f0f10157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:23.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.774+0000 7f0f07fff700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f0f101574f0 0x7f0f10157960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51954/0 (socket says 172.21.15.104:51954) 2024-08-17T02:23:23.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.774+0000 7f0f07fff700 1 -- 172.21.15.104:0/3825036498 learned_addr learned my addr 172.21.15.104:0/3825036498 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:23.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.774+0000 7f0f14977700 1 --2- 172.21.15.104:0/3825036498 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f101514d0 0x7f0f1006ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:23.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.774+0000 7f0f07fff700 1 -- 172.21.15.104:0/3825036498 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f101514d0 msgr2=0x7f0f1006ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:23:23.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.774+0000 7f0f07fff700 1 --2- 172.21.15.104:0/3825036498 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f101514d0 0x7f0f1006ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:23.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.774+0000 7f0f07fff700 1 -- 172.21.15.104:0/3825036498 >> v1:172.21.15.117:6789/0 conn(0x7f0f100b0d90 legacy=0x7f0f100c96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:23.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.774+0000 7f0f07fff700 1 -- 172.21.15.104:0/3825036498 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f10158290 con 0x7f0f101574f0 2024-08-17T02:23:23.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.774+0000 7f0f07fff700 1 --2- 172.21.15.104:0/3825036498 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f101574f0 0x7f0f10157960 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0f000099b0 tx=0x7f0f00009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=341edbe95b74c6c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:23.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.774+0000 7f0f077fe700 1 -- 172.21.15.104:0/3825036498 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f00009ea0 con 0x7f0f101574f0 2024-08-17T02:23:23.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.774+0000 7f0f077fe700 1 -- 172.21.15.104:0/3825036498 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f0000b860 con 0x7f0f101574f0 2024-08-17T02:23:23.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.774+0000 7f0f077fe700 1 -- 172.21.15.104:0/3825036498 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0000bc00 con 0x7f0f101574f0 2024-08-17T02:23:23.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.774+0000 7f0f15979700 1 -- 172.21.15.104:0/3825036498 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f101574f0 msgr2=0x7f0f10157960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:23.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.774+0000 7f0f15979700 1 --2- 172.21.15.104:0/3825036498 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f101574f0 0x7f0f10157960 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0f000099b0 tx=0x7f0f00009250 comp rx=0 tx=0).stop 2024-08-17T02:23:23.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.774+0000 7f0f15979700 1 -- 172.21.15.104:0/3825036498 shutdown_connections 2024-08-17T02:23:23.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.774+0000 7f0f15979700 1 --2- 172.21.15.104:0/3825036498 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f101574f0 0x7f0f10157960 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:23.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.774+0000 7f0f15979700 1 --2- 172.21.15.104:0/3825036498 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f101514d0 0x7f0f1006ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:23.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.774+0000 7f0f15979700 1 -- 172.21.15.104:0/3825036498 >> 172.21.15.104:0/3825036498 conn(0x7f0f100678a0 msgr2=0x7f0f10067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:23.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.774+0000 7f0f15979700 1 -- 172.21.15.104:0/3825036498 shutdown_connections 2024-08-17T02:23:23.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.774+0000 7f0f15979700 1 -- 172.21.15.104:0/3825036498 wait complete. 2024-08-17T02:23:23.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.778+0000 7f0f15979700 1 Processor -- start 2024-08-17T02:23:23.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.778+0000 7f0f15979700 1 -- start start 2024-08-17T02:23:23.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.782+0000 7f0f15979700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f100b0d90 0x7f0f10149b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:23.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.782+0000 7f0f15979700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f101514d0 0x7f0f101518a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:23.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.782+0000 7f0f15979700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f101574f0 0x7f0f1014e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:23.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.782+0000 7f0f15979700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1014a0a0 con 0x7f0f101574f0 2024-08-17T02:23:23.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.782+0000 7f0f15979700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1014a220 con 0x7f0f100b0d90 2024-08-17T02:23:23.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.782+0000 7f0f15979700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1014a500 con 0x7f0f101514d0 2024-08-17T02:23:23.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.782+0000 7f0f15178700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f101574f0 0x7f0f1014e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:23.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.782+0000 7f0f15178700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f101574f0 0x7f0f1014e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51960/0 (socket says 172.21.15.104:51960) 2024-08-17T02:23:23.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.782+0000 7f0f15178700 1 -- 172.21.15.104:0/3536844354 learned_addr learned my addr 172.21.15.104:0/3536844354 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:23.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.782+0000 7f0f14977700 1 --2- 172.21.15.104:0/3536844354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f100b0d90 0x7f0f10149b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:23.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.782+0000 7f0f07fff700 1 --2- 172.21.15.104:0/3536844354 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f101514d0 0x7f0f101518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:23.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.782+0000 7f0f15178700 1 -- 172.21.15.104:0/3536844354 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f101514d0 msgr2=0x7f0f101518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:23.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.782+0000 7f0f15178700 1 --2- 172.21.15.104:0/3536844354 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f101514d0 0x7f0f101518a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:23.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.782+0000 7f0f15178700 1 -- 172.21.15.104:0/3536844354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f100b0d90 msgr2=0x7f0f10149b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:23.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.782+0000 7f0f15178700 1 --2- 172.21.15.104:0/3536844354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f100b0d90 0x7f0f10149b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:23.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.782+0000 7f0f15178700 1 -- 172.21.15.104:0/3536844354 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f000094f0 con 0x7f0f101574f0 2024-08-17T02:23:23.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.782+0000 7f0f07fff700 1 --2- 172.21.15.104:0/3536844354 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f101514d0 0x7f0f101518a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:23:23.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.782+0000 7f0f15178700 1 --2- 172.21.15.104:0/3536844354 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f101574f0 0x7f0f1014e780 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0f0800c910 tx=0x7f0f08001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:23.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.782+0000 7f0f04ff9700 1 -- 172.21.15.104:0/3536844354 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f08012630 con 0x7f0f101574f0 2024-08-17T02:23:23.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.782+0000 7f0f04ff9700 1 -- 172.21.15.104:0/3536844354 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f080127b0 con 0x7f0f101574f0 2024-08-17T02:23:23.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.782+0000 7f0f15979700 1 -- 172.21.15.104:0/3536844354 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f10152210 con 0x7f0f101574f0 2024-08-17T02:23:23.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.782+0000 7f0f04ff9700 1 -- 172.21.15.104:0/3536844354 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f08012b70 con 0x7f0f101574f0 2024-08-17T02:23:23.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.782+0000 7f0f15979700 1 -- 172.21.15.104:0/3536844354 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f101527d0 con 0x7f0f101574f0 2024-08-17T02:23:23.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.782+0000 7f0f15979700 1 -- 172.21.15.104:0/3536844354 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f10064330 con 0x7f0f101574f0 2024-08-17T02:23:23.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.786+0000 7f0f04ff9700 1 -- 172.21.15.104:0/3536844354 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f0f08003030 con 0x7f0f101574f0 2024-08-17T02:23:23.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.786+0000 7f0f04ff9700 1 --2- 172.21.15.104:0/3536844354 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f0efc060860 0x7f0efc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:23.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.786+0000 7f0f04ff9700 1 -- 172.21.15.104:0/3536844354 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f0f0807cec0 con 0x7f0f101574f0 2024-08-17T02:23:23.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.786+0000 7f0f14977700 1 --2- 172.21.15.104:0/3536844354 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f0efc060860 0x7f0efc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:23.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.786+0000 7f0f14977700 1 --2- 172.21.15.104:0/3536844354 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f0efc060860 0x7f0efc062d10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c009db0 tx=0x7f0f0c0091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:23.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.794+0000 7f0f04ff9700 1 -- 172.21.15.104:0/3536844354 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f0f0804cef0 con 0x7f0f101574f0 2024-08-17T02:23:23.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.962+0000 7f0f15979700 1 -- 172.21.15.104:0/3536844354 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool ls", "detail": "detail", "format": "json"} v 0) v1 -- 0x7f0f1014a640 con 0x7f0f101574f0 2024-08-17T02:23:23.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.962+0000 7f0f04ff9700 1 -- 172.21.15.104:0/3536844354 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool ls", "detail": "detail", "format": "json"}]=0 v37) v1 ==== 97+0+8050 (secure 0 0 0) 0x7f0f08050510 con 0x7f0f101574f0 2024-08-17T02:23:23.968 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:23:23.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.966+0000 7f0f15979700 1 -- 172.21.15.104:0/3536844354 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f0efc060860 msgr2=0x7f0efc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:23.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.966+0000 7f0f15979700 1 --2- 172.21.15.104:0/3536844354 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f0efc060860 0x7f0efc062d10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c009db0 tx=0x7f0f0c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:23:23.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.966+0000 7f0f15979700 1 -- 172.21.15.104:0/3536844354 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f101574f0 msgr2=0x7f0f1014e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:23.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.966+0000 7f0f15979700 1 --2- 172.21.15.104:0/3536844354 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f101574f0 0x7f0f1014e780 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0f0800c910 tx=0x7f0f08001710 comp rx=0 tx=0).stop 2024-08-17T02:23:23.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.966+0000 7f0f15979700 1 -- 172.21.15.104:0/3536844354 shutdown_connections 2024-08-17T02:23:23.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.966+0000 7f0f15979700 1 --2- 172.21.15.104:0/3536844354 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f0efc060860 0x7f0efc062d10 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:23.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.966+0000 7f0f15979700 1 --2- 172.21.15.104:0/3536844354 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f101574f0 0x7f0f1014e780 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:23.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.966+0000 7f0f15979700 1 --2- 172.21.15.104:0/3536844354 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f101514d0 0x7f0f101518a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:23.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.966+0000 7f0f15979700 1 --2- 172.21.15.104:0/3536844354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f100b0d90 0x7f0f10149b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:23.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.966+0000 7f0f15979700 1 -- 172.21.15.104:0/3536844354 >> 172.21.15.104:0/3536844354 conn(0x7f0f100678a0 msgr2=0x7f0f100b1210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:23.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.966+0000 7f0f15979700 1 -- 172.21.15.104:0/3536844354 shutdown_connections 2024-08-17T02:23:23.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:23.966+0000 7f0f15979700 1 -- 172.21.15.104:0/3536844354 wait complete. 2024-08-17T02:23:23.985 INFO:teuthology.orchestra.run.smithi104.stdout:[{"pool_id":1,"pool_name":".mgr","create_time":"2024-08-17T02:22:10.143970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool_id":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:23:03.390787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool_id":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:23:04.462361+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool_id":6,"pool_name":"cephfs.volume_0000000000188090.meta","create_time":"2024-08-17T02:23:21.239436+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000188090"}}},{"pool_id":7,"pool_name":"cephfs.volume_0000000000188090.data","create_time":"2024-08-17T02:23:21.337636+0000","flags":163841,"flags_names":"hashpspool,creating,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000188090"}}}] 2024-08-17T02:23:23.986 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs get volume_0000000000188090 --format=json 2024-08-17T02:23:24.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.086+0000 7f57b6acd700 1 Processor -- start 2024-08-17T02:23:24.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.086+0000 7f57b6acd700 1 -- start start 2024-08-17T02:23:24.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.090+0000 7f57b6acd700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f57b00b14a0 0x7f57b00cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:24.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.090+0000 7f57b6acd700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57b00cbaa0 con 0x7f57b00cb390 2024-08-17T02:23:24.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.090+0000 7f57b6acd700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57b0157630 con 0x7f57b0154900 2024-08-17T02:23:24.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.090+0000 7f57b6acd700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b0068790 con 0x7f57b00b14a0 2024-08-17T02:23:24.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.090+0000 7f57b62cc700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f57b00cb390 0x7f57b0160ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:39006/0 (socket says 172.21.15.104:39006) 2024-08-17T02:23:24.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.090+0000 7f57b62cc700 1 -- 172.21.15.104:0/2678362043 learned_addr learned my addr 172.21.15.104:0/2678362043 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:23:24.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.090+0000 7f57b52ca700 1 --2- 172.21.15.104:0/2678362043 >> v2:172.21.15.117:3300/0 conn(0x7f57b00b14a0 0x7f57b00cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:24.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.090+0000 7f57b4ac9700 1 -- 172.21.15.104:0/2678362043 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2136135125 0 0) 0x7f57b00cbaa0 con 0x7f57b00cb390 2024-08-17T02:23:24.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.090+0000 7f57b4ac9700 1 -- 172.21.15.104:0/2678362043 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5798003570 con 0x7f57b00cb390 2024-08-17T02:23:24.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.090+0000 7f57b52ca700 1 -- 172.21.15.104:0/2678362043 >> v1:172.21.15.117:6789/0 conn(0x7f57b0154900 legacy=0x7f57b00b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:24.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.090+0000 7f57b52ca700 1 -- 172.21.15.104:0/2678362043 >> v1:172.21.15.104:6789/0 conn(0x7f57b00cb390 legacy=0x7f57b0160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:24.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.090+0000 7f57b52ca700 1 -- 172.21.15.104:0/2678362043 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b0157910 con 0x7f57b00b14a0 2024-08-17T02:23:24.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.090+0000 7f57b52ca700 1 --2- 172.21.15.104:0/2678362043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57b00b14a0 0x7f57b00cae50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f57ac009e60 tx=0x7f57ac009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fdd52a15743dfb4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:24.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.090+0000 7f57b4ac9700 1 -- 172.21.15.104:0/2678362043 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac00e070 con 0x7f57b00b14a0 2024-08-17T02:23:24.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.090+0000 7f57b4ac9700 1 -- 172.21.15.104:0/2678362043 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ac00bb60 con 0x7f57b00b14a0 2024-08-17T02:23:24.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.090+0000 7f57b4ac9700 1 -- 172.21.15.104:0/2678362043 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac012430 con 0x7f57b00b14a0 2024-08-17T02:23:24.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.090+0000 7f57b6acd700 1 -- 172.21.15.104:0/2678362043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57b00b14a0 msgr2=0x7f57b00cae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:24.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.090+0000 7f57b6acd700 1 --2- 172.21.15.104:0/2678362043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57b00b14a0 0x7f57b00cae50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f57ac009e60 tx=0x7f57ac009780 comp rx=0 tx=0).stop 2024-08-17T02:23:24.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.090+0000 7f57b6acd700 1 -- 172.21.15.104:0/2678362043 shutdown_connections 2024-08-17T02:23:24.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.090+0000 7f57b6acd700 1 --2- 172.21.15.104:0/2678362043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57b00b14a0 0x7f57b00cae50 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:24.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.090+0000 7f57b6acd700 1 -- 172.21.15.104:0/2678362043 >> 172.21.15.104:0/2678362043 conn(0x7f57b00678d0 msgr2=0x7f57b0067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:24.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.090+0000 7f57b6acd700 1 -- 172.21.15.104:0/2678362043 shutdown_connections 2024-08-17T02:23:24.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.090+0000 7f57b6acd700 1 -- 172.21.15.104:0/2678362043 wait complete. 2024-08-17T02:23:24.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.094+0000 7f57b6acd700 1 Processor -- start 2024-08-17T02:23:24.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.094+0000 7f57b6acd700 1 -- start start 2024-08-17T02:23:24.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.094+0000 7f57b6acd700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57b00b14a0 0x7f57b014ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:24.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.094+0000 7f57b6acd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f57b00cb390 0x7f57b0169980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:24.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.094+0000 7f57b6acd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57b0154900 0x7f57b0155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:24.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.094+0000 7f57b6acd700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b0150450 con 0x7f57b00cb390 2024-08-17T02:23:24.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.094+0000 7f57b6acd700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b016c560 con 0x7f57b0154900 2024-08-17T02:23:24.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.094+0000 7f57b6acd700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b0169ec0 con 0x7f57b00b14a0 2024-08-17T02:23:24.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.094+0000 7f57b52ca700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f57b00cb390 0x7f57b0169980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:24.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.094+0000 7f57b52ca700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f57b00cb390 0x7f57b0169980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51974/0 (socket says 172.21.15.104:51974) 2024-08-17T02:23:24.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.094+0000 7f57b52ca700 1 -- 172.21.15.104:0/2457373907 learned_addr learned my addr 172.21.15.104:0/2457373907 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:24.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.094+0000 7f57b5acb700 1 --2- 172.21.15.104:0/2457373907 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57b00b14a0 0x7f57b014ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:24.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.094+0000 7f57b62cc700 1 --2- 172.21.15.104:0/2457373907 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57b0154900 0x7f57b0155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:24.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.094+0000 7f57b52ca700 1 -- 172.21.15.104:0/2457373907 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57b00b14a0 msgr2=0x7f57b014ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:24.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.094+0000 7f57b52ca700 1 --2- 172.21.15.104:0/2457373907 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57b00b14a0 0x7f57b014ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:24.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.094+0000 7f57b52ca700 1 -- 172.21.15.104:0/2457373907 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57b0154900 msgr2=0x7f57b0155ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:24.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.094+0000 7f57b52ca700 1 --2- 172.21.15.104:0/2457373907 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57b0154900 0x7f57b0155ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:24.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.094+0000 7f57b52ca700 1 -- 172.21.15.104:0/2457373907 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57ac009a20 con 0x7f57b00cb390 2024-08-17T02:23:24.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.094+0000 7f57b62cc700 1 --2- 172.21.15.104:0/2457373907 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57b0154900 0x7f57b0155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:23:24.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.094+0000 7f57b52ca700 1 --2- 172.21.15.104:0/2457373907 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f57b00cb390 0x7f57b0169980 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f57b006c2d0 tx=0x7f57ac019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:24.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.094+0000 7f57a5ffb700 1 -- 172.21.15.104:0/2457373907 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac012cb0 con 0x7f57b00cb390 2024-08-17T02:23:24.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.094+0000 7f57a5ffb700 1 -- 172.21.15.104:0/2457373907 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ac012e10 con 0x7f57b00cb390 2024-08-17T02:23:24.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.094+0000 7f57b6acd700 1 -- 172.21.15.104:0/2457373907 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57b0150830 con 0x7f57b00cb390 2024-08-17T02:23:24.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.094+0000 7f57a5ffb700 1 -- 172.21.15.104:0/2457373907 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac0276c0 con 0x7f57b00cb390 2024-08-17T02:23:24.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.094+0000 7f57b6acd700 1 -- 172.21.15.104:0/2457373907 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57b016c7b0 con 0x7f57b00cb390 2024-08-17T02:23:24.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.098+0000 7f57b6acd700 1 -- 172.21.15.104:0/2457373907 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57b00643a0 con 0x7f57b00cb390 2024-08-17T02:23:24.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.098+0000 7f57a5ffb700 1 -- 172.21.15.104:0/2457373907 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f57ac024070 con 0x7f57b00cb390 2024-08-17T02:23:24.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.098+0000 7f57a5ffb700 1 --2- 172.21.15.104:0/2457373907 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f579c060860 0x7f579c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:24.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.098+0000 7f57a5ffb700 1 -- 172.21.15.104:0/2457373907 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f57ac07f4d0 con 0x7f57b00cb390 2024-08-17T02:23:24.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.098+0000 7f57b5acb700 1 --2- 172.21.15.104:0/2457373907 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f579c060860 0x7f579c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:24.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.098+0000 7f57b5acb700 1 --2- 172.21.15.104:0/2457373907 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f579c060860 0x7f579c062d10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f57b0156940 tx=0x7f57a0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:24.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.106+0000 7f57a5ffb700 1 -- 172.21.15.104:0/2457373907 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f57ac04f5a0 con 0x7f57b00cb390 2024-08-17T02:23:24.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.318+0000 7f57b6acd700 1 -- 172.21.15.104:0/2457373907 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs get", "fs_name": "volume_0000000000188090", "format": "json"} v 0) v1 -- 0x7f57b006f5f0 con 0x7f57b00cb390 2024-08-17T02:23:24.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.318+0000 7f57a5ffb700 1 -- 172.21.15.104:0/2457373907 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs get", "fs_name": "volume_0000000000188090", "format": "json"}]=0 v18) v1 ==== 110+0+1847 (secure 0 0 0) 0x7f57ac052bc0 con 0x7f57b00cb390 2024-08-17T02:23:24.325 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:23:24.326 INFO:teuthology.orchestra.run.smithi104.stdout:{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:23:22.321122+0000","modified":"2024-08-17T02:23:24.304353+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4959},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4959":{"gid":4959,"name":"c","rank":0,"incarnation":16,"state":"up:active","state_seq":8,"addr":"172.21.15.104:6833/4148924116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":4148924116},{"type":"v1","addr":"172.21.15.104:6833","nonce":4148924116}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000188090","balancer":"","standby_count_wanted":1},"id":3} 2024-08-17T02:23:24.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.322+0000 7f57b6acd700 1 -- 172.21.15.104:0/2457373907 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f579c060860 msgr2=0x7f579c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:24.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.322+0000 7f57b6acd700 1 --2- 172.21.15.104:0/2457373907 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f579c060860 0x7f579c062d10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f57b0156940 tx=0x7f57a0009040 comp rx=0 tx=0).stop 2024-08-17T02:23:24.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.322+0000 7f57b6acd700 1 -- 172.21.15.104:0/2457373907 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f57b00cb390 msgr2=0x7f57b0169980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:24.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.322+0000 7f57b6acd700 1 --2- 172.21.15.104:0/2457373907 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f57b00cb390 0x7f57b0169980 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f57b006c2d0 tx=0x7f57ac019000 comp rx=0 tx=0).stop 2024-08-17T02:23:24.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.322+0000 7f57b6acd700 1 -- 172.21.15.104:0/2457373907 shutdown_connections 2024-08-17T02:23:24.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.322+0000 7f57b6acd700 1 --2- 172.21.15.104:0/2457373907 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f579c060860 0x7f579c062d10 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:24.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.322+0000 7f57b6acd700 1 --2- 172.21.15.104:0/2457373907 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57b0154900 0x7f57b0155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:24.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.322+0000 7f57b6acd700 1 --2- 172.21.15.104:0/2457373907 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f57b00cb390 0x7f57b0169980 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:24.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.322+0000 7f57b6acd700 1 --2- 172.21.15.104:0/2457373907 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57b00b14a0 0x7f57b014ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:24.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.322+0000 7f57b6acd700 1 -- 172.21.15.104:0/2457373907 >> 172.21.15.104:0/2457373907 conn(0x7f57b00678d0 msgr2=0x7f57b006d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:24.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.322+0000 7f57b6acd700 1 -- 172.21.15.104:0/2457373907 shutdown_connections 2024-08-17T02:23:24.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.322+0000 7f57b6acd700 1 -- 172.21.15.104:0/2457373907 wait complete. 2024-08-17T02:23:24.338 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000188090 --yes-i-really-mean-it 2024-08-17T02:23:24.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.442+0000 7f9c1df68700 1 Processor -- start 2024-08-17T02:23:24.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.442+0000 7f9c1df68700 1 -- start start 2024-08-17T02:23:24.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.442+0000 7f9c1df68700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f9c181501b0 0x7f9c18150580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:24.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.442+0000 7f9c1df68700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c1815a3b0 con 0x7f9c180686a0 2024-08-17T02:23:24.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.442+0000 7f9c1df68700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c18159ac0 con 0x7f9c180ab860 2024-08-17T02:23:24.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.442+0000 7f9c1df68700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c18159d60 con 0x7f9c181501b0 2024-08-17T02:23:24.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.442+0000 7f9c1cf66700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f9c181501b0 0x7f9c18150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:24.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.442+0000 7f9c1cf66700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f9c181501b0 0x7f9c18150580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51982/0 (socket says 172.21.15.104:51982) 2024-08-17T02:23:24.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.442+0000 7f9c1cf66700 1 -- 172.21.15.104:0/1190529512 learned_addr learned my addr 172.21.15.104:0/1190529512 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:24.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.442+0000 7f9c1cf66700 1 -- 172.21.15.104:0/1190529512 >> v1:172.21.15.117:6789/0 conn(0x7f9c180ab860 legacy=0x7f9c18156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:24.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.442+0000 7f9c1cf66700 1 -- 172.21.15.104:0/1190529512 >> v1:172.21.15.104:6789/0 conn(0x7f9c180686a0 legacy=0x7f9c180af540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:24.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.442+0000 7f9c1cf66700 1 -- 172.21.15.104:0/1190529512 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c1815a040 con 0x7f9c181501b0 2024-08-17T02:23:24.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.442+0000 7f9c1cf66700 1 --2- 172.21.15.104:0/1190529512 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c181501b0 0x7f9c18150580 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c0099b0 tx=0x7f9c0c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97e5dd21089c35e4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:24.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.446+0000 7f9c177fe700 1 -- 172.21.15.104:0/1190529512 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c00b860 con 0x7f9c181501b0 2024-08-17T02:23:24.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.446+0000 7f9c177fe700 1 -- 172.21.15.104:0/1190529512 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c0c00b9c0 con 0x7f9c181501b0 2024-08-17T02:23:24.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.446+0000 7f9c177fe700 1 -- 172.21.15.104:0/1190529512 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c00bd60 con 0x7f9c181501b0 2024-08-17T02:23:24.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.446+0000 7f9c1df68700 1 -- 172.21.15.104:0/1190529512 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c181501b0 msgr2=0x7f9c18150580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:24.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.446+0000 7f9c1df68700 1 --2- 172.21.15.104:0/1190529512 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c181501b0 0x7f9c18150580 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c0099b0 tx=0x7f9c0c009250 comp rx=0 tx=0).stop 2024-08-17T02:23:24.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.446+0000 7f9c1df68700 1 -- 172.21.15.104:0/1190529512 shutdown_connections 2024-08-17T02:23:24.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.446+0000 7f9c1df68700 1 --2- 172.21.15.104:0/1190529512 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c181501b0 0x7f9c18150580 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:24.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.446+0000 7f9c1df68700 1 -- 172.21.15.104:0/1190529512 >> 172.21.15.104:0/1190529512 conn(0x7f9c1806e350 msgr2=0x7f9c1806b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:23:24.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.446+0000 7f9c1df68700 1 -- 172.21.15.104:0/1190529512 shutdown_connections 2024-08-17T02:23:24.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.446+0000 7f9c1df68700 1 -- 172.21.15.104:0/1190529512 wait complete. 2024-08-17T02:23:24.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.446+0000 7f9c1df68700 1 Processor -- start 2024-08-17T02:23:24.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.446+0000 7f9c1df68700 1 -- start start 2024-08-17T02:23:24.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.446+0000 7f9c1df68700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c180686a0 0x7f9c1814f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:24.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.450+0000 7f9c1df68700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c180ab860 0x7f9c18141f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:24.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.450+0000 7f9c1df68700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c181501b0 0x7f9c1806a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:24.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.450+0000 7f9c1df68700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c18158820 con 0x7f9c180686a0 2024-08-17T02:23:24.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.450+0000 7f9c1df68700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1814b560 con 0x7f9c180ab860 2024-08-17T02:23:24.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.450+0000 7f9c1df68700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1814b840 con 0x7f9c181501b0 2024-08-17T02:23:24.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.450+0000 7f9c1cf66700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c180686a0 0x7f9c1814f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:24.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.450+0000 7f9c1cf66700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c180686a0 0x7f9c1814f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51990/0 (socket says 172.21.15.104:51990) 2024-08-17T02:23:24.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.450+0000 7f9c1cf66700 1 -- 172.21.15.104:0/2069795730 learned_addr learned my addr 172.21.15.104:0/2069795730 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:23:24.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.450+0000 7f9c17fff700 1 --2- 172.21.15.104:0/2069795730 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c180ab860 0x7f9c18141f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:24.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.450+0000 7f9c1d767700 1 --2- 172.21.15.104:0/2069795730 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c181501b0 0x7f9c1806a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:24.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.450+0000 7f9c1cf66700 1 -- 172.21.15.104:0/2069795730 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c181501b0 msgr2=0x7f9c1806a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:24.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.450+0000 7f9c1cf66700 1 --2- 172.21.15.104:0/2069795730 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c181501b0 0x7f9c1806a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:24.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.450+0000 7f9c1cf66700 1 -- 172.21.15.104:0/2069795730 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c180ab860 msgr2=0x7f9c18141f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:23:24.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.450+0000 7f9c1cf66700 1 --2- 172.21.15.104:0/2069795730 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c180ab860 0x7f9c18141f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:23:24.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.450+0000 7f9c1cf66700 1 -- 172.21.15.104:0/2069795730 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c0c0094f0 con 0x7f9c180686a0 2024-08-17T02:23:24.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.450+0000 7f9c17fff700 1 --2- 172.21.15.104:0/2069795730 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c180ab860 0x7f9c18141f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:23:24.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.450+0000 7f9c1d767700 1 --2- 172.21.15.104:0/2069795730 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c181501b0 0x7f9c1806a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:23:24.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.450+0000 7f9c1cf66700 1 --2- 172.21.15.104:0/2069795730 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c180686a0 0x7f9c1814f2a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9c18064c90 tx=0x7f9c0c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:24.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.450+0000 7f9c14ff9700 1 -- 172.21.15.104:0/2069795730 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c011ea0 con 0x7f9c180686a0 2024-08-17T02:23:24.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.450+0000 7f9c14ff9700 1 -- 172.21.15.104:0/2069795730 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c0c01a630 con 0x7f9c180686a0 2024-08-17T02:23:24.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.450+0000 7f9c1df68700 1 -- 172.21.15.104:0/2069795730 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c1814bb20 con 0x7f9c180686a0 2024-08-17T02:23:24.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.450+0000 7f9c14ff9700 1 -- 172.21.15.104:0/2069795730 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c01a9b0 con 0x7f9c180686a0 2024-08-17T02:23:24.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.450+0000 7f9c1df68700 1 -- 172.21.15.104:0/2069795730 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c1814e9c0 con 0x7f9c180686a0 2024-08-17T02:23:24.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.450+0000 7f9c1df68700 1 -- 172.21.15.104:0/2069795730 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c180638f0 con 0x7f9c180686a0 2024-08-17T02:23:24.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.450+0000 7f9c14ff9700 1 -- 172.21.15.104:0/2069795730 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9c0c02d440 con 0x7f9c180686a0 2024-08-17T02:23:24.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.454+0000 7f9c14ff9700 1 --2- 172.21.15.104:0/2069795730 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f9bfc060860 0x7f9bfc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:23:24.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.454+0000 7f9c14ff9700 1 -- 172.21.15.104:0/2069795730 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f9c0c07ea30 con 0x7f9c180686a0 2024-08-17T02:23:24.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.454+0000 7f9c17fff700 1 --2- 172.21.15.104:0/2069795730 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f9bfc060860 0x7f9bfc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:23:24.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.454+0000 7f9c17fff700 1 --2- 172.21.15.104:0/2069795730 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f9bfc060860 0x7f9bfc062d10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9c180ab6b0 tx=0x7f9c04009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:23:24.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.462+0000 7f9c14ff9700 1 -- 172.21.15.104:0/2069795730 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f9c0c04eb00 con 0x7f9c180686a0 2024-08-17T02:23:24.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:23:24.650+0000 7f9c1df68700 1 -- 172.21.15.104:0/2069795730 --> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "volume_0000000000188090", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c18066f40 con 0x7f9bfc060860 2024-08-17T02:23:25.494 INFO:tasks.ceph.mds.c.smithi104.stderr:2024-08-17T02:23:25.486+0000 7fbd0588f700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:23:50.013 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:23:50.017 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:24:20.062 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:24:20.065 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:24:50.240 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:24:50.243 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:25:20.319 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:25:20.322 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:25:24.356 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-08-17T02:25:24.357 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-17T02:25:24.357 DEBUG:teuthology.orchestra.run.smithi104:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:25:24.378 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:25:24.399 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-17T02:25:24.399 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi104.front.sepia.ceph.com... 2024-08-17T02:25:24.399 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:25:24.399 DEBUG:teuthology.orchestra.run.smithi104:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-08-17T02:25:24.413 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi104.stderr:ceph-fuse[33515]: fuse finished with error 0 and tester_r 0 2024-08-17T02:25:24.415 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi104.front.sepia.ceph.com 2024-08-17T02:25:24.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:24.415 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-17T02:25:24.517 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi117.front.sepia.ceph.com... 2024-08-17T02:25:24.517 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:25:24.518 DEBUG:teuthology.orchestra.run.smithi117:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-08-17T02:25:24.533 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[30169]: fuse finished with error 0 and tester_r 0 2024-08-17T02:25:24.535 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2024-08-17T02:25:24.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:24.536 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-08-17T02:25:24.633 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi104.front.sepia.ceph.com 2024-08-17T02:25:24.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:24.634 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-08-17T02:25:24.642 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:25:24.642 INFO:teuthology.orchestra.run.smithi104.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-08-17T02:25:24.642 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2024-08-17T02:25:24.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:24.643 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-08-17T02:25:24.649 INFO:teuthology.orchestra.run.smithi117.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-08-17T02:25:24.650 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:25:24.651 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:25:24.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.765+0000 7f4bd759e700 1 Processor -- start 2024-08-17T02:25:24.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.765+0000 7f4bd759e700 1 -- start start 2024-08-17T02:25:24.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.765+0000 7f4bd759e700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4bd8159040 0x7f4bd80cf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.765+0000 7f4bd759e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4bd815d5b0 0x7f4bd80d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.765+0000 7f4bd759e700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bd80cf190 con 0x7f4bd80d0010 2024-08-17T02:25:24.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.765+0000 7f4bd759e700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bd80d09a0 con 0x7f4bd8159040 2024-08-17T02:25:24.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.765+0000 7f4bd759e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd80ce5e0 con 0x7f4bd815d5b0 2024-08-17T02:25:24.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.765+0000 7f4bd5d9b700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f4bd80d0010 0x7f4bd815cea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:35828/0 (socket says 172.21.15.104:35828) 2024-08-17T02:25:24.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.765+0000 7f4bd5d9b700 1 -- 172.21.15.104:0/253153997 learned_addr learned my addr 172.21.15.104:0/253153997 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:25:24.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.765+0000 7f4bd659c700 1 --2- 172.21.15.104:0/253153997 >> v2:172.21.15.117:3300/0 conn(0x7f4bd8159040 0x7f4bd80cf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.765+0000 7f4bd6d9d700 1 --2- 172.21.15.104:0/253153997 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4bd815d5b0 0x7f4bd80d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.765+0000 7f4bd559a700 1 -- 172.21.15.104:0/253153997 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1562131519 0 0) 0x7f4bd80cf190 con 0x7f4bd80d0010 2024-08-17T02:25:24.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.765+0000 7f4bd559a700 1 -- 172.21.15.104:0/253153997 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bb8003570 con 0x7f4bd80d0010 2024-08-17T02:25:24.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.765+0000 7f4bd559a700 1 -- 172.21.15.104:0/253153997 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3223993682 0 0) 0x7f4bb8003570 con 0x7f4bd80d0010 2024-08-17T02:25:24.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.765+0000 7f4bd559a700 1 -- 172.21.15.104:0/253153997 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4bd815d5b0 msgr2=0x7f4bd80d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:24.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.765+0000 7f4bd559a700 1 --2- 172.21.15.104:0/253153997 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4bd815d5b0 0x7f4bd80d0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.765+0000 7f4bd559a700 1 -- 172.21.15.104:0/253153997 >> v2:172.21.15.117:3300/0 conn(0x7f4bd8159040 msgr2=0x7f4bd80cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:24.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.765+0000 7f4bd559a700 1 --2- 172.21.15.104:0/253153997 >> v2:172.21.15.117:3300/0 conn(0x7f4bd8159040 0x7f4bd80cf620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.765+0000 7f4bd559a700 1 -- 172.21.15.104:0/253153997 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd80ce860 con 0x7f4bd80d0010 2024-08-17T02:25:24.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.765+0000 7f4bd559a700 1 -- 172.21.15.104:0/253153997 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1279957748 0 0) 0x7f4bc80017f0 con 0x7f4bd80d0010 2024-08-17T02:25:24.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.765+0000 7f4bd559a700 1 -- 172.21.15.104:0/253153997 >> v1:172.21.15.104:6789/0 conn(0x7f4bd80d0010 legacy=0x7f4bd815cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:24.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.765+0000 7f4bd559a700 1 --2- 172.21.15.104:0/253153997 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bb8003a60 0x7f4bb8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.765+0000 7f4bd559a700 1 --2- 172.21.15.104:0/253153997 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4bd815d5b0 0x7f4bb8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.765+0000 7f4bd559a700 1 --2- 172.21.15.104:0/253153997 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4bb8004d50 0x7f4bb80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.765+0000 7f4bd559a700 1 -- 172.21.15.104:0/253153997 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd80d09a0 con 0x7f4bb8004d50 2024-08-17T02:25:24.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.765+0000 7f4bd559a700 1 -- 172.21.15.104:0/253153997 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd80ce5e0 con 0x7f4bb8003a60 2024-08-17T02:25:24.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.765+0000 7f4bd559a700 1 -- 172.21.15.104:0/253153997 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb800ba60 con 0x7f4bd815d5b0 2024-08-17T02:25:24.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.765+0000 7f4bd659c700 1 --2- 172.21.15.104:0/253153997 >> v2:172.21.15.117:3300/0 conn(0x7f4bd8159040 0x7f4bd80cf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:24.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.765+0000 7f4bd6d9d700 1 --2- 172.21.15.104:0/253153997 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4bb8004d50 0x7f4bb80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.765+0000 7f4bd5d9b700 1 --2- 172.21.15.104:0/253153997 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4bd815d5b0 0x7f4bb8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.765+0000 7f4bd659c700 1 --2- 172.21.15.104:0/253153997 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bb8003a60 0x7f4bb8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.769+0000 7f4bd6d9d700 1 -- 172.21.15.104:0/253153997 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4bd815d5b0 msgr2=0x7f4bb8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:24.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.769+0000 7f4bd6d9d700 1 --2- 172.21.15.104:0/253153997 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4bd815d5b0 0x7f4bb8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.769+0000 7f4bd6d9d700 1 -- 172.21.15.104:0/253153997 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bb8003a60 msgr2=0x7f4bb8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:24.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.769+0000 7f4bd6d9d700 1 --2- 172.21.15.104:0/253153997 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bb8003a60 0x7f4bb8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.769+0000 7f4bd6d9d700 1 -- 172.21.15.104:0/253153997 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb8003570 con 0x7f4bb8004d50 2024-08-17T02:25:24.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.769+0000 7f4bd6d9d700 1 --2- 172.21.15.104:0/253153997 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4bb8004d50 0x7f4bb80051c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0009c00 tx=0x7f4bd00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88d2f2597f003243 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:24.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.769+0000 7f4bd559a700 1 -- 172.21.15.104:0/253153997 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd000e6b0 con 0x7f4bb8004d50 2024-08-17T02:25:24.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.769+0000 7f4bd559a700 1 -- 172.21.15.104:0/253153997 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd000e810 con 0x7f4bb8004d50 2024-08-17T02:25:24.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.769+0000 7f4bd559a700 1 -- 172.21.15.104:0/253153997 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd000ebd0 con 0x7f4bb8004d50 2024-08-17T02:25:24.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.769+0000 7f4bd759e700 1 -- 172.21.15.104:0/253153997 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4bb8004d50 msgr2=0x7f4bb80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:24.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.769+0000 7f4bd759e700 1 --2- 172.21.15.104:0/253153997 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4bb8004d50 0x7f4bb80051c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0009c00 tx=0x7f4bd00091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.769+0000 7f4bd6d9d700 1 -- 172.21.15.104:0/253153997 reap_dead start 2024-08-17T02:25:24.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.769+0000 7f4bd759e700 1 -- 172.21.15.104:0/253153997 shutdown_connections 2024-08-17T02:25:24.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.769+0000 7f4bd759e700 1 -- 172.21.15.104:0/253153997 >> 172.21.15.104:0/253153997 conn(0x7f4bd8068250 msgr2=0x7f4bd8068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:24.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.769+0000 7f4bd759e700 1 -- 172.21.15.104:0/253153997 shutdown_connections 2024-08-17T02:25:24.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.769+0000 7f4bd759e700 1 -- 172.21.15.104:0/253153997 wait complete. 2024-08-17T02:25:24.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.773+0000 7f4bd759e700 1 Processor -- start 2024-08-17T02:25:24.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.773+0000 7f4bd759e700 1 -- start start 2024-08-17T02:25:24.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.773+0000 7f4bd759e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bd8152f70 0x7f4bd80ae150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.773+0000 7f4bd759e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4bd80a69b0 0x7f4bd81559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.773+0000 7f4bd759e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4bd8155f30 0x7f4bd816cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.773+0000 7f4bd759e700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd80a7ac0 con 0x7f4bd80a69b0 2024-08-17T02:25:24.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.773+0000 7f4bd759e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd8156360 con 0x7f4bd8152f70 2024-08-17T02:25:24.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.773+0000 7f4bd759e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd80a6eb0 con 0x7f4bd8155f30 2024-08-17T02:25:24.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.773+0000 7f4bd5d9b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4bd80a69b0 0x7f4bd81559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.773+0000 7f4bd5d9b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4bd80a69b0 0x7f4bd81559f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:40040/0 (socket says 172.21.15.104:40040) 2024-08-17T02:25:24.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.773+0000 7f4bd5d9b700 1 -- 172.21.15.104:0/631072873 learned_addr learned my addr 172.21.15.104:0/631072873 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:24.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.773+0000 7f4bd659c700 1 --2- 172.21.15.104:0/631072873 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bd8152f70 0x7f4bd80ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.773+0000 7f4bd6d9d700 1 --2- 172.21.15.104:0/631072873 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4bd8155f30 0x7f4bd816cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.777+0000 7f4bd5d9b700 1 -- 172.21.15.104:0/631072873 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4bd8155f30 msgr2=0x7f4bd816cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:24.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.777+0000 7f4bd5d9b700 1 --2- 172.21.15.104:0/631072873 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4bd8155f30 0x7f4bd816cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.777+0000 7f4bd5d9b700 1 -- 172.21.15.104:0/631072873 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bd8152f70 msgr2=0x7f4bd80ae150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:24.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.777+0000 7f4bd5d9b700 1 --2- 172.21.15.104:0/631072873 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bd8152f70 0x7f4bd80ae150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.777+0000 7f4bd5d9b700 1 -- 172.21.15.104:0/631072873 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd80a7190 con 0x7f4bd80a69b0 2024-08-17T02:25:24.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.777+0000 7f4bd5d9b700 1 --2- 172.21.15.104:0/631072873 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4bd80a69b0 0x7f4bd81559f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4bc800a650 tx=0x7f4bc8002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:24.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.777+0000 7f4bce7fc700 1 -- 172.21.15.104:0/631072873 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc8013600 con 0x7f4bd80a69b0 2024-08-17T02:25:24.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.777+0000 7f4bce7fc700 1 -- 172.21.15.104:0/631072873 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc8013780 con 0x7f4bd80a69b0 2024-08-17T02:25:24.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.777+0000 7f4bd759e700 1 -- 172.21.15.104:0/631072873 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bd80a7470 con 0x7f4bd80a69b0 2024-08-17T02:25:24.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.777+0000 7f4bce7fc700 1 -- 172.21.15.104:0/631072873 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc8013b40 con 0x7f4bd80a69b0 2024-08-17T02:25:24.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.777+0000 7f4bd759e700 1 -- 172.21.15.104:0/631072873 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bd80ae690 con 0x7f4bd80a69b0 2024-08-17T02:25:24.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.777+0000 7f4bd759e700 1 -- 172.21.15.104:0/631072873 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bd80a7c70 con 0x7f4bd80a69b0 2024-08-17T02:25:24.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.777+0000 7f4bce7fc700 1 -- 172.21.15.104:0/631072873 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f4bc801c400 con 0x7f4bd80a69b0 2024-08-17T02:25:24.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.781+0000 7f4bce7fc700 1 --2- 172.21.15.104:0/631072873 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4bbc060890 0x7f4bbc062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.781+0000 7f4bce7fc700 1 -- 172.21.15.104:0/631072873 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f4bc807e0f0 con 0x7f4bd80a69b0 2024-08-17T02:25:24.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.781+0000 7f4bd659c700 1 --2- 172.21.15.104:0/631072873 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4bbc060890 0x7f4bbc062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.781+0000 7f4bd659c700 1 --2- 172.21.15.104:0/631072873 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4bbc060890 0x7f4bbc062d40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4bc00093f0 tx=0x7f4bc0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:24.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.785+0000 7f4bce7fc700 1 -- 172.21.15.104:0/631072873 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f4bd80a7c70 con 0x7f4bd80a69b0 2024-08-17T02:25:24.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.985+0000 7f4bd759e700 1 -- 172.21.15.104:0/631072873 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4bd80a78f0 con 0x7f4bd80a69b0 2024-08-17T02:25:24.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.989+0000 7f4bce7fc700 1 -- 172.21.15.104:0/631072873 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+5690 (secure 0 0 0) 0x7f4bc804e150 con 0x7f4bd80a69b0 2024-08-17T02:25:24.990 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:25:24.991 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/3848434798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3848434798},{"type":"v1","addr":"172.21.15.117:6836","nonce":3848434798}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4894,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1461239637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1461239637},{"type":"v1","addr":"172.21.15.117:6837","nonce":1461239637}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:23:05.468383+0000","modified":"2024-08-17T02:23:08.148034+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4965},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4965":{"gid":4965,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/38993094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":38993094},{"type":"v1","addr":"172.21.15.104:6835","nonce":38993094}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:23:22.321122+0000","modified":"2024-08-17T02:23:24.304353+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4959},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4959":{"gid":4959,"name":"c","rank":0,"incarnation":16,"state":"up:active","state_seq":8,"addr":"172.21.15.104:6833/4148924116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":4148924116},{"type":"v1","addr":"172.21.15.104:6833","nonce":4148924116}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000188090","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:25:24.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.993+0000 7f4bd759e700 1 -- 172.21.15.104:0/631072873 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4bbc060890 msgr2=0x7f4bbc062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:24.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.993+0000 7f4bd759e700 1 --2- 172.21.15.104:0/631072873 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4bbc060890 0x7f4bbc062d40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4bc00093f0 tx=0x7f4bc0008040 comp rx=0 tx=0).stop 2024-08-17T02:25:24.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.993+0000 7f4bd759e700 1 -- 172.21.15.104:0/631072873 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4bd80a69b0 msgr2=0x7f4bd81559f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:24.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.993+0000 7f4bd759e700 1 --2- 172.21.15.104:0/631072873 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4bd80a69b0 0x7f4bd81559f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4bc800a650 tx=0x7f4bc8002210 comp rx=0 tx=0).stop 2024-08-17T02:25:24.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.993+0000 7f4bd759e700 1 -- 172.21.15.104:0/631072873 shutdown_connections 2024-08-17T02:25:24.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.993+0000 7f4bd759e700 1 --2- 172.21.15.104:0/631072873 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4bbc060890 0x7f4bbc062d40 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.993+0000 7f4bd759e700 1 --2- 172.21.15.104:0/631072873 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4bd8155f30 0x7f4bd816cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.993+0000 7f4bd759e700 1 --2- 172.21.15.104:0/631072873 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4bd80a69b0 0x7f4bd81559f0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.993+0000 7f4bd759e700 1 --2- 172.21.15.104:0/631072873 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bd8152f70 0x7f4bd80ae150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.993+0000 7f4bd759e700 1 -- 172.21.15.104:0/631072873 >> 172.21.15.104:0/631072873 conn(0x7f4bd8068250 msgr2=0x7f4bd815ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:24.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.993+0000 7f4bd759e700 1 -- 172.21.15.104:0/631072873 shutdown_connections 2024-08-17T02:25:24.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:24.993+0000 7f4bd759e700 1 -- 172.21.15.104:0/631072873 wait complete. 2024-08-17T02:25:24.997 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 18 2024-08-17T02:25:25.011 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:25.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.117+0000 7f2ecb229700 1 Processor -- start 2024-08-17T02:25:25.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.117+0000 7f2ecb229700 1 -- start start 2024-08-17T02:25:25.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.117+0000 7f2ecb229700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2ec4155d20 0x7f2ec40b0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.117+0000 7f2ecb229700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2ec40ad7c0 0x7f2ec40aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.117+0000 7f2ecb229700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ec40af2b0 con 0x7f2ec406df10 2024-08-17T02:25:25.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.117+0000 7f2ecb229700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ec40adc10 con 0x7f2ec40ad7c0 2024-08-17T02:25:25.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.117+0000 7f2ecb229700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ec40af590 con 0x7f2ec4155d20 2024-08-17T02:25:25.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.117+0000 7f2ec9a26700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2ec40ad7c0 0x7f2ec40aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.117+0000 7f2ec9a26700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2ec40ad7c0 0x7f2ec40aea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:40050/0 (socket says 172.21.15.104:40050) 2024-08-17T02:25:25.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.117+0000 7f2ec9a26700 1 -- 172.21.15.104:0/231328356 learned_addr learned my addr 172.21.15.104:0/231328356 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:25.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.117+0000 7f2eca227700 1 --2- 172.21.15.104:0/231328356 >> v2:172.21.15.117:3300/0 conn(0x7f2ec4155d20 0x7f2ec40b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.117+0000 7f2ec9a26700 1 -- 172.21.15.104:0/231328356 >> v2:172.21.15.117:3300/0 conn(0x7f2ec4155d20 msgr2=0x7f2ec40b0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:25.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.117+0000 7f2ec9a26700 1 --2- 172.21.15.104:0/231328356 >> v2:172.21.15.117:3300/0 conn(0x7f2ec4155d20 0x7f2ec40b0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.117+0000 7f2ec9a26700 1 -- 172.21.15.104:0/231328356 >> v1:172.21.15.117:6789/0 conn(0x7f2ec406df10 legacy=0x7f2ec406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.117+0000 7f2ec9a26700 1 -- 172.21.15.104:0/231328356 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec40af870 con 0x7f2ec40ad7c0 2024-08-17T02:25:25.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.117+0000 7f2ec9a26700 1 --2- 172.21.15.104:0/231328356 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ec40ad7c0 0x7f2ec40aea80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2ec40b1d50 tx=0x7f2ec0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e633a077760d474f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.117+0000 7f2ec9225700 1 -- 172.21.15.104:0/231328356 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec000e070 con 0x7f2ec40ad7c0 2024-08-17T02:25:25.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.117+0000 7f2ec9225700 1 -- 172.21.15.104:0/231328356 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec000ba50 con 0x7f2ec40ad7c0 2024-08-17T02:25:25.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.117+0000 7f2ec9225700 1 -- 172.21.15.104:0/231328356 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec00092e0 con 0x7f2ec40ad7c0 2024-08-17T02:25:25.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.121+0000 7f2ecb229700 1 -- 172.21.15.104:0/231328356 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ec40ad7c0 msgr2=0x7f2ec40aea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.121+0000 7f2ecb229700 1 --2- 172.21.15.104:0/231328356 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ec40ad7c0 0x7f2ec40aea80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2ec40b1d50 tx=0x7f2ec0009840 comp rx=0 tx=0).stop 2024-08-17T02:25:25.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.121+0000 7f2ecb229700 1 -- 172.21.15.104:0/231328356 shutdown_connections 2024-08-17T02:25:25.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.121+0000 7f2ecb229700 1 --2- 172.21.15.104:0/231328356 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ec40ad7c0 0x7f2ec40aea80 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.121+0000 7f2ecb229700 1 --2- 172.21.15.104:0/231328356 >> v2:172.21.15.117:3300/0 conn(0x7f2ec4155d20 0x7f2ec40b0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.121+0000 7f2ecb229700 1 -- 172.21.15.104:0/231328356 >> 172.21.15.104:0/231328356 conn(0x7f2ec40678d0 msgr2=0x7f2ec4067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:25.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.121+0000 7f2ecb229700 1 -- 172.21.15.104:0/231328356 shutdown_connections 2024-08-17T02:25:25.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.121+0000 7f2ecb229700 1 -- 172.21.15.104:0/231328356 wait complete. 2024-08-17T02:25:25.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.121+0000 7f2ecb229700 1 Processor -- start 2024-08-17T02:25:25.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.121+0000 7f2ecb229700 1 -- start start 2024-08-17T02:25:25.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.125+0000 7f2ecb229700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ec406df10 0x7f2ec414ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.125+0000 7f2ecb229700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ec40ad7c0 0x7f2ec414b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.125+0000 7f2ecb229700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ec4155d20 0x7f2ec414d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.125+0000 7f2ecb229700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec414c670 con 0x7f2ec40ad7c0 2024-08-17T02:25:25.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.125+0000 7f2ecb229700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec4156220 con 0x7f2ec406df10 2024-08-17T02:25:25.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.125+0000 7f2ecb229700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec414bd80 con 0x7f2ec4155d20 2024-08-17T02:25:25.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.125+0000 7f2ec9a26700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ec40ad7c0 0x7f2ec414b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.125+0000 7f2ec9a26700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ec40ad7c0 0x7f2ec414b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:40060/0 (socket says 172.21.15.104:40060) 2024-08-17T02:25:25.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.125+0000 7f2ec9a26700 1 -- 172.21.15.104:0/3128919559 learned_addr learned my addr 172.21.15.104:0/3128919559 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:25.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.125+0000 7f2eca227700 1 --2- 172.21.15.104:0/3128919559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ec406df10 0x7f2ec414ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.125+0000 7f2ecaa28700 1 --2- 172.21.15.104:0/3128919559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ec4155d20 0x7f2ec414d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.125+0000 7f2ec9a26700 1 -- 172.21.15.104:0/3128919559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ec4155d20 msgr2=0x7f2ec414d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.125+0000 7f2ec9a26700 1 --2- 172.21.15.104:0/3128919559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ec4155d20 0x7f2ec414d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.125+0000 7f2ec9a26700 1 -- 172.21.15.104:0/3128919559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ec406df10 msgr2=0x7f2ec414ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.125+0000 7f2ec9a26700 1 --2- 172.21.15.104:0/3128919559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ec406df10 0x7f2ec414ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.125+0000 7f2ec9a26700 1 -- 172.21.15.104:0/3128919559 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec0009ae0 con 0x7f2ec40ad7c0 2024-08-17T02:25:25.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.125+0000 7f2eca227700 1 --2- 172.21.15.104:0/3128919559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ec406df10 0x7f2ec414ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:25.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.125+0000 7f2ec9a26700 1 --2- 172.21.15.104:0/3128919559 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ec40ad7c0 0x7f2ec414b1c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2ec406c2d0 tx=0x7f2ec0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.125+0000 7f2eba7fc700 1 -- 172.21.15.104:0/3128919559 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec0008a80 con 0x7f2ec40ad7c0 2024-08-17T02:25:25.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.125+0000 7f2eba7fc700 1 -- 172.21.15.104:0/3128919559 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec0008c00 con 0x7f2ec40ad7c0 2024-08-17T02:25:25.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.125+0000 7f2ecb229700 1 -- 172.21.15.104:0/3128919559 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ec414b7c0 con 0x7f2ec40ad7c0 2024-08-17T02:25:25.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.125+0000 7f2eba7fc700 1 -- 172.21.15.104:0/3128919559 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec0026460 con 0x7f2ec40ad7c0 2024-08-17T02:25:25.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.125+0000 7f2ecb229700 1 -- 172.21.15.104:0/3128919559 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ec414c1e0 con 0x7f2ec40ad7c0 2024-08-17T02:25:25.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.125+0000 7f2ecb229700 1 -- 172.21.15.104:0/3128919559 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ec4152200 con 0x7f2ec40ad7c0 2024-08-17T02:25:25.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.125+0000 7f2eba7fc700 1 -- 172.21.15.104:0/3128919559 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2ec0003040 con 0x7f2ec40ad7c0 2024-08-17T02:25:25.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.129+0000 7f2eba7fc700 1 --2- 172.21.15.104:0/3128919559 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f2eb0060890 0x7f2eb0062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.129+0000 7f2eba7fc700 1 -- 172.21.15.104:0/3128919559 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f2ec007ed30 con 0x7f2ec40ad7c0 2024-08-17T02:25:25.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.129+0000 7f2eca227700 1 --2- 172.21.15.104:0/3128919559 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f2eb0060890 0x7f2eb0062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.129+0000 7f2eca227700 1 --2- 172.21.15.104:0/3128919559 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f2eb0060890 0x7f2eb0062d40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4006fd0 tx=0x7f2eb4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.133+0000 7f2eba7fc700 1 -- 172.21.15.104:0/3128919559 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f2ec4152200 con 0x7f2ec40ad7c0 2024-08-17T02:25:25.304 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.301+0000 7f2ecb229700 1 -- 172.21.15.104:0/3128919559 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ec4152200 con 0x7f2ec40ad7c0 2024-08-17T02:25:25.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.301+0000 7f2eba7fc700 1 -- 172.21.15.104:0/3128919559 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+18837 (secure 0 0 0) 0x7f2ec4152200 con 0x7f2ec40ad7c0 2024-08-17T02:25:25.307 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:25:25.307 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":41,"fsid":"fd5f7fb8-d34b-49bb-89a8-62b7dad1bc25","created":"2024-08-17T02:21:57.891389+0000","modified":"2024-08-17T02:24:03.367031+0000","last_up_change":"2024-08-17T02:22:08.924546+0000","last_in_change":"2024-08-17T02:21:59.938028+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:22:10.143970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:23:03.390787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:23:04.462361+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000188090.meta","create_time":"2024-08-17T02:23:21.239436+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000188090"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000188090.data","create_time":"2024-08-17T02:23:21.337636+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000188090"}}}],"osds":[{"osd":0,"uuid":"606b9088-590e-4709-aa3a-b0f6e22972ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":24257},{"type":"v1","addr":"172.21.15.104:6809","nonce":24257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":24257},{"type":"v1","addr":"172.21.15.104:6811","nonce":24257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":24257},{"type":"v1","addr":"172.21.15.104:6815","nonce":24257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":24257},{"type":"v1","addr":"172.21.15.104:6813","nonce":24257}]},"public_addr":"172.21.15.104:6809/24257","cluster_addr":"172.21.15.104:6811/24257","heartbeat_back_addr":"172.21.15.104:6815/24257","heartbeat_front_addr":"172.21.15.104:6813/24257","state":["exists","up"]},{"osd":1,"uuid":"9bc6a909-0c2f-4889-afe7-4a47f89b0f64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":24256},{"type":"v1","addr":"172.21.15.104:6825","nonce":24256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":24256},{"type":"v1","addr":"172.21.15.104:6827","nonce":24256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":24256},{"type":"v1","addr":"172.21.15.104:6831","nonce":24256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":24256},{"type":"v1","addr":"172.21.15.104:6829","nonce":24256}]},"public_addr":"172.21.15.104:6825/24256","cluster_addr":"172.21.15.104:6827/24256","heartbeat_back_addr":"172.21.15.104:6831/24256","heartbeat_front_addr":"172.21.15.104:6829/24256","state":["exists","up"]},{"osd":2,"uuid":"23da31d5-aefb-4edb-b79d-fa05e1becef7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":24255},{"type":"v1","addr":"172.21.15.104:6817","nonce":24255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":24255},{"type":"v1","addr":"172.21.15.104:6819","nonce":24255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":24255},{"type":"v1","addr":"172.21.15.104:6823","nonce":24255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":24255},{"type":"v1","addr":"172.21.15.104:6821","nonce":24255}]},"public_addr":"172.21.15.104:6817/24255","cluster_addr":"172.21.15.104:6819/24255","heartbeat_back_addr":"172.21.15.104:6823/24255","heartbeat_front_addr":"172.21.15.104:6821/24255","state":["exists","up"]},{"osd":3,"uuid":"6e4a5ec2-b415-45ef-8381-61a59eb65224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":24254},{"type":"v1","addr":"172.21.15.104:6801","nonce":24254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":24254},{"type":"v1","addr":"172.21.15.104:6803","nonce":24254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":24254},{"type":"v1","addr":"172.21.15.104:6807","nonce":24254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":24254},{"type":"v1","addr":"172.21.15.104:6805","nonce":24254}]},"public_addr":"172.21.15.104:6801/24254","cluster_addr":"172.21.15.104:6803/24254","heartbeat_back_addr":"172.21.15.104:6807/24254","heartbeat_front_addr":"172.21.15.104:6805/24254","state":["exists","up"]},{"osd":4,"uuid":"8d5bea2d-9039-4013-8c99-2c046c5b8a17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":24421},{"type":"v1","addr":"172.21.15.117:6804","nonce":24421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":24421},{"type":"v1","addr":"172.21.15.117:6809","nonce":24421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":24421},{"type":"v1","addr":"172.21.15.117:6815","nonce":24421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":24421},{"type":"v1","addr":"172.21.15.117:6813","nonce":24421}]},"public_addr":"172.21.15.117:6804/24421","cluster_addr":"172.21.15.117:6809/24421","heartbeat_back_addr":"172.21.15.117:6815/24421","heartbeat_front_addr":"172.21.15.117:6813/24421","state":["exists","up"]},{"osd":5,"uuid":"de8b36fc-121c-4f05-8f5b-28f513d9f21f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":24422},{"type":"v1","addr":"172.21.15.117:6817","nonce":24422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":24422},{"type":"v1","addr":"172.21.15.117:6819","nonce":24422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":24422},{"type":"v1","addr":"172.21.15.117:6823","nonce":24422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":24422},{"type":"v1","addr":"172.21.15.117:6821","nonce":24422}]},"public_addr":"172.21.15.117:6817/24422","cluster_addr":"172.21.15.117:6819/24422","heartbeat_back_addr":"172.21.15.117:6823/24422","heartbeat_front_addr":"172.21.15.117:6821/24422","state":["exists","up"]},{"osd":6,"uuid":"6a87f09f-7bf7-4f7a-be87-530ac1ff8ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":24420},{"type":"v1","addr":"172.21.15.117:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6803","nonce":24420},{"type":"v1","addr":"172.21.15.117:6805","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":24420},{"type":"v1","addr":"172.21.15.117:6811","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":24420},{"type":"v1","addr":"172.21.15.117:6808","nonce":24420}]},"public_addr":"172.21.15.117:6801/24420","cluster_addr":"172.21.15.117:6805/24420","heartbeat_back_addr":"172.21.15.117:6811/24420","heartbeat_front_addr":"172.21.15.117:6808/24420","state":["exists","up"]},{"osd":7,"uuid":"e31d8041-1aa1-4b5d-83b3-0a373426dd9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":24423},{"type":"v1","addr":"172.21.15.117:6825","nonce":24423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":24423},{"type":"v1","addr":"172.21.15.117:6827","nonce":24423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":24423},{"type":"v1","addr":"172.21.15.117:6831","nonce":24423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":24423},{"type":"v1","addr":"172.21.15.117:6829","nonce":24423}]},"public_addr":"172.21.15.117:6825/24423","cluster_addr":"172.21.15.117:6827/24423","heartbeat_back_addr":"172.21.15.117:6831/24423","heartbeat_front_addr":"172.21.15.117:6829/24423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.220874+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.210039+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.434762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.247206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.184316+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.306325+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.035719+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.400303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.35","mappings":[{"from":4,"to":5}]},{"pgid":"5.36","mappings":[{"from":4,"to":3}]},{"pgid":"5.37","mappings":[{"from":4,"to":5}]},{"pgid":"5.3c","mappings":[{"from":4,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:25.309 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.305+0000 7f2ecb229700 1 -- 172.21.15.104:0/3128919559 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f2eb0060890 msgr2=0x7f2eb0062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.309 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.305+0000 7f2ecb229700 1 --2- 172.21.15.104:0/3128919559 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f2eb0060890 0x7f2eb0062d40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4006fd0 tx=0x7f2eb4008040 comp rx=0 tx=0).stop 2024-08-17T02:25:25.309 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.305+0000 7f2ecb229700 1 -- 172.21.15.104:0/3128919559 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ec40ad7c0 msgr2=0x7f2ec414b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.305+0000 7f2ecb229700 1 --2- 172.21.15.104:0/3128919559 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ec40ad7c0 0x7f2ec414b1c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2ec406c2d0 tx=0x7f2ec0018000 comp rx=0 tx=0).stop 2024-08-17T02:25:25.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.305+0000 7f2ecb229700 1 -- 172.21.15.104:0/3128919559 shutdown_connections 2024-08-17T02:25:25.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.305+0000 7f2ecb229700 1 --2- 172.21.15.104:0/3128919559 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f2eb0060890 0x7f2eb0062d40 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.305+0000 7f2ecb229700 1 --2- 172.21.15.104:0/3128919559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ec4155d20 0x7f2ec414d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.305+0000 7f2ecb229700 1 --2- 172.21.15.104:0/3128919559 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ec40ad7c0 0x7f2ec414b1c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.305+0000 7f2ecb229700 1 --2- 172.21.15.104:0/3128919559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ec406df10 0x7f2ec414ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.305+0000 7f2ecb229700 1 -- 172.21.15.104:0/3128919559 >> 172.21.15.104:0/3128919559 conn(0x7f2ec40678d0 msgr2=0x7f2ec406a420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:25.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.305+0000 7f2ecb229700 1 -- 172.21.15.104:0/3128919559 shutdown_connections 2024-08-17T02:25:25.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.305+0000 7f2ecb229700 1 -- 172.21.15.104:0/3128919559 wait complete. 2024-08-17T02:25:25.321 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:22:10.143970+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:23:03.390787+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:23:04.462361+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs.volume_0000000000188090.meta', 'create_time': '2024-08-17T02:23:21.239436+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000000188090'}}}, {'pool': 7, 'pool_name': 'cephfs.volume_0000000000188090.data', 'create_time': '2024-08-17T02:23:21.337636+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000188090'}}}] 2024-08-17T02:25:25.321 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:25:25.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.425+0000 7f56b0980700 1 Processor -- start 2024-08-17T02:25:25.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.425+0000 7f56b0980700 1 -- start start 2024-08-17T02:25:25.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.425+0000 7f56b0980700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56ac142b40 0x7f56ac0a9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.425+0000 7f56b0980700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56ac06ee60 con 0x7f56ac0a9040 2024-08-17T02:25:25.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.425+0000 7f56b0980700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56ac06e2e0 con 0x7f56ac06d5b0 2024-08-17T02:25:25.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.425+0000 7f56b0980700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac06e5c0 con 0x7f56ac142b40 2024-08-17T02:25:25.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.425+0000 7f56aa59c700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f56ac0a9040 0x7f56ac142430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:35832/0 (socket says 172.21.15.104:35832) 2024-08-17T02:25:25.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.425+0000 7f56aa59c700 1 -- 172.21.15.104:0/1128986080 learned_addr learned my addr 172.21.15.104:0/1128986080 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:25:25.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.425+0000 7f56a9d9b700 1 --2- 172.21.15.104:0/1128986080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56ac142b40 0x7f56ac0a9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.425+0000 7f56a959a700 1 -- 172.21.15.104:0/1128986080 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2606787041 0 0) 0x7f56ac06ee60 con 0x7f56ac0a9040 2024-08-17T02:25:25.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.425+0000 7f56a959a700 1 -- 172.21.15.104:0/1128986080 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5698003570 con 0x7f56ac0a9040 2024-08-17T02:25:25.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.425+0000 7f56a959a700 1 -- 172.21.15.104:0/1128986080 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 23337712 0 0) 0x7f56ac06e2e0 con 0x7f56ac06d5b0 2024-08-17T02:25:25.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.425+0000 7f56a959a700 1 -- 172.21.15.104:0/1128986080 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56ac06ee60 con 0x7f56ac06d5b0 2024-08-17T02:25:25.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.425+0000 7f56a9d9b700 1 -- 172.21.15.104:0/1128986080 >> v1:172.21.15.117:6789/0 conn(0x7f56ac06d5b0 legacy=0x7f56ac06da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.425+0000 7f56a9d9b700 1 -- 172.21.15.104:0/1128986080 >> v1:172.21.15.104:6789/0 conn(0x7f56ac0a9040 legacy=0x7f56ac142430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.425+0000 7f56a9d9b700 1 -- 172.21.15.104:0/1128986080 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56ac06e8a0 con 0x7f56ac142b40 2024-08-17T02:25:25.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.425+0000 7f56a9d9b700 1 --2- 172.21.15.104:0/1128986080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56ac142b40 0x7f56ac0a9410 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f569c009910 tx=0x7f569c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76ee5737d788a06d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.429+0000 7f56a959a700 1 -- 172.21.15.104:0/1128986080 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c011630 con 0x7f56ac142b40 2024-08-17T02:25:25.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.429+0000 7f56a959a700 1 -- 172.21.15.104:0/1128986080 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569c011790 con 0x7f56ac142b40 2024-08-17T02:25:25.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.429+0000 7f56a959a700 1 -- 172.21.15.104:0/1128986080 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c011b10 con 0x7f56ac142b40 2024-08-17T02:25:25.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.429+0000 7f56b0980700 1 -- 172.21.15.104:0/1128986080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56ac142b40 msgr2=0x7f56ac0a9410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.429+0000 7f56b0980700 1 --2- 172.21.15.104:0/1128986080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56ac142b40 0x7f56ac0a9410 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f569c009910 tx=0x7f569c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.429+0000 7f56b0980700 1 -- 172.21.15.104:0/1128986080 shutdown_connections 2024-08-17T02:25:25.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.429+0000 7f56b0980700 1 --2- 172.21.15.104:0/1128986080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56ac142b40 0x7f56ac0a9410 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.429+0000 7f56b0980700 1 -- 172.21.15.104:0/1128986080 >> 172.21.15.104:0/1128986080 conn(0x7f56ac066e00 msgr2=0x7f56ac067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:25.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.429+0000 7f56b0980700 1 -- 172.21.15.104:0/1128986080 shutdown_connections 2024-08-17T02:25:25.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.429+0000 7f56b0980700 1 -- 172.21.15.104:0/1128986080 wait complete. 2024-08-17T02:25:25.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.429+0000 7f56b0980700 1 Processor -- start 2024-08-17T02:25:25.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.429+0000 7f56b0980700 1 -- start start 2024-08-17T02:25:25.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.433+0000 7f56b0980700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56ac06d5b0 0x7f56ac0aac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.433+0000 7f56b0980700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56ac0a9040 0x7f56ac1590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.433+0000 7f56b0980700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56ac142b40 0x7f56ac132040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.433+0000 7f56b0980700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac0ac3f0 con 0x7f56ac142b40 2024-08-17T02:25:25.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.433+0000 7f56b0980700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac0ab7e0 con 0x7f56ac0a9040 2024-08-17T02:25:25.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.433+0000 7f56b0980700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac0abac0 con 0x7f56ac06d5b0 2024-08-17T02:25:25.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.433+0000 7f56aad9d700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56ac142b40 0x7f56ac132040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.433+0000 7f56aad9d700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56ac142b40 0x7f56ac132040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:40068/0 (socket says 172.21.15.104:40068) 2024-08-17T02:25:25.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.433+0000 7f56aad9d700 1 -- 172.21.15.104:0/3050391036 learned_addr learned my addr 172.21.15.104:0/3050391036 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:25.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.433+0000 7f56aa59c700 1 --2- 172.21.15.104:0/3050391036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56ac06d5b0 0x7f56ac0aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.433+0000 7f56a9d9b700 1 --2- 172.21.15.104:0/3050391036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56ac0a9040 0x7f56ac1590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.433+0000 7f56aad9d700 1 -- 172.21.15.104:0/3050391036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56ac06d5b0 msgr2=0x7f56ac0aac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.433+0000 7f56aad9d700 1 --2- 172.21.15.104:0/3050391036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56ac06d5b0 0x7f56ac0aac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.433+0000 7f56aad9d700 1 -- 172.21.15.104:0/3050391036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56ac0a9040 msgr2=0x7f56ac1590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.433+0000 7f56aad9d700 1 --2- 172.21.15.104:0/3050391036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56ac0a9040 0x7f56ac1590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.433+0000 7f56aad9d700 1 -- 172.21.15.104:0/3050391036 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f569c009420 con 0x7f56ac142b40 2024-08-17T02:25:25.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.433+0000 7f56aa59c700 1 --2- 172.21.15.104:0/3050391036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56ac06d5b0 0x7f56ac0aac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:25.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.433+0000 7f56a9d9b700 1 --2- 172.21.15.104:0/3050391036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56ac0a9040 0x7f56ac1590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:25.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.433+0000 7f56aad9d700 1 --2- 172.21.15.104:0/3050391036 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56ac142b40 0x7f56ac132040 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f56a400c910 tx=0x7f56a40027a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.433+0000 7f56a27fc700 1 -- 172.21.15.104:0/3050391036 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a400a7e0 con 0x7f56ac142b40 2024-08-17T02:25:25.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.433+0000 7f56a27fc700 1 -- 172.21.15.104:0/3050391036 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a400a960 con 0x7f56ac142b40 2024-08-17T02:25:25.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.433+0000 7f56b0980700 1 -- 172.21.15.104:0/3050391036 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56ac0abda0 con 0x7f56ac142b40 2024-08-17T02:25:25.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.433+0000 7f56a27fc700 1 -- 172.21.15.104:0/3050391036 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a400ad20 con 0x7f56ac142b40 2024-08-17T02:25:25.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.433+0000 7f56b0980700 1 -- 172.21.15.104:0/3050391036 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56ac1595e0 con 0x7f56ac142b40 2024-08-17T02:25:25.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.433+0000 7f56b0980700 1 -- 172.21.15.104:0/3050391036 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56ac0ac560 con 0x7f56ac142b40 2024-08-17T02:25:25.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.433+0000 7f56a27fc700 1 -- 172.21.15.104:0/3050391036 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f56a4012630 con 0x7f56ac142b40 2024-08-17T02:25:25.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.437+0000 7f56a27fc700 1 --2- 172.21.15.104:0/3050391036 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f568c060860 0x7f568c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.437+0000 7f56a27fc700 1 -- 172.21.15.104:0/3050391036 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f56a407d4a0 con 0x7f56ac142b40 2024-08-17T02:25:25.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.437+0000 7f56aa59c700 1 --2- 172.21.15.104:0/3050391036 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f568c060860 0x7f568c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.437+0000 7f56aa59c700 1 --2- 172.21.15.104:0/3050391036 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f568c060860 0x7f568c062d10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f56940058d0 tx=0x7f5694009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.441+0000 7f56a27fc700 1 -- 172.21.15.104:0/3050391036 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f56a404d460 con 0x7f56ac142b40 2024-08-17T02:25:25.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.605+0000 7f56b0980700 1 -- 172.21.15.104:0/3050391036 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f56ac0645c0 con 0x7f56ac142b40 2024-08-17T02:25:25.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.605+0000 7f56a27fc700 1 -- 172.21.15.104:0/3050391036 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f56a4050a80 con 0x7f56ac142b40 2024-08-17T02:25:25.609 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-08-17T02:25:25.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.609+0000 7f56b0980700 1 -- 172.21.15.104:0/3050391036 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f568c060860 msgr2=0x7f568c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.609+0000 7f56b0980700 1 --2- 172.21.15.104:0/3050391036 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f568c060860 0x7f568c062d10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f56940058d0 tx=0x7f5694009040 comp rx=0 tx=0).stop 2024-08-17T02:25:25.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.609+0000 7f56b0980700 1 -- 172.21.15.104:0/3050391036 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56ac142b40 msgr2=0x7f56ac132040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.609+0000 7f56b0980700 1 --2- 172.21.15.104:0/3050391036 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56ac142b40 0x7f56ac132040 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f56a400c910 tx=0x7f56a40027a0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.609+0000 7f56b0980700 1 -- 172.21.15.104:0/3050391036 shutdown_connections 2024-08-17T02:25:25.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.609+0000 7f56b0980700 1 --2- 172.21.15.104:0/3050391036 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f568c060860 0x7f568c062d10 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.609+0000 7f56b0980700 1 --2- 172.21.15.104:0/3050391036 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56ac142b40 0x7f56ac132040 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.609+0000 7f56b0980700 1 --2- 172.21.15.104:0/3050391036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56ac0a9040 0x7f56ac1590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.609+0000 7f56b0980700 1 --2- 172.21.15.104:0/3050391036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56ac06d5b0 0x7f56ac0aac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.609+0000 7f56b0980700 1 -- 172.21.15.104:0/3050391036 >> 172.21.15.104:0/3050391036 conn(0x7f56ac066e00 msgr2=0x7f56ac140b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:25.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.609+0000 7f56b0980700 1 -- 172.21.15.104:0/3050391036 shutdown_connections 2024-08-17T02:25:25.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.609+0000 7f56b0980700 1 -- 172.21.15.104:0/3050391036 wait complete. 2024-08-17T02:25:25.623 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:25:25.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.725+0000 7fb2e135c700 1 Processor -- start 2024-08-17T02:25:25.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.725+0000 7fb2e135c700 1 -- start start 2024-08-17T02:25:25.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.725+0000 7fb2e135c700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb2dc06ead0 0x7fb2dc06eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.725+0000 7fb2e135c700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2dc152bd0 0x7fb2dc152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.725+0000 7fb2e135c700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2dc0ace30 con 0x7fb2dc0b1830 2024-08-17T02:25:25.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.725+0000 7fb2e135c700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2dc156dd0 con 0x7fb2dc06ead0 2024-08-17T02:25:25.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.725+0000 7fb2e135c700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2dc156450 con 0x7fb2dc152bd0 2024-08-17T02:25:25.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.729+0000 7fb2e0b5b700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2dc152bd0 0x7fb2dc152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.729+0000 7fb2dbfff700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb2dc06ead0 0x7fb2dc06eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.729+0000 7fb2e0b5b700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2dc152bd0 0x7fb2dc152fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.104:50636/0 (socket says 172.21.15.104:50636) 2024-08-17T02:25:25.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.729+0000 7fb2e0b5b700 1 -- 172.21.15.104:0/180584476 learned_addr learned my addr 172.21.15.104:0/180584476 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:25.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.729+0000 7fb2db7fe700 1 --1- 172.21.15.104:0/180584476 >> v1:172.21.15.117:6789/0 conn(0x7fb2dc0b1830 0x7fb2dc155c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.104:44056/0 (socket says 172.21.15.104:44056) 2024-08-17T02:25:25.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.729+0000 7fb2e0b5b700 1 -- 172.21.15.104:0/180584476 >> v2:172.21.15.117:3300/0 conn(0x7fb2dc06ead0 msgr2=0x7fb2dc06eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:25.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.729+0000 7fb2e0b5b700 1 --2- 172.21.15.104:0/180584476 >> v2:172.21.15.117:3300/0 conn(0x7fb2dc06ead0 0x7fb2dc06eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.729+0000 7fb2e0b5b700 1 -- 172.21.15.104:0/180584476 >> v1:172.21.15.117:6789/0 conn(0x7fb2dc0b1830 legacy=0x7fb2dc155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.729+0000 7fb2daffd700 1 -- 172.21.15.104:0/180584476 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3425746798 0 0) 0x7fb2dc0ace30 con 0x7fb2dc0b1830 2024-08-17T02:25:25.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.729+0000 7fb2e0b5b700 1 -- 172.21.15.104:0/180584476 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2dc156730 con 0x7fb2dc152bd0 2024-08-17T02:25:25.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.729+0000 7fb2e0b5b700 1 --2- 172.21.15.104:0/180584476 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2dc152bd0 0x7fb2dc152fe0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb2d40099b0 tx=0x7fb2d4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23123f63f9b7262e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.729+0000 7fb2daffd700 1 -- 172.21.15.104:0/180584476 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d4009ea0 con 0x7fb2dc152bd0 2024-08-17T02:25:25.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.729+0000 7fb2daffd700 1 -- 172.21.15.104:0/180584476 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d400b860 con 0x7fb2dc152bd0 2024-08-17T02:25:25.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.729+0000 7fb2daffd700 1 -- 172.21.15.104:0/180584476 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d400bc00 con 0x7fb2dc152bd0 2024-08-17T02:25:25.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.729+0000 7fb2e135c700 1 -- 172.21.15.104:0/180584476 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2dc152bd0 msgr2=0x7fb2dc152fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.729+0000 7fb2e135c700 1 --2- 172.21.15.104:0/180584476 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2dc152bd0 0x7fb2dc152fe0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb2d40099b0 tx=0x7fb2d4009250 comp rx=0 tx=0).stop 2024-08-17T02:25:25.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.729+0000 7fb2e135c700 1 -- 172.21.15.104:0/180584476 shutdown_connections 2024-08-17T02:25:25.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.729+0000 7fb2e135c700 1 --2- 172.21.15.104:0/180584476 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2dc152bd0 0x7fb2dc152fe0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.729+0000 7fb2e135c700 1 --2- 172.21.15.104:0/180584476 >> v2:172.21.15.117:3300/0 conn(0x7fb2dc06ead0 0x7fb2dc06eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.729+0000 7fb2e135c700 1 -- 172.21.15.104:0/180584476 >> 172.21.15.104:0/180584476 conn(0x7fb2dc0678a0 msgr2=0x7fb2dc067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:25.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.729+0000 7fb2e135c700 1 -- 172.21.15.104:0/180584476 shutdown_connections 2024-08-17T02:25:25.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.729+0000 7fb2e135c700 1 -- 172.21.15.104:0/180584476 wait complete. 2024-08-17T02:25:25.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.733+0000 7fb2e135c700 1 Processor -- start 2024-08-17T02:25:25.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.733+0000 7fb2e135c700 1 -- start start 2024-08-17T02:25:25.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.733+0000 7fb2e135c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb2dc06ead0 0x7fb2dc150e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.733+0000 7fb2e135c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2dc0b1830 0x7fb2dc1487a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.733+0000 7fb2e135c700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2dc152bd0 0x7fb2dc1541a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.733+0000 7fb2e135c700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2dc148310 con 0x7fb2dc06ead0 2024-08-17T02:25:25.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.733+0000 7fb2e135c700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2dc1479e0 con 0x7fb2dc0b1830 2024-08-17T02:25:25.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.733+0000 7fb2e135c700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2dc147cc0 con 0x7fb2dc152bd0 2024-08-17T02:25:25.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.733+0000 7fb2dbfff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb2dc06ead0 0x7fb2dc150e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.733+0000 7fb2db7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2dc0b1830 0x7fb2dc1487a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.733+0000 7fb2dbfff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb2dc06ead0 0x7fb2dc150e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:40082/0 (socket says 172.21.15.104:40082) 2024-08-17T02:25:25.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.733+0000 7fb2dbfff700 1 -- 172.21.15.104:0/3040398598 learned_addr learned my addr 172.21.15.104:0/3040398598 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:25.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.733+0000 7fb2e0b5b700 1 --2- 172.21.15.104:0/3040398598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2dc152bd0 0x7fb2dc1541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.733+0000 7fb2db7fe700 1 -- 172.21.15.104:0/3040398598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2dc152bd0 msgr2=0x7fb2dc1541a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.733+0000 7fb2db7fe700 1 --2- 172.21.15.104:0/3040398598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2dc152bd0 0x7fb2dc1541a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.733+0000 7fb2db7fe700 1 -- 172.21.15.104:0/3040398598 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb2dc06ead0 msgr2=0x7fb2dc150e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.733+0000 7fb2db7fe700 1 --2- 172.21.15.104:0/3040398598 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb2dc06ead0 0x7fb2dc150e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.733+0000 7fb2db7fe700 1 -- 172.21.15.104:0/3040398598 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d40094f0 con 0x7fb2dc0b1830 2024-08-17T02:25:25.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.733+0000 7fb2e0b5b700 1 --2- 172.21.15.104:0/3040398598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2dc152bd0 0x7fb2dc1541a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:25.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.733+0000 7fb2dbfff700 1 --2- 172.21.15.104:0/3040398598 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb2dc06ead0 0x7fb2dc150e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:25.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.733+0000 7fb2db7fe700 1 --2- 172.21.15.104:0/3040398598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2dc0b1830 0x7fb2dc1487a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb2c400cd50 tx=0x7fb2c4001b00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.733+0000 7fb2d3fff700 1 -- 172.21.15.104:0/3040398598 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c4005df0 con 0x7fb2dc0b1830 2024-08-17T02:25:25.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.733+0000 7fb2e135c700 1 -- 172.21.15.104:0/3040398598 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2dc147fa0 con 0x7fb2dc0b1830 2024-08-17T02:25:25.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.733+0000 7fb2d3fff700 1 -- 172.21.15.104:0/3040398598 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c400aa80 con 0x7fb2dc0b1830 2024-08-17T02:25:25.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.733+0000 7fb2e135c700 1 -- 172.21.15.104:0/3040398598 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2dc144cf0 con 0x7fb2dc0b1830 2024-08-17T02:25:25.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.733+0000 7fb2d3fff700 1 -- 172.21.15.104:0/3040398598 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c400abf0 con 0x7fb2dc0b1830 2024-08-17T02:25:25.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.737+0000 7fb2e135c700 1 -- 172.21.15.104:0/3040398598 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2dc0b0d00 con 0x7fb2dc0b1830 2024-08-17T02:25:25.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.737+0000 7fb2d3fff700 1 -- 172.21.15.104:0/3040398598 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb2c40070f0 con 0x7fb2dc0b1830 2024-08-17T02:25:25.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.737+0000 7fb2d3fff700 1 --2- 172.21.15.104:0/3040398598 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb2bc060860 0x7fb2bc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.737+0000 7fb2d3fff700 1 -- 172.21.15.104:0/3040398598 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fb2c407cdd0 con 0x7fb2dc0b1830 2024-08-17T02:25:25.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.737+0000 7fb2dbfff700 1 --2- 172.21.15.104:0/3040398598 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb2bc060860 0x7fb2bc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.737+0000 7fb2dbfff700 1 --2- 172.21.15.104:0/3040398598 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb2bc060860 0x7fb2bc062d10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc009fd0 tx=0x7fb2cc0091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.749+0000 7fb2d3fff700 1 -- 172.21.15.104:0/3040398598 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb2dc0b0d00 con 0x7fb2dc0b1830 2024-08-17T02:25:25.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.917+0000 7fb2e135c700 1 -- 172.21.15.104:0/3040398598 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb2dc1484c0 con 0x7fb2dc0b1830 2024-08-17T02:25:25.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.917+0000 7fb2d3fff700 1 -- 172.21.15.104:0/3040398598 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb2dc1484c0 con 0x7fb2dc0b1830 2024-08-17T02:25:25.920 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 32 2024-08-17T02:25:25.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.917+0000 7fb2e135c700 1 -- 172.21.15.104:0/3040398598 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb2bc060860 msgr2=0x7fb2bc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.917+0000 7fb2e135c700 1 --2- 172.21.15.104:0/3040398598 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb2bc060860 0x7fb2bc062d10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc009fd0 tx=0x7fb2cc0091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.917+0000 7fb2e135c700 1 -- 172.21.15.104:0/3040398598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2dc0b1830 msgr2=0x7fb2dc1487a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.917+0000 7fb2e135c700 1 --2- 172.21.15.104:0/3040398598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2dc0b1830 0x7fb2dc1487a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb2c400cd50 tx=0x7fb2c4001b00 comp rx=0 tx=0).stop 2024-08-17T02:25:25.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.917+0000 7fb2e135c700 1 -- 172.21.15.104:0/3040398598 shutdown_connections 2024-08-17T02:25:25.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.917+0000 7fb2e135c700 1 --2- 172.21.15.104:0/3040398598 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb2bc060860 0x7fb2bc062d10 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.917+0000 7fb2e135c700 1 --2- 172.21.15.104:0/3040398598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2dc152bd0 0x7fb2dc1541a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.917+0000 7fb2e135c700 1 --2- 172.21.15.104:0/3040398598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2dc0b1830 0x7fb2dc1487a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.917+0000 7fb2e135c700 1 --2- 172.21.15.104:0/3040398598 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb2dc06ead0 0x7fb2dc150e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.917+0000 7fb2e135c700 1 -- 172.21.15.104:0/3040398598 >> 172.21.15.104:0/3040398598 conn(0x7fb2dc0678a0 msgr2=0x7fb2dc068f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:25.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.917+0000 7fb2e135c700 1 -- 172.21.15.104:0/3040398598 shutdown_connections 2024-08-17T02:25:25.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:25.917+0000 7fb2e135c700 1 -- 172.21.15.104:0/3040398598 wait complete. 2024-08-17T02:25:25.934 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:25:26.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.041+0000 7f798259c700 1 Processor -- start 2024-08-17T02:25:26.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.041+0000 7f798259c700 1 -- start start 2024-08-17T02:25:26.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.045+0000 7f798259c700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f797c155e70 0x7f797c0ada10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:26.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.045+0000 7f798259c700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f797c0b1910 0x7f797c0ca600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:26.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.045+0000 7f798259c700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f797c0c9b90 con 0x7f797c0adf50 2024-08-17T02:25:26.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.045+0000 7f798259c700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f797c0ae3d0 con 0x7f797c155e70 2024-08-17T02:25:26.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.045+0000 7f798259c700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f797c0c9e00 con 0x7f797c0b1910 2024-08-17T02:25:26.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.045+0000 7f797bfff700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f797c155e70 0x7f797c0ada10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:26.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.045+0000 7f797bfff700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f797c155e70 0x7f797c0ada10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:40092/0 (socket says 172.21.15.104:40092) 2024-08-17T02:25:26.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.045+0000 7f797bfff700 1 -- 172.21.15.104:0/1177955811 learned_addr learned my addr 172.21.15.104:0/1177955811 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:26.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.045+0000 7f7980b39700 1 --2- 172.21.15.104:0/1177955811 >> v2:172.21.15.117:3300/0 conn(0x7f797c0b1910 0x7f797c0ca600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:26.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.045+0000 7f797bfff700 1 -- 172.21.15.104:0/1177955811 >> v2:172.21.15.117:3300/0 conn(0x7f797c0b1910 msgr2=0x7f797c0ca600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:26.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.045+0000 7f797bfff700 1 --2- 172.21.15.104:0/1177955811 >> v2:172.21.15.117:3300/0 conn(0x7f797c0b1910 0x7f797c0ca600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.045+0000 7f797bfff700 1 -- 172.21.15.104:0/1177955811 >> v1:172.21.15.117:6789/0 conn(0x7f797c0adf50 legacy=0x7f797c0b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.045+0000 7f797bfff700 1 -- 172.21.15.104:0/1177955811 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f797c0ca0e0 con 0x7f797c155e70 2024-08-17T02:25:26.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.045+0000 7f797bfff700 1 --2- 172.21.15.104:0/1177955811 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f797c155e70 0x7f797c0ada10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f797c0b2ab0 tx=0x7f796c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1207127cd4af071 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:26.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.045+0000 7f797b7fe700 1 -- 172.21.15.104:0/1177955811 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c00dba0 con 0x7f797c155e70 2024-08-17T02:25:26.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.045+0000 7f797b7fe700 1 -- 172.21.15.104:0/1177955811 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796c00dd00 con 0x7f797c155e70 2024-08-17T02:25:26.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.045+0000 7f797b7fe700 1 -- 172.21.15.104:0/1177955811 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c0196d0 con 0x7f797c155e70 2024-08-17T02:25:26.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.045+0000 7f798259c700 1 -- 172.21.15.104:0/1177955811 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f797c155e70 msgr2=0x7f797c0ada10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.045+0000 7f798259c700 1 --2- 172.21.15.104:0/1177955811 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f797c155e70 0x7f797c0ada10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f797c0b2ab0 tx=0x7f796c00b4f0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.045+0000 7f798259c700 1 -- 172.21.15.104:0/1177955811 shutdown_connections 2024-08-17T02:25:26.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.045+0000 7f798259c700 1 --2- 172.21.15.104:0/1177955811 >> v2:172.21.15.117:3300/0 conn(0x7f797c0b1910 0x7f797c0ca600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.045+0000 7f798259c700 1 --2- 172.21.15.104:0/1177955811 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f797c155e70 0x7f797c0ada10 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.045+0000 7f798259c700 1 -- 172.21.15.104:0/1177955811 >> 172.21.15.104:0/1177955811 conn(0x7f797c0687a0 msgr2=0x7f797c06c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:26.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.045+0000 7f798259c700 1 -- 172.21.15.104:0/1177955811 shutdown_connections 2024-08-17T02:25:26.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.045+0000 7f798259c700 1 -- 172.21.15.104:0/1177955811 wait complete. 2024-08-17T02:25:26.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.049+0000 7f798259c700 1 Processor -- start 2024-08-17T02:25:26.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.049+0000 7f798259c700 1 -- start start 2024-08-17T02:25:26.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.049+0000 7f798259c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f797c0b1910 0x7f797c14d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:26.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.049+0000 7f798259c700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f797c155e70 0x7f797c14a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:26.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.049+0000 7f798259c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f797c06bcf0 0x7f797c06c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:26.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.049+0000 7f798259c700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797c06c6b0 con 0x7f797c0b1910 2024-08-17T02:25:26.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.049+0000 7f798259c700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797c14c610 con 0x7f797c06bcf0 2024-08-17T02:25:26.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.049+0000 7f798259c700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f797c14ba00 con 0x7f797c155e70 2024-08-17T02:25:26.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.049+0000 7f797bfff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f797c0b1910 0x7f797c14d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:26.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.049+0000 7f797bfff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f797c0b1910 0x7f797c14d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:40098/0 (socket says 172.21.15.104:40098) 2024-08-17T02:25:26.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.049+0000 7f797bfff700 1 -- 172.21.15.104:0/1124620349 learned_addr learned my addr 172.21.15.104:0/1124620349 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:26.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.049+0000 7f79737fe700 1 --2- 172.21.15.104:0/1124620349 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f797c155e70 0x7f797c14a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:26.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.049+0000 7f7980b39700 1 --2- 172.21.15.104:0/1124620349 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f797c06bcf0 0x7f797c06c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:26.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.049+0000 7f797bfff700 1 -- 172.21.15.104:0/1124620349 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f797c155e70 msgr2=0x7f797c14a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.049+0000 7f797bfff700 1 --2- 172.21.15.104:0/1124620349 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f797c155e70 0x7f797c14a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.049+0000 7f797bfff700 1 -- 172.21.15.104:0/1124620349 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f797c06bcf0 msgr2=0x7f797c06c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.049+0000 7f797bfff700 1 --2- 172.21.15.104:0/1124620349 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f797c06bcf0 0x7f797c06c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.049+0000 7f797bfff700 1 -- 172.21.15.104:0/1124620349 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f796c00b790 con 0x7f797c0b1910 2024-08-17T02:25:26.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.049+0000 7f79737fe700 1 --2- 172.21.15.104:0/1124620349 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f797c155e70 0x7f797c14a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:26.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.053+0000 7f797bfff700 1 --2- 172.21.15.104:0/1124620349 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f797c0b1910 0x7f797c14d490 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f796c00b760 tx=0x7f796c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:26.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.053+0000 7f7978ff9700 1 -- 172.21.15.104:0/1124620349 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c010470 con 0x7f797c0b1910 2024-08-17T02:25:26.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.053+0000 7f7978ff9700 1 -- 172.21.15.104:0/1124620349 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796c0105d0 con 0x7f797c0b1910 2024-08-17T02:25:26.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.053+0000 7f798259c700 1 -- 172.21.15.104:0/1124620349 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f797c14bce0 con 0x7f797c0b1910 2024-08-17T02:25:26.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.053+0000 7f7978ff9700 1 -- 172.21.15.104:0/1124620349 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c010990 con 0x7f797c0b1910 2024-08-17T02:25:26.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.053+0000 7f798259c700 1 -- 172.21.15.104:0/1124620349 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f797c14c2a0 con 0x7f797c0b1910 2024-08-17T02:25:26.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.053+0000 7f7978ff9700 1 -- 172.21.15.104:0/1124620349 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f796c022030 con 0x7f797c0b1910 2024-08-17T02:25:26.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.053+0000 7f798259c700 1 -- 172.21.15.104:0/1124620349 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f797c0645c0 con 0x7f797c0b1910 2024-08-17T02:25:26.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.053+0000 7f7978ff9700 1 --2- 172.21.15.104:0/1124620349 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f795c060860 0x7f795c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:26.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.053+0000 7f7978ff9700 1 -- 172.21.15.104:0/1124620349 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f796c014070 con 0x7f797c0b1910 2024-08-17T02:25:26.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.053+0000 7f79737fe700 1 --2- 172.21.15.104:0/1124620349 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f795c060860 0x7f795c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:26.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.057+0000 7f79737fe700 1 --2- 172.21.15.104:0/1124620349 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f795c060860 0x7f795c062d10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7964007fd0 tx=0x7f7964009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:26.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.065+0000 7f7978ff9700 1 -- 172.21.15.104:0/1124620349 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f796c051240 con 0x7f797c0b1910 2024-08-17T02:25:26.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.221+0000 7f798259c700 1 -- 172.21.15.104:0/1124620349 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f797c0ad7f0 con 0x7f797c0b1910 2024-08-17T02:25:26.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.221+0000 7f7978ff9700 1 -- 172.21.15.104:0/1124620349 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7f796c023380 con 0x7f797c0b1910 2024-08-17T02:25:26.224 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 64 2024-08-17T02:25:26.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.221+0000 7f798259c700 1 -- 172.21.15.104:0/1124620349 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f795c060860 msgr2=0x7f795c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.221+0000 7f798259c700 1 --2- 172.21.15.104:0/1124620349 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f795c060860 0x7f795c062d10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7964007fd0 tx=0x7f7964009040 comp rx=0 tx=0).stop 2024-08-17T02:25:26.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.221+0000 7f798259c700 1 -- 172.21.15.104:0/1124620349 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f797c0b1910 msgr2=0x7f797c14d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.221+0000 7f798259c700 1 --2- 172.21.15.104:0/1124620349 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f797c0b1910 0x7f797c14d490 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f796c00b760 tx=0x7f796c01b000 comp rx=0 tx=0).stop 2024-08-17T02:25:26.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.221+0000 7f798259c700 1 -- 172.21.15.104:0/1124620349 shutdown_connections 2024-08-17T02:25:26.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.221+0000 7f798259c700 1 --2- 172.21.15.104:0/1124620349 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f795c060860 0x7f795c062d10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.221+0000 7f798259c700 1 --2- 172.21.15.104:0/1124620349 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f797c06bcf0 0x7f797c06c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.221+0000 7f798259c700 1 --2- 172.21.15.104:0/1124620349 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f797c155e70 0x7f797c14a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.221+0000 7f798259c700 1 --2- 172.21.15.104:0/1124620349 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f797c0b1910 0x7f797c14d490 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.221+0000 7f798259c700 1 -- 172.21.15.104:0/1124620349 >> 172.21.15.104:0/1124620349 conn(0x7f797c0687a0 msgr2=0x7f797c0acd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:26.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.225+0000 7f798259c700 1 -- 172.21.15.104:0/1124620349 shutdown_connections 2024-08-17T02:25:26.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.225+0000 7f798259c700 1 -- 172.21.15.104:0/1124620349 wait complete. 2024-08-17T02:25:26.238 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000188090.meta pg_num 2024-08-17T02:25:26.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.345+0000 7f7c78f35700 1 Processor -- start 2024-08-17T02:25:26.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.349+0000 7f7c78f35700 1 -- start start 2024-08-17T02:25:26.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.349+0000 7f7c78f35700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7c7413f680 0x7f7c740aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:26.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.349+0000 7f7c78f35700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c740b0810 con 0x7f7c740ad6c0 2024-08-17T02:25:26.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.349+0000 7f7c78f35700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c740afc70 con 0x7f7c7413fa50 2024-08-17T02:25:26.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.349+0000 7f7c78f35700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c740af060 con 0x7f7c7413f680 2024-08-17T02:25:26.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.349+0000 7f7c73fff700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f7c740ad6c0 0x7f7c7406e010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:35834/0 (socket says 172.21.15.104:35834) 2024-08-17T02:25:26.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.349+0000 7f7c73fff700 1 -- 172.21.15.104:0/90008041 learned_addr learned my addr 172.21.15.104:0/90008041 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:25:26.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.349+0000 7f7c737fe700 1 --2- 172.21.15.104:0/90008041 >> v2:172.21.15.117:3300/0 conn(0x7f7c7413f680 0x7f7c740aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:26.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.349+0000 7f7c727fc700 1 -- 172.21.15.104:0/90008041 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1684124321 0 0) 0x7f7c740b0810 con 0x7f7c740ad6c0 2024-08-17T02:25:26.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.349+0000 7f7c727fc700 1 -- 172.21.15.104:0/90008041 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c60003570 con 0x7f7c740ad6c0 2024-08-17T02:25:26.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.349+0000 7f7c727fc700 1 -- 172.21.15.104:0/90008041 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2940414511 0 0) 0x7f7c60003570 con 0x7f7c740ad6c0 2024-08-17T02:25:26.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.349+0000 7f7c727fc700 1 -- 172.21.15.104:0/90008041 >> v2:172.21.15.117:3300/0 conn(0x7f7c7413f680 msgr2=0x7f7c740aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:26.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.349+0000 7f7c727fc700 1 --2- 172.21.15.104:0/90008041 >> v2:172.21.15.117:3300/0 conn(0x7f7c7413f680 0x7f7c740aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.349+0000 7f7c727fc700 1 -- 172.21.15.104:0/90008041 >> v1:172.21.15.117:6789/0 conn(0x7f7c7413fa50 legacy=0x7f7c740b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.349+0000 7f7c727fc700 1 -- 172.21.15.104:0/90008041 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c740af340 con 0x7f7c740ad6c0 2024-08-17T02:25:26.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.349+0000 7f7c727fc700 1 -- 172.21.15.104:0/90008041 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1279957748 0 0) 0x7f7c6c0017f0 con 0x7f7c740ad6c0 2024-08-17T02:25:26.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.349+0000 7f7c727fc700 1 -- 172.21.15.104:0/90008041 >> v1:172.21.15.104:6789/0 conn(0x7f7c740ad6c0 legacy=0x7f7c7406e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.349+0000 7f7c727fc700 1 --2- 172.21.15.104:0/90008041 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c60003a60 0x7f7c60003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:26.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.349+0000 7f7c727fc700 1 --2- 172.21.15.104:0/90008041 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c60004810 0x7f7c60004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:26.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.349+0000 7f7c727fc700 1 --2- 172.21.15.104:0/90008041 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c600052e0 0x7f7c6000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:26.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.349+0000 7f7c727fc700 1 -- 172.21.15.104:0/90008041 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c740af060 con 0x7f7c600052e0 2024-08-17T02:25:26.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.349+0000 7f7c727fc700 1 -- 172.21.15.104:0/90008041 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6000c230 con 0x7f7c60004810 2024-08-17T02:25:26.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.349+0000 7f7c727fc700 1 -- 172.21.15.104:0/90008041 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6000c3f0 con 0x7f7c60003a60 2024-08-17T02:25:26.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.349+0000 7f7c73fff700 1 --2- 172.21.15.104:0/90008041 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c600052e0 0x7f7c6000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:26.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.349+0000 7f7c737fe700 1 --2- 172.21.15.104:0/90008041 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c60003a60 0x7f7c60003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:26.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.349+0000 7f7c72ffd700 1 --2- 172.21.15.104:0/90008041 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c60004810 0x7f7c60004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:26.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.349+0000 7f7c73fff700 1 -- 172.21.15.104:0/90008041 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c60003a60 msgr2=0x7f7c60003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:26.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.349+0000 7f7c73fff700 1 --2- 172.21.15.104:0/90008041 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c60003a60 0x7f7c60003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.349+0000 7f7c73fff700 1 -- 172.21.15.104:0/90008041 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c60004810 msgr2=0x7f7c60004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:26.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.349+0000 7f7c73fff700 1 --2- 172.21.15.104:0/90008041 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c60004810 0x7f7c60004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.349+0000 7f7c73fff700 1 -- 172.21.15.104:0/90008041 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c60003570 con 0x7f7c600052e0 2024-08-17T02:25:26.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.349+0000 7f7c73fff700 1 -- 172.21.15.104:0/90008041 reap_dead start 2024-08-17T02:25:26.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.349+0000 7f7c73fff700 1 --2- 172.21.15.104:0/90008041 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c600052e0 0x7f7c6000ba60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c00a930 tx=0x7f7c6c0021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7e5a40c0b5648e1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:26.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.349+0000 7f7c727fc700 1 -- 172.21.15.104:0/90008041 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c0070d0 con 0x7f7c600052e0 2024-08-17T02:25:26.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.349+0000 7f7c727fc700 1 -- 172.21.15.104:0/90008041 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6c007270 con 0x7f7c600052e0 2024-08-17T02:25:26.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.349+0000 7f7c727fc700 1 -- 172.21.15.104:0/90008041 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c007630 con 0x7f7c600052e0 2024-08-17T02:25:26.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.353+0000 7f7c78f35700 1 -- 172.21.15.104:0/90008041 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c600052e0 msgr2=0x7f7c6000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.353+0000 7f7c78f35700 1 --2- 172.21.15.104:0/90008041 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c600052e0 0x7f7c6000ba60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c00a930 tx=0x7f7c6c0021d0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.353+0000 7f7c78f35700 1 -- 172.21.15.104:0/90008041 shutdown_connections 2024-08-17T02:25:26.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.353+0000 7f7c78f35700 1 --2- 172.21.15.104:0/90008041 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c600052e0 0x7f7c6000ba60 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.353+0000 7f7c78f35700 1 -- 172.21.15.104:0/90008041 >> 172.21.15.104:0/90008041 conn(0x7f7c740678a0 msgr2=0x7f7c74067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:26.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.353+0000 7f7c78f35700 1 -- 172.21.15.104:0/90008041 shutdown_connections 2024-08-17T02:25:26.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.353+0000 7f7c78f35700 1 -- 172.21.15.104:0/90008041 wait complete. 2024-08-17T02:25:26.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.353+0000 7f7c78f35700 1 Processor -- start 2024-08-17T02:25:26.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.353+0000 7f7c78f35700 1 -- start start 2024-08-17T02:25:26.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.353+0000 7f7c78f35700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c600052e0 0x7f7c741584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:26.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.353+0000 7f7c78f35700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c7414d0f0 0x7f7c7414d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:26.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.353+0000 7f7c78f35700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c7414a890 0x7f7c7414ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:26.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.353+0000 7f7c78f35700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7412d6e0 con 0x7f7c7414a890 2024-08-17T02:25:26.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.353+0000 7f7c78f35700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c74155ec0 con 0x7f7c600052e0 2024-08-17T02:25:26.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.353+0000 7f7c78f35700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7414bce0 con 0x7f7c7414d0f0 2024-08-17T02:25:26.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.353+0000 7f7c73fff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c7414a890 0x7f7c7414ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:26.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.353+0000 7f7c73fff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c7414a890 0x7f7c7414ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:40126/0 (socket says 172.21.15.104:40126) 2024-08-17T02:25:26.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.353+0000 7f7c73fff700 1 -- 172.21.15.104:0/518562013 learned_addr learned my addr 172.21.15.104:0/518562013 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:26.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.353+0000 7f7c72ffd700 1 --2- 172.21.15.104:0/518562013 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c7414d0f0 0x7f7c7414d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:26.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.353+0000 7f7c737fe700 1 --2- 172.21.15.104:0/518562013 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c600052e0 0x7f7c741584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:26.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.357+0000 7f7c73fff700 1 -- 172.21.15.104:0/518562013 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c7414d0f0 msgr2=0x7f7c7414d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.357+0000 7f7c73fff700 1 --2- 172.21.15.104:0/518562013 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c7414d0f0 0x7f7c7414d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.357+0000 7f7c73fff700 1 -- 172.21.15.104:0/518562013 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c600052e0 msgr2=0x7f7c741584d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.357+0000 7f7c73fff700 1 --2- 172.21.15.104:0/518562013 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c600052e0 0x7f7c741584d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.357+0000 7f7c73fff700 1 -- 172.21.15.104:0/518562013 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c740cb390 con 0x7f7c7414a890 2024-08-17T02:25:26.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.357+0000 7f7c73fff700 1 --2- 172.21.15.104:0/518562013 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c7414a890 0x7f7c7414ad30 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c00af20 tx=0x7f7c6c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:26.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.357+0000 7f7c6b7fe700 1 -- 172.21.15.104:0/518562013 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c022070 con 0x7f7c7414a890 2024-08-17T02:25:26.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.357+0000 7f7c6b7fe700 1 -- 172.21.15.104:0/518562013 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6c0073e0 con 0x7f7c7414a890 2024-08-17T02:25:26.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.357+0000 7f7c78f35700 1 -- 172.21.15.104:0/518562013 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c74130780 con 0x7f7c7414a890 2024-08-17T02:25:26.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.357+0000 7f7c6b7fe700 1 -- 172.21.15.104:0/518562013 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c01d420 con 0x7f7c7414a890 2024-08-17T02:25:26.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.357+0000 7f7c78f35700 1 -- 172.21.15.104:0/518562013 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c7414ba00 con 0x7f7c7414a890 2024-08-17T02:25:26.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.357+0000 7f7c78f35700 1 -- 172.21.15.104:0/518562013 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c74064330 con 0x7f7c7414a890 2024-08-17T02:25:26.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.357+0000 7f7c6b7fe700 1 -- 172.21.15.104:0/518562013 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7c6c01d810 con 0x7f7c7414a890 2024-08-17T02:25:26.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.357+0000 7f7c6b7fe700 1 --2- 172.21.15.104:0/518562013 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7c54060890 0x7f7c54062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:26.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.357+0000 7f7c6b7fe700 1 -- 172.21.15.104:0/518562013 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f7c6c07e720 con 0x7f7c7414a890 2024-08-17T02:25:26.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.357+0000 7f7c737fe700 1 --2- 172.21.15.104:0/518562013 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7c54060890 0x7f7c54062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:26.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.361+0000 7f7c737fe700 1 --2- 172.21.15.104:0/518562013 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7c54060890 0x7f7c54062d40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7c64006ee0 tx=0x7f7c6400b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:26.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.365+0000 7f7c6b7fe700 1 -- 172.21.15.104:0/518562013 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f7c6c04e780 con 0x7f7c7414a890 2024-08-17T02:25:26.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.525+0000 7f7c78f35700 1 -- 172.21.15.104:0/518562013 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000188090.meta", "var": "pg_num"} v 0) v1 -- 0x7f7c740cb370 con 0x7f7c7414a890 2024-08-17T02:25:26.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.525+0000 7f7c6b7fe700 1 -- 172.21.15.104:0/518562013 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000188090.meta", "var": "pg_num"}]=0 v41) v1 ==== 124+0+11 (secure 0 0 0) 0x7f7c6c051da0 con 0x7f7c7414a890 2024-08-17T02:25:26.527 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 32 2024-08-17T02:25:26.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.525+0000 7f7c78f35700 1 -- 172.21.15.104:0/518562013 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7c54060890 msgr2=0x7f7c54062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.525+0000 7f7c78f35700 1 --2- 172.21.15.104:0/518562013 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7c54060890 0x7f7c54062d40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7c64006ee0 tx=0x7f7c6400b040 comp rx=0 tx=0).stop 2024-08-17T02:25:26.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.525+0000 7f7c78f35700 1 -- 172.21.15.104:0/518562013 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c7414a890 msgr2=0x7f7c7414ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.525+0000 7f7c78f35700 1 --2- 172.21.15.104:0/518562013 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c7414a890 0x7f7c7414ad30 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c00af20 tx=0x7f7c6c016000 comp rx=0 tx=0).stop 2024-08-17T02:25:26.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.525+0000 7f7c78f35700 1 -- 172.21.15.104:0/518562013 shutdown_connections 2024-08-17T02:25:26.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.525+0000 7f7c78f35700 1 --2- 172.21.15.104:0/518562013 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7c54060890 0x7f7c54062d40 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.525+0000 7f7c78f35700 1 --2- 172.21.15.104:0/518562013 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c7414a890 0x7f7c7414ad30 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.525+0000 7f7c78f35700 1 --2- 172.21.15.104:0/518562013 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c7414d0f0 0x7f7c7414d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.525+0000 7f7c78f35700 1 --2- 172.21.15.104:0/518562013 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c600052e0 0x7f7c741584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.525+0000 7f7c78f35700 1 -- 172.21.15.104:0/518562013 >> 172.21.15.104:0/518562013 conn(0x7f7c740678a0 msgr2=0x7f7c7406dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:26.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.525+0000 7f7c78f35700 1 -- 172.21.15.104:0/518562013 shutdown_connections 2024-08-17T02:25:26.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.525+0000 7f7c78f35700 1 -- 172.21.15.104:0/518562013 wait complete. 2024-08-17T02:25:26.542 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000188090.data pg_num 2024-08-17T02:25:26.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.649+0000 7fc941597700 1 Processor -- start 2024-08-17T02:25:26.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.649+0000 7fc941597700 1 -- start start 2024-08-17T02:25:26.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.649+0000 7fc941597700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc93c13f680 0x7fc93c0aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:26.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.649+0000 7fc941597700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc93c13fa50 0x7fc93c0ad6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:26.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.649+0000 7fc941597700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc93c0afc70 con 0x7fc93c0b0100 2024-08-17T02:25:26.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.649+0000 7fc941597700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc93c0adc00 con 0x7fc93c13fa50 2024-08-17T02:25:26.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.649+0000 7fc941597700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc93c0af060 con 0x7fc93c13f680 2024-08-17T02:25:26.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.649+0000 7fc940d96700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fc93c0b0100 0x7fc93c06e010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:35844/0 (socket says 172.21.15.104:35844) 2024-08-17T02:25:26.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.649+0000 7fc940d96700 1 -- 172.21.15.104:0/1824084936 learned_addr learned my addr 172.21.15.104:0/1824084936 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:25:26.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.653+0000 7fc93bfff700 1 --2- 172.21.15.104:0/1824084936 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc93c13f680 0x7fc93c0aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:26.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.653+0000 7fc93b7fe700 1 --2- 172.21.15.104:0/1824084936 >> v2:172.21.15.117:3300/0 conn(0x7fc93c13fa50 0x7fc93c0ad6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:26.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.653+0000 7fc93affd700 1 -- 172.21.15.104:0/1824084936 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2396037286 0 0) 0x7fc93c0afc70 con 0x7fc93c0b0100 2024-08-17T02:25:26.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.653+0000 7fc93affd700 1 -- 172.21.15.104:0/1824084936 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc928003570 con 0x7fc93c0b0100 2024-08-17T02:25:26.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.653+0000 7fc93bfff700 1 -- 172.21.15.104:0/1824084936 >> v2:172.21.15.117:3300/0 conn(0x7fc93c13fa50 msgr2=0x7fc93c0ad6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:26.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.653+0000 7fc93bfff700 1 --2- 172.21.15.104:0/1824084936 >> v2:172.21.15.117:3300/0 conn(0x7fc93c13fa50 0x7fc93c0ad6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.653+0000 7fc93bfff700 1 -- 172.21.15.104:0/1824084936 >> v1:172.21.15.104:6789/0 conn(0x7fc93c0b0100 legacy=0x7fc93c06e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.653+0000 7fc93affd700 1 -- 172.21.15.104:0/1824084936 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4220538876 0 0) 0x7fc928003570 con 0x7fc93c0b0100 2024-08-17T02:25:26.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.653+0000 7fc93bfff700 1 -- 172.21.15.104:0/1824084936 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc93c0af340 con 0x7fc93c13f680 2024-08-17T02:25:26.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.653+0000 7fc93bfff700 1 --2- 172.21.15.104:0/1824084936 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc93c13f680 0x7fc93c0aea80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc92c009e60 tx=0x7fc92c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25a37faa8b97d0b1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:26.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.653+0000 7fc93affd700 1 -- 172.21.15.104:0/1824084936 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c00e070 con 0x7fc93c13f680 2024-08-17T02:25:26.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.653+0000 7fc93affd700 1 -- 172.21.15.104:0/1824084936 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92c00b7a0 con 0x7fc93c13f680 2024-08-17T02:25:26.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.653+0000 7fc93affd700 1 -- 172.21.15.104:0/1824084936 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc934001470 con 0x7fc93c13f680 2024-08-17T02:25:26.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.653+0000 7fc941597700 1 -- 172.21.15.104:0/1824084936 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc93c13f680 msgr2=0x7fc93c0aea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.653+0000 7fc941597700 1 --2- 172.21.15.104:0/1824084936 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc93c13f680 0x7fc93c0aea80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc92c009e60 tx=0x7fc92c009780 comp rx=0 tx=0).stop 2024-08-17T02:25:26.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.653+0000 7fc941597700 1 -- 172.21.15.104:0/1824084936 shutdown_connections 2024-08-17T02:25:26.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.653+0000 7fc941597700 1 --2- 172.21.15.104:0/1824084936 >> v2:172.21.15.117:3300/0 conn(0x7fc93c13fa50 0x7fc93c0ad6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.653+0000 7fc941597700 1 --2- 172.21.15.104:0/1824084936 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc93c13f680 0x7fc93c0aea80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.653+0000 7fc941597700 1 -- 172.21.15.104:0/1824084936 >> 172.21.15.104:0/1824084936 conn(0x7fc93c0678a0 msgr2=0x7fc93c067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:26.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.653+0000 7fc941597700 1 -- 172.21.15.104:0/1824084936 shutdown_connections 2024-08-17T02:25:26.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.653+0000 7fc941597700 1 -- 172.21.15.104:0/1824084936 wait complete. 2024-08-17T02:25:26.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.657+0000 7fc941597700 1 Processor -- start 2024-08-17T02:25:26.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.657+0000 7fc941597700 1 -- start start 2024-08-17T02:25:26.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.657+0000 7fc941597700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc93c0b0100 0x7fc93c158e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:26.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.657+0000 7fc941597700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc93c13f680 0x7fc93c14fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:26.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.657+0000 7fc941597700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc93c13fa50 0x7fc93c1506c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:26.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.657+0000 7fc941597700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93c152d10 con 0x7fc93c13f680 2024-08-17T02:25:26.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.657+0000 7fc941597700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93c1523e0 con 0x7fc93c13fa50 2024-08-17T02:25:26.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.657+0000 7fc941597700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc93c1526c0 con 0x7fc93c0b0100 2024-08-17T02:25:26.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.657+0000 7fc93b7fe700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc93c13f680 0x7fc93c14fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:26.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.657+0000 7fc93b7fe700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc93c13f680 0x7fc93c14fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:40134/0 (socket says 172.21.15.104:40134) 2024-08-17T02:25:26.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.657+0000 7fc93b7fe700 1 -- 172.21.15.104:0/475309747 learned_addr learned my addr 172.21.15.104:0/475309747 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:26.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.657+0000 7fc93bfff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc93c0b0100 0x7fc93c158e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:26.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.657+0000 7fc940d96700 1 --2- 172.21.15.104:0/475309747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc93c13fa50 0x7fc93c1506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:26.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.657+0000 7fc93b7fe700 1 -- 172.21.15.104:0/475309747 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc93c0b0100 msgr2=0x7fc93c158e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.657+0000 7fc93b7fe700 1 --2- 172.21.15.104:0/475309747 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc93c0b0100 0x7fc93c158e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.657+0000 7fc93b7fe700 1 -- 172.21.15.104:0/475309747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc93c13fa50 msgr2=0x7fc93c1506c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.657+0000 7fc93b7fe700 1 --2- 172.21.15.104:0/475309747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc93c13fa50 0x7fc93c1506c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.657+0000 7fc93b7fe700 1 -- 172.21.15.104:0/475309747 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc92c009a20 con 0x7fc93c13f680 2024-08-17T02:25:26.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.657+0000 7fc940d96700 1 --2- 172.21.15.104:0/475309747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc93c13fa50 0x7fc93c1506c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:26.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.657+0000 7fc93bfff700 1 --2- 172.21.15.104:0/475309747 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc93c0b0100 0x7fc93c158e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:26.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.657+0000 7fc93b7fe700 1 --2- 172.21.15.104:0/475309747 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc93c13f680 0x7fc93c14fe60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc92400e900 tx=0x7fc9240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:26.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.657+0000 7fc933fff700 1 -- 172.21.15.104:0/475309747 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc924013680 con 0x7fc93c13f680 2024-08-17T02:25:26.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.657+0000 7fc933fff700 1 -- 172.21.15.104:0/475309747 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9240137e0 con 0x7fc93c13f680 2024-08-17T02:25:26.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.657+0000 7fc941597700 1 -- 172.21.15.104:0/475309747 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc93c1529a0 con 0x7fc93c13f680 2024-08-17T02:25:26.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.657+0000 7fc933fff700 1 -- 172.21.15.104:0/475309747 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc924013ba0 con 0x7fc93c13f680 2024-08-17T02:25:26.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.657+0000 7fc941597700 1 -- 172.21.15.104:0/475309747 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc93c150c00 con 0x7fc93c13f680 2024-08-17T02:25:26.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.661+0000 7fc941597700 1 -- 172.21.15.104:0/475309747 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc93c159380 con 0x7fc93c13f680 2024-08-17T02:25:26.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.661+0000 7fc933fff700 1 -- 172.21.15.104:0/475309747 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fc9240123d0 con 0x7fc93c13f680 2024-08-17T02:25:26.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.661+0000 7fc933fff700 1 --2- 172.21.15.104:0/475309747 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fc91c060860 0x7fc91c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:26.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.661+0000 7fc933fff700 1 -- 172.21.15.104:0/475309747 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fc92407d0a0 con 0x7fc93c13f680 2024-08-17T02:25:26.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.661+0000 7fc93bfff700 1 --2- 172.21.15.104:0/475309747 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fc91c060860 0x7fc91c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:26.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.661+0000 7fc93bfff700 1 --2- 172.21.15.104:0/475309747 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fc91c060860 0x7fc91c062d10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0099f0 tx=0x7fc92c018000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:26.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.669+0000 7fc933fff700 1 -- 172.21.15.104:0/475309747 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fc92404d100 con 0x7fc93c13f680 2024-08-17T02:25:26.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.833+0000 7fc941597700 1 -- 172.21.15.104:0/475309747 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000188090.data", "var": "pg_num"} v 0) v1 -- 0x7fc93c152ec0 con 0x7fc93c13f680 2024-08-17T02:25:26.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.833+0000 7fc933fff700 1 -- 172.21.15.104:0/475309747 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000188090.data", "var": "pg_num"}]=0 v41) v1 ==== 124+0+11 (secure 0 0 0) 0x7fc924050720 con 0x7fc93c13f680 2024-08-17T02:25:26.837 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 32 2024-08-17T02:25:26.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.837+0000 7fc941597700 1 -- 172.21.15.104:0/475309747 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fc91c060860 msgr2=0x7fc91c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.837+0000 7fc941597700 1 --2- 172.21.15.104:0/475309747 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fc91c060860 0x7fc91c062d10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0099f0 tx=0x7fc92c018000 comp rx=0 tx=0).stop 2024-08-17T02:25:26.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.837+0000 7fc941597700 1 -- 172.21.15.104:0/475309747 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc93c13f680 msgr2=0x7fc93c14fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.837+0000 7fc941597700 1 --2- 172.21.15.104:0/475309747 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc93c13f680 0x7fc93c14fe60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc92400e900 tx=0x7fc9240091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.837+0000 7fc941597700 1 -- 172.21.15.104:0/475309747 shutdown_connections 2024-08-17T02:25:26.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.837+0000 7fc941597700 1 --2- 172.21.15.104:0/475309747 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fc91c060860 0x7fc91c062d10 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.837+0000 7fc941597700 1 --2- 172.21.15.104:0/475309747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc93c13fa50 0x7fc93c1506c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.837+0000 7fc941597700 1 --2- 172.21.15.104:0/475309747 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc93c13f680 0x7fc93c14fe60 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.837+0000 7fc941597700 1 --2- 172.21.15.104:0/475309747 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc93c0b0100 0x7fc93c158e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.837+0000 7fc941597700 1 -- 172.21.15.104:0/475309747 >> 172.21.15.104:0/475309747 conn(0x7fc93c0678a0 msgr2=0x7fc93c13e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:26.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.837+0000 7fc941597700 1 -- 172.21.15.104:0/475309747 shutdown_connections 2024-08-17T02:25:26.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.837+0000 7fc941597700 1 -- 172.21.15.104:0/475309747 wait complete. 2024-08-17T02:25:26.851 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:25:26.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.953+0000 7f977b59e700 1 Processor -- start 2024-08-17T02:25:26.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.953+0000 7f977b59e700 1 -- start start 2024-08-17T02:25:26.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.957+0000 7f977b59e700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f977c158eb0 0x7f977c0aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:26.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.957+0000 7f977b59e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f977c06e620 0x7f977c0ac490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:26.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.957+0000 7f977b59e700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f977c0ac000 con 0x7f977c0aecc0 2024-08-17T02:25:26.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.957+0000 7f977b59e700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f977c0ab3f0 con 0x7f977c158eb0 2024-08-17T02:25:26.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.957+0000 7f977b59e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977c0ab6d0 con 0x7f977c06e620 2024-08-17T02:25:26.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.957+0000 7f977a59c700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f977c158eb0 0x7f977c0aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:26.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.957+0000 7f977a59c700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f977c158eb0 0x7f977c0aaa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33138/0 (socket says 172.21.15.104:33138) 2024-08-17T02:25:26.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.957+0000 7f977a59c700 1 -- 172.21.15.104:0/748584571 learned_addr learned my addr 172.21.15.104:0/748584571 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:26.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.957+0000 7f977ad9d700 1 --2- 172.21.15.104:0/748584571 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f977c06e620 0x7f977c0ac490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:26.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.957+0000 7f977a59c700 1 -- 172.21.15.104:0/748584571 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f977c06e620 msgr2=0x7f977c0ac490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:26.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.957+0000 7f977a59c700 1 --2- 172.21.15.104:0/748584571 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f977c06e620 0x7f977c0ac490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.957+0000 7f977a59c700 1 -- 172.21.15.104:0/748584571 >> v1:172.21.15.117:6789/0 conn(0x7f977c0aecc0 legacy=0x7f977c06df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.957+0000 7f977a59c700 1 -- 172.21.15.104:0/748584571 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f977c0ab9b0 con 0x7f977c158eb0 2024-08-17T02:25:26.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.957+0000 7f977ad9d700 1 --2- 172.21.15.104:0/748584571 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f977c06e620 0x7f977c0ac490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:26.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.957+0000 7f977a59c700 1 --2- 172.21.15.104:0/748584571 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f977c158eb0 0x7f977c0aaa80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f976c0099b0 tx=0x7f976c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be428e020deb2493 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:26.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.957+0000 7f977959a700 1 -- 172.21.15.104:0/748584571 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c00b860 con 0x7f977c158eb0 2024-08-17T02:25:26.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.957+0000 7f977959a700 1 -- 172.21.15.104:0/748584571 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976c00b9c0 con 0x7f977c158eb0 2024-08-17T02:25:26.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.957+0000 7f977959a700 1 -- 172.21.15.104:0/748584571 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c00bd60 con 0x7f977c158eb0 2024-08-17T02:25:26.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.957+0000 7f977b59e700 1 -- 172.21.15.104:0/748584571 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f977c158eb0 msgr2=0x7f977c0aaa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.957+0000 7f977b59e700 1 --2- 172.21.15.104:0/748584571 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f977c158eb0 0x7f977c0aaa80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f976c0099b0 tx=0x7f976c009250 comp rx=0 tx=0).stop 2024-08-17T02:25:26.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.957+0000 7f977b59e700 1 -- 172.21.15.104:0/748584571 shutdown_connections 2024-08-17T02:25:26.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.957+0000 7f977b59e700 1 --2- 172.21.15.104:0/748584571 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f977c06e620 0x7f977c0ac490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.957+0000 7f977b59e700 1 --2- 172.21.15.104:0/748584571 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f977c158eb0 0x7f977c0aaa80 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.957+0000 7f977b59e700 1 -- 172.21.15.104:0/748584571 >> 172.21.15.104:0/748584571 conn(0x7f977c0678d0 msgr2=0x7f977c067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:26.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.957+0000 7f977b59e700 1 -- 172.21.15.104:0/748584571 shutdown_connections 2024-08-17T02:25:26.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.957+0000 7f977b59e700 1 -- 172.21.15.104:0/748584571 wait complete. 2024-08-17T02:25:26.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.961+0000 7f977b59e700 1 Processor -- start 2024-08-17T02:25:26.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.961+0000 7f977b59e700 1 -- start start 2024-08-17T02:25:26.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.961+0000 7f977b59e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f977c06e620 0x7f977c141650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:26.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.961+0000 7f977b59e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f977c0aecc0 0x7f977c0caa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:26.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.961+0000 7f977b59e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f977c158eb0 0x7f977c0cafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:26.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.961+0000 7f977b59e700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c14e430 con 0x7f977c158eb0 2024-08-17T02:25:26.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.961+0000 7f977b59e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c14d860 con 0x7f977c06e620 2024-08-17T02:25:26.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.961+0000 7f977b59e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977c14e8c0 con 0x7f977c0aecc0 2024-08-17T02:25:26.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.961+0000 7f977ad9d700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f977c158eb0 0x7f977c0cafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:26.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.961+0000 7f977ad9d700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f977c158eb0 0x7f977c0cafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33146/0 (socket says 172.21.15.104:33146) 2024-08-17T02:25:26.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.961+0000 7f977ad9d700 1 -- 172.21.15.104:0/2968275995 learned_addr learned my addr 172.21.15.104:0/2968275995 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:26.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.961+0000 7f9779d9b700 1 --2- 172.21.15.104:0/2968275995 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f977c0aecc0 0x7f977c0caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:26.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.961+0000 7f977a59c700 1 --2- 172.21.15.104:0/2968275995 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f977c06e620 0x7f977c141650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:26.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.961+0000 7f977ad9d700 1 -- 172.21.15.104:0/2968275995 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f977c0aecc0 msgr2=0x7f977c0caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.961+0000 7f977ad9d700 1 --2- 172.21.15.104:0/2968275995 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f977c0aecc0 0x7f977c0caa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.961+0000 7f977ad9d700 1 -- 172.21.15.104:0/2968275995 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f977c06e620 msgr2=0x7f977c141650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.961+0000 7f977ad9d700 1 --2- 172.21.15.104:0/2968275995 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f977c06e620 0x7f977c141650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.961+0000 7f977ad9d700 1 -- 172.21.15.104:0/2968275995 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f976c0094f0 con 0x7f977c158eb0 2024-08-17T02:25:26.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.965+0000 7f977ad9d700 1 --2- 172.21.15.104:0/2968275995 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f977c158eb0 0x7f977c0cafc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9774007f60 tx=0x7f9774009950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:26.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.965+0000 7f97727fc700 1 -- 172.21.15.104:0/2968275995 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977400db80 con 0x7f977c158eb0 2024-08-17T02:25:26.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.965+0000 7f97727fc700 1 -- 172.21.15.104:0/2968275995 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977400f040 con 0x7f977c158eb0 2024-08-17T02:25:26.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.965+0000 7f97727fc700 1 -- 172.21.15.104:0/2968275995 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9774015440 con 0x7f977c158eb0 2024-08-17T02:25:26.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.965+0000 7f977b59e700 1 -- 172.21.15.104:0/2968275995 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f977c14db00 con 0x7f977c158eb0 2024-08-17T02:25:26.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.965+0000 7f977b59e700 1 -- 172.21.15.104:0/2968275995 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f977c14e0c0 con 0x7f977c158eb0 2024-08-17T02:25:26.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.965+0000 7f977b59e700 1 -- 172.21.15.104:0/2968275995 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f977c0643a0 con 0x7f977c158eb0 2024-08-17T02:25:26.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.965+0000 7f97727fc700 1 -- 172.21.15.104:0/2968275995 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f977401e3b0 con 0x7f977c158eb0 2024-08-17T02:25:26.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.965+0000 7f97727fc700 1 --2- 172.21.15.104:0/2968275995 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f9760060860 0x7f9760062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:26.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.965+0000 7f97727fc700 1 -- 172.21.15.104:0/2968275995 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f977407d3a0 con 0x7f977c158eb0 2024-08-17T02:25:26.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.965+0000 7f977a59c700 1 --2- 172.21.15.104:0/2968275995 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f9760060860 0x7f9760062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:26.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.969+0000 7f977a59c700 1 --2- 172.21.15.104:0/2968275995 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f9760060860 0x7f9760062d10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f976c0099b0 tx=0x7f976c017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:26.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:26.973+0000 7f97727fc700 1 -- 172.21.15.104:0/2968275995 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f977404d400 con 0x7f977c158eb0 2024-08-17T02:25:27.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.165+0000 7f977b59e700 1 -- 172.21.15.104:0/2968275995 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f977c0af120 con 0x7f977c158eb0 2024-08-17T02:25:27.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.169+0000 7f97727fc700 1 -- 172.21.15.104:0/2968275995 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+5690 (secure 0 0 0) 0x7f9774050a20 con 0x7f977c158eb0 2024-08-17T02:25:27.171 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:25:27.171 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/3848434798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3848434798},{"type":"v1","addr":"172.21.15.117:6836","nonce":3848434798}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4894,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1461239637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1461239637},{"type":"v1","addr":"172.21.15.117:6837","nonce":1461239637}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:23:05.468383+0000","modified":"2024-08-17T02:23:08.148034+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4965},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4965":{"gid":4965,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/38993094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":38993094},{"type":"v1","addr":"172.21.15.104:6835","nonce":38993094}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:23:22.321122+0000","modified":"2024-08-17T02:23:24.304353+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4959},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4959":{"gid":4959,"name":"c","rank":0,"incarnation":16,"state":"up:active","state_seq":8,"addr":"172.21.15.104:6833/4148924116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":4148924116},{"type":"v1","addr":"172.21.15.104:6833","nonce":4148924116}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000188090","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:25:27.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.169+0000 7f977b59e700 1 -- 172.21.15.104:0/2968275995 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f9760060860 msgr2=0x7f9760062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:27.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.169+0000 7f977b59e700 1 --2- 172.21.15.104:0/2968275995 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f9760060860 0x7f9760062d10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f976c0099b0 tx=0x7f976c017000 comp rx=0 tx=0).stop 2024-08-17T02:25:27.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.169+0000 7f977b59e700 1 -- 172.21.15.104:0/2968275995 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f977c158eb0 msgr2=0x7f977c0cafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:27.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.169+0000 7f977b59e700 1 --2- 172.21.15.104:0/2968275995 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f977c158eb0 0x7f977c0cafc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9774007f60 tx=0x7f9774009950 comp rx=0 tx=0).stop 2024-08-17T02:25:27.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.169+0000 7f977b59e700 1 -- 172.21.15.104:0/2968275995 shutdown_connections 2024-08-17T02:25:27.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.169+0000 7f977b59e700 1 --2- 172.21.15.104:0/2968275995 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f9760060860 0x7f9760062d10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.169+0000 7f977b59e700 1 --2- 172.21.15.104:0/2968275995 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f977c158eb0 0x7f977c0cafc0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.169+0000 7f977b59e700 1 --2- 172.21.15.104:0/2968275995 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f977c0aecc0 0x7f977c0caa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.169+0000 7f977b59e700 1 --2- 172.21.15.104:0/2968275995 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f977c06e620 0x7f977c141650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.169+0000 7f977b59e700 1 -- 172.21.15.104:0/2968275995 >> 172.21.15.104:0/2968275995 conn(0x7f977c0678d0 msgr2=0x7f977c14ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:27.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.169+0000 7f977b59e700 1 -- 172.21.15.104:0/2968275995 shutdown_connections 2024-08-17T02:25:27.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.169+0000 7f977b59e700 1 -- 172.21.15.104:0/2968275995 wait complete. 2024-08-17T02:25:27.176 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 18 2024-08-17T02:25:27.185 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:27.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.285+0000 7f21dddef700 1 Processor -- start 2024-08-17T02:25:27.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.285+0000 7f21dddef700 1 -- start start 2024-08-17T02:25:27.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.285+0000 7f21dddef700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21d8154900 0x7f21d80b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:27.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.285+0000 7f21dddef700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f21d80b12d0 0x7f21d80cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:27.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.285+0000 7f21dddef700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21d80cbaa0 con 0x7f21d80cb390 2024-08-17T02:25:27.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.285+0000 7f21dddef700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21d8068790 con 0x7f21d80b12d0 2024-08-17T02:25:27.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.285+0000 7f21dddef700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d81583f0 con 0x7f21d8154900 2024-08-17T02:25:27.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.285+0000 7f21d7fff700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f21d80b12d0 0x7f21d80cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:27.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.285+0000 7f21dd5ee700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f21d80cb390 0x7f21d806df10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:39464/0 (socket says 172.21.15.104:39464) 2024-08-17T02:25:27.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.285+0000 7f21dd5ee700 1 -- 172.21.15.104:0/2292920203 learned_addr learned my addr 172.21.15.104:0/2292920203 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:25:27.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.289+0000 7f21dcded700 1 --2- 172.21.15.104:0/2292920203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21d8154900 0x7f21d80b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:27.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.289+0000 7f21d7fff700 1 -- 172.21.15.104:0/2292920203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21d8154900 msgr2=0x7f21d80b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:27.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.289+0000 7f21d7fff700 1 --2- 172.21.15.104:0/2292920203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21d8154900 0x7f21d80b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.289+0000 7f21d7fff700 1 -- 172.21.15.104:0/2292920203 >> v1:172.21.15.104:6789/0 conn(0x7f21d80cb390 legacy=0x7f21d806df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:27.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.289+0000 7f21d7fff700 1 -- 172.21.15.104:0/2292920203 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d80b1700 con 0x7f21d80b12d0 2024-08-17T02:25:27.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.289+0000 7f21d7fff700 1 --2- 172.21.15.104:0/2292920203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f21d80b12d0 0x7f21d80cae50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f21c8009e60 tx=0x7f21c8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8bf08c028b5d3d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:27.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.289+0000 7f21d77fe700 1 -- 172.21.15.104:0/2292920203 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c800e070 con 0x7f21d80b12d0 2024-08-17T02:25:27.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.289+0000 7f21d77fe700 1 -- 172.21.15.104:0/2292920203 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c800bc30 con 0x7f21d80b12d0 2024-08-17T02:25:27.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.289+0000 7f21d77fe700 1 -- 172.21.15.104:0/2292920203 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c8012430 con 0x7f21d80b12d0 2024-08-17T02:25:27.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.289+0000 7f21dddef700 1 -- 172.21.15.104:0/2292920203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f21d80b12d0 msgr2=0x7f21d80cae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:27.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.289+0000 7f21dddef700 1 --2- 172.21.15.104:0/2292920203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f21d80b12d0 0x7f21d80cae50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f21c8009e60 tx=0x7f21c8009780 comp rx=0 tx=0).stop 2024-08-17T02:25:27.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.289+0000 7f21dddef700 1 -- 172.21.15.104:0/2292920203 shutdown_connections 2024-08-17T02:25:27.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.289+0000 7f21dddef700 1 --2- 172.21.15.104:0/2292920203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f21d80b12d0 0x7f21d80cae50 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.289+0000 7f21dddef700 1 --2- 172.21.15.104:0/2292920203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21d8154900 0x7f21d80b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.289+0000 7f21dddef700 1 -- 172.21.15.104:0/2292920203 >> 172.21.15.104:0/2292920203 conn(0x7f21d80678d0 msgr2=0x7f21d8067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:27.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.289+0000 7f21dddef700 1 -- 172.21.15.104:0/2292920203 shutdown_connections 2024-08-17T02:25:27.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.289+0000 7f21dddef700 1 -- 172.21.15.104:0/2292920203 wait complete. 2024-08-17T02:25:27.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.293+0000 7f21dddef700 1 Processor -- start 2024-08-17T02:25:27.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.293+0000 7f21dddef700 1 -- start start 2024-08-17T02:25:27.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.293+0000 7f21dddef700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21d80b12d0 0x7f21d80a9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:27.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.293+0000 7f21dddef700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f21d80cb390 0x7f21d8155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:27.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.293+0000 7f21dddef700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21d8154900 0x7f21d81561e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:27.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.293+0000 7f21dddef700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d8142480 con 0x7f21d80cb390 2024-08-17T02:25:27.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.293+0000 7f21dddef700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d81437f0 con 0x7f21d80b12d0 2024-08-17T02:25:27.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.293+0000 7f21dddef700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d8143ad0 con 0x7f21d8154900 2024-08-17T02:25:27.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.293+0000 7f21d7fff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f21d80cb390 0x7f21d8155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:27.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.293+0000 7f21d7fff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f21d80cb390 0x7f21d8155ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33174/0 (socket says 172.21.15.104:33174) 2024-08-17T02:25:27.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.293+0000 7f21d7fff700 1 -- 172.21.15.104:0/2788337086 learned_addr learned my addr 172.21.15.104:0/2788337086 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:27.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.293+0000 7f21dcded700 1 --2- 172.21.15.104:0/2788337086 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21d80b12d0 0x7f21d80a9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:27.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.293+0000 7f21dd5ee700 1 --2- 172.21.15.104:0/2788337086 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21d8154900 0x7f21d81561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:27.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.293+0000 7f21d7fff700 1 -- 172.21.15.104:0/2788337086 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21d8154900 msgr2=0x7f21d81561e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:27.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.293+0000 7f21d7fff700 1 --2- 172.21.15.104:0/2788337086 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21d8154900 0x7f21d81561e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.293+0000 7f21d7fff700 1 -- 172.21.15.104:0/2788337086 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21d80b12d0 msgr2=0x7f21d80a9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:27.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.293+0000 7f21d7fff700 1 --2- 172.21.15.104:0/2788337086 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21d80b12d0 0x7f21d80a9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.293+0000 7f21d7fff700 1 -- 172.21.15.104:0/2788337086 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c8009a20 con 0x7f21d80cb390 2024-08-17T02:25:27.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.293+0000 7f21dd5ee700 1 --2- 172.21.15.104:0/2788337086 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21d8154900 0x7f21d81561e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:27.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.293+0000 7f21d7fff700 1 --2- 172.21.15.104:0/2788337086 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f21d80cb390 0x7f21d8155ca0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f21c80097c0 tx=0x7f21c8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:27.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.293+0000 7f21d4ff9700 1 -- 172.21.15.104:0/2788337086 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c8012e80 con 0x7f21d80cb390 2024-08-17T02:25:27.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.293+0000 7f21d4ff9700 1 -- 172.21.15.104:0/2788337086 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c8027470 con 0x7f21d80cb390 2024-08-17T02:25:27.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.293+0000 7f21d4ff9700 1 -- 172.21.15.104:0/2788337086 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c8027830 con 0x7f21d80cb390 2024-08-17T02:25:27.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.293+0000 7f21dddef700 1 -- 172.21.15.104:0/2788337086 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d8143db0 con 0x7f21d80cb390 2024-08-17T02:25:27.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.297+0000 7f21dddef700 1 -- 172.21.15.104:0/2788337086 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d8144370 con 0x7f21d80cb390 2024-08-17T02:25:27.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.297+0000 7f21dddef700 1 -- 172.21.15.104:0/2788337086 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d80643a0 con 0x7f21d80cb390 2024-08-17T02:25:27.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.297+0000 7f21d4ff9700 1 -- 172.21.15.104:0/2788337086 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f21c8024070 con 0x7f21d80cb390 2024-08-17T02:25:27.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.297+0000 7f21d4ff9700 1 --2- 172.21.15.104:0/2788337086 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f21bc060860 0x7f21bc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:27.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.297+0000 7f21d4ff9700 1 -- 172.21.15.104:0/2788337086 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f21c807fa40 con 0x7f21d80cb390 2024-08-17T02:25:27.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.297+0000 7f21dcded700 1 --2- 172.21.15.104:0/2788337086 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f21bc060860 0x7f21bc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:27.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.301+0000 7f21dcded700 1 --2- 172.21.15.104:0/2788337086 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f21bc060860 0x7f21bc062d10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f21d0006fd0 tx=0x7f21d0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:27.309 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.305+0000 7f21d4ff9700 1 -- 172.21.15.104:0/2788337086 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f21c8081e60 con 0x7f21d80cb390 2024-08-17T02:25:27.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.473+0000 7f21dddef700 1 -- 172.21.15.104:0/2788337086 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21d806f5f0 con 0x7f21d80cb390 2024-08-17T02:25:27.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.477+0000 7f21d4ff9700 1 -- 172.21.15.104:0/2788337086 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+18837 (secure 0 0 0) 0x7f21c804faa0 con 0x7f21d80cb390 2024-08-17T02:25:27.480 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:25:27.480 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":41,"fsid":"fd5f7fb8-d34b-49bb-89a8-62b7dad1bc25","created":"2024-08-17T02:21:57.891389+0000","modified":"2024-08-17T02:24:03.367031+0000","last_up_change":"2024-08-17T02:22:08.924546+0000","last_in_change":"2024-08-17T02:21:59.938028+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:22:10.143970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:23:03.390787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:23:04.462361+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000188090.meta","create_time":"2024-08-17T02:23:21.239436+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000188090"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000188090.data","create_time":"2024-08-17T02:23:21.337636+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000188090"}}}],"osds":[{"osd":0,"uuid":"606b9088-590e-4709-aa3a-b0f6e22972ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":24257},{"type":"v1","addr":"172.21.15.104:6809","nonce":24257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":24257},{"type":"v1","addr":"172.21.15.104:6811","nonce":24257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":24257},{"type":"v1","addr":"172.21.15.104:6815","nonce":24257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":24257},{"type":"v1","addr":"172.21.15.104:6813","nonce":24257}]},"public_addr":"172.21.15.104:6809/24257","cluster_addr":"172.21.15.104:6811/24257","heartbeat_back_addr":"172.21.15.104:6815/24257","heartbeat_front_addr":"172.21.15.104:6813/24257","state":["exists","up"]},{"osd":1,"uuid":"9bc6a909-0c2f-4889-afe7-4a47f89b0f64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":24256},{"type":"v1","addr":"172.21.15.104:6825","nonce":24256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":24256},{"type":"v1","addr":"172.21.15.104:6827","nonce":24256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":24256},{"type":"v1","addr":"172.21.15.104:6831","nonce":24256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":24256},{"type":"v1","addr":"172.21.15.104:6829","nonce":24256}]},"public_addr":"172.21.15.104:6825/24256","cluster_addr":"172.21.15.104:6827/24256","heartbeat_back_addr":"172.21.15.104:6831/24256","heartbeat_front_addr":"172.21.15.104:6829/24256","state":["exists","up"]},{"osd":2,"uuid":"23da31d5-aefb-4edb-b79d-fa05e1becef7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":24255},{"type":"v1","addr":"172.21.15.104:6817","nonce":24255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":24255},{"type":"v1","addr":"172.21.15.104:6819","nonce":24255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":24255},{"type":"v1","addr":"172.21.15.104:6823","nonce":24255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":24255},{"type":"v1","addr":"172.21.15.104:6821","nonce":24255}]},"public_addr":"172.21.15.104:6817/24255","cluster_addr":"172.21.15.104:6819/24255","heartbeat_back_addr":"172.21.15.104:6823/24255","heartbeat_front_addr":"172.21.15.104:6821/24255","state":["exists","up"]},{"osd":3,"uuid":"6e4a5ec2-b415-45ef-8381-61a59eb65224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":24254},{"type":"v1","addr":"172.21.15.104:6801","nonce":24254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":24254},{"type":"v1","addr":"172.21.15.104:6803","nonce":24254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":24254},{"type":"v1","addr":"172.21.15.104:6807","nonce":24254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":24254},{"type":"v1","addr":"172.21.15.104:6805","nonce":24254}]},"public_addr":"172.21.15.104:6801/24254","cluster_addr":"172.21.15.104:6803/24254","heartbeat_back_addr":"172.21.15.104:6807/24254","heartbeat_front_addr":"172.21.15.104:6805/24254","state":["exists","up"]},{"osd":4,"uuid":"8d5bea2d-9039-4013-8c99-2c046c5b8a17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":24421},{"type":"v1","addr":"172.21.15.117:6804","nonce":24421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":24421},{"type":"v1","addr":"172.21.15.117:6809","nonce":24421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":24421},{"type":"v1","addr":"172.21.15.117:6815","nonce":24421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":24421},{"type":"v1","addr":"172.21.15.117:6813","nonce":24421}]},"public_addr":"172.21.15.117:6804/24421","cluster_addr":"172.21.15.117:6809/24421","heartbeat_back_addr":"172.21.15.117:6815/24421","heartbeat_front_addr":"172.21.15.117:6813/24421","state":["exists","up"]},{"osd":5,"uuid":"de8b36fc-121c-4f05-8f5b-28f513d9f21f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":24422},{"type":"v1","addr":"172.21.15.117:6817","nonce":24422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":24422},{"type":"v1","addr":"172.21.15.117:6819","nonce":24422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":24422},{"type":"v1","addr":"172.21.15.117:6823","nonce":24422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":24422},{"type":"v1","addr":"172.21.15.117:6821","nonce":24422}]},"public_addr":"172.21.15.117:6817/24422","cluster_addr":"172.21.15.117:6819/24422","heartbeat_back_addr":"172.21.15.117:6823/24422","heartbeat_front_addr":"172.21.15.117:6821/24422","state":["exists","up"]},{"osd":6,"uuid":"6a87f09f-7bf7-4f7a-be87-530ac1ff8ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":24420},{"type":"v1","addr":"172.21.15.117:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6803","nonce":24420},{"type":"v1","addr":"172.21.15.117:6805","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":24420},{"type":"v1","addr":"172.21.15.117:6811","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":24420},{"type":"v1","addr":"172.21.15.117:6808","nonce":24420}]},"public_addr":"172.21.15.117:6801/24420","cluster_addr":"172.21.15.117:6805/24420","heartbeat_back_addr":"172.21.15.117:6811/24420","heartbeat_front_addr":"172.21.15.117:6808/24420","state":["exists","up"]},{"osd":7,"uuid":"e31d8041-1aa1-4b5d-83b3-0a373426dd9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":24423},{"type":"v1","addr":"172.21.15.117:6825","nonce":24423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":24423},{"type":"v1","addr":"172.21.15.117:6827","nonce":24423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":24423},{"type":"v1","addr":"172.21.15.117:6831","nonce":24423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":24423},{"type":"v1","addr":"172.21.15.117:6829","nonce":24423}]},"public_addr":"172.21.15.117:6825/24423","cluster_addr":"172.21.15.117:6827/24423","heartbeat_back_addr":"172.21.15.117:6831/24423","heartbeat_front_addr":"172.21.15.117:6829/24423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.220874+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.210039+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.434762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.247206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.184316+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.306325+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.035719+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.400303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.35","mappings":[{"from":4,"to":5}]},{"pgid":"5.36","mappings":[{"from":4,"to":3}]},{"pgid":"5.37","mappings":[{"from":4,"to":5}]},{"pgid":"5.3c","mappings":[{"from":4,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:27.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.481+0000 7f21dddef700 1 -- 172.21.15.104:0/2788337086 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f21bc060860 msgr2=0x7f21bc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:27.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.481+0000 7f21dddef700 1 --2- 172.21.15.104:0/2788337086 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f21bc060860 0x7f21bc062d10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f21d0006fd0 tx=0x7f21d0008040 comp rx=0 tx=0).stop 2024-08-17T02:25:27.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.481+0000 7f21dddef700 1 -- 172.21.15.104:0/2788337086 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f21d80cb390 msgr2=0x7f21d8155ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:27.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.481+0000 7f21dddef700 1 --2- 172.21.15.104:0/2788337086 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f21d80cb390 0x7f21d8155ca0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f21c80097c0 tx=0x7f21c8019000 comp rx=0 tx=0).stop 2024-08-17T02:25:27.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.481+0000 7f21dddef700 1 -- 172.21.15.104:0/2788337086 shutdown_connections 2024-08-17T02:25:27.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.481+0000 7f21dddef700 1 --2- 172.21.15.104:0/2788337086 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f21bc060860 0x7f21bc062d10 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.481+0000 7f21dddef700 1 --2- 172.21.15.104:0/2788337086 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21d8154900 0x7f21d81561e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.481+0000 7f21dddef700 1 --2- 172.21.15.104:0/2788337086 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f21d80cb390 0x7f21d8155ca0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.481+0000 7f21dddef700 1 --2- 172.21.15.104:0/2788337086 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21d80b12d0 0x7f21d80a9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.481+0000 7f21dddef700 1 -- 172.21.15.104:0/2788337086 >> 172.21.15.104:0/2788337086 conn(0x7f21d80678d0 msgr2=0x7f21d8153a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:27.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.481+0000 7f21dddef700 1 -- 172.21.15.104:0/2788337086 shutdown_connections 2024-08-17T02:25:27.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.481+0000 7f21dddef700 1 -- 172.21.15.104:0/2788337086 wait complete. 2024-08-17T02:25:27.502 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:25:27.502 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:25:27.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.605+0000 7f08874bf700 1 Processor -- start 2024-08-17T02:25:27.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.605+0000 7f08874bf700 1 -- start start 2024-08-17T02:25:27.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.605+0000 7f08874bf700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08800cadf0 0x7f08800cd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:27.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.605+0000 7f08874bf700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0880146620 0x7f0880146a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:27.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.605+0000 7f08874bf700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08801611f0 con 0x7f08800cccd0 2024-08-17T02:25:27.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.605+0000 7f08874bf700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08801614b0 con 0x7f0880146620 2024-08-17T02:25:27.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.605+0000 7f08874bf700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0880161790 con 0x7f08800cadf0 2024-08-17T02:25:27.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.605+0000 7f08864bd700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f08800cccd0 0x7f08800ca6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:39472/0 (socket says 172.21.15.104:39472) 2024-08-17T02:25:27.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.605+0000 7f08864bd700 1 -- 172.21.15.104:0/3106624341 learned_addr learned my addr 172.21.15.104:0/3106624341 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:25:27.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.605+0000 7f0886cbe700 1 --2- 172.21.15.104:0/3106624341 >> v2:172.21.15.117:3300/0 conn(0x7f0880146620 0x7f0880146a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:27.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.605+0000 7f0885cbc700 1 --2- 172.21.15.104:0/3106624341 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08800cadf0 0x7f08800cd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:27.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.605+0000 7f08854bb700 1 -- 172.21.15.104:0/3106624341 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1104606365 0 0) 0x7f08801611f0 con 0x7f08800cccd0 2024-08-17T02:25:27.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.605+0000 7f08854bb700 1 -- 172.21.15.104:0/3106624341 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f086c003570 con 0x7f08800cccd0 2024-08-17T02:25:27.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.605+0000 7f0886cbe700 1 -- 172.21.15.104:0/3106624341 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08800cadf0 msgr2=0x7f08800cd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:27.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.605+0000 7f0886cbe700 1 --2- 172.21.15.104:0/3106624341 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08800cadf0 0x7f08800cd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.605+0000 7f0886cbe700 1 -- 172.21.15.104:0/3106624341 >> v1:172.21.15.104:6789/0 conn(0x7f08800cccd0 legacy=0x7f08800ca6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:27.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.605+0000 7f08854bb700 1 -- 172.21.15.104:0/3106624341 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 338443286 0 0) 0x7f086c003570 con 0x7f08800cccd0 2024-08-17T02:25:27.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.605+0000 7f0886cbe700 1 -- 172.21.15.104:0/3106624341 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0880161a70 con 0x7f0880146620 2024-08-17T02:25:27.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.605+0000 7f0885cbc700 1 --2- 172.21.15.104:0/3106624341 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08800cadf0 0x7f08800cd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:27.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.609+0000 7f0886cbe700 1 --2- 172.21.15.104:0/3106624341 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0880146620 0x7f0880146a70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f08780098e0 tx=0x7f08780091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8edcd5204ce79afb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:27.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.609+0000 7f08854bb700 1 -- 172.21.15.104:0/3106624341 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087c0017f0 con 0x7f0880146620 2024-08-17T02:25:27.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.609+0000 7f08854bb700 1 -- 172.21.15.104:0/3106624341 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0878011420 con 0x7f0880146620 2024-08-17T02:25:27.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.609+0000 7f08854bb700 1 -- 172.21.15.104:0/3106624341 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08780117a0 con 0x7f0880146620 2024-08-17T02:25:27.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.609+0000 7f08874bf700 1 -- 172.21.15.104:0/3106624341 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0880146620 msgr2=0x7f0880146a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:27.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.609+0000 7f08874bf700 1 --2- 172.21.15.104:0/3106624341 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0880146620 0x7f0880146a70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f08780098e0 tx=0x7f08780091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.609+0000 7f08874bf700 1 -- 172.21.15.104:0/3106624341 shutdown_connections 2024-08-17T02:25:27.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.609+0000 7f08874bf700 1 --2- 172.21.15.104:0/3106624341 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0880146620 0x7f0880146a70 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.609+0000 7f08874bf700 1 --2- 172.21.15.104:0/3106624341 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08800cadf0 0x7f08800cd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.609+0000 7f08874bf700 1 -- 172.21.15.104:0/3106624341 >> 172.21.15.104:0/3106624341 conn(0x7f08800d00a0 msgr2=0x7f08800d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:27.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.609+0000 7f08874bf700 1 -- 172.21.15.104:0/3106624341 shutdown_connections 2024-08-17T02:25:27.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.609+0000 7f08874bf700 1 -- 172.21.15.104:0/3106624341 wait complete. 2024-08-17T02:25:27.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.609+0000 7f08874bf700 1 Processor -- start 2024-08-17T02:25:27.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.609+0000 7f08874bf700 1 -- start start 2024-08-17T02:25:27.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.613+0000 7f08874bf700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08800cadf0 0x7f0880144d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:27.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.613+0000 7f08874bf700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08800cccd0 0x7f08800af590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:27.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.613+0000 7f08874bf700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0880146620 0x7f08800c5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:27.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.613+0000 7f08874bf700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08801452d0 con 0x7f0880146620 2024-08-17T02:25:27.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.613+0000 7f08874bf700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f088016d8f0 con 0x7f08800cadf0 2024-08-17T02:25:27.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.613+0000 7f08874bf700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f088016d5c0 con 0x7f08800cccd0 2024-08-17T02:25:27.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.613+0000 7f0886cbe700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0880146620 0x7f08800c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:27.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.613+0000 7f0886cbe700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0880146620 0x7f08800c5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33180/0 (socket says 172.21.15.104:33180) 2024-08-17T02:25:27.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.613+0000 7f0886cbe700 1 -- 172.21.15.104:0/3455359456 learned_addr learned my addr 172.21.15.104:0/3455359456 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:27.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.613+0000 7f08864bd700 1 --2- 172.21.15.104:0/3455359456 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08800cadf0 0x7f0880144d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:27.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.613+0000 7f0885cbc700 1 --2- 172.21.15.104:0/3455359456 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08800cccd0 0x7f08800af590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:27.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.613+0000 7f0886cbe700 1 -- 172.21.15.104:0/3455359456 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08800cccd0 msgr2=0x7f08800af590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:27.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.613+0000 7f0886cbe700 1 --2- 172.21.15.104:0/3455359456 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08800cccd0 0x7f08800af590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.613+0000 7f0886cbe700 1 -- 172.21.15.104:0/3455359456 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08800cadf0 msgr2=0x7f0880144d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:27.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.613+0000 7f0886cbe700 1 --2- 172.21.15.104:0/3455359456 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08800cadf0 0x7f0880144d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.613+0000 7f0886cbe700 1 -- 172.21.15.104:0/3455359456 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0874009420 con 0x7f0880146620 2024-08-17T02:25:27.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.613+0000 7f08864bd700 1 --2- 172.21.15.104:0/3455359456 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08800cadf0 0x7f0880144d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:27.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.613+0000 7f0886cbe700 1 --2- 172.21.15.104:0/3455359456 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0880146620 0x7f08800c5490 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0880067f50 tx=0x7f0878016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:27.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.613+0000 7f08727fc700 1 -- 172.21.15.104:0/3455359456 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087801cc20 con 0x7f0880146620 2024-08-17T02:25:27.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.613+0000 7f08727fc700 1 -- 172.21.15.104:0/3455359456 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f087801cda0 con 0x7f0880146620 2024-08-17T02:25:27.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.613+0000 7f08874bf700 1 -- 172.21.15.104:0/3455359456 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0878009420 con 0x7f0880146620 2024-08-17T02:25:27.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.613+0000 7f08727fc700 1 -- 172.21.15.104:0/3455359456 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087801a6a0 con 0x7f0880146620 2024-08-17T02:25:27.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.613+0000 7f08874bf700 1 -- 172.21.15.104:0/3455359456 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08800b01c0 con 0x7f0880146620 2024-08-17T02:25:27.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.617+0000 7f08874bf700 1 -- 172.21.15.104:0/3455359456 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08800638f0 con 0x7f0880146620 2024-08-17T02:25:27.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.617+0000 7f08727fc700 1 -- 172.21.15.104:0/3455359456 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f087801aa90 con 0x7f0880146620 2024-08-17T02:25:27.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.617+0000 7f08727fc700 1 --2- 172.21.15.104:0/3455359456 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f0864060890 0x7f0864062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:27.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.617+0000 7f08727fc700 1 -- 172.21.15.104:0/3455359456 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f087807e870 con 0x7f0880146620 2024-08-17T02:25:27.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.617+0000 7f08864bd700 1 --2- 172.21.15.104:0/3455359456 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f0864060890 0x7f0864062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:27.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.617+0000 7f08864bd700 1 --2- 172.21.15.104:0/3455359456 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f0864060890 0x7f0864062d40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f087c0019a0 tx=0x7f087c0015b0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:27.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.625+0000 7f08727fc700 1 -- 172.21.15.104:0/3455359456 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f087804e8e0 con 0x7f0880146620 2024-08-17T02:25:27.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.825+0000 7f08874bf700 1 -- 172.21.15.104:0/3455359456 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f088016da30 con 0x7f0880146620 2024-08-17T02:25:27.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.829+0000 7f08727fc700 1 -- 172.21.15.104:0/3455359456 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+5690 (secure 0 0 0) 0x7f0878051f00 con 0x7f0880146620 2024-08-17T02:25:27.831 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:25:27.831 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/3848434798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3848434798},{"type":"v1","addr":"172.21.15.117:6836","nonce":3848434798}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4894,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1461239637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1461239637},{"type":"v1","addr":"172.21.15.117:6837","nonce":1461239637}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:23:05.468383+0000","modified":"2024-08-17T02:23:08.148034+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4965},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4965":{"gid":4965,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/38993094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":38993094},{"type":"v1","addr":"172.21.15.104:6835","nonce":38993094}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:23:22.321122+0000","modified":"2024-08-17T02:23:24.304353+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4959},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4959":{"gid":4959,"name":"c","rank":0,"incarnation":16,"state":"up:active","state_seq":8,"addr":"172.21.15.104:6833/4148924116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":4148924116},{"type":"v1","addr":"172.21.15.104:6833","nonce":4148924116}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000188090","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:25:27.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.833+0000 7f08874bf700 1 -- 172.21.15.104:0/3455359456 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f0864060890 msgr2=0x7f0864062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:27.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.833+0000 7f08874bf700 1 --2- 172.21.15.104:0/3455359456 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f0864060890 0x7f0864062d40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f087c0019a0 tx=0x7f087c0015b0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.833+0000 7f08874bf700 1 -- 172.21.15.104:0/3455359456 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0880146620 msgr2=0x7f08800c5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:27.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.833+0000 7f08874bf700 1 --2- 172.21.15.104:0/3455359456 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0880146620 0x7f08800c5490 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0880067f50 tx=0x7f0878016000 comp rx=0 tx=0).stop 2024-08-17T02:25:27.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.833+0000 7f08874bf700 1 -- 172.21.15.104:0/3455359456 shutdown_connections 2024-08-17T02:25:27.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.833+0000 7f08874bf700 1 --2- 172.21.15.104:0/3455359456 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f0864060890 0x7f0864062d40 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.833+0000 7f08874bf700 1 --2- 172.21.15.104:0/3455359456 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0880146620 0x7f08800c5490 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.833+0000 7f08874bf700 1 --2- 172.21.15.104:0/3455359456 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08800cccd0 0x7f08800af590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.833+0000 7f08874bf700 1 --2- 172.21.15.104:0/3455359456 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08800cadf0 0x7f0880144d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.833+0000 7f08874bf700 1 -- 172.21.15.104:0/3455359456 >> 172.21.15.104:0/3455359456 conn(0x7f08800d00a0 msgr2=0x7f08801604c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:27.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.833+0000 7f08874bf700 1 -- 172.21.15.104:0/3455359456 shutdown_connections 2024-08-17T02:25:27.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.833+0000 7f08874bf700 1 -- 172.21.15.104:0/3455359456 wait complete. 2024-08-17T02:25:27.837 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 18 2024-08-17T02:25:27.852 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:25:27.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.961+0000 7f053f365700 1 Processor -- start 2024-08-17T02:25:27.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.961+0000 7f053f365700 1 -- start start 2024-08-17T02:25:27.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.961+0000 7f053f365700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f05380b14a0 0x7f05380cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:27.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.961+0000 7f053f365700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f05380cb390 0x7f0538160ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:27.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.961+0000 7f053f365700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05380cbaa0 con 0x7f0538154900 2024-08-17T02:25:27.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.961+0000 7f053f365700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0538068790 con 0x7f05380cb390 2024-08-17T02:25:27.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.961+0000 7f053f365700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05381583f0 con 0x7f05380b14a0 2024-08-17T02:25:27.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.961+0000 7f053e363700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f0538154900 0x7f05380b0d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:39482/0 (socket says 172.21.15.104:39482) 2024-08-17T02:25:27.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.961+0000 7f053e363700 1 -- 172.21.15.104:0/4266085745 learned_addr learned my addr 172.21.15.104:0/4266085745 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:25:27.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.961+0000 7f053eb64700 1 --2- 172.21.15.104:0/4266085745 >> v2:172.21.15.104:3300/0 conn(0x7f05380cb390 0x7f0538160ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:27.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.961+0000 7f053db62700 1 --2- 172.21.15.104:0/4266085745 >> v2:172.21.15.117:3300/0 conn(0x7f05380b14a0 0x7f05380cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:27.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.961+0000 7f053d361700 1 -- 172.21.15.104:0/4266085745 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3687170201 0 0) 0x7f05380cbaa0 con 0x7f0538154900 2024-08-17T02:25:27.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.961+0000 7f053d361700 1 -- 172.21.15.104:0/4266085745 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0524003570 con 0x7f0538154900 2024-08-17T02:25:27.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.961+0000 7f053db62700 1 -- 172.21.15.104:0/4266085745 >> v2:172.21.15.104:3300/0 conn(0x7f05380cb390 msgr2=0x7f0538160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:27.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.961+0000 7f053db62700 1 --2- 172.21.15.104:0/4266085745 >> v2:172.21.15.104:3300/0 conn(0x7f05380cb390 0x7f0538160ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.961+0000 7f053db62700 1 -- 172.21.15.104:0/4266085745 >> v1:172.21.15.104:6789/0 conn(0x7f0538154900 legacy=0x7f05380b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:27.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.961+0000 7f053db62700 1 -- 172.21.15.104:0/4266085745 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0538157630 con 0x7f05380b14a0 2024-08-17T02:25:27.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.961+0000 7f053eb64700 1 --2- 172.21.15.104:0/4266085745 >> v2:172.21.15.104:3300/0 conn(0x7f05380cb390 0x7f0538160ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:27.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.961+0000 7f053db62700 1 --2- 172.21.15.104:0/4266085745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05380b14a0 0x7f05380cae50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f053806f390 tx=0x7f05280091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=333dda41f69194f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:27.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.961+0000 7f053d361700 1 -- 172.21.15.104:0/4266085745 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0528011630 con 0x7f05380b14a0 2024-08-17T02:25:27.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.961+0000 7f053d361700 1 -- 172.21.15.104:0/4266085745 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0528011790 con 0x7f05380b14a0 2024-08-17T02:25:27.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.961+0000 7f053d361700 1 -- 172.21.15.104:0/4266085745 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0528011b30 con 0x7f05380b14a0 2024-08-17T02:25:27.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.961+0000 7f053f365700 1 -- 172.21.15.104:0/4266085745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05380b14a0 msgr2=0x7f05380cae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:27.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.961+0000 7f053f365700 1 --2- 172.21.15.104:0/4266085745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05380b14a0 0x7f05380cae50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f053806f390 tx=0x7f05280091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.961+0000 7f053f365700 1 -- 172.21.15.104:0/4266085745 shutdown_connections 2024-08-17T02:25:27.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.961+0000 7f053f365700 1 --2- 172.21.15.104:0/4266085745 >> v2:172.21.15.104:3300/0 conn(0x7f05380cb390 0x7f0538160ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.961+0000 7f053f365700 1 --2- 172.21.15.104:0/4266085745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05380b14a0 0x7f05380cae50 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.961+0000 7f053f365700 1 -- 172.21.15.104:0/4266085745 >> 172.21.15.104:0/4266085745 conn(0x7f05380678d0 msgr2=0x7f0538067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:27.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.961+0000 7f053f365700 1 -- 172.21.15.104:0/4266085745 shutdown_connections 2024-08-17T02:25:27.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.961+0000 7f053f365700 1 -- 172.21.15.104:0/4266085745 wait complete. 2024-08-17T02:25:27.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.965+0000 7f053f365700 1 Processor -- start 2024-08-17T02:25:27.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.965+0000 7f053f365700 1 -- start start 2024-08-17T02:25:27.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.965+0000 7f053f365700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05380b14a0 0x7f0538150140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:27.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.965+0000 7f053f365700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05380cb390 0x7f05380aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:27.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.965+0000 7f053f365700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0538154900 0x7f05380c9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:27.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.965+0000 7f053f365700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05381695a0 con 0x7f05380b14a0 2024-08-17T02:25:27.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.965+0000 7f053f365700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05380af3b0 con 0x7f0538154900 2024-08-17T02:25:27.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.965+0000 7f053f365700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05380af690 con 0x7f05380cb390 2024-08-17T02:25:27.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.965+0000 7f053e363700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05380b14a0 0x7f0538150140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:27.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.965+0000 7f053e363700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05380b14a0 0x7f0538150140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33206/0 (socket says 172.21.15.104:33206) 2024-08-17T02:25:27.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.965+0000 7f053e363700 1 -- 172.21.15.104:0/1278928294 learned_addr learned my addr 172.21.15.104:0/1278928294 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:27.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.965+0000 7f053db62700 1 --2- 172.21.15.104:0/1278928294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05380cb390 0x7f05380aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:27.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.965+0000 7f053eb64700 1 --2- 172.21.15.104:0/1278928294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0538154900 0x7f05380c9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:27.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.965+0000 7f053e363700 1 -- 172.21.15.104:0/1278928294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05380cb390 msgr2=0x7f05380aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:27.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.965+0000 7f053e363700 1 --2- 172.21.15.104:0/1278928294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05380cb390 0x7f05380aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.965+0000 7f053e363700 1 -- 172.21.15.104:0/1278928294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0538154900 msgr2=0x7f05380c9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:27.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.965+0000 7f053e363700 1 --2- 172.21.15.104:0/1278928294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0538154900 0x7f05380c9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.965+0000 7f053e363700 1 -- 172.21.15.104:0/1278928294 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0530009a20 con 0x7f05380b14a0 2024-08-17T02:25:27.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.965+0000 7f053eb64700 1 --2- 172.21.15.104:0/1278928294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0538154900 0x7f05380c9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:27.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.965+0000 7f053e363700 1 --2- 172.21.15.104:0/1278928294 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05380b14a0 0x7f0538150140 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f05340011e0 tx=0x7f0534007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:27.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.969+0000 7f052e7fc700 1 -- 172.21.15.104:0/1278928294 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0534005b30 con 0x7f05380b14a0 2024-08-17T02:25:27.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.969+0000 7f052e7fc700 1 -- 172.21.15.104:0/1278928294 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0534005c90 con 0x7f05380b14a0 2024-08-17T02:25:27.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.969+0000 7f053f365700 1 -- 172.21.15.104:0/1278928294 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0528009420 con 0x7f05380b14a0 2024-08-17T02:25:27.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.969+0000 7f052e7fc700 1 -- 172.21.15.104:0/1278928294 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0534007320 con 0x7f05380b14a0 2024-08-17T02:25:27.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.969+0000 7f053f365700 1 -- 172.21.15.104:0/1278928294 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0538150680 con 0x7f05380b14a0 2024-08-17T02:25:27.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.969+0000 7f052e7fc700 1 -- 172.21.15.104:0/1278928294 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f0534007690 con 0x7f05380b14a0 2024-08-17T02:25:27.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.969+0000 7f053f365700 1 -- 172.21.15.104:0/1278928294 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05380643a0 con 0x7f05380b14a0 2024-08-17T02:25:27.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.969+0000 7f052e7fc700 1 --2- 172.21.15.104:0/1278928294 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f051c060860 0x7f051c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:27.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.973+0000 7f052e7fc700 1 -- 172.21.15.104:0/1278928294 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f053407c480 con 0x7f05380b14a0 2024-08-17T02:25:27.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.973+0000 7f053db62700 1 --2- 172.21.15.104:0/1278928294 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f051c060860 0x7f051c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:27.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.973+0000 7f053db62700 1 --2- 172.21.15.104:0/1278928294 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f051c060860 0x7f051c062d10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f053806f390 tx=0x7f0528017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:27.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:27.977+0000 7f052e7fc700 1 -- 172.21.15.104:0/1278928294 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f053404c440 con 0x7f05380b14a0 2024-08-17T02:25:28.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.173+0000 7f053f365700 1 -- 172.21.15.104:0/1278928294 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f053806f5f0 con 0x7f05380b14a0 2024-08-17T02:25:28.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.173+0000 7f052e7fc700 1 -- 172.21.15.104:0/1278928294 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+5690 (secure 0 0 0) 0x7f053404fa60 con 0x7f05380b14a0 2024-08-17T02:25:28.178 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:25:28.178 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/3848434798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3848434798},{"type":"v1","addr":"172.21.15.117:6836","nonce":3848434798}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4894,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1461239637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1461239637},{"type":"v1","addr":"172.21.15.117:6837","nonce":1461239637}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:23:05.468383+0000","modified":"2024-08-17T02:23:08.148034+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4965},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4965":{"gid":4965,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/38993094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":38993094},{"type":"v1","addr":"172.21.15.104:6835","nonce":38993094}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:23:22.321122+0000","modified":"2024-08-17T02:23:24.304353+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4959},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4959":{"gid":4959,"name":"c","rank":0,"incarnation":16,"state":"up:active","state_seq":8,"addr":"172.21.15.104:6833/4148924116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":4148924116},{"type":"v1","addr":"172.21.15.104:6833","nonce":4148924116}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000188090","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:25:28.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.177+0000 7f053f365700 1 -- 172.21.15.104:0/1278928294 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f051c060860 msgr2=0x7f051c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.177+0000 7f053f365700 1 --2- 172.21.15.104:0/1278928294 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f051c060860 0x7f051c062d10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f053806f390 tx=0x7f0528017000 comp rx=0 tx=0).stop 2024-08-17T02:25:28.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.177+0000 7f053f365700 1 -- 172.21.15.104:0/1278928294 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05380b14a0 msgr2=0x7f0538150140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.177+0000 7f053f365700 1 --2- 172.21.15.104:0/1278928294 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05380b14a0 0x7f0538150140 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f05340011e0 tx=0x7f0534007df0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.177+0000 7f053f365700 1 -- 172.21.15.104:0/1278928294 shutdown_connections 2024-08-17T02:25:28.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.177+0000 7f053f365700 1 --2- 172.21.15.104:0/1278928294 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f051c060860 0x7f051c062d10 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.177+0000 7f053f365700 1 --2- 172.21.15.104:0/1278928294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0538154900 0x7f05380c9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.177+0000 7f053f365700 1 --2- 172.21.15.104:0/1278928294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05380cb390 0x7f05380aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.177+0000 7f053f365700 1 --2- 172.21.15.104:0/1278928294 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05380b14a0 0x7f0538150140 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.177+0000 7f053f365700 1 -- 172.21.15.104:0/1278928294 >> 172.21.15.104:0/1278928294 conn(0x7f05380678d0 msgr2=0x7f0538151a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:28.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.177+0000 7f053f365700 1 -- 172.21.15.104:0/1278928294 shutdown_connections 2024-08-17T02:25:28.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.177+0000 7f053f365700 1 -- 172.21.15.104:0/1278928294 wait complete. 2024-08-17T02:25:28.183 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 18 2024-08-17T02:25:28.197 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:28.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.297+0000 7f6fd700e700 1 Processor -- start 2024-08-17T02:25:28.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.297+0000 7f6fd700e700 1 -- start start 2024-08-17T02:25:28.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.297+0000 7f6fd700e700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6fd0154900 0x7f6fd00b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:28.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.297+0000 7f6fd700e700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fd00b1730 con 0x7f6fd00cb560 2024-08-17T02:25:28.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.297+0000 7f6fd700e700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fd00cbaa0 con 0x7f6fd00b12d0 2024-08-17T02:25:28.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.297+0000 7f6fd700e700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fd0068790 con 0x7f6fd0154900 2024-08-17T02:25:28.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.297+0000 7f6fd680d700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f6fd00cb560 0x7f6fd0160ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:39492/0 (socket says 172.21.15.104:39492) 2024-08-17T02:25:28.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.297+0000 7f6fd680d700 1 -- 172.21.15.104:0/1319275575 learned_addr learned my addr 172.21.15.104:0/1319275575 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:25:28.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.297+0000 7f6fd600c700 1 --2- 172.21.15.104:0/1319275575 >> v2:172.21.15.117:3300/0 conn(0x7f6fd0154900 0x7f6fd00b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:28.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.297+0000 7f6fd500a700 1 -- 172.21.15.104:0/1319275575 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2653360135 0 0) 0x7f6fc8001490 con 0x7f6fd00cb560 2024-08-17T02:25:28.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.297+0000 7f6fd500a700 1 -- 172.21.15.104:0/1319275575 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fbc003570 con 0x7f6fd00cb560 2024-08-17T02:25:28.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.297+0000 7f6fd500a700 1 -- 172.21.15.104:0/1319275575 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3108659442 0 0) 0x7f6fd00cbaa0 con 0x7f6fd00b12d0 2024-08-17T02:25:28.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.297+0000 7f6fd500a700 1 -- 172.21.15.104:0/1319275575 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fc8001490 con 0x7f6fd00b12d0 2024-08-17T02:25:28.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.301+0000 7f6fd500a700 1 -- 172.21.15.104:0/1319275575 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1451206686 0 0) 0x7f6fbc003570 con 0x7f6fd00cb560 2024-08-17T02:25:28.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.301+0000 7f6fd500a700 1 -- 172.21.15.104:0/1319275575 >> v2:172.21.15.117:3300/0 conn(0x7f6fd0154900 msgr2=0x7f6fd00b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:28.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.301+0000 7f6fd500a700 1 --2- 172.21.15.104:0/1319275575 >> v2:172.21.15.117:3300/0 conn(0x7f6fd0154900 0x7f6fd00b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.301+0000 7f6fd500a700 1 -- 172.21.15.104:0/1319275575 >> v1:172.21.15.117:6789/0 conn(0x7f6fd00b12d0 legacy=0x7f6fd00cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.301+0000 7f6fd500a700 1 -- 172.21.15.104:0/1319275575 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd0157630 con 0x7f6fd00cb560 2024-08-17T02:25:28.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.301+0000 7f6fd500a700 1 -- 172.21.15.104:0/1319275575 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1279957748 0 0) 0x7f6fc8001980 con 0x7f6fd00cb560 2024-08-17T02:25:28.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.301+0000 7f6fd500a700 1 -- 172.21.15.104:0/1319275575 >> v1:172.21.15.104:6789/0 conn(0x7f6fd00cb560 legacy=0x7f6fd0160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.301+0000 7f6fd500a700 1 --2- 172.21.15.104:0/1319275575 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6fbc003bf0 0x7f6fbc003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:28.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.301+0000 7f6fd500a700 1 --2- 172.21.15.104:0/1319275575 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fbc004810 0x7f6fbc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:28.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.301+0000 7f6fd500a700 1 --2- 172.21.15.104:0/1319275575 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fbc0051c0 0x7f6fbc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:28.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.301+0000 7f6fd500a700 1 -- 172.21.15.104:0/1319275575 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd0068790 con 0x7f6fbc003bf0 2024-08-17T02:25:28.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.301+0000 7f6fd500a700 1 -- 172.21.15.104:0/1319275575 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fbc00c0b0 con 0x7f6fbc0051c0 2024-08-17T02:25:28.307 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.301+0000 7f6fd500a700 1 -- 172.21.15.104:0/1319275575 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fbc00c270 con 0x7f6fbc004810 2024-08-17T02:25:28.307 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.301+0000 7f6fd680d700 1 --2- 172.21.15.104:0/1319275575 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fbc0051c0 0x7f6fbc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:28.307 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.301+0000 7f6fd600c700 1 --2- 172.21.15.104:0/1319275575 >> v2:172.21.15.117:3300/0 conn(0x7f6fd0154900 0x7f6fd00b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:28.307 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.301+0000 7f6fd580b700 1 --2- 172.21.15.104:0/1319275575 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fbc004810 0x7f6fbc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:28.307 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.301+0000 7f6fd600c700 1 --2- 172.21.15.104:0/1319275575 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6fbc003bf0 0x7f6fbc003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:28.307 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.301+0000 7f6fd600c700 1 -- 172.21.15.104:0/1319275575 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fbc004810 msgr2=0x7f6fbc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:28.307 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.301+0000 7f6fd600c700 1 --2- 172.21.15.104:0/1319275575 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fbc004810 0x7f6fbc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.307 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.301+0000 7f6fd600c700 1 -- 172.21.15.104:0/1319275575 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fbc0051c0 msgr2=0x7f6fbc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:28.307 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.301+0000 7f6fd600c700 1 --2- 172.21.15.104:0/1319275575 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fbc0051c0 0x7f6fbc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.307 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.301+0000 7f6fd600c700 1 -- 172.21.15.104:0/1319275575 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fbc003570 con 0x7f6fbc003bf0 2024-08-17T02:25:28.307 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.301+0000 7f6fd680d700 1 -- 172.21.15.104:0/1319275575 reap_dead start 2024-08-17T02:25:28.307 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.301+0000 7f6fd600c700 1 --2- 172.21.15.104:0/1319275575 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6fbc003bf0 0x7f6fbc003fe0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc009db0 tx=0x7f6fcc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3db1aade3fcc0266 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:28.307 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.301+0000 7f6fd500a700 1 -- 172.21.15.104:0/1319275575 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc009740 con 0x7f6fbc003bf0 2024-08-17T02:25:28.307 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.301+0000 7f6fd500a700 1 -- 172.21.15.104:0/1319275575 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fcc00e920 con 0x7f6fbc003bf0 2024-08-17T02:25:28.307 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.301+0000 7f6fd500a700 1 -- 172.21.15.104:0/1319275575 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc00eca0 con 0x7f6fbc003bf0 2024-08-17T02:25:28.308 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.301+0000 7f6fd700e700 1 -- 172.21.15.104:0/1319275575 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6fbc003bf0 msgr2=0x7f6fbc003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.308 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.301+0000 7f6fd700e700 1 --2- 172.21.15.104:0/1319275575 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6fbc003bf0 0x7f6fbc003fe0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc009db0 tx=0x7f6fcc0091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.308 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.301+0000 7f6fd700e700 1 -- 172.21.15.104:0/1319275575 shutdown_connections 2024-08-17T02:25:28.308 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.301+0000 7f6fd700e700 1 --2- 172.21.15.104:0/1319275575 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6fbc003bf0 0x7f6fbc003fe0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.308 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.301+0000 7f6fd700e700 1 -- 172.21.15.104:0/1319275575 >> 172.21.15.104:0/1319275575 conn(0x7f6fd00678d0 msgr2=0x7f6fd0067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:28.308 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.301+0000 7f6fd700e700 1 -- 172.21.15.104:0/1319275575 shutdown_connections 2024-08-17T02:25:28.308 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.301+0000 7f6fd700e700 1 -- 172.21.15.104:0/1319275575 wait complete. 2024-08-17T02:25:28.309 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.305+0000 7f6fd700e700 1 Processor -- start 2024-08-17T02:25:28.309 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.305+0000 7f6fd700e700 1 -- start start 2024-08-17T02:25:28.309 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.305+0000 7f6fd700e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6fbc003bf0 0x7f6fd00b0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:28.309 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.305+0000 7f6fd700e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fd00aacb0 0x7f6fd014fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:28.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.305+0000 7f6fd700e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fd00aecf0 0x7f6fd0063180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:28.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.305+0000 7f6fd700e700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd00b01e0 con 0x7f6fbc003bf0 2024-08-17T02:25:28.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.305+0000 7f6fd700e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd01500c0 con 0x7f6fd00aacb0 2024-08-17T02:25:28.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.305+0000 7f6fd700e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd00af5d0 con 0x7f6fd00aecf0 2024-08-17T02:25:28.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.305+0000 7f6fd600c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6fbc003bf0 0x7f6fd00b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:28.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.305+0000 7f6fd600c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6fbc003bf0 0x7f6fd00b0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33228/0 (socket says 172.21.15.104:33228) 2024-08-17T02:25:28.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.305+0000 7f6fd600c700 1 -- 172.21.15.104:0/3436519683 learned_addr learned my addr 172.21.15.104:0/3436519683 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:28.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.305+0000 7f6fd580b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fd00aacb0 0x7f6fd014fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:28.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.305+0000 7f6fd680d700 1 --2- 172.21.15.104:0/3436519683 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fd00aecf0 0x7f6fd0063180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:28.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.305+0000 7f6fd600c700 1 -- 172.21.15.104:0/3436519683 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fd00aecf0 msgr2=0x7f6fd0063180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.305+0000 7f6fd600c700 1 --2- 172.21.15.104:0/3436519683 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fd00aecf0 0x7f6fd0063180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.305+0000 7f6fd600c700 1 -- 172.21.15.104:0/3436519683 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fd00aacb0 msgr2=0x7f6fd014fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.305+0000 7f6fd600c700 1 --2- 172.21.15.104:0/3436519683 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fd00aacb0 0x7f6fd014fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.305+0000 7f6fd600c700 1 -- 172.21.15.104:0/3436519683 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd00af8b0 con 0x7f6fbc003bf0 2024-08-17T02:25:28.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.309+0000 7f6fd600c700 1 --2- 172.21.15.104:0/3436519683 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6fbc003bf0 0x7f6fd00b0670 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc00c080 tx=0x7f6fcc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:28.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.309+0000 7f6fc67fc700 1 -- 172.21.15.104:0/3436519683 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc0253f0 con 0x7f6fbc003bf0 2024-08-17T02:25:28.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.309+0000 7f6fc67fc700 1 -- 172.21.15.104:0/3436519683 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fcc021040 con 0x7f6fbc003bf0 2024-08-17T02:25:28.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.309+0000 7f6fd700e700 1 -- 172.21.15.104:0/3436519683 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fd00afb90 con 0x7f6fbc003bf0 2024-08-17T02:25:28.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.309+0000 7f6fc67fc700 1 -- 172.21.15.104:0/3436519683 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc0257a0 con 0x7f6fbc003bf0 2024-08-17T02:25:28.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.309+0000 7f6fd700e700 1 -- 172.21.15.104:0/3436519683 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fd00af160 con 0x7f6fbc003bf0 2024-08-17T02:25:28.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.309+0000 7f6fd700e700 1 -- 172.21.15.104:0/3436519683 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fd00af380 con 0x7f6fbc003bf0 2024-08-17T02:25:28.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.309+0000 7f6fc67fc700 1 -- 172.21.15.104:0/3436519683 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6fcc025b50 con 0x7f6fbc003bf0 2024-08-17T02:25:28.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.309+0000 7f6fc67fc700 1 --2- 172.21.15.104:0/3436519683 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f6fb4060860 0x7f6fb4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:28.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.309+0000 7f6fc67fc700 1 -- 172.21.15.104:0/3436519683 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f6fcc07ec30 con 0x7f6fbc003bf0 2024-08-17T02:25:28.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.309+0000 7f6fd580b700 1 --2- 172.21.15.104:0/3436519683 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f6fb4060860 0x7f6fb4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:28.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.309+0000 7f6fd580b700 1 --2- 172.21.15.104:0/3436519683 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f6fb4060860 0x7f6fb4062d10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0168550 tx=0x7f6fc0007d10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:28.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.313+0000 7f6fc67fc700 1 -- 172.21.15.104:0/3436519683 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f6fcc04ed90 con 0x7f6fbc003bf0 2024-08-17T02:25:28.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.481+0000 7f6fd700e700 1 -- 172.21.15.104:0/3436519683 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6fd00643a0 con 0x7f6fbc003bf0 2024-08-17T02:25:28.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.485+0000 7f6fc67fc700 1 -- 172.21.15.104:0/3436519683 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+18837 (secure 0 0 0) 0x7f6fcc052370 con 0x7f6fbc003bf0 2024-08-17T02:25:28.487 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:25:28.488 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":41,"fsid":"fd5f7fb8-d34b-49bb-89a8-62b7dad1bc25","created":"2024-08-17T02:21:57.891389+0000","modified":"2024-08-17T02:24:03.367031+0000","last_up_change":"2024-08-17T02:22:08.924546+0000","last_in_change":"2024-08-17T02:21:59.938028+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:22:10.143970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:23:03.390787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:23:04.462361+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000188090.meta","create_time":"2024-08-17T02:23:21.239436+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000188090"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000188090.data","create_time":"2024-08-17T02:23:21.337636+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000188090"}}}],"osds":[{"osd":0,"uuid":"606b9088-590e-4709-aa3a-b0f6e22972ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":24257},{"type":"v1","addr":"172.21.15.104:6809","nonce":24257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":24257},{"type":"v1","addr":"172.21.15.104:6811","nonce":24257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":24257},{"type":"v1","addr":"172.21.15.104:6815","nonce":24257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":24257},{"type":"v1","addr":"172.21.15.104:6813","nonce":24257}]},"public_addr":"172.21.15.104:6809/24257","cluster_addr":"172.21.15.104:6811/24257","heartbeat_back_addr":"172.21.15.104:6815/24257","heartbeat_front_addr":"172.21.15.104:6813/24257","state":["exists","up"]},{"osd":1,"uuid":"9bc6a909-0c2f-4889-afe7-4a47f89b0f64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":24256},{"type":"v1","addr":"172.21.15.104:6825","nonce":24256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":24256},{"type":"v1","addr":"172.21.15.104:6827","nonce":24256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":24256},{"type":"v1","addr":"172.21.15.104:6831","nonce":24256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":24256},{"type":"v1","addr":"172.21.15.104:6829","nonce":24256}]},"public_addr":"172.21.15.104:6825/24256","cluster_addr":"172.21.15.104:6827/24256","heartbeat_back_addr":"172.21.15.104:6831/24256","heartbeat_front_addr":"172.21.15.104:6829/24256","state":["exists","up"]},{"osd":2,"uuid":"23da31d5-aefb-4edb-b79d-fa05e1becef7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":24255},{"type":"v1","addr":"172.21.15.104:6817","nonce":24255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":24255},{"type":"v1","addr":"172.21.15.104:6819","nonce":24255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":24255},{"type":"v1","addr":"172.21.15.104:6823","nonce":24255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":24255},{"type":"v1","addr":"172.21.15.104:6821","nonce":24255}]},"public_addr":"172.21.15.104:6817/24255","cluster_addr":"172.21.15.104:6819/24255","heartbeat_back_addr":"172.21.15.104:6823/24255","heartbeat_front_addr":"172.21.15.104:6821/24255","state":["exists","up"]},{"osd":3,"uuid":"6e4a5ec2-b415-45ef-8381-61a59eb65224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":24254},{"type":"v1","addr":"172.21.15.104:6801","nonce":24254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":24254},{"type":"v1","addr":"172.21.15.104:6803","nonce":24254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":24254},{"type":"v1","addr":"172.21.15.104:6807","nonce":24254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":24254},{"type":"v1","addr":"172.21.15.104:6805","nonce":24254}]},"public_addr":"172.21.15.104:6801/24254","cluster_addr":"172.21.15.104:6803/24254","heartbeat_back_addr":"172.21.15.104:6807/24254","heartbeat_front_addr":"172.21.15.104:6805/24254","state":["exists","up"]},{"osd":4,"uuid":"8d5bea2d-9039-4013-8c99-2c046c5b8a17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":24421},{"type":"v1","addr":"172.21.15.117:6804","nonce":24421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":24421},{"type":"v1","addr":"172.21.15.117:6809","nonce":24421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":24421},{"type":"v1","addr":"172.21.15.117:6815","nonce":24421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":24421},{"type":"v1","addr":"172.21.15.117:6813","nonce":24421}]},"public_addr":"172.21.15.117:6804/24421","cluster_addr":"172.21.15.117:6809/24421","heartbeat_back_addr":"172.21.15.117:6815/24421","heartbeat_front_addr":"172.21.15.117:6813/24421","state":["exists","up"]},{"osd":5,"uuid":"de8b36fc-121c-4f05-8f5b-28f513d9f21f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":24422},{"type":"v1","addr":"172.21.15.117:6817","nonce":24422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":24422},{"type":"v1","addr":"172.21.15.117:6819","nonce":24422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":24422},{"type":"v1","addr":"172.21.15.117:6823","nonce":24422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":24422},{"type":"v1","addr":"172.21.15.117:6821","nonce":24422}]},"public_addr":"172.21.15.117:6817/24422","cluster_addr":"172.21.15.117:6819/24422","heartbeat_back_addr":"172.21.15.117:6823/24422","heartbeat_front_addr":"172.21.15.117:6821/24422","state":["exists","up"]},{"osd":6,"uuid":"6a87f09f-7bf7-4f7a-be87-530ac1ff8ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":24420},{"type":"v1","addr":"172.21.15.117:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6803","nonce":24420},{"type":"v1","addr":"172.21.15.117:6805","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":24420},{"type":"v1","addr":"172.21.15.117:6811","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":24420},{"type":"v1","addr":"172.21.15.117:6808","nonce":24420}]},"public_addr":"172.21.15.117:6801/24420","cluster_addr":"172.21.15.117:6805/24420","heartbeat_back_addr":"172.21.15.117:6811/24420","heartbeat_front_addr":"172.21.15.117:6808/24420","state":["exists","up"]},{"osd":7,"uuid":"e31d8041-1aa1-4b5d-83b3-0a373426dd9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":24423},{"type":"v1","addr":"172.21.15.117:6825","nonce":24423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":24423},{"type":"v1","addr":"172.21.15.117:6827","nonce":24423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":24423},{"type":"v1","addr":"172.21.15.117:6831","nonce":24423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":24423},{"type":"v1","addr":"172.21.15.117:6829","nonce":24423}]},"public_addr":"172.21.15.117:6825/24423","cluster_addr":"172.21.15.117:6827/24423","heartbeat_back_addr":"172.21.15.117:6831/24423","heartbeat_front_addr":"172.21.15.117:6829/24423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.220874+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.210039+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.434762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.247206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.184316+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.306325+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.035719+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.400303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.35","mappings":[{"from":4,"to":5}]},{"pgid":"5.36","mappings":[{"from":4,"to":3}]},{"pgid":"5.37","mappings":[{"from":4,"to":5}]},{"pgid":"5.3c","mappings":[{"from":4,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:28.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.485+0000 7f6fd700e700 1 -- 172.21.15.104:0/3436519683 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f6fb4060860 msgr2=0x7f6fb4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.485+0000 7f6fd700e700 1 --2- 172.21.15.104:0/3436519683 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f6fb4060860 0x7f6fb4062d10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0168550 tx=0x7f6fc0007d10 comp rx=0 tx=0).stop 2024-08-17T02:25:28.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.485+0000 7f6fd700e700 1 -- 172.21.15.104:0/3436519683 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6fbc003bf0 msgr2=0x7f6fd00b0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.485+0000 7f6fd700e700 1 --2- 172.21.15.104:0/3436519683 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6fbc003bf0 0x7f6fd00b0670 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc00c080 tx=0x7f6fcc019000 comp rx=0 tx=0).stop 2024-08-17T02:25:28.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.485+0000 7f6fd700e700 1 -- 172.21.15.104:0/3436519683 shutdown_connections 2024-08-17T02:25:28.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.485+0000 7f6fd700e700 1 --2- 172.21.15.104:0/3436519683 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f6fb4060860 0x7f6fb4062d10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.485+0000 7f6fd700e700 1 --2- 172.21.15.104:0/3436519683 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fd00aecf0 0x7f6fd0063180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.485+0000 7f6fd700e700 1 --2- 172.21.15.104:0/3436519683 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fd00aacb0 0x7f6fd014fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.485+0000 7f6fd700e700 1 --2- 172.21.15.104:0/3436519683 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6fbc003bf0 0x7f6fd00b0670 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.485+0000 7f6fd700e700 1 -- 172.21.15.104:0/3436519683 >> 172.21.15.104:0/3436519683 conn(0x7f6fd00678d0 msgr2=0x7f6fd006cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:28.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.485+0000 7f6fd700e700 1 -- 172.21.15.104:0/3436519683 shutdown_connections 2024-08-17T02:25:28.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.485+0000 7f6fd700e700 1 -- 172.21.15.104:0/3436519683 wait complete. 2024-08-17T02:25:28.501 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-17T02:25:28.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.605+0000 7ff967056700 1 Processor -- start 2024-08-17T02:25:28.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.605+0000 7ff967056700 1 -- start start 2024-08-17T02:25:28.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.605+0000 7ff967056700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff9600cb450 0x7ff96006e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:28.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.605+0000 7ff967056700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9600cb870 con 0x7ff9600adf10 2024-08-17T02:25:28.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.605+0000 7ff967056700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9601610c0 con 0x7ff96006e470 2024-08-17T02:25:28.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.605+0000 7ff967056700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff960158290 con 0x7ff9600cb450 2024-08-17T02:25:28.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.605+0000 7ff964df2700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7ff9600adf10 0x7ff9600ae2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:39500/0 (socket says 172.21.15.104:39500) 2024-08-17T02:25:28.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.605+0000 7ff964df2700 1 -- 172.21.15.104:0/2971595153 learned_addr learned my addr 172.21.15.104:0/2971595153 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:25:28.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.605+0000 7ff9655f3700 1 --2- 172.21.15.104:0/2971595153 >> v2:172.21.15.104:3300/0 conn(0x7ff9600cb450 0x7ff96006e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:28.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.605+0000 7ff95f7fe700 1 -- 172.21.15.104:0/2971595153 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1818432295 0 0) 0x7ff9600cb870 con 0x7ff9600adf10 2024-08-17T02:25:28.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.605+0000 7ff95f7fe700 1 -- 172.21.15.104:0/2971595153 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff950003570 con 0x7ff9600adf10 2024-08-17T02:25:28.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.605+0000 7ff95f7fe700 1 -- 172.21.15.104:0/2971595153 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3314823221 0 0) 0x7ff950003570 con 0x7ff9600adf10 2024-08-17T02:25:28.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.605+0000 7ff9655f3700 1 -- 172.21.15.104:0/2971595153 >> v1:172.21.15.117:6789/0 conn(0x7ff96006e470 legacy=0x7ff9600cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.605+0000 7ff9655f3700 1 -- 172.21.15.104:0/2971595153 >> v1:172.21.15.104:6789/0 conn(0x7ff9600adf10 legacy=0x7ff9600ae2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.605+0000 7ff9655f3700 1 -- 172.21.15.104:0/2971595153 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff96015dff0 con 0x7ff9600cb450 2024-08-17T02:25:28.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.605+0000 7ff9655f3700 1 --2- 172.21.15.104:0/2971595153 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9600cb450 0x7ff96006e910 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff958009e60 tx=0x7ff958009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a81f30d48f039491 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:28.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.605+0000 7ff95f7fe700 1 -- 172.21.15.104:0/2971595153 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95800e070 con 0x7ff9600cb450 2024-08-17T02:25:28.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.605+0000 7ff95f7fe700 1 -- 172.21.15.104:0/2971595153 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95800b850 con 0x7ff9600cb450 2024-08-17T02:25:28.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.605+0000 7ff95f7fe700 1 -- 172.21.15.104:0/2971595153 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff954001470 con 0x7ff9600cb450 2024-08-17T02:25:28.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.605+0000 7ff967056700 1 -- 172.21.15.104:0/2971595153 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9600cb450 msgr2=0x7ff96006e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.605+0000 7ff967056700 1 --2- 172.21.15.104:0/2971595153 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9600cb450 0x7ff96006e910 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff958009e60 tx=0x7ff958009780 comp rx=0 tx=0).stop 2024-08-17T02:25:28.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.605+0000 7ff967056700 1 -- 172.21.15.104:0/2971595153 shutdown_connections 2024-08-17T02:25:28.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.605+0000 7ff967056700 1 --2- 172.21.15.104:0/2971595153 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9600cb450 0x7ff96006e910 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.605+0000 7ff967056700 1 -- 172.21.15.104:0/2971595153 >> 172.21.15.104:0/2971595153 conn(0x7ff960067810 msgr2=0x7ff960067c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:28.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.605+0000 7ff967056700 1 -- 172.21.15.104:0/2971595153 shutdown_connections 2024-08-17T02:25:28.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.605+0000 7ff967056700 1 -- 172.21.15.104:0/2971595153 wait complete. 2024-08-17T02:25:28.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.609+0000 7ff967056700 1 Processor -- start 2024-08-17T02:25:28.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.609+0000 7ff967056700 1 -- start start 2024-08-17T02:25:28.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.609+0000 7ff967056700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff96006e470 0x7ff96016e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:28.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.609+0000 7ff967056700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9600adf10 0x7ff960155f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:28.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.609+0000 7ff967056700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9600cb450 0x7ff960069d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:28.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.609+0000 7ff967056700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96016f290 con 0x7ff96006e470 2024-08-17T02:25:28.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.609+0000 7ff967056700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96016ecb0 con 0x7ff9600cb450 2024-08-17T02:25:28.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.609+0000 7ff967056700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff96016e9d0 con 0x7ff9600adf10 2024-08-17T02:25:28.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.609+0000 7ff964df2700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff96006e470 0x7ff96016e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:28.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.609+0000 7ff964df2700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff96006e470 0x7ff96016e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33254/0 (socket says 172.21.15.104:33254) 2024-08-17T02:25:28.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.609+0000 7ff964df2700 1 -- 172.21.15.104:0/4136222952 learned_addr learned my addr 172.21.15.104:0/4136222952 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:28.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.609+0000 7ff9655f3700 1 --2- 172.21.15.104:0/4136222952 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9600cb450 0x7ff960069d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:28.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.609+0000 7ff95ffff700 1 --2- 172.21.15.104:0/4136222952 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9600adf10 0x7ff960155f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:28.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.609+0000 7ff964df2700 1 -- 172.21.15.104:0/4136222952 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9600adf10 msgr2=0x7ff960155f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.609+0000 7ff964df2700 1 --2- 172.21.15.104:0/4136222952 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9600adf10 0x7ff960155f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.609+0000 7ff964df2700 1 -- 172.21.15.104:0/4136222952 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9600cb450 msgr2=0x7ff960069d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.609+0000 7ff964df2700 1 --2- 172.21.15.104:0/4136222952 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9600cb450 0x7ff960069d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.609+0000 7ff964df2700 1 -- 172.21.15.104:0/4136222952 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff958009a20 con 0x7ff96006e470 2024-08-17T02:25:28.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.609+0000 7ff9655f3700 1 --2- 172.21.15.104:0/4136222952 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9600cb450 0x7ff960069d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:28.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.609+0000 7ff95ffff700 1 --2- 172.21.15.104:0/4136222952 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9600adf10 0x7ff960155f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:28.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.609+0000 7ff964df2700 1 --2- 172.21.15.104:0/4136222952 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff96006e470 0x7ff96016e490 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff95400cbf0 tx=0x7ff954001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:28.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.609+0000 7ff95cff9700 1 -- 172.21.15.104:0/4136222952 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff954007360 con 0x7ff96006e470 2024-08-17T02:25:28.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.609+0000 7ff95cff9700 1 -- 172.21.15.104:0/4136222952 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9540074c0 con 0x7ff96006e470 2024-08-17T02:25:28.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.613+0000 7ff967056700 1 -- 172.21.15.104:0/4136222952 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9601587a0 con 0x7ff96006e470 2024-08-17T02:25:28.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.613+0000 7ff95cff9700 1 -- 172.21.15.104:0/4136222952 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff954004830 con 0x7ff96006e470 2024-08-17T02:25:28.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.613+0000 7ff967056700 1 -- 172.21.15.104:0/4136222952 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9600b1890 con 0x7ff96006e470 2024-08-17T02:25:28.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.613+0000 7ff967056700 1 -- 172.21.15.104:0/4136222952 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9600645c0 con 0x7ff96006e470 2024-08-17T02:25:28.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.613+0000 7ff95cff9700 1 -- 172.21.15.104:0/4136222952 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff954004be0 con 0x7ff96006e470 2024-08-17T02:25:28.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.613+0000 7ff95cff9700 1 --2- 172.21.15.104:0/4136222952 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff944060860 0x7ff944062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:28.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.613+0000 7ff95cff9700 1 -- 172.21.15.104:0/4136222952 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6719+0+0 (secure 0 0 0) 0x7ff95407c720 con 0x7ff96006e470 2024-08-17T02:25:28.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.613+0000 7ff95ffff700 1 --2- 172.21.15.104:0/4136222952 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff944060860 0x7ff944062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:28.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.617+0000 7ff95ffff700 1 --2- 172.21.15.104:0/4136222952 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff944060860 0x7ff944062d10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff96015ccb0 tx=0x7ff94c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:28.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.621+0000 7ff95cff9700 1 -- 172.21.15.104:0/4136222952 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff95404c800 con 0x7ff96006e470 2024-08-17T02:25:28.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.817+0000 7ff967056700 1 -- 172.21.15.104:0/4136222952 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff9600ad110 con 0x7ff96006e470 2024-08-17T02:25:28.820 INFO:tasks.ceph.mon.a.smithi104.stderr:2024-08-17T02:25:28.817+0000 7f0dc6781700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:25:28.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.825+0000 7ff95cff9700 1 -- 172.21.15.104:0/4136222952 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff95404fe20 con 0x7ff96006e470 2024-08-17T02:25:28.831 INFO:tasks.ceph.mds.a.smithi104.stderr: -7294> 2024-08-17T02:23:10.486+0000 7f2106535700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:25:28.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.829+0000 7ff967056700 1 -- 172.21.15.104:0/4136222952 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff944060860 msgr2=0x7ff944062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.829+0000 7ff967056700 1 --2- 172.21.15.104:0/4136222952 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff944060860 0x7ff944062d10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff96015ccb0 tx=0x7ff94c009040 comp rx=0 tx=0).stop 2024-08-17T02:25:28.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.829+0000 7ff967056700 1 -- 172.21.15.104:0/4136222952 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff96006e470 msgr2=0x7ff96016e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.829+0000 7ff967056700 1 --2- 172.21.15.104:0/4136222952 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff96006e470 0x7ff96016e490 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff95400cbf0 tx=0x7ff954001aa0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.829+0000 7ff967056700 1 -- 172.21.15.104:0/4136222952 shutdown_connections 2024-08-17T02:25:28.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.829+0000 7ff967056700 1 --2- 172.21.15.104:0/4136222952 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff944060860 0x7ff944062d10 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.829+0000 7ff967056700 1 --2- 172.21.15.104:0/4136222952 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9600cb450 0x7ff960069d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.829+0000 7ff967056700 1 --2- 172.21.15.104:0/4136222952 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9600adf10 0x7ff960155f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.829+0000 7ff967056700 1 --2- 172.21.15.104:0/4136222952 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff96006e470 0x7ff96016e490 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.829+0000 7ff967056700 1 -- 172.21.15.104:0/4136222952 >> 172.21.15.104:0/4136222952 conn(0x7ff960067810 msgr2=0x7ff96015f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:28.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.833+0000 7ff967056700 1 -- 172.21.15.104:0/4136222952 shutdown_connections 2024-08-17T02:25:28.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.833+0000 7ff967056700 1 -- 172.21.15.104:0/4136222952 wait complete. 2024-08-17T02:25:28.835 INFO:teuthology.orchestra.run.smithi104.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:25:28.847 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-17T02:25:28.859 INFO:tasks.ceph.mds.a.smithi104.stdout:starting mds.a at 2024-08-17T02:25:28.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.949+0000 7fb028d1b700 1 Processor -- start 2024-08-17T02:25:28.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.949+0000 7fb028d1b700 1 -- start start 2024-08-17T02:25:28.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.949+0000 7fb028d1b700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb024159290 0x7fb024066e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:28.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.949+0000 7fb028d1b700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb0240b5bf0 0x7fb024067340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:28.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.949+0000 7fb028d1b700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0240b2f80 con 0x7fb024158ec0 2024-08-17T02:25:28.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.949+0000 7fb028d1b700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0240cf210 con 0x7fb0240b5bf0 2024-08-17T02:25:28.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.949+0000 7fb028d1b700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0240cf4b0 con 0x7fb024159290 2024-08-17T02:25:28.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.953+0000 7fb0237fe700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fb024158ec0 0x7fb0240ccb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:39520/0 (socket says 172.21.15.104:39520) 2024-08-17T02:25:28.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.953+0000 7fb0237fe700 1 -- 172.21.15.104:0/4084261597 learned_addr learned my addr 172.21.15.104:0/4084261597 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:25:28.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.953+0000 7fb023fff700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb0240b5bf0 0x7fb024067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:28.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.953+0000 7fb022ffd700 1 --2- 172.21.15.104:0/4084261597 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb024159290 0x7fb024066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:28.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.953+0000 7fb0227fc700 1 -- 172.21.15.104:0/4084261597 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1895394350 0 0) 0x7fb0240b2f80 con 0x7fb024158ec0 2024-08-17T02:25:28.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.953+0000 7fb0227fc700 1 -- 172.21.15.104:0/4084261597 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb010003570 con 0x7fb024158ec0 2024-08-17T02:25:28.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.953+0000 7fb022ffd700 1 -- 172.21.15.104:0/4084261597 >> v2:172.21.15.104:3300/0 conn(0x7fb0240b5bf0 msgr2=0x7fb024067340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:28.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.953+0000 7fb022ffd700 1 --2- 172.21.15.104:0/4084261597 >> v2:172.21.15.104:3300/0 conn(0x7fb0240b5bf0 0x7fb024067340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.953+0000 7fb022ffd700 1 -- 172.21.15.104:0/4084261597 >> v1:172.21.15.104:6789/0 conn(0x7fb024158ec0 legacy=0x7fb0240ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.953+0000 7fb022ffd700 1 -- 172.21.15.104:0/4084261597 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0240cf790 con 0x7fb024159290 2024-08-17T02:25:28.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.953+0000 7fb022ffd700 1 --2- 172.21.15.104:0/4084261597 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb024159290 0x7fb024066e00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb00c0098e0 tx=0x7fb00c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0103578100e8e10 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:28.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.953+0000 7fb0227fc700 1 -- 172.21.15.104:0/4084261597 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c011630 con 0x7fb024159290 2024-08-17T02:25:28.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.953+0000 7fb0227fc700 1 -- 172.21.15.104:0/4084261597 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00c011790 con 0x7fb024159290 2024-08-17T02:25:28.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.953+0000 7fb0227fc700 1 -- 172.21.15.104:0/4084261597 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c011b30 con 0x7fb024159290 2024-08-17T02:25:28.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.953+0000 7fb028d1b700 1 -- 172.21.15.104:0/4084261597 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb024159290 msgr2=0x7fb024066e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.953+0000 7fb028d1b700 1 --2- 172.21.15.104:0/4084261597 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb024159290 0x7fb024066e00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb00c0098e0 tx=0x7fb00c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.953+0000 7fb028d1b700 1 -- 172.21.15.104:0/4084261597 shutdown_connections 2024-08-17T02:25:28.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.953+0000 7fb028d1b700 1 --2- 172.21.15.104:0/4084261597 >> v2:172.21.15.104:3300/0 conn(0x7fb0240b5bf0 0x7fb024067340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.953+0000 7fb028d1b700 1 --2- 172.21.15.104:0/4084261597 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb024159290 0x7fb024066e00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.953+0000 7fb028d1b700 1 -- 172.21.15.104:0/4084261597 >> 172.21.15.104:0/4084261597 conn(0x7fb02406a3b0 msgr2=0x7fb0240b1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:28.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.953+0000 7fb028d1b700 1 -- 172.21.15.104:0/4084261597 shutdown_connections 2024-08-17T02:25:28.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.953+0000 7fb028d1b700 1 -- 172.21.15.104:0/4084261597 wait complete. 2024-08-17T02:25:28.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.953+0000 7fb028d1b700 1 Processor -- start 2024-08-17T02:25:28.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.953+0000 7fb028d1b700 1 -- start start 2024-08-17T02:25:28.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.957+0000 7fb028d1b700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0240b5bf0 0x7fb024150480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:28.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.957+0000 7fb028d1b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb024158ec0 0x7fb02413fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:28.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.957+0000 7fb028d1b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb024159290 0x7fb02414d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:28.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.957+0000 7fb028d1b700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0241401e0 con 0x7fb024159290 2024-08-17T02:25:28.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.957+0000 7fb028d1b700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02414fff0 con 0x7fb024158ec0 2024-08-17T02:25:28.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.957+0000 7fb028d1b700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02414e2a0 con 0x7fb0240b5bf0 2024-08-17T02:25:28.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.957+0000 7fb023fff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb024159290 0x7fb02414d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:28.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.957+0000 7fb022ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb024158ec0 0x7fb02413fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:28.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.957+0000 7fb023fff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb024159290 0x7fb02414d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33296/0 (socket says 172.21.15.104:33296) 2024-08-17T02:25:28.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.957+0000 7fb023fff700 1 -- 172.21.15.104:0/3381496555 learned_addr learned my addr 172.21.15.104:0/3381496555 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:28.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.957+0000 7fb0237fe700 1 --2- 172.21.15.104:0/3381496555 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0240b5bf0 0x7fb024150480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:28.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.957+0000 7fb022ffd700 1 -- 172.21.15.104:0/3381496555 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0240b5bf0 msgr2=0x7fb024150480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.957+0000 7fb022ffd700 1 --2- 172.21.15.104:0/3381496555 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0240b5bf0 0x7fb024150480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.957+0000 7fb022ffd700 1 -- 172.21.15.104:0/3381496555 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb024159290 msgr2=0x7fb02414d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.957+0000 7fb022ffd700 1 --2- 172.21.15.104:0/3381496555 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb024159290 0x7fb02414d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.957+0000 7fb022ffd700 1 -- 172.21.15.104:0/3381496555 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb00c009420 con 0x7fb024158ec0 2024-08-17T02:25:28.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.957+0000 7fb022ffd700 1 --2- 172.21.15.104:0/3381496555 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb024158ec0 0x7fb02413fca0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb00c016000 tx=0x7fb00c017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:28.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.957+0000 7fb01b7fe700 1 -- 172.21.15.104:0/3381496555 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c020070 con 0x7fb024158ec0 2024-08-17T02:25:28.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.957+0000 7fb01b7fe700 1 -- 172.21.15.104:0/3381496555 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00c000bc0 con 0x7fb024158ec0 2024-08-17T02:25:28.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.957+0000 7fb028d1b700 1 -- 172.21.15.104:0/3381496555 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb02414f6e0 con 0x7fb024158ec0 2024-08-17T02:25:28.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.957+0000 7fb01b7fe700 1 -- 172.21.15.104:0/3381496555 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c026420 con 0x7fb024158ec0 2024-08-17T02:25:28.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.957+0000 7fb028d1b700 1 -- 172.21.15.104:0/3381496555 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb02414fc80 con 0x7fb024158ec0 2024-08-17T02:25:28.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.961+0000 7fb028d1b700 1 -- 172.21.15.104:0/3381496555 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb024150180 con 0x7fb024158ec0 2024-08-17T02:25:28.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.961+0000 7fb01b7fe700 1 -- 172.21.15.104:0/3381496555 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb00c024070 con 0x7fb024158ec0 2024-08-17T02:25:28.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.961+0000 7fb01b7fe700 1 --2- 172.21.15.104:0/3381496555 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb0040608e0 0x7fb004062d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:28.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.961+0000 7fb01b7fe700 1 -- 172.21.15.104:0/3381496555 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6805+0+0 (secure 0 0 0) 0x7fb00c07e170 con 0x7fb024158ec0 2024-08-17T02:25:28.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.961+0000 7fb0237fe700 1 --2- 172.21.15.104:0/3381496555 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb0040608e0 0x7fb004062d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:28.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.961+0000 7fb0237fe700 1 --2- 172.21.15.104:0/3381496555 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb0040608e0 0x7fb004062d90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb01c005c50 tx=0x7fb01c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:28.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:28.973+0000 7fb01b7fe700 1 -- 172.21.15.104:0/3381496555 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb00c04e150 con 0x7fb024158ec0 2024-08-17T02:25:29.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:29.177+0000 7fb028d1b700 1 -- 172.21.15.104:0/3381496555 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb024064330 con 0x7fb024158ec0 2024-08-17T02:25:29.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:29.828+0000 7fb01b7fe700 1 -- 172.21.15.104:0/3381496555 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb00c0516f0 con 0x7fb024158ec0 2024-08-17T02:25:29.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:29.832+0000 7fb028d1b700 1 -- 172.21.15.104:0/3381496555 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb0040608e0 msgr2=0x7fb004062d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:29.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:29.832+0000 7fb028d1b700 1 --2- 172.21.15.104:0/3381496555 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb0040608e0 0x7fb004062d90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb01c005c50 tx=0x7fb01c009040 comp rx=0 tx=0).stop 2024-08-17T02:25:29.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:29.832+0000 7fb028d1b700 1 -- 172.21.15.104:0/3381496555 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb024158ec0 msgr2=0x7fb02413fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:29.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:29.832+0000 7fb028d1b700 1 --2- 172.21.15.104:0/3381496555 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb024158ec0 0x7fb02413fca0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb00c016000 tx=0x7fb00c017000 comp rx=0 tx=0).stop 2024-08-17T02:25:29.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:29.832+0000 7fb028d1b700 1 -- 172.21.15.104:0/3381496555 shutdown_connections 2024-08-17T02:25:29.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:29.832+0000 7fb028d1b700 1 --2- 172.21.15.104:0/3381496555 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb0040608e0 0x7fb004062d90 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:29.832+0000 7fb028d1b700 1 --2- 172.21.15.104:0/3381496555 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb024159290 0x7fb02414d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:29.832+0000 7fb028d1b700 1 --2- 172.21.15.104:0/3381496555 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb024158ec0 0x7fb02413fca0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:29.832+0000 7fb028d1b700 1 --2- 172.21.15.104:0/3381496555 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0240b5bf0 0x7fb024150480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:29.832+0000 7fb028d1b700 1 -- 172.21.15.104:0/3381496555 >> 172.21.15.104:0/3381496555 conn(0x7fb02406a3b0 msgr2=0x7fb02415dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:29.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:29.832+0000 7fb028d1b700 1 -- 172.21.15.104:0/3381496555 shutdown_connections 2024-08-17T02:25:29.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:29.832+0000 7fb028d1b700 1 -- 172.21.15.104:0/3381496555 wait complete. 2024-08-17T02:25:29.853 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-17T02:25:30.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.012+0000 7f6c329f2700 1 Processor -- start 2024-08-17T02:25:30.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.012+0000 7f6c329f2700 1 -- start start 2024-08-17T02:25:30.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.012+0000 7f6c329f2700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6c2c0b37a0 0x7f6c2c0aea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:30.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.012+0000 7f6c329f2700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c2c0b0de0 con 0x7f6c2c0b2160 2024-08-17T02:25:30.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.012+0000 7f6c329f2700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c2c0b10c0 con 0x7f6c2c0cd260 2024-08-17T02:25:30.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.012+0000 7f6c329f2700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c2c0b13a0 con 0x7f6c2c0b37a0 2024-08-17T02:25:30.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.012+0000 7f6c321f1700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6c2c0b37a0 0x7f6c2c0aea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:30.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.012+0000 7f6c311ef700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f6c2c0b2160 0x7f6c2c0b3090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:39528/0 (socket says 172.21.15.104:39528) 2024-08-17T02:25:30.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.012+0000 7f6c311ef700 1 -- 172.21.15.104:0/742623540 learned_addr learned my addr 172.21.15.104:0/742623540 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:25:30.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.012+0000 7f6c321f1700 1 -- 172.21.15.104:0/742623540 >> v1:172.21.15.117:6789/0 conn(0x7f6c2c0cd260 legacy=0x7f6c2c157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:30.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.012+0000 7f6c321f1700 1 -- 172.21.15.104:0/742623540 >> v1:172.21.15.104:6789/0 conn(0x7f6c2c0b2160 legacy=0x7f6c2c0b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:30.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.012+0000 7f6c321f1700 1 -- 172.21.15.104:0/742623540 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c2c0b1680 con 0x7f6c2c0b37a0 2024-08-17T02:25:30.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.012+0000 7f6c309ee700 1 -- 172.21.15.104:0/742623540 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1031862136 0 0) 0x7f6c2c0b0de0 con 0x7f6c2c0b2160 2024-08-17T02:25:30.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.012+0000 7f6c321f1700 1 --2- 172.21.15.104:0/742623540 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c2c0b37a0 0x7f6c2c0aea50 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f6c24009e60 tx=0x7f6c24009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6734fef5f3fc422 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:30.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.012+0000 7f6c309ee700 1 -- 172.21.15.104:0/742623540 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2400e070 con 0x7f6c2c0b37a0 2024-08-17T02:25:30.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.012+0000 7f6c309ee700 1 -- 172.21.15.104:0/742623540 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2400bc30 con 0x7f6c2c0b37a0 2024-08-17T02:25:30.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.012+0000 7f6c309ee700 1 -- 172.21.15.104:0/742623540 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c24012430 con 0x7f6c2c0b37a0 2024-08-17T02:25:30.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.016+0000 7f6c329f2700 1 -- 172.21.15.104:0/742623540 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c2c0b37a0 msgr2=0x7f6c2c0aea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:30.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.016+0000 7f6c329f2700 1 --2- 172.21.15.104:0/742623540 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c2c0b37a0 0x7f6c2c0aea50 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f6c24009e60 tx=0x7f6c24009780 comp rx=0 tx=0).stop 2024-08-17T02:25:30.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.016+0000 7f6c329f2700 1 -- 172.21.15.104:0/742623540 shutdown_connections 2024-08-17T02:25:30.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.016+0000 7f6c329f2700 1 --2- 172.21.15.104:0/742623540 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c2c0b37a0 0x7f6c2c0aea50 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.016+0000 7f6c329f2700 1 -- 172.21.15.104:0/742623540 >> 172.21.15.104:0/742623540 conn(0x7f6c2c0cdeb0 msgr2=0x7f6c2c0ce2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:30.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.016+0000 7f6c329f2700 1 -- 172.21.15.104:0/742623540 shutdown_connections 2024-08-17T02:25:30.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.016+0000 7f6c329f2700 1 -- 172.21.15.104:0/742623540 wait complete. 2024-08-17T02:25:30.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.016+0000 7f6c329f2700 1 Processor -- start 2024-08-17T02:25:30.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.016+0000 7f6c329f2700 1 -- start start 2024-08-17T02:25:30.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.016+0000 7f6c329f2700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c2c0b2160 0x7f6c2c06c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:30.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.016+0000 7f6c329f2700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c2c0b37a0 0x7f6c2c151c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:30.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.016+0000 7f6c329f2700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c2c0cd260 0x7f6c2c142890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:30.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.016+0000 7f6c329f2700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2c152180 con 0x7f6c2c0cd260 2024-08-17T02:25:30.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.016+0000 7f6c329f2700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2c06b270 con 0x7f6c2c0b37a0 2024-08-17T02:25:30.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.016+0000 7f6c329f2700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2c06b550 con 0x7f6c2c0b2160 2024-08-17T02:25:30.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.016+0000 7f6c321f1700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c2c0cd260 0x7f6c2c142890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:30.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.016+0000 7f6c321f1700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c2c0cd260 0x7f6c2c142890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33320/0 (socket says 172.21.15.104:33320) 2024-08-17T02:25:30.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.016+0000 7f6c321f1700 1 -- 172.21.15.104:0/834183489 learned_addr learned my addr 172.21.15.104:0/834183489 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:30.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.016+0000 7f6c311ef700 1 --2- 172.21.15.104:0/834183489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c2c0b37a0 0x7f6c2c151c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:30.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.016+0000 7f6c319f0700 1 --2- 172.21.15.104:0/834183489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c2c0b2160 0x7f6c2c06c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:30.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.016+0000 7f6c321f1700 1 -- 172.21.15.104:0/834183489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c2c0b2160 msgr2=0x7f6c2c06c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:30.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.016+0000 7f6c321f1700 1 --2- 172.21.15.104:0/834183489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c2c0b2160 0x7f6c2c06c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.016+0000 7f6c321f1700 1 -- 172.21.15.104:0/834183489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c2c0b37a0 msgr2=0x7f6c2c151c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:30.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.016+0000 7f6c321f1700 1 --2- 172.21.15.104:0/834183489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c2c0b37a0 0x7f6c2c151c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.016+0000 7f6c321f1700 1 -- 172.21.15.104:0/834183489 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c24009a20 con 0x7f6c2c0cd260 2024-08-17T02:25:30.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.016+0000 7f6c311ef700 1 --2- 172.21.15.104:0/834183489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c2c0b37a0 0x7f6c2c151c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:30.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.016+0000 7f6c319f0700 1 --2- 172.21.15.104:0/834183489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c2c0b2160 0x7f6c2c06c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:30.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.016+0000 7f6c321f1700 1 --2- 172.21.15.104:0/834183489 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c2c0cd260 0x7f6c2c142890 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6c24013000 tx=0x7f6c24019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:30.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.016+0000 7f6c21ffb700 1 -- 172.21.15.104:0/834183489 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2401b630 con 0x7f6c2c0cd260 2024-08-17T02:25:30.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.016+0000 7f6c21ffb700 1 -- 172.21.15.104:0/834183489 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2401b790 con 0x7f6c2c0cd260 2024-08-17T02:25:30.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.016+0000 7f6c329f2700 1 -- 172.21.15.104:0/834183489 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c2c06b830 con 0x7f6c2c0cd260 2024-08-17T02:25:30.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.016+0000 7f6c21ffb700 1 -- 172.21.15.104:0/834183489 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2401bb30 con 0x7f6c2c0cd260 2024-08-17T02:25:30.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.016+0000 7f6c329f2700 1 -- 172.21.15.104:0/834183489 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c2c06bdf0 con 0x7f6c2c0cd260 2024-08-17T02:25:30.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.020+0000 7f6c329f2700 1 -- 172.21.15.104:0/834183489 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c2c06bfe0 con 0x7f6c2c0cd260 2024-08-17T02:25:30.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.020+0000 7f6c21ffb700 1 -- 172.21.15.104:0/834183489 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6c2401c400 con 0x7f6c2c0cd260 2024-08-17T02:25:30.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.020+0000 7f6c21ffb700 1 --2- 172.21.15.104:0/834183489 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f6c10060860 0x7f6c10062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:30.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.020+0000 7f6c21ffb700 1 -- 172.21.15.104:0/834183489 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6805+0+0 (secure 0 0 0) 0x7f6c2407eff0 con 0x7f6c2c0cd260 2024-08-17T02:25:30.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.020+0000 7f6c319f0700 1 --2- 172.21.15.104:0/834183489 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f6c10060860 0x7f6c10062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:30.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.020+0000 7f6c319f0700 1 --2- 172.21.15.104:0/834183489 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f6c10060860 0x7f6c10062d10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6c28001840 tx=0x7f6c28009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:30.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.028+0000 7f6c21ffb700 1 -- 172.21.15.104:0/834183489 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f6c2404eff0 con 0x7f6c2c0cd260 2024-08-17T02:25:30.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.196+0000 7f6c329f2700 1 -- 172.21.15.104:0/834183489 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6c2c0644b0 con 0x7f6c2c0cd260 2024-08-17T02:25:30.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.836+0000 7f6c21ffb700 1 -- 172.21.15.104:0/834183489 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v43) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6c24009880 con 0x7f6c2c0cd260 2024-08-17T02:25:30.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.840+0000 7f6c329f2700 1 -- 172.21.15.104:0/834183489 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f6c10060860 msgr2=0x7f6c10062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:30.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.840+0000 7f6c329f2700 1 --2- 172.21.15.104:0/834183489 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f6c10060860 0x7f6c10062d10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6c28001840 tx=0x7f6c28009040 comp rx=0 tx=0).stop 2024-08-17T02:25:30.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.840+0000 7f6c329f2700 1 -- 172.21.15.104:0/834183489 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c2c0cd260 msgr2=0x7f6c2c142890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:30.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.840+0000 7f6c329f2700 1 --2- 172.21.15.104:0/834183489 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c2c0cd260 0x7f6c2c142890 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6c24013000 tx=0x7f6c24019000 comp rx=0 tx=0).stop 2024-08-17T02:25:30.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.840+0000 7f6c329f2700 1 -- 172.21.15.104:0/834183489 shutdown_connections 2024-08-17T02:25:30.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.840+0000 7f6c329f2700 1 --2- 172.21.15.104:0/834183489 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f6c10060860 0x7f6c10062d10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.840+0000 7f6c329f2700 1 --2- 172.21.15.104:0/834183489 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c2c0cd260 0x7f6c2c142890 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.840+0000 7f6c329f2700 1 --2- 172.21.15.104:0/834183489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c2c0b37a0 0x7f6c2c151c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.840+0000 7f6c329f2700 1 --2- 172.21.15.104:0/834183489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c2c0b2160 0x7f6c2c06c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.840+0000 7f6c329f2700 1 -- 172.21.15.104:0/834183489 >> 172.21.15.104:0/834183489 conn(0x7f6c2c0cdeb0 msgr2=0x7f6c2c0ad910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:30.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.840+0000 7f6c329f2700 1 -- 172.21.15.104:0/834183489 shutdown_connections 2024-08-17T02:25:30.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.840+0000 7f6c329f2700 1 -- 172.21.15.104:0/834183489 wait complete. 2024-08-17T02:25:30.850 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_metadata' removed 2024-08-17T02:25:30.859 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-17T02:25:30.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.968+0000 7fbe8a32b700 1 Processor -- start 2024-08-17T02:25:30.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.968+0000 7fbe8a32b700 1 -- start start 2024-08-17T02:25:30.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.972+0000 7fbe8a32b700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fbe84068db0 0x7fbe840acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:30.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.972+0000 7fbe8a32b700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbe84153400 0x7fbe8406be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:30.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.972+0000 7fbe8a32b700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe8406c3d0 con 0x7fbe84153030 2024-08-17T02:25:30.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.972+0000 7fbe8a32b700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe84155c20 con 0x7fbe84068db0 2024-08-17T02:25:30.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.972+0000 7fbe89329700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fbe84153030 0x7fbe840686a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:39544/0 (socket says 172.21.15.104:39544) 2024-08-17T02:25:30.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.972+0000 7fbe89329700 1 -- 172.21.15.104:0/3263945745 learned_addr learned my addr 172.21.15.104:0/3263945745 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:25:30.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.972+0000 7fbe8a32b700 1 -- 172.21.15.104:0/3263945745 --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe84155e30 con 0x7fbe84153400 2024-08-17T02:25:30.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.972+0000 7fbe88b28700 1 --2- 172.21.15.104:0/3263945745 >> v2:172.21.15.104:3300/0 conn(0x7fbe84068db0 0x7fbe840acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:30.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.972+0000 7fbe89b2a700 1 --2- 172.21.15.104:0/3263945745 >> v2:172.21.15.117:3300/0 conn(0x7fbe84153400 0x7fbe8406be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:30.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.972+0000 7fbe7bfff700 1 -- 172.21.15.104:0/3263945745 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 84273562 0 0) 0x7fbe8406c3d0 con 0x7fbe84153030 2024-08-17T02:25:30.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.972+0000 7fbe7bfff700 1 -- 172.21.15.104:0/3263945745 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe70003570 con 0x7fbe84153030 2024-08-17T02:25:30.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.972+0000 7fbe88b28700 1 -- 172.21.15.104:0/3263945745 >> v2:172.21.15.117:3300/0 conn(0x7fbe84153400 msgr2=0x7fbe8406be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:30.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.972+0000 7fbe88b28700 1 --2- 172.21.15.104:0/3263945745 >> v2:172.21.15.117:3300/0 conn(0x7fbe84153400 0x7fbe8406be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.972+0000 7fbe7bfff700 1 -- 172.21.15.104:0/3263945745 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 992665804 0 0) 0x7fbe70003570 con 0x7fbe84153030 2024-08-17T02:25:30.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.972+0000 7fbe88b28700 1 -- 172.21.15.104:0/3263945745 >> v1:172.21.15.104:6789/0 conn(0x7fbe84153030 legacy=0x7fbe840686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:30.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.972+0000 7fbe88b28700 1 -- 172.21.15.104:0/3263945745 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe84156110 con 0x7fbe84068db0 2024-08-17T02:25:30.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.972+0000 7fbe88b28700 1 --2- 172.21.15.104:0/3263945745 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe84068db0 0x7fbe840acd40 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fbe840704e0 tx=0x7fbe740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaad78d11afba245 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:30.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.972+0000 7fbe7bfff700 1 -- 172.21.15.104:0/3263945745 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe80001490 con 0x7fbe84068db0 2024-08-17T02:25:30.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.972+0000 7fbe7bfff700 1 -- 172.21.15.104:0/3263945745 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe74011420 con 0x7fbe84068db0 2024-08-17T02:25:30.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.972+0000 7fbe7bfff700 1 -- 172.21.15.104:0/3263945745 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe740117c0 con 0x7fbe84068db0 2024-08-17T02:25:30.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.976+0000 7fbe8a32b700 1 -- 172.21.15.104:0/3263945745 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe84068db0 msgr2=0x7fbe840acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:30.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.976+0000 7fbe8a32b700 1 --2- 172.21.15.104:0/3263945745 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe84068db0 0x7fbe840acd40 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fbe840704e0 tx=0x7fbe740091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.976+0000 7fbe8a32b700 1 -- 172.21.15.104:0/3263945745 shutdown_connections 2024-08-17T02:25:30.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.976+0000 7fbe8a32b700 1 --2- 172.21.15.104:0/3263945745 >> v2:172.21.15.117:3300/0 conn(0x7fbe84153400 0x7fbe8406be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.976+0000 7fbe8a32b700 1 --2- 172.21.15.104:0/3263945745 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe84068db0 0x7fbe840acd40 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.976+0000 7fbe8a32b700 1 -- 172.21.15.104:0/3263945745 >> 172.21.15.104:0/3263945745 conn(0x7fbe840ccfd0 msgr2=0x7fbe8406d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:30.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.976+0000 7fbe8a32b700 1 -- 172.21.15.104:0/3263945745 shutdown_connections 2024-08-17T02:25:30.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.976+0000 7fbe8a32b700 1 -- 172.21.15.104:0/3263945745 wait complete. 2024-08-17T02:25:30.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.976+0000 7fbe8a32b700 1 Processor -- start 2024-08-17T02:25:30.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.976+0000 7fbe8a32b700 1 -- start start 2024-08-17T02:25:30.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.980+0000 7fbe8a32b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe84068db0 0x7fbe841407e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:30.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.980+0000 7fbe8a32b700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe84153030 0x7fbe8414c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:30.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.980+0000 7fbe8a32b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe84153400 0x7fbe840ab9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:30.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.980+0000 7fbe89329700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe84068db0 0x7fbe841407e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:30.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.980+0000 7fbe8a32b700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8414a620 con 0x7fbe84068db0 2024-08-17T02:25:30.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.980+0000 7fbe8a32b700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8414a900 con 0x7fbe84153400 2024-08-17T02:25:30.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.980+0000 7fbe89329700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe84068db0 0x7fbe841407e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33336/0 (socket says 172.21.15.104:33336) 2024-08-17T02:25:30.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.980+0000 7fbe8a32b700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8414abe0 con 0x7fbe84153030 2024-08-17T02:25:30.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.980+0000 7fbe89329700 1 -- 172.21.15.104:0/2171142042 learned_addr learned my addr 172.21.15.104:0/2171142042 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:30.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.980+0000 7fbe88b28700 1 --2- 172.21.15.104:0/2171142042 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe84153030 0x7fbe8414c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:30.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.980+0000 7fbe89329700 1 -- 172.21.15.104:0/2171142042 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe84153030 msgr2=0x7fbe8414c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:30.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.980+0000 7fbe89329700 1 --2- 172.21.15.104:0/2171142042 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe84153030 0x7fbe8414c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.980+0000 7fbe89329700 1 -- 172.21.15.104:0/2171142042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe84153400 msgr2=0x7fbe840ab9a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-17T02:25:30.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.980+0000 7fbe89b2a700 1 --2- 172.21.15.104:0/2171142042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe84153400 0x7fbe840ab9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:30.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.980+0000 7fbe89329700 1 --2- 172.21.15.104:0/2171142042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe84153400 0x7fbe840ab9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.980+0000 7fbe89329700 1 -- 172.21.15.104:0/2171142042 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe74009420 con 0x7fbe84068db0 2024-08-17T02:25:30.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.980+0000 7fbe88b28700 1 --2- 172.21.15.104:0/2171142042 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe84153030 0x7fbe8414c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:30.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.984+0000 7fbe89329700 1 --2- 172.21.15.104:0/2171142042 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe84068db0 0x7fbe841407e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fbe8000cb90 tx=0x7fbe80001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:30.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.984+0000 7fbe797fa700 1 -- 172.21.15.104:0/2171142042 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe80007e90 con 0x7fbe84068db0 2024-08-17T02:25:30.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.984+0000 7fbe797fa700 1 -- 172.21.15.104:0/2171142042 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe80007360 con 0x7fbe84068db0 2024-08-17T02:25:30.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.984+0000 7fbe797fa700 1 -- 172.21.15.104:0/2171142042 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe80004830 con 0x7fbe84068db0 2024-08-17T02:25:30.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.984+0000 7fbe8a32b700 1 -- 172.21.15.104:0/2171142042 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe8414aec0 con 0x7fbe84068db0 2024-08-17T02:25:30.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.984+0000 7fbe8a32b700 1 -- 172.21.15.104:0/2171142042 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe84140d20 con 0x7fbe84068db0 2024-08-17T02:25:30.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.984+0000 7fbe8a32b700 1 -- 172.21.15.104:0/2171142042 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe840644b0 con 0x7fbe84068db0 2024-08-17T02:25:30.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.984+0000 7fbe797fa700 1 -- 172.21.15.104:0/2171142042 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fbe80004be0 con 0x7fbe84068db0 2024-08-17T02:25:30.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.984+0000 7fbe797fa700 1 --2- 172.21.15.104:0/2171142042 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fbe68060930 0x7fbe68062de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:30.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.988+0000 7fbe88b28700 1 --2- 172.21.15.104:0/2171142042 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fbe68060930 0x7fbe68062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:30.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.988+0000 7fbe88b28700 1 --2- 172.21.15.104:0/2171142042 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fbe68060930 0x7fbe68062de0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbe840704e0 tx=0x7fbe74016000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:30.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.992+0000 7fbe797fa700 1 -- 172.21.15.104:0/2171142042 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6367+0+0 (secure 0 0 0) 0x7fbe80050ae0 con 0x7fbe84068db0 2024-08-17T02:25:30.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:30.992+0000 7fbe797fa700 1 -- 172.21.15.104:0/2171142042 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fbe80081060 con 0x7fbe84068db0 2024-08-17T02:25:31.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.160+0000 7fbe8a32b700 1 -- 172.21.15.104:0/2171142042 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbe8406e6d0 con 0x7fbe84068db0 2024-08-17T02:25:31.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.840+0000 7fbe797fa700 1 -- 172.21.15.104:0/2171142042 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v44) v1 ==== 169+0+0 (secure 0 0 0) 0x7fbe80081020 con 0x7fbe84068db0 2024-08-17T02:25:31.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.848+0000 7fbe8a32b700 1 -- 172.21.15.104:0/2171142042 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fbe68060930 msgr2=0x7fbe68062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:31.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.848+0000 7fbe8a32b700 1 --2- 172.21.15.104:0/2171142042 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fbe68060930 0x7fbe68062de0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbe840704e0 tx=0x7fbe74016000 comp rx=0 tx=0).stop 2024-08-17T02:25:31.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.848+0000 7fbe8a32b700 1 -- 172.21.15.104:0/2171142042 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe84068db0 msgr2=0x7fbe841407e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:31.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.848+0000 7fbe8a32b700 1 --2- 172.21.15.104:0/2171142042 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe84068db0 0x7fbe841407e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fbe8000cb90 tx=0x7fbe80001af0 comp rx=0 tx=0).stop 2024-08-17T02:25:31.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.848+0000 7fbe8a32b700 1 -- 172.21.15.104:0/2171142042 shutdown_connections 2024-08-17T02:25:31.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.848+0000 7fbe8a32b700 1 --2- 172.21.15.104:0/2171142042 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fbe68060930 0x7fbe68062de0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:31.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.848+0000 7fbe8a32b700 1 --2- 172.21.15.104:0/2171142042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe84153400 0x7fbe840ab9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:31.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.848+0000 7fbe8a32b700 1 --2- 172.21.15.104:0/2171142042 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe84153030 0x7fbe8414c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:31.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.848+0000 7fbe8a32b700 1 --2- 172.21.15.104:0/2171142042 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe84068db0 0x7fbe841407e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:31.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.848+0000 7fbe8a32b700 1 -- 172.21.15.104:0/2171142042 >> 172.21.15.104:0/2171142042 conn(0x7fbe840ccfd0 msgr2=0x7fbe84154d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:31.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.848+0000 7fbe8a32b700 1 -- 172.21.15.104:0/2171142042 shutdown_connections 2024-08-17T02:25:31.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.848+0000 7fbe8a32b700 1 -- 172.21.15.104:0/2171142042 wait complete. 2024-08-17T02:25:31.855 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_data' removed 2024-08-17T02:25:31.866 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:31.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.968+0000 7fd3df59e700 1 Processor -- start 2024-08-17T02:25:31.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.968+0000 7fd3df59e700 1 -- start start 2024-08-17T02:25:31.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.968+0000 7fd3df59e700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fd3e0156d80 0x7fd3e00aec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:31.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.968+0000 7fd3df59e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3e0067f50 0x7fd3e0157150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:31.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.968+0000 7fd3df59e700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3e00cc8c0 con 0x7fd3e00af170 2024-08-17T02:25:31.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.968+0000 7fd3df59e700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3e00af5f0 con 0x7fd3e0156d80 2024-08-17T02:25:31.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.968+0000 7fd3df59e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e00cbca0 con 0x7fd3e0067f50 2024-08-17T02:25:31.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.968+0000 7fd3de59c700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fd3e0156d80 0x7fd3e00aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:31.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.968+0000 7fd3d5d9b700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fd3e00af170 0x7fd3e0067840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:39554/0 (socket says 172.21.15.104:39554) 2024-08-17T02:25:31.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.968+0000 7fd3d5d9b700 1 -- 172.21.15.104:0/3829210409 learned_addr learned my addr 172.21.15.104:0/3829210409 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:25:31.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.968+0000 7fd3ded9d700 1 --2- 172.21.15.104:0/3829210409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3e0067f50 0x7fd3e0157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:31.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.968+0000 7fd3ddd9b700 1 -- 172.21.15.104:0/3829210409 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1193492203 0 0) 0x7fd3e00cc8c0 con 0x7fd3e00af170 2024-08-17T02:25:31.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.968+0000 7fd3ddd9b700 1 -- 172.21.15.104:0/3829210409 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3cc003570 con 0x7fd3e00af170 2024-08-17T02:25:31.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.968+0000 7fd3de59c700 1 -- 172.21.15.104:0/3829210409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3e0067f50 msgr2=0x7fd3e0157150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:31.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.968+0000 7fd3de59c700 1 --2- 172.21.15.104:0/3829210409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3e0067f50 0x7fd3e0157150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:31.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.968+0000 7fd3de59c700 1 -- 172.21.15.104:0/3829210409 >> v1:172.21.15.104:6789/0 conn(0x7fd3e00af170 legacy=0x7fd3e0067840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:31.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.968+0000 7fd3de59c700 1 -- 172.21.15.104:0/3829210409 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e0068450 con 0x7fd3e0156d80 2024-08-17T02:25:31.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.968+0000 7fd3de59c700 1 --2- 172.21.15.104:0/3829210409 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd3e0156d80 0x7fd3e00aec30 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd3d00098e0 tx=0x7fd3d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ba581e60f55eec server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:31.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.968+0000 7fd3ddd9b700 1 -- 172.21.15.104:0/3829210409 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d0011630 con 0x7fd3e0156d80 2024-08-17T02:25:31.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.968+0000 7fd3ddd9b700 1 -- 172.21.15.104:0/3829210409 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3d0011790 con 0x7fd3e0156d80 2024-08-17T02:25:31.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.968+0000 7fd3ddd9b700 1 -- 172.21.15.104:0/3829210409 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d0011b10 con 0x7fd3e0156d80 2024-08-17T02:25:31.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.972+0000 7fd3df59e700 1 -- 172.21.15.104:0/3829210409 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd3e0156d80 msgr2=0x7fd3e00aec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:31.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.972+0000 7fd3df59e700 1 --2- 172.21.15.104:0/3829210409 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd3e0156d80 0x7fd3e00aec30 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd3d00098e0 tx=0x7fd3d00091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:31.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.972+0000 7fd3df59e700 1 -- 172.21.15.104:0/3829210409 shutdown_connections 2024-08-17T02:25:31.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.972+0000 7fd3df59e700 1 --2- 172.21.15.104:0/3829210409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3e0067f50 0x7fd3e0157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:31.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.972+0000 7fd3df59e700 1 --2- 172.21.15.104:0/3829210409 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd3e0156d80 0x7fd3e00aec30 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:31.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.972+0000 7fd3df59e700 1 -- 172.21.15.104:0/3829210409 >> 172.21.15.104:0/3829210409 conn(0x7fd3e006e070 msgr2=0x7fd3e00b1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:31.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.972+0000 7fd3df59e700 1 -- 172.21.15.104:0/3829210409 shutdown_connections 2024-08-17T02:25:31.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.972+0000 7fd3df59e700 1 -- 172.21.15.104:0/3829210409 wait complete. 2024-08-17T02:25:31.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.972+0000 7fd3df59e700 1 Processor -- start 2024-08-17T02:25:31.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.972+0000 7fd3df59e700 1 -- start start 2024-08-17T02:25:31.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.972+0000 7fd3df59e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3e0067f50 0x7fd3e0159640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:31.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.972+0000 7fd3df59e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3e00af170 0x7fd3e00a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:31.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.972+0000 7fd3df59e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd3e0156d80 0x7fd3e0167a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:31.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.972+0000 7fd3df59e700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e01547b0 con 0x7fd3e0156d80 2024-08-17T02:25:31.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.976+0000 7fd3df59e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e0154a90 con 0x7fd3e00af170 2024-08-17T02:25:31.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.976+0000 7fd3df59e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e0154d70 con 0x7fd3e0067f50 2024-08-17T02:25:31.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.976+0000 7fd3ded9d700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd3e0156d80 0x7fd3e0167a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:31.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.976+0000 7fd3ded9d700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd3e0156d80 0x7fd3e0167a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33354/0 (socket says 172.21.15.104:33354) 2024-08-17T02:25:31.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.976+0000 7fd3ded9d700 1 -- 172.21.15.104:0/737621860 learned_addr learned my addr 172.21.15.104:0/737621860 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:31.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.976+0000 7fd3d5d9b700 1 --2- 172.21.15.104:0/737621860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3e00af170 0x7fd3e00a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:31.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.976+0000 7fd3de59c700 1 --2- 172.21.15.104:0/737621860 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3e0067f50 0x7fd3e0159640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:31.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.976+0000 7fd3ded9d700 1 -- 172.21.15.104:0/737621860 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3e0067f50 msgr2=0x7fd3e0159640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:31.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.976+0000 7fd3ded9d700 1 --2- 172.21.15.104:0/737621860 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3e0067f50 0x7fd3e0159640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:31.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.976+0000 7fd3ded9d700 1 -- 172.21.15.104:0/737621860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3e00af170 msgr2=0x7fd3e00a6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:31.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.976+0000 7fd3ded9d700 1 --2- 172.21.15.104:0/737621860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3e00af170 0x7fd3e00a6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:31.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.976+0000 7fd3ded9d700 1 -- 172.21.15.104:0/737621860 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d0009420 con 0x7fd3e0156d80 2024-08-17T02:25:31.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.976+0000 7fd3d5d9b700 1 --2- 172.21.15.104:0/737621860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3e00af170 0x7fd3e00a6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:31.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.976+0000 7fd3ded9d700 1 --2- 172.21.15.104:0/737621860 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd3e0156d80 0x7fd3e0167a90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd3d8009df0 tx=0x7fd3d800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:31.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.976+0000 7fd3d6ffd700 1 -- 172.21.15.104:0/737621860 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d800caa0 con 0x7fd3e0156d80 2024-08-17T02:25:31.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.976+0000 7fd3d6ffd700 1 -- 172.21.15.104:0/737621860 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3d800f040 con 0x7fd3e0156d80 2024-08-17T02:25:31.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.976+0000 7fd3df59e700 1 -- 172.21.15.104:0/737621860 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3e0155050 con 0x7fd3e0156d80 2024-08-17T02:25:31.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.976+0000 7fd3d6ffd700 1 -- 172.21.15.104:0/737621860 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d800ce70 con 0x7fd3e0156d80 2024-08-17T02:25:31.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.976+0000 7fd3df59e700 1 -- 172.21.15.104:0/737621860 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3e0159b80 con 0x7fd3e0156d80 2024-08-17T02:25:31.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.976+0000 7fd3df59e700 1 -- 172.21.15.104:0/737621860 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3e00638f0 con 0x7fd3e0156d80 2024-08-17T02:25:31.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.980+0000 7fd3d6ffd700 1 -- 172.21.15.104:0/737621860 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd3d8014690 con 0x7fd3e0156d80 2024-08-17T02:25:31.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.980+0000 7fd3d6ffd700 1 --2- 172.21.15.104:0/737621860 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fd3c0060860 0x7fd3c0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:31.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.980+0000 7fd3d6ffd700 1 -- 172.21.15.104:0/737621860 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fd3d807d710 con 0x7fd3e0156d80 2024-08-17T02:25:31.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.980+0000 7fd3de59c700 1 --2- 172.21.15.104:0/737621860 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fd3c0060860 0x7fd3c0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:31.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.980+0000 7fd3de59c700 1 --2- 172.21.15.104:0/737621860 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fd3c0060860 0x7fd3c0062d10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd3d00091e0 tx=0x7fd3d0017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:31.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:31.988+0000 7fd3d6ffd700 1 -- 172.21.15.104:0/737621860 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd3d8051570 con 0x7fd3e0156d80 2024-08-17T02:25:32.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.152+0000 7fd3df59e700 1 -- 172.21.15.104:0/737621860 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3e006ae60 con 0x7fd3e0156d80 2024-08-17T02:25:32.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.152+0000 7fd3d6ffd700 1 -- 172.21.15.104:0/737621860 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+15558 (secure 0 0 0) 0x7fd3d8051100 con 0x7fd3e0156d80 2024-08-17T02:25:32.157 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:25:32.157 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":44,"fsid":"fd5f7fb8-d34b-49bb-89a8-62b7dad1bc25","created":"2024-08-17T02:21:57.891389+0000","modified":"2024-08-17T02:25:31.834848+0000","last_up_change":"2024-08-17T02:22:08.924546+0000","last_in_change":"2024-08-17T02:21:59.938028+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:22:10.143970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000188090.meta","create_time":"2024-08-17T02:23:21.239436+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000188090"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000188090.data","create_time":"2024-08-17T02:23:21.337636+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000188090"}}}],"osds":[{"osd":0,"uuid":"606b9088-590e-4709-aa3a-b0f6e22972ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":24257},{"type":"v1","addr":"172.21.15.104:6809","nonce":24257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":24257},{"type":"v1","addr":"172.21.15.104:6811","nonce":24257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":24257},{"type":"v1","addr":"172.21.15.104:6815","nonce":24257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":24257},{"type":"v1","addr":"172.21.15.104:6813","nonce":24257}]},"public_addr":"172.21.15.104:6809/24257","cluster_addr":"172.21.15.104:6811/24257","heartbeat_back_addr":"172.21.15.104:6815/24257","heartbeat_front_addr":"172.21.15.104:6813/24257","state":["exists","up"]},{"osd":1,"uuid":"9bc6a909-0c2f-4889-afe7-4a47f89b0f64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":24256},{"type":"v1","addr":"172.21.15.104:6825","nonce":24256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":24256},{"type":"v1","addr":"172.21.15.104:6827","nonce":24256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":24256},{"type":"v1","addr":"172.21.15.104:6831","nonce":24256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":24256},{"type":"v1","addr":"172.21.15.104:6829","nonce":24256}]},"public_addr":"172.21.15.104:6825/24256","cluster_addr":"172.21.15.104:6827/24256","heartbeat_back_addr":"172.21.15.104:6831/24256","heartbeat_front_addr":"172.21.15.104:6829/24256","state":["exists","up"]},{"osd":2,"uuid":"23da31d5-aefb-4edb-b79d-fa05e1becef7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":24255},{"type":"v1","addr":"172.21.15.104:6817","nonce":24255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":24255},{"type":"v1","addr":"172.21.15.104:6819","nonce":24255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":24255},{"type":"v1","addr":"172.21.15.104:6823","nonce":24255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":24255},{"type":"v1","addr":"172.21.15.104:6821","nonce":24255}]},"public_addr":"172.21.15.104:6817/24255","cluster_addr":"172.21.15.104:6819/24255","heartbeat_back_addr":"172.21.15.104:6823/24255","heartbeat_front_addr":"172.21.15.104:6821/24255","state":["exists","up"]},{"osd":3,"uuid":"6e4a5ec2-b415-45ef-8381-61a59eb65224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":24254},{"type":"v1","addr":"172.21.15.104:6801","nonce":24254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":24254},{"type":"v1","addr":"172.21.15.104:6803","nonce":24254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":24254},{"type":"v1","addr":"172.21.15.104:6807","nonce":24254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":24254},{"type":"v1","addr":"172.21.15.104:6805","nonce":24254}]},"public_addr":"172.21.15.104:6801/24254","cluster_addr":"172.21.15.104:6803/24254","heartbeat_back_addr":"172.21.15.104:6807/24254","heartbeat_front_addr":"172.21.15.104:6805/24254","state":["exists","up"]},{"osd":4,"uuid":"8d5bea2d-9039-4013-8c99-2c046c5b8a17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":24421},{"type":"v1","addr":"172.21.15.117:6804","nonce":24421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":24421},{"type":"v1","addr":"172.21.15.117:6809","nonce":24421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":24421},{"type":"v1","addr":"172.21.15.117:6815","nonce":24421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":24421},{"type":"v1","addr":"172.21.15.117:6813","nonce":24421}]},"public_addr":"172.21.15.117:6804/24421","cluster_addr":"172.21.15.117:6809/24421","heartbeat_back_addr":"172.21.15.117:6815/24421","heartbeat_front_addr":"172.21.15.117:6813/24421","state":["exists","up"]},{"osd":5,"uuid":"de8b36fc-121c-4f05-8f5b-28f513d9f21f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":24422},{"type":"v1","addr":"172.21.15.117:6817","nonce":24422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":24422},{"type":"v1","addr":"172.21.15.117:6819","nonce":24422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":24422},{"type":"v1","addr":"172.21.15.117:6823","nonce":24422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":24422},{"type":"v1","addr":"172.21.15.117:6821","nonce":24422}]},"public_addr":"172.21.15.117:6817/24422","cluster_addr":"172.21.15.117:6819/24422","heartbeat_back_addr":"172.21.15.117:6823/24422","heartbeat_front_addr":"172.21.15.117:6821/24422","state":["exists","up"]},{"osd":6,"uuid":"6a87f09f-7bf7-4f7a-be87-530ac1ff8ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":24420},{"type":"v1","addr":"172.21.15.117:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6803","nonce":24420},{"type":"v1","addr":"172.21.15.117:6805","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":24420},{"type":"v1","addr":"172.21.15.117:6811","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":24420},{"type":"v1","addr":"172.21.15.117:6808","nonce":24420}]},"public_addr":"172.21.15.117:6801/24420","cluster_addr":"172.21.15.117:6805/24420","heartbeat_back_addr":"172.21.15.117:6811/24420","heartbeat_front_addr":"172.21.15.117:6808/24420","state":["exists","up"]},{"osd":7,"uuid":"e31d8041-1aa1-4b5d-83b3-0a373426dd9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":24423},{"type":"v1","addr":"172.21.15.117:6825","nonce":24423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":24423},{"type":"v1","addr":"172.21.15.117:6827","nonce":24423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":24423},{"type":"v1","addr":"172.21.15.117:6831","nonce":24423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":24423},{"type":"v1","addr":"172.21.15.117:6829","nonce":24423}]},"public_addr":"172.21.15.117:6825/24423","cluster_addr":"172.21.15.117:6827/24423","heartbeat_back_addr":"172.21.15.117:6831/24423","heartbeat_front_addr":"172.21.15.117:6829/24423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.220874+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.210039+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.434762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.247206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.184316+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.306325+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.035719+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.400303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.104:6835/38993094":"2024-08-18T02:25:28.820410+0000","172.21.15.104:6834/38993094":"2024-08-18T02:25:28.820410+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:32.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.156+0000 7fd3df59e700 1 -- 172.21.15.104:0/737621860 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fd3c0060860 msgr2=0x7fd3c0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:32.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.156+0000 7fd3df59e700 1 --2- 172.21.15.104:0/737621860 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fd3c0060860 0x7fd3c0062d10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd3d00091e0 tx=0x7fd3d0017000 comp rx=0 tx=0).stop 2024-08-17T02:25:32.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.156+0000 7fd3df59e700 1 -- 172.21.15.104:0/737621860 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd3e0156d80 msgr2=0x7fd3e0167a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:32.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.156+0000 7fd3df59e700 1 --2- 172.21.15.104:0/737621860 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd3e0156d80 0x7fd3e0167a90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd3d8009df0 tx=0x7fd3d800b040 comp rx=0 tx=0).stop 2024-08-17T02:25:32.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.156+0000 7fd3df59e700 1 -- 172.21.15.104:0/737621860 shutdown_connections 2024-08-17T02:25:32.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.156+0000 7fd3df59e700 1 --2- 172.21.15.104:0/737621860 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fd3c0060860 0x7fd3c0062d10 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.156+0000 7fd3df59e700 1 --2- 172.21.15.104:0/737621860 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd3e0156d80 0x7fd3e0167a90 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.156+0000 7fd3df59e700 1 --2- 172.21.15.104:0/737621860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3e00af170 0x7fd3e00a6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.156+0000 7fd3df59e700 1 --2- 172.21.15.104:0/737621860 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3e0067f50 0x7fd3e0159640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.156+0000 7fd3df59e700 1 -- 172.21.15.104:0/737621860 >> 172.21.15.104:0/737621860 conn(0x7fd3e006e070 msgr2=0x7fd3e00cbe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:32.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.156+0000 7fd3df59e700 1 -- 172.21.15.104:0/737621860 shutdown_connections 2024-08-17T02:25:32.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.156+0000 7fd3df59e700 1 -- 172.21.15.104:0/737621860 wait complete. 2024-08-17T02:25:32.172 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:22:10.143970+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 6, 'pool_name': 'cephfs.volume_0000000000188090.meta', 'create_time': '2024-08-17T02:23:21.239436+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000000188090'}}}, {'pool': 7, 'pool_name': 'cephfs.volume_0000000000188090.data', 'create_time': '2024-08-17T02:23:21.337636+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000188090'}}}] 2024-08-17T02:25:32.172 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:25:32.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.280+0000 7f5458980700 1 Processor -- start 2024-08-17T02:25:32.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.280+0000 7f5458980700 1 -- start start 2024-08-17T02:25:32.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.284+0000 7f5458980700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5454140910 0x7f54540c8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:32.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.284+0000 7f5458980700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54540c3e30 con 0x7f54540cbab0 2024-08-17T02:25:32.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.284+0000 7f5458980700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54540c4110 con 0x7f54540ae6f0 2024-08-17T02:25:32.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.284+0000 7f5458980700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54540c43f0 con 0x7f5454140910 2024-08-17T02:25:32.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.284+0000 7f545259c700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f54540cbab0 0x7f54540c2c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:39562/0 (socket says 172.21.15.104:39562) 2024-08-17T02:25:32.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.284+0000 7f545259c700 1 -- 172.21.15.104:0/2108388727 learned_addr learned my addr 172.21.15.104:0/2108388727 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:25:32.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.284+0000 7f5452d9d700 1 --2- 172.21.15.104:0/2108388727 >> v2:172.21.15.117:3300/0 conn(0x7f5454140910 0x7f54540c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:32.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.284+0000 7f5451d9b700 1 -- 172.21.15.104:0/2108388727 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3868416112 0 0) 0x7f54540c3e30 con 0x7f54540cbab0 2024-08-17T02:25:32.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.284+0000 7f5451d9b700 1 -- 172.21.15.104:0/2108388727 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f543c003570 con 0x7f54540cbab0 2024-08-17T02:25:32.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.284+0000 7f5451d9b700 1 -- 172.21.15.104:0/2108388727 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 563286862 0 0) 0x7f54540c4110 con 0x7f54540ae6f0 2024-08-17T02:25:32.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.284+0000 7f5451d9b700 1 -- 172.21.15.104:0/2108388727 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54540c3e30 con 0x7f54540ae6f0 2024-08-17T02:25:32.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.284+0000 7f5452d9d700 1 -- 172.21.15.104:0/2108388727 >> v1:172.21.15.117:6789/0 conn(0x7f54540ae6f0 legacy=0x7f54540c3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:32.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.284+0000 7f5451d9b700 1 -- 172.21.15.104:0/2108388727 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2968583660 0 0) 0x7f543c003570 con 0x7f54540cbab0 2024-08-17T02:25:32.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.284+0000 7f5452d9d700 1 -- 172.21.15.104:0/2108388727 >> v1:172.21.15.104:6789/0 conn(0x7f54540cbab0 legacy=0x7f54540c2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:32.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.284+0000 7f5452d9d700 1 -- 172.21.15.104:0/2108388727 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54540c46d0 con 0x7f5454140910 2024-08-17T02:25:32.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.284+0000 7f5452d9d700 1 --2- 172.21.15.104:0/2108388727 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5454140910 0x7f54540c8520 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5444009e60 tx=0x7f5444009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77b9121e4fca328 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:32.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.284+0000 7f5451d9b700 1 -- 172.21.15.104:0/2108388727 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544400e070 con 0x7f5454140910 2024-08-17T02:25:32.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.284+0000 7f5451d9b700 1 -- 172.21.15.104:0/2108388727 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f544400b7a0 con 0x7f5454140910 2024-08-17T02:25:32.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.284+0000 7f5451d9b700 1 -- 172.21.15.104:0/2108388727 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544c001470 con 0x7f5454140910 2024-08-17T02:25:32.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.284+0000 7f5458980700 1 -- 172.21.15.104:0/2108388727 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5454140910 msgr2=0x7f54540c8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:32.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.284+0000 7f5458980700 1 --2- 172.21.15.104:0/2108388727 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5454140910 0x7f54540c8520 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5444009e60 tx=0x7f5444009780 comp rx=0 tx=0).stop 2024-08-17T02:25:32.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.284+0000 7f5458980700 1 -- 172.21.15.104:0/2108388727 shutdown_connections 2024-08-17T02:25:32.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.284+0000 7f5458980700 1 --2- 172.21.15.104:0/2108388727 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5454140910 0x7f54540c8520 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.284+0000 7f5458980700 1 -- 172.21.15.104:0/2108388727 >> 172.21.15.104:0/2108388727 conn(0x7f54540cdee0 msgr2=0x7f54540ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:32.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.284+0000 7f5458980700 1 -- 172.21.15.104:0/2108388727 shutdown_connections 2024-08-17T02:25:32.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.284+0000 7f5458980700 1 -- 172.21.15.104:0/2108388727 wait complete. 2024-08-17T02:25:32.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.288+0000 7f5458980700 1 Processor -- start 2024-08-17T02:25:32.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.288+0000 7f5458980700 1 -- start start 2024-08-17T02:25:32.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.288+0000 7f5458980700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54540ae6f0 0x7f54541671d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:32.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.288+0000 7f5458980700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54540cbab0 0x7f5454159220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:32.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.288+0000 7f5458980700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5454140910 0x7f5454159760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:32.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.288+0000 7f5458980700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54540c5b20 con 0x7f5454140910 2024-08-17T02:25:32.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.288+0000 7f5458980700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5454158690 con 0x7f54540cbab0 2024-08-17T02:25:32.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.288+0000 7f5458980700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54540c54d0 con 0x7f54540ae6f0 2024-08-17T02:25:32.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.288+0000 7f545359e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5454140910 0x7f5454159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:32.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.288+0000 7f545359e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5454140910 0x7f5454159760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33368/0 (socket says 172.21.15.104:33368) 2024-08-17T02:25:32.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.288+0000 7f545359e700 1 -- 172.21.15.104:0/3026267812 learned_addr learned my addr 172.21.15.104:0/3026267812 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:32.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.288+0000 7f545259c700 1 --2- 172.21.15.104:0/3026267812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54540cbab0 0x7f5454159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:32.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.288+0000 7f5452d9d700 1 --2- 172.21.15.104:0/3026267812 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54540ae6f0 0x7f54541671d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:32.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.288+0000 7f545259c700 1 -- 172.21.15.104:0/3026267812 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54540ae6f0 msgr2=0x7f54541671d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:32.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.288+0000 7f545259c700 1 --2- 172.21.15.104:0/3026267812 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54540ae6f0 0x7f54541671d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.288+0000 7f545259c700 1 -- 172.21.15.104:0/3026267812 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5454140910 msgr2=0x7f5454159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:32.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.288+0000 7f545259c700 1 --2- 172.21.15.104:0/3026267812 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5454140910 0x7f5454159760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.288+0000 7f545259c700 1 -- 172.21.15.104:0/3026267812 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5444009a20 con 0x7f54540cbab0 2024-08-17T02:25:32.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.288+0000 7f545359e700 1 --2- 172.21.15.104:0/3026267812 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5454140910 0x7f5454159760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:32.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.292+0000 7f545259c700 1 --2- 172.21.15.104:0/3026267812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54540cbab0 0x7f5454159220 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f544c00cb60 tx=0x7f544c001560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:32.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.292+0000 7f543affd700 1 -- 172.21.15.104:0/3026267812 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544c007150 con 0x7f54540cbab0 2024-08-17T02:25:32.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.292+0000 7f543affd700 1 -- 172.21.15.104:0/3026267812 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f544c0072b0 con 0x7f54540cbab0 2024-08-17T02:25:32.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.292+0000 7f5458980700 1 -- 172.21.15.104:0/3026267812 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54540c57b0 con 0x7f54540cbab0 2024-08-17T02:25:32.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.292+0000 7f543affd700 1 -- 172.21.15.104:0/3026267812 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544c007670 con 0x7f54540cbab0 2024-08-17T02:25:32.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.292+0000 7f5458980700 1 -- 172.21.15.104:0/3026267812 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f545416a4f0 con 0x7f54540cbab0 2024-08-17T02:25:32.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.292+0000 7f5458980700 1 -- 172.21.15.104:0/3026267812 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54540638f0 con 0x7f54540cbab0 2024-08-17T02:25:32.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.292+0000 7f543affd700 1 -- 172.21.15.104:0/3026267812 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f544c004a40 con 0x7f54540cbab0 2024-08-17T02:25:32.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.292+0000 7f543affd700 1 --2- 172.21.15.104:0/3026267812 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f5440060860 0x7f5440062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:32.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.292+0000 7f543affd700 1 -- 172.21.15.104:0/3026267812 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f544c07c180 con 0x7f54540cbab0 2024-08-17T02:25:32.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.292+0000 7f5452d9d700 1 --2- 172.21.15.104:0/3026267812 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f5440060860 0x7f5440062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:32.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.296+0000 7f5452d9d700 1 --2- 172.21.15.104:0/3026267812 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f5440060860 0x7f5440062d10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f54440099f0 tx=0x7f5444017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:32.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.300+0000 7f543affd700 1 -- 172.21.15.104:0/3026267812 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f544c04c5d0 con 0x7f54540cbab0 2024-08-17T02:25:32.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.472+0000 7f5458980700 1 -- 172.21.15.104:0/3026267812 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f545406bc70 con 0x7f54540cbab0 2024-08-17T02:25:32.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.476+0000 7f543affd700 1 -- 172.21.15.104:0/3026267812 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7f544c04fbf0 con 0x7f54540cbab0 2024-08-17T02:25:32.479 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-08-17T02:25:32.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.476+0000 7f5458980700 1 -- 172.21.15.104:0/3026267812 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f5440060860 msgr2=0x7f5440062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:32.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.476+0000 7f5458980700 1 --2- 172.21.15.104:0/3026267812 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f5440060860 0x7f5440062d10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f54440099f0 tx=0x7f5444017000 comp rx=0 tx=0).stop 2024-08-17T02:25:32.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.476+0000 7f5458980700 1 -- 172.21.15.104:0/3026267812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54540cbab0 msgr2=0x7f5454159220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:32.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.476+0000 7f5458980700 1 --2- 172.21.15.104:0/3026267812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54540cbab0 0x7f5454159220 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f544c00cb60 tx=0x7f544c001560 comp rx=0 tx=0).stop 2024-08-17T02:25:32.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.476+0000 7f5458980700 1 -- 172.21.15.104:0/3026267812 shutdown_connections 2024-08-17T02:25:32.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.476+0000 7f5458980700 1 --2- 172.21.15.104:0/3026267812 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f5440060860 0x7f5440062d10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.476+0000 7f5458980700 1 --2- 172.21.15.104:0/3026267812 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5454140910 0x7f5454159760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.476+0000 7f5458980700 1 --2- 172.21.15.104:0/3026267812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54540cbab0 0x7f5454159220 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.476+0000 7f5458980700 1 --2- 172.21.15.104:0/3026267812 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54540ae6f0 0x7f54541671d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.476+0000 7f5458980700 1 -- 172.21.15.104:0/3026267812 >> 172.21.15.104:0/3026267812 conn(0x7f54540cdee0 msgr2=0x7f545406b560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:32.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.476+0000 7f5458980700 1 -- 172.21.15.104:0/3026267812 shutdown_connections 2024-08-17T02:25:32.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.476+0000 7f5458980700 1 -- 172.21.15.104:0/3026267812 wait complete. 2024-08-17T02:25:32.494 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000188090.meta pg_num 2024-08-17T02:25:32.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.604+0000 7f1c54a73700 1 Processor -- start 2024-08-17T02:25:32.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.604+0000 7f1c54a73700 1 -- start start 2024-08-17T02:25:32.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.608+0000 7f1c54a73700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c50140770 0x7f1c500ad110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:32.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.608+0000 7f1c54a73700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1c50140b40 0x7f1c5015aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:32.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.608+0000 7f1c54a73700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c500aff80 con 0x7f1c500ad650 2024-08-17T02:25:32.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.608+0000 7f1c54a73700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c500adb50 con 0x7f1c50140b40 2024-08-17T02:25:32.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.608+0000 7f1c54a73700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c500ade30 con 0x7f1c50140770 2024-08-17T02:25:32.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.608+0000 7f1c4f7fe700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c50140770 0x7f1c500ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:32.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.608+0000 7f1c46ffd700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1c50140b40 0x7f1c5015aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:32.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.608+0000 7f1c4ffff700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f1c500ad650 0x7f1c501574d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.104:57690/0 (socket says 172.21.15.104:57690) 2024-08-17T02:25:32.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.608+0000 7f1c4ffff700 1 -- 172.21.15.104:0/3645464325 learned_addr learned my addr 172.21.15.104:0/3645464325 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:25:32.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.608+0000 7f1c4f7fe700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c50140770 0x7f1c500ad110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.104:36972/0 (socket says 172.21.15.104:36972) 2024-08-17T02:25:32.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.608+0000 7f1c46ffd700 1 -- 172.21.15.104:0/3645464325 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c50140770 msgr2=0x7f1c500ad110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:32.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.608+0000 7f1c46ffd700 1 --2- 172.21.15.104:0/3645464325 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c50140770 0x7f1c500ad110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.608+0000 7f1c46ffd700 1 -- 172.21.15.104:0/3645464325 >> v1:172.21.15.117:6789/0 conn(0x7f1c500ad650 legacy=0x7f1c501574d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:32.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.608+0000 7f1c46ffd700 1 -- 172.21.15.104:0/3645464325 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c500ae110 con 0x7f1c50140b40 2024-08-17T02:25:32.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.608+0000 7f1c4effd700 1 -- 172.21.15.104:0/3645464325 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2538384854 0 0) 0x7f1c500aff80 con 0x7f1c500ad650 2024-08-17T02:25:32.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.608+0000 7f1c46ffd700 1 --2- 172.21.15.104:0/3645464325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c50140b40 0x7f1c5015aad0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1c380098e0 tx=0x7f1c380091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9199b2bdbd1cde6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:32.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.608+0000 7f1c4effd700 1 -- 172.21.15.104:0/3645464325 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3800b640 con 0x7f1c50140b40 2024-08-17T02:25:32.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.608+0000 7f1c4effd700 1 -- 172.21.15.104:0/3645464325 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3800b7a0 con 0x7f1c50140b40 2024-08-17T02:25:32.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.608+0000 7f1c4effd700 1 -- 172.21.15.104:0/3645464325 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3800bb40 con 0x7f1c50140b40 2024-08-17T02:25:32.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.608+0000 7f1c54a73700 1 -- 172.21.15.104:0/3645464325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c50140b40 msgr2=0x7f1c5015aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:32.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.608+0000 7f1c54a73700 1 --2- 172.21.15.104:0/3645464325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c50140b40 0x7f1c5015aad0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1c380098e0 tx=0x7f1c380091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.608+0000 7f1c54a73700 1 -- 172.21.15.104:0/3645464325 shutdown_connections 2024-08-17T02:25:32.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.608+0000 7f1c54a73700 1 --2- 172.21.15.104:0/3645464325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c50140b40 0x7f1c5015aad0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.608+0000 7f1c54a73700 1 --2- 172.21.15.104:0/3645464325 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c50140770 0x7f1c500ad110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.608+0000 7f1c54a73700 1 -- 172.21.15.104:0/3645464325 >> 172.21.15.104:0/3645464325 conn(0x7f1c500c9830 msgr2=0x7f1c500c9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:32.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.608+0000 7f1c54a73700 1 -- 172.21.15.104:0/3645464325 shutdown_connections 2024-08-17T02:25:32.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.608+0000 7f1c54a73700 1 -- 172.21.15.104:0/3645464325 wait complete. 2024-08-17T02:25:32.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.612+0000 7f1c54a73700 1 Processor -- start 2024-08-17T02:25:32.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.612+0000 7f1c54a73700 1 -- start start 2024-08-17T02:25:32.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.612+0000 7f1c54a73700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c500ad650 0x7f1c501550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:32.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.612+0000 7f1c54a73700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c50140770 0x7f1c5013d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:32.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.612+0000 7f1c54a73700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c50140b40 0x7f1c500677b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:32.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.612+0000 7f1c54a73700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c50156350 con 0x7f1c50140770 2024-08-17T02:25:32.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.612+0000 7f1c54a73700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5015d1f0 con 0x7f1c500ad650 2024-08-17T02:25:32.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.612+0000 7f1c54a73700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c500697d0 con 0x7f1c50140b40 2024-08-17T02:25:32.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.612+0000 7f1c46ffd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c50140770 0x7f1c5013d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:32.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.612+0000 7f1c46ffd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c50140770 0x7f1c5013d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33382/0 (socket says 172.21.15.104:33382) 2024-08-17T02:25:32.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.612+0000 7f1c46ffd700 1 -- 172.21.15.104:0/1712149514 learned_addr learned my addr 172.21.15.104:0/1712149514 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:32.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.612+0000 7f1c4f7fe700 1 --2- 172.21.15.104:0/1712149514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c500ad650 0x7f1c501550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:32.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.612+0000 7f1c4ffff700 1 --2- 172.21.15.104:0/1712149514 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c50140b40 0x7f1c500677b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:32.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.612+0000 7f1c46ffd700 1 -- 172.21.15.104:0/1712149514 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c50140b40 msgr2=0x7f1c500677b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:32.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.612+0000 7f1c46ffd700 1 --2- 172.21.15.104:0/1712149514 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c50140b40 0x7f1c500677b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.612+0000 7f1c46ffd700 1 -- 172.21.15.104:0/1712149514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c500ad650 msgr2=0x7f1c501550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:32.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.612+0000 7f1c46ffd700 1 --2- 172.21.15.104:0/1712149514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c500ad650 0x7f1c501550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.612+0000 7f1c46ffd700 1 -- 172.21.15.104:0/1712149514 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c38009420 con 0x7f1c50140770 2024-08-17T02:25:32.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.612+0000 7f1c46ffd700 1 --2- 172.21.15.104:0/1712149514 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c50140770 0x7f1c5013d1f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1c380093f0 tx=0x7f1c38017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:32.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.616+0000 7f1c47fff700 1 -- 172.21.15.104:0/1712149514 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3800bb20 con 0x7f1c50140770 2024-08-17T02:25:32.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.616+0000 7f1c47fff700 1 -- 172.21.15.104:0/1712149514 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c38000c90 con 0x7f1c50140770 2024-08-17T02:25:32.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.616+0000 7f1c54a73700 1 -- 172.21.15.104:0/1712149514 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c5013d730 con 0x7f1c50140770 2024-08-17T02:25:32.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.616+0000 7f1c47fff700 1 -- 172.21.15.104:0/1712149514 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c38011650 con 0x7f1c50140770 2024-08-17T02:25:32.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.616+0000 7f1c54a73700 1 -- 172.21.15.104:0/1712149514 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c50155880 con 0x7f1c50140770 2024-08-17T02:25:32.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.616+0000 7f1c54a73700 1 -- 172.21.15.104:0/1712149514 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c500699d0 con 0x7f1c50140770 2024-08-17T02:25:32.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.616+0000 7f1c47fff700 1 -- 172.21.15.104:0/1712149514 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1c38011a40 con 0x7f1c50140770 2024-08-17T02:25:32.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.616+0000 7f1c47fff700 1 --2- 172.21.15.104:0/1712149514 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f1c34060860 0x7f1c34062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:32.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.616+0000 7f1c47fff700 1 -- 172.21.15.104:0/1712149514 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f1c3807e000 con 0x7f1c50140770 2024-08-17T02:25:32.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.616+0000 7f1c4f7fe700 1 --2- 172.21.15.104:0/1712149514 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f1c34060860 0x7f1c34062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:32.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.620+0000 7f1c4f7fe700 1 --2- 172.21.15.104:0/1712149514 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f1c34060860 0x7f1c34062d10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1c40009db0 tx=0x7f1c400091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:32.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.624+0000 7f1c47fff700 1 -- 172.21.15.104:0/1712149514 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f1c500699d0 con 0x7f1c50140770 2024-08-17T02:25:32.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.788+0000 7f1c54a73700 1 -- 172.21.15.104:0/1712149514 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000188090.meta", "var": "pg_num"} v 0) v1 -- 0x7f1c50069990 con 0x7f1c50140770 2024-08-17T02:25:32.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.788+0000 7f1c47fff700 1 -- 172.21.15.104:0/1712149514 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000188090.meta", "var": "pg_num"}]=0 v44) v1 ==== 124+0+11 (secure 0 0 0) 0x7f1c3804e3d0 con 0x7f1c50140770 2024-08-17T02:25:32.792 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 32 2024-08-17T02:25:32.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.788+0000 7f1c54a73700 1 -- 172.21.15.104:0/1712149514 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f1c34060860 msgr2=0x7f1c34062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:32.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.788+0000 7f1c54a73700 1 --2- 172.21.15.104:0/1712149514 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f1c34060860 0x7f1c34062d10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1c40009db0 tx=0x7f1c400091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.788+0000 7f1c54a73700 1 -- 172.21.15.104:0/1712149514 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c50140770 msgr2=0x7f1c5013d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:32.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.788+0000 7f1c54a73700 1 --2- 172.21.15.104:0/1712149514 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c50140770 0x7f1c5013d1f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1c380093f0 tx=0x7f1c38017000 comp rx=0 tx=0).stop 2024-08-17T02:25:32.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.788+0000 7f1c54a73700 1 -- 172.21.15.104:0/1712149514 shutdown_connections 2024-08-17T02:25:32.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.788+0000 7f1c54a73700 1 --2- 172.21.15.104:0/1712149514 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f1c34060860 0x7f1c34062d10 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.788+0000 7f1c54a73700 1 --2- 172.21.15.104:0/1712149514 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c50140b40 0x7f1c500677b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.788+0000 7f1c54a73700 1 --2- 172.21.15.104:0/1712149514 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c50140770 0x7f1c5013d1f0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.788+0000 7f1c54a73700 1 --2- 172.21.15.104:0/1712149514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c500ad650 0x7f1c501550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.792+0000 7f1c54a73700 1 -- 172.21.15.104:0/1712149514 >> 172.21.15.104:0/1712149514 conn(0x7f1c500c9830 msgr2=0x7f1c5013f540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:32.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.792+0000 7f1c54a73700 1 -- 172.21.15.104:0/1712149514 shutdown_connections 2024-08-17T02:25:32.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.792+0000 7f1c54a73700 1 -- 172.21.15.104:0/1712149514 wait complete. 2024-08-17T02:25:32.806 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000188090.data pg_num 2024-08-17T02:25:32.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.912+0000 7f8a0df9b700 1 Processor -- start 2024-08-17T02:25:32.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.912+0000 7f8a0df9b700 1 -- start start 2024-08-17T02:25:32.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.916+0000 7f8a0df9b700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8a08140e00 0x7f8a080c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:32.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.916+0000 7f8a0df9b700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a080c3b90 con 0x7f8a08140a30 2024-08-17T02:25:32.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.916+0000 7f8a0df9b700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a080cca60 con 0x7f8a080b0e30 2024-08-17T02:25:32.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.916+0000 7f8a0df9b700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a080ca510 con 0x7f8a08140e00 2024-08-17T02:25:32.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.916+0000 7f8a077fe700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f8a08140a30 0x7f8a080cbc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:39564/0 (socket says 172.21.15.104:39564) 2024-08-17T02:25:32.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.916+0000 7f8a077fe700 1 -- 172.21.15.104:0/1669297937 learned_addr learned my addr 172.21.15.104:0/1669297937 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:25:32.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.916+0000 7f8a06ffd700 1 --2- 172.21.15.104:0/1669297937 >> v2:172.21.15.117:3300/0 conn(0x7f8a08140e00 0x7f8a080c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:32.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.916+0000 7f8a067fc700 1 -- 172.21.15.104:0/1669297937 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3203905989 0 0) 0x7f8a080c3b90 con 0x7f8a08140a30 2024-08-17T02:25:32.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.916+0000 7f8a067fc700 1 -- 172.21.15.104:0/1669297937 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89f4003570 con 0x7f8a08140a30 2024-08-17T02:25:32.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.916+0000 7f8a067fc700 1 -- 172.21.15.104:0/1669297937 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 777748805 0 0) 0x7f89f4003570 con 0x7f8a08140a30 2024-08-17T02:25:32.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.916+0000 7f8a067fc700 1 -- 172.21.15.104:0/1669297937 >> v2:172.21.15.117:3300/0 conn(0x7f8a08140e00 msgr2=0x7f8a080c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:32.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.916+0000 7f8a067fc700 1 --2- 172.21.15.104:0/1669297937 >> v2:172.21.15.117:3300/0 conn(0x7f8a08140e00 0x7f8a080c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.916+0000 7f8a067fc700 1 -- 172.21.15.104:0/1669297937 >> v1:172.21.15.117:6789/0 conn(0x7f8a080b0e30 legacy=0x7f8a080cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:32.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.916+0000 7f8a067fc700 1 -- 172.21.15.104:0/1669297937 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a080ca7f0 con 0x7f8a08140a30 2024-08-17T02:25:32.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.916+0000 7f8a067fc700 1 -- 172.21.15.104:0/1669297937 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1279957748 0 0) 0x7f8a000017f0 con 0x7f8a08140a30 2024-08-17T02:25:32.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.916+0000 7f8a067fc700 1 -- 172.21.15.104:0/1669297937 >> v1:172.21.15.104:6789/0 conn(0x7f8a08140a30 legacy=0x7f8a080cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:32.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.916+0000 7f8a067fc700 1 --2- 172.21.15.104:0/1669297937 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89f4003a60 0x7f89f4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:32.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.916+0000 7f8a067fc700 1 --2- 172.21.15.104:0/1669297937 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89f4004810 0x7f89f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:32.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.916+0000 7f8a067fc700 1 --2- 172.21.15.104:0/1669297937 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f89f40051c0 0x7f89f400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:32.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.916+0000 7f8a067fc700 1 -- 172.21.15.104:0/1669297937 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a080ca510 con 0x7f89f40051c0 2024-08-17T02:25:32.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.916+0000 7f8a067fc700 1 -- 172.21.15.104:0/1669297937 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f400c050 con 0x7f89f4004810 2024-08-17T02:25:32.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.916+0000 7f8a067fc700 1 -- 172.21.15.104:0/1669297937 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f400c210 con 0x7f89f4003a60 2024-08-17T02:25:32.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.916+0000 7f8a07fff700 1 --2- 172.21.15.104:0/1669297937 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f89f40051c0 0x7f89f400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:32.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.916+0000 7f8a077fe700 1 --2- 172.21.15.104:0/1669297937 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89f4003a60 0x7f89f4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:32.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.916+0000 7f8a07fff700 1 -- 172.21.15.104:0/1669297937 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89f4003a60 msgr2=0x7f89f4003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:32.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.916+0000 7f8a07fff700 1 --2- 172.21.15.104:0/1669297937 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89f4003a60 0x7f89f4003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.916+0000 7f8a07fff700 1 -- 172.21.15.104:0/1669297937 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89f4004810 msgr2=0x7f89f4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:32.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.916+0000 7f8a07fff700 1 --2- 172.21.15.104:0/1669297937 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89f4004810 0x7f89f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.916+0000 7f8a07fff700 1 -- 172.21.15.104:0/1669297937 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f4003570 con 0x7f89f40051c0 2024-08-17T02:25:32.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.916+0000 7f8a077fe700 1 --2- 172.21.15.104:0/1669297937 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89f4003a60 0x7f89f4003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:32.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.916+0000 7f8a07fff700 1 -- 172.21.15.104:0/1669297937 reap_dead start 2024-08-17T02:25:32.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.916+0000 7f8a07fff700 1 --2- 172.21.15.104:0/1669297937 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f89f40051c0 0x7f89f400ba60 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f89f80019a0 tx=0x7f89f8007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7429f1068a77bec7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:32.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.916+0000 7f8a067fc700 1 -- 172.21.15.104:0/1669297937 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f800c5d0 con 0x7f89f40051c0 2024-08-17T02:25:32.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.916+0000 7f8a067fc700 1 -- 172.21.15.104:0/1669297937 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f800c730 con 0x7f89f40051c0 2024-08-17T02:25:32.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.916+0000 7f8a067fc700 1 -- 172.21.15.104:0/1669297937 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f800cad0 con 0x7f89f40051c0 2024-08-17T02:25:32.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.920+0000 7f8a0df9b700 1 -- 172.21.15.104:0/1669297937 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f89f40051c0 msgr2=0x7f89f400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:32.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.920+0000 7f8a0df9b700 1 --2- 172.21.15.104:0/1669297937 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f89f40051c0 0x7f89f400ba60 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f89f80019a0 tx=0x7f89f8007d10 comp rx=0 tx=0).stop 2024-08-17T02:25:32.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.920+0000 7f8a0df9b700 1 -- 172.21.15.104:0/1669297937 shutdown_connections 2024-08-17T02:25:32.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.920+0000 7f8a0df9b700 1 --2- 172.21.15.104:0/1669297937 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f89f40051c0 0x7f89f400ba60 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.920+0000 7f8a0df9b700 1 -- 172.21.15.104:0/1669297937 >> 172.21.15.104:0/1669297937 conn(0x7f8a080caae0 msgr2=0x7f8a080caee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:32.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.920+0000 7f8a0df9b700 1 -- 172.21.15.104:0/1669297937 shutdown_connections 2024-08-17T02:25:32.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.920+0000 7f8a0df9b700 1 -- 172.21.15.104:0/1669297937 wait complete. 2024-08-17T02:25:32.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.920+0000 7f8a0df9b700 1 Processor -- start 2024-08-17T02:25:32.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.920+0000 7f8a0df9b700 1 -- start start 2024-08-17T02:25:32.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.920+0000 7f8a0df9b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f89f40051c0 0x7f8a0806ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:32.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.920+0000 7f8a0df9b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a080c7c10 0x7f8a08069160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:32.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.920+0000 7f8a0df9b700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a08164fd0 0x7f8a08165450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:32.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.920+0000 7f8a0df9b700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0806a6c0 con 0x7f89f40051c0 2024-08-17T02:25:32.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.920+0000 7f8a0df9b700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a08069ab0 con 0x7f8a080c7c10 2024-08-17T02:25:32.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.920+0000 7f8a0df9b700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a08069d90 con 0x7f8a08164fd0 2024-08-17T02:25:32.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.920+0000 7f8a077fe700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f89f40051c0 0x7f8a0806ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:32.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.920+0000 7f8a077fe700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f89f40051c0 0x7f8a0806ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33400/0 (socket says 172.21.15.104:33400) 2024-08-17T02:25:32.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.920+0000 7f8a077fe700 1 -- 172.21.15.104:0/461130740 learned_addr learned my addr 172.21.15.104:0/461130740 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:32.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.920+0000 7f8a07fff700 1 --2- 172.21.15.104:0/461130740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a08164fd0 0x7f8a08165450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:32.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.920+0000 7f8a06ffd700 1 --2- 172.21.15.104:0/461130740 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a080c7c10 0x7f8a08069160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:32.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.920+0000 7f8a077fe700 1 -- 172.21.15.104:0/461130740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a08164fd0 msgr2=0x7f8a08165450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:32.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.920+0000 7f8a077fe700 1 --2- 172.21.15.104:0/461130740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a08164fd0 0x7f8a08165450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.920+0000 7f8a077fe700 1 -- 172.21.15.104:0/461130740 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a080c7c10 msgr2=0x7f8a08069160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:32.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.920+0000 7f8a077fe700 1 --2- 172.21.15.104:0/461130740 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a080c7c10 0x7f8a08069160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.920+0000 7f8a077fe700 1 -- 172.21.15.104:0/461130740 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a0806a070 con 0x7f89f40051c0 2024-08-17T02:25:32.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.920+0000 7f8a06ffd700 1 --2- 172.21.15.104:0/461130740 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a080c7c10 0x7f8a08069160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:32.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.924+0000 7f8a077fe700 1 --2- 172.21.15.104:0/461130740 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f89f40051c0 0x7f8a0806ab50 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8a00007ab0 tx=0x7f8a00001130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:32.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.924+0000 7f89ff7fe700 1 -- 172.21.15.104:0/461130740 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0000eb60 con 0x7f89f40051c0 2024-08-17T02:25:32.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.924+0000 7f89ff7fe700 1 -- 172.21.15.104:0/461130740 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a00010040 con 0x7f89f40051c0 2024-08-17T02:25:32.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.924+0000 7f8a0df9b700 1 -- 172.21.15.104:0/461130740 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a0806a350 con 0x7f89f40051c0 2024-08-17T02:25:32.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.924+0000 7f89ff7fe700 1 -- 172.21.15.104:0/461130740 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0000eed0 con 0x7f89f40051c0 2024-08-17T02:25:32.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.924+0000 7f8a0df9b700 1 -- 172.21.15.104:0/461130740 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a08165990 con 0x7f89f40051c0 2024-08-17T02:25:32.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.924+0000 7f8a0df9b700 1 -- 172.21.15.104:0/461130740 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a080645c0 con 0x7f89f40051c0 2024-08-17T02:25:32.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.924+0000 7f89ff7fe700 1 -- 172.21.15.104:0/461130740 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8a00014600 con 0x7f89f40051c0 2024-08-17T02:25:32.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.924+0000 7f89ff7fe700 1 --2- 172.21.15.104:0/461130740 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f89e8060890 0x7f89e8062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:32.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.924+0000 7f89ff7fe700 1 -- 172.21.15.104:0/461130740 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f8a0007ccd0 con 0x7f89f40051c0 2024-08-17T02:25:32.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.928+0000 7f8a06ffd700 1 --2- 172.21.15.104:0/461130740 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f89e8060890 0x7f89e8062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:32.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.928+0000 7f8a06ffd700 1 --2- 172.21.15.104:0/461130740 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f89e8060890 0x7f89e8062d40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f89f00093f0 tx=0x7f89f0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:32.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:32.932+0000 7f89ff7fe700 1 -- 172.21.15.104:0/461130740 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f8a0004d000 con 0x7f89f40051c0 2024-08-17T02:25:33.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.092+0000 7f8a0df9b700 1 -- 172.21.15.104:0/461130740 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000188090.data", "var": "pg_num"} v 0) v1 -- 0x7f8a080b0940 con 0x7f89f40051c0 2024-08-17T02:25:33.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.096+0000 7f89ff7fe700 1 -- 172.21.15.104:0/461130740 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000188090.data", "var": "pg_num"}]=0 v44) v1 ==== 124+0+11 (secure 0 0 0) 0x7f8a00050620 con 0x7f89f40051c0 2024-08-17T02:25:33.099 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 32 2024-08-17T02:25:33.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.096+0000 7f8a0df9b700 1 -- 172.21.15.104:0/461130740 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f89e8060890 msgr2=0x7f89e8062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:33.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.096+0000 7f8a0df9b700 1 --2- 172.21.15.104:0/461130740 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f89e8060890 0x7f89e8062d40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f89f00093f0 tx=0x7f89f0008040 comp rx=0 tx=0).stop 2024-08-17T02:25:33.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.096+0000 7f8a0df9b700 1 -- 172.21.15.104:0/461130740 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f89f40051c0 msgr2=0x7f8a0806ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:33.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.096+0000 7f8a0df9b700 1 --2- 172.21.15.104:0/461130740 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f89f40051c0 0x7f8a0806ab50 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8a00007ab0 tx=0x7f8a00001130 comp rx=0 tx=0).stop 2024-08-17T02:25:33.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.096+0000 7f8a0df9b700 1 -- 172.21.15.104:0/461130740 shutdown_connections 2024-08-17T02:25:33.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.096+0000 7f8a0df9b700 1 --2- 172.21.15.104:0/461130740 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f89e8060890 0x7f89e8062d40 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.096+0000 7f8a0df9b700 1 --2- 172.21.15.104:0/461130740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a08164fd0 0x7f8a08165450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.096+0000 7f8a0df9b700 1 --2- 172.21.15.104:0/461130740 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a080c7c10 0x7f8a08069160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.096+0000 7f8a0df9b700 1 --2- 172.21.15.104:0/461130740 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f89f40051c0 0x7f8a0806ab50 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.096+0000 7f8a0df9b700 1 -- 172.21.15.104:0/461130740 >> 172.21.15.104:0/461130740 conn(0x7f8a080caae0 msgr2=0x7f8a080b34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:33.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.096+0000 7f8a0df9b700 1 -- 172.21.15.104:0/461130740 shutdown_connections 2024-08-17T02:25:33.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.096+0000 7f8a0df9b700 1 -- 172.21.15.104:0/461130740 wait complete. 2024-08-17T02:25:33.114 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:25:33.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.212+0000 7f86c6829700 1 Processor -- start 2024-08-17T02:25:33.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.212+0000 7f86c6829700 1 -- start start 2024-08-17T02:25:33.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.212+0000 7f86c6829700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86c00af5a0 0x7f86c00af9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:33.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.212+0000 7f86c6829700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f86c00aff10 0x7f86c0155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:33.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.212+0000 7f86c6829700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c00a9f60 con 0x7f86c0155380 2024-08-17T02:25:33.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.212+0000 7f86c6829700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86c006e4b0 con 0x7f86c00aff10 2024-08-17T02:25:33.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.212+0000 7f86c6829700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c006e6a0 con 0x7f86c00af5a0 2024-08-17T02:25:33.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.212+0000 7f86bffff700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f86c0155380 0x7f86c00a9730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:39570/0 (socket says 172.21.15.104:39570) 2024-08-17T02:25:33.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.212+0000 7f86bffff700 1 -- 172.21.15.104:0/1958853552 learned_addr learned my addr 172.21.15.104:0/1958853552 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:25:33.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.212+0000 7f86c4dc6700 1 --2- 172.21.15.104:0/1958853552 >> v2:172.21.15.104:3300/0 conn(0x7f86c00aff10 0x7f86c0155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:33.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.212+0000 7f86bf7fe700 1 --2- 172.21.15.104:0/1958853552 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86c00af5a0 0x7f86c00af9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:33.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.212+0000 7f86beffd700 1 -- 172.21.15.104:0/1958853552 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1621950395 0 0) 0x7f86c00a9f60 con 0x7f86c0155380 2024-08-17T02:25:33.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.212+0000 7f86beffd700 1 -- 172.21.15.104:0/1958853552 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86a8003570 con 0x7f86c0155380 2024-08-17T02:25:33.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.212+0000 7f86c4dc6700 1 -- 172.21.15.104:0/1958853552 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86c00af5a0 msgr2=0x7f86c00af9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:33.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.212+0000 7f86c4dc6700 1 --2- 172.21.15.104:0/1958853552 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86c00af5a0 0x7f86c00af9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.212+0000 7f86c4dc6700 1 -- 172.21.15.104:0/1958853552 >> v1:172.21.15.104:6789/0 conn(0x7f86c0155380 legacy=0x7f86c00a9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:33.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.212+0000 7f86beffd700 1 -- 172.21.15.104:0/1958853552 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3816060643 0 0) 0x7f86a8003570 con 0x7f86c0155380 2024-08-17T02:25:33.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.212+0000 7f86c4dc6700 1 -- 172.21.15.104:0/1958853552 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c006e980 con 0x7f86c00aff10 2024-08-17T02:25:33.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.212+0000 7f86c4dc6700 1 --2- 172.21.15.104:0/1958853552 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86c00aff10 0x7f86c0155750 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f86b00098e0 tx=0x7f86b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5123f0a9588ba753 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:33.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.212+0000 7f86beffd700 1 -- 172.21.15.104:0/1958853552 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b80017f0 con 0x7f86c00aff10 2024-08-17T02:25:33.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.212+0000 7f86beffd700 1 -- 172.21.15.104:0/1958853552 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b0011420 con 0x7f86c00aff10 2024-08-17T02:25:33.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.212+0000 7f86beffd700 1 -- 172.21.15.104:0/1958853552 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b00117c0 con 0x7f86c00aff10 2024-08-17T02:25:33.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.212+0000 7f86c6829700 1 -- 172.21.15.104:0/1958853552 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86c00aff10 msgr2=0x7f86c0155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:33.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.212+0000 7f86c6829700 1 --2- 172.21.15.104:0/1958853552 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86c00aff10 0x7f86c0155750 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f86b00098e0 tx=0x7f86b00091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.212+0000 7f86c6829700 1 -- 172.21.15.104:0/1958853552 shutdown_connections 2024-08-17T02:25:33.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.212+0000 7f86c6829700 1 --2- 172.21.15.104:0/1958853552 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86c00aff10 0x7f86c0155750 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.212+0000 7f86c6829700 1 --2- 172.21.15.104:0/1958853552 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86c00af5a0 0x7f86c00af9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.212+0000 7f86c6829700 1 -- 172.21.15.104:0/1958853552 >> 172.21.15.104:0/1958853552 conn(0x7f86c0066e00 msgr2=0x7f86c0067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:33.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.212+0000 7f86c6829700 1 -- 172.21.15.104:0/1958853552 shutdown_connections 2024-08-17T02:25:33.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.212+0000 7f86c6829700 1 -- 172.21.15.104:0/1958853552 wait complete. 2024-08-17T02:25:33.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.216+0000 7f86c6829700 1 Processor -- start 2024-08-17T02:25:33.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.216+0000 7f86c6829700 1 -- start start 2024-08-17T02:25:33.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.216+0000 7f86c6829700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86c00af5a0 0x7f86c00c16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:33.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.216+0000 7f86c6829700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86c00aff10 0x7f86c01578a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:33.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.216+0000 7f86c6829700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86c0155380 0x7f86c0157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:33.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.216+0000 7f86c6829700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c00c2000 con 0x7f86c00af5a0 2024-08-17T02:25:33.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.216+0000 7f86c6829700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c00c22e0 con 0x7f86c00aff10 2024-08-17T02:25:33.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.216+0000 7f86c6829700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c00c25c0 con 0x7f86c0155380 2024-08-17T02:25:33.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.216+0000 7f86bffff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86c00af5a0 0x7f86c00c16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:33.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.216+0000 7f86bffff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86c00af5a0 0x7f86c00c16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33412/0 (socket says 172.21.15.104:33412) 2024-08-17T02:25:33.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.216+0000 7f86bffff700 1 -- 172.21.15.104:0/1628250761 learned_addr learned my addr 172.21.15.104:0/1628250761 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:33.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.216+0000 7f86c4dc6700 1 --2- 172.21.15.104:0/1628250761 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86c0155380 0x7f86c0157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:33.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.216+0000 7f86bf7fe700 1 --2- 172.21.15.104:0/1628250761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86c00aff10 0x7f86c01578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:33.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.216+0000 7f86bffff700 1 -- 172.21.15.104:0/1628250761 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86c0155380 msgr2=0x7f86c0157de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:33.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.216+0000 7f86bffff700 1 --2- 172.21.15.104:0/1628250761 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86c0155380 0x7f86c0157de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.216+0000 7f86bffff700 1 -- 172.21.15.104:0/1628250761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86c00aff10 msgr2=0x7f86c01578a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:33.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.216+0000 7f86bffff700 1 --2- 172.21.15.104:0/1628250761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86c00aff10 0x7f86c01578a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.216+0000 7f86bffff700 1 -- 172.21.15.104:0/1628250761 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b0009420 con 0x7f86c00af5a0 2024-08-17T02:25:33.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.216+0000 7f86bf7fe700 1 --2- 172.21.15.104:0/1628250761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86c00aff10 0x7f86c01578a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:33.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.216+0000 7f86bffff700 1 --2- 172.21.15.104:0/1628250761 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86c00af5a0 0x7f86c00c16b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f86b800ccd0 tx=0x7f86b80016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:33.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.220+0000 7f86a7fff700 1 -- 172.21.15.104:0/1628250761 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b8004dc0 con 0x7f86c00af5a0 2024-08-17T02:25:33.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.220+0000 7f86a7fff700 1 -- 172.21.15.104:0/1628250761 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b800a770 con 0x7f86c00af5a0 2024-08-17T02:25:33.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.220+0000 7f86c6829700 1 -- 172.21.15.104:0/1628250761 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86c00c28a0 con 0x7f86c00af5a0 2024-08-17T02:25:33.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.220+0000 7f86a7fff700 1 -- 172.21.15.104:0/1628250761 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b800ab30 con 0x7f86c00af5a0 2024-08-17T02:25:33.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.220+0000 7f86c6829700 1 -- 172.21.15.104:0/1628250761 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c00c1bf0 con 0x7f86c00af5a0 2024-08-17T02:25:33.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.220+0000 7f86c6829700 1 -- 172.21.15.104:0/1628250761 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86c00645c0 con 0x7f86c00af5a0 2024-08-17T02:25:33.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.220+0000 7f86a7fff700 1 -- 172.21.15.104:0/1628250761 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f86b8007150 con 0x7f86c00af5a0 2024-08-17T02:25:33.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.220+0000 7f86a7fff700 1 --2- 172.21.15.104:0/1628250761 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f86ac060860 0x7f86ac062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:33.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.220+0000 7f86a7fff700 1 -- 172.21.15.104:0/1628250761 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f86b807c890 con 0x7f86c00af5a0 2024-08-17T02:25:33.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.224+0000 7f86bf7fe700 1 --2- 172.21.15.104:0/1628250761 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f86ac060860 0x7f86ac062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:33.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.224+0000 7f86bf7fe700 1 --2- 172.21.15.104:0/1628250761 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f86ac060860 0x7f86ac062d10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f86c0158620 tx=0x7f86b4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:33.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.232+0000 7f86a7fff700 1 -- 172.21.15.104:0/1628250761 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f86b804cce0 con 0x7f86c00af5a0 2024-08-17T02:25:33.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.424+0000 7f86c6829700 1 -- 172.21.15.104:0/1628250761 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f86c006df60 con 0x7f86c00af5a0 2024-08-17T02:25:33.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.424+0000 7f86a7fff700 1 -- 172.21.15.104:0/1628250761 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4627 (secure 0 0 0) 0x7f86b8018090 con 0x7f86c00af5a0 2024-08-17T02:25:33.428 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:25:33.428 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":20,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/3848434798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3848434798},{"type":"v1","addr":"172.21.15.117:6836","nonce":3848434798}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4894,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1461239637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1461239637},{"type":"v1","addr":"172.21.15.117:6837","nonce":1461239637}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5328,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/3001967297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":3001967297},{"type":"v1","addr":"172.21.15.104:6835","nonce":3001967297}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:23:22.321122+0000","modified":"2024-08-17T02:23:24.304353+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4959},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4959":{"gid":4959,"name":"c","rank":0,"incarnation":16,"state":"up:active","state_seq":8,"addr":"172.21.15.104:6833/4148924116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":4148924116},{"type":"v1","addr":"172.21.15.104:6833","nonce":4148924116}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000188090","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:25:33.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.424+0000 7f86c6829700 1 -- 172.21.15.104:0/1628250761 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f86ac060860 msgr2=0x7f86ac062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:33.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.424+0000 7f86c6829700 1 --2- 172.21.15.104:0/1628250761 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f86ac060860 0x7f86ac062d10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f86c0158620 tx=0x7f86b4008040 comp rx=0 tx=0).stop 2024-08-17T02:25:33.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.424+0000 7f86c6829700 1 -- 172.21.15.104:0/1628250761 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86c00af5a0 msgr2=0x7f86c00c16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:33.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.424+0000 7f86c6829700 1 --2- 172.21.15.104:0/1628250761 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86c00af5a0 0x7f86c00c16b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f86b800ccd0 tx=0x7f86b80016f0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.424+0000 7f86c6829700 1 -- 172.21.15.104:0/1628250761 shutdown_connections 2024-08-17T02:25:33.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.424+0000 7f86c6829700 1 --2- 172.21.15.104:0/1628250761 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f86ac060860 0x7f86ac062d10 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.424+0000 7f86c6829700 1 --2- 172.21.15.104:0/1628250761 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86c0155380 0x7f86c0157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.424+0000 7f86c6829700 1 --2- 172.21.15.104:0/1628250761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86c00aff10 0x7f86c01578a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.424+0000 7f86c6829700 1 --2- 172.21.15.104:0/1628250761 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86c00af5a0 0x7f86c00c16b0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.424+0000 7f86c6829700 1 -- 172.21.15.104:0/1628250761 >> 172.21.15.104:0/1628250761 conn(0x7f86c0066e00 msgr2=0x7f86c0068060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:33.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.424+0000 7f86c6829700 1 -- 172.21.15.104:0/1628250761 shutdown_connections 2024-08-17T02:25:33.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.424+0000 7f86c6829700 1 -- 172.21.15.104:0/1628250761 wait complete. 2024-08-17T02:25:33.431 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 20 2024-08-17T02:25:33.442 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:33.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.540+0000 7f3696390700 1 Processor -- start 2024-08-17T02:25:33.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.540+0000 7f3696390700 1 -- start start 2024-08-17T02:25:33.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.540+0000 7f3696390700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f36900cb560 0x7f3690161ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:33.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.540+0000 7f3696390700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36900cbaa0 con 0x7f3690154900 2024-08-17T02:25:33.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.540+0000 7f3696390700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3690157630 con 0x7f36900b14a0 2024-08-17T02:25:33.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.540+0000 7f3696390700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3690068790 con 0x7f36900cb560 2024-08-17T02:25:33.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.540+0000 7f369538e700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f3690154900 0x7f36900b0d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:39574/0 (socket says 172.21.15.104:39574) 2024-08-17T02:25:33.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.540+0000 7f369538e700 1 -- 172.21.15.104:0/911803092 learned_addr learned my addr 172.21.15.104:0/911803092 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:25:33.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.540+0000 7f3695b8f700 1 --2- 172.21.15.104:0/911803092 >> v2:172.21.15.117:3300/0 conn(0x7f36900cb560 0x7f3690161ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:33.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.540+0000 7f3687fff700 1 -- 172.21.15.104:0/911803092 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1839321706 0 0) 0x7f3690157630 con 0x7f36900b14a0 2024-08-17T02:25:33.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.540+0000 7f3687fff700 1 -- 172.21.15.104:0/911803092 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3678003570 con 0x7f36900b14a0 2024-08-17T02:25:33.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.540+0000 7f3687fff700 1 -- 172.21.15.104:0/911803092 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3858791770 0 0) 0x7f36900cbaa0 con 0x7f3690154900 2024-08-17T02:25:33.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.544+0000 7f3687fff700 1 -- 172.21.15.104:0/911803092 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3690157630 con 0x7f3690154900 2024-08-17T02:25:33.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.544+0000 7f3695b8f700 1 -- 172.21.15.104:0/911803092 >> v1:172.21.15.117:6789/0 conn(0x7f36900b14a0 legacy=0x7f36900cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:33.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.544+0000 7f3695b8f700 1 -- 172.21.15.104:0/911803092 >> v1:172.21.15.104:6789/0 conn(0x7f3690154900 legacy=0x7f36900b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:33.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.544+0000 7f3695b8f700 1 -- 172.21.15.104:0/911803092 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3690157910 con 0x7f36900cb560 2024-08-17T02:25:33.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.544+0000 7f3695b8f700 1 --2- 172.21.15.104:0/911803092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36900cb560 0x7f3690161ad0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f36880098e0 tx=0x7f36880091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4d4877f86c83008 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:33.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.544+0000 7f3687fff700 1 -- 172.21.15.104:0/911803092 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3688011630 con 0x7f36900cb560 2024-08-17T02:25:33.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.544+0000 7f3687fff700 1 -- 172.21.15.104:0/911803092 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3688011790 con 0x7f36900cb560 2024-08-17T02:25:33.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.544+0000 7f3687fff700 1 -- 172.21.15.104:0/911803092 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3688011b10 con 0x7f36900cb560 2024-08-17T02:25:33.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.544+0000 7f3696390700 1 -- 172.21.15.104:0/911803092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36900cb560 msgr2=0x7f3690161ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:33.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.544+0000 7f3696390700 1 --2- 172.21.15.104:0/911803092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36900cb560 0x7f3690161ad0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f36880098e0 tx=0x7f36880091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.544+0000 7f3696390700 1 -- 172.21.15.104:0/911803092 shutdown_connections 2024-08-17T02:25:33.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.544+0000 7f3696390700 1 --2- 172.21.15.104:0/911803092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36900cb560 0x7f3690161ad0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.544+0000 7f3696390700 1 -- 172.21.15.104:0/911803092 >> 172.21.15.104:0/911803092 conn(0x7f36900678d0 msgr2=0x7f3690067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:33.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.544+0000 7f3696390700 1 -- 172.21.15.104:0/911803092 shutdown_connections 2024-08-17T02:25:33.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.544+0000 7f3696390700 1 -- 172.21.15.104:0/911803092 wait complete. 2024-08-17T02:25:33.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.544+0000 7f3696390700 1 Processor -- start 2024-08-17T02:25:33.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.544+0000 7f3696390700 1 -- start start 2024-08-17T02:25:33.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.548+0000 7f3696390700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36900b14a0 0x7f36901597c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:33.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.548+0000 7f3696390700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36900cb560 0x7f36900aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:33.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.548+0000 7f3696390700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3690154900 0x7f3690145360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:33.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.548+0000 7f3696390700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36900b0150 con 0x7f36900cb560 2024-08-17T02:25:33.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.548+0000 7f3696390700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36900af540 con 0x7f3690154900 2024-08-17T02:25:33.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.548+0000 7f3696390700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36900af820 con 0x7f36900b14a0 2024-08-17T02:25:33.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.548+0000 7f3694b8d700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36900cb560 0x7f36900aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:33.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.548+0000 7f3694b8d700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36900cb560 0x7f36900aeb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33420/0 (socket says 172.21.15.104:33420) 2024-08-17T02:25:33.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.548+0000 7f3694b8d700 1 -- 172.21.15.104:0/3286966417 learned_addr learned my addr 172.21.15.104:0/3286966417 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:33.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.548+0000 7f369538e700 1 --2- 172.21.15.104:0/3286966417 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36900b14a0 0x7f36901597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:33.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.548+0000 7f3695b8f700 1 --2- 172.21.15.104:0/3286966417 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3690154900 0x7f3690145360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:33.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.548+0000 7f3694b8d700 1 -- 172.21.15.104:0/3286966417 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36900b14a0 msgr2=0x7f36901597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:33.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.548+0000 7f3694b8d700 1 --2- 172.21.15.104:0/3286966417 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36900b14a0 0x7f36901597c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.548+0000 7f3694b8d700 1 -- 172.21.15.104:0/3286966417 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3690154900 msgr2=0x7f3690145360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:33.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.548+0000 7f3694b8d700 1 --2- 172.21.15.104:0/3286966417 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3690154900 0x7f3690145360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.548+0000 7f3694b8d700 1 -- 172.21.15.104:0/3286966417 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3688009420 con 0x7f36900cb560 2024-08-17T02:25:33.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.548+0000 7f3694b8d700 1 --2- 172.21.15.104:0/3286966417 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36900cb560 0x7f36900aeb80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f368c00cb20 tx=0x7f368c0027a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:33.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.548+0000 7f36857fa700 1 -- 172.21.15.104:0/3286966417 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368c0040f0 con 0x7f36900cb560 2024-08-17T02:25:33.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.548+0000 7f36857fa700 1 -- 172.21.15.104:0/3286966417 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f368c00a7e0 con 0x7f36900cb560 2024-08-17T02:25:33.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.548+0000 7f3696390700 1 -- 172.21.15.104:0/3286966417 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36900afb00 con 0x7f36900cb560 2024-08-17T02:25:33.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.548+0000 7f36857fa700 1 -- 172.21.15.104:0/3286966417 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368c00aba0 con 0x7f36900cb560 2024-08-17T02:25:33.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.548+0000 7f3696390700 1 -- 172.21.15.104:0/3286966417 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36900ab2d0 con 0x7f36900cb560 2024-08-17T02:25:33.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.548+0000 7f3696390700 1 -- 172.21.15.104:0/3286966417 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36900b0300 con 0x7f36900cb560 2024-08-17T02:25:33.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.552+0000 7f36857fa700 1 -- 172.21.15.104:0/3286966417 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f368c012420 con 0x7f36900cb560 2024-08-17T02:25:33.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.552+0000 7f36857fa700 1 --2- 172.21.15.104:0/3286966417 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f367c060890 0x7f367c062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:33.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.552+0000 7f36857fa700 1 -- 172.21.15.104:0/3286966417 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f368c07cb80 con 0x7f36900cb560 2024-08-17T02:25:33.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.552+0000 7f369538e700 1 --2- 172.21.15.104:0/3286966417 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f367c060890 0x7f367c062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:33.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.552+0000 7f369538e700 1 --2- 172.21.15.104:0/3286966417 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f367c060890 0x7f367c062d40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3680007fd0 tx=0x7f3680009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:33.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.560+0000 7f36857fa700 1 -- 172.21.15.104:0/3286966417 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f36900b0300 con 0x7f36900cb560 2024-08-17T02:25:33.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.724+0000 7f3696390700 1 -- 172.21.15.104:0/3286966417 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36900643a0 con 0x7f36900cb560 2024-08-17T02:25:33.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.728+0000 7f36857fa700 1 -- 172.21.15.104:0/3286966417 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+15558 (secure 0 0 0) 0x7f368c050aa0 con 0x7f36900cb560 2024-08-17T02:25:33.731 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:25:33.732 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":44,"fsid":"fd5f7fb8-d34b-49bb-89a8-62b7dad1bc25","created":"2024-08-17T02:21:57.891389+0000","modified":"2024-08-17T02:25:31.834848+0000","last_up_change":"2024-08-17T02:22:08.924546+0000","last_in_change":"2024-08-17T02:21:59.938028+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:22:10.143970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000188090.meta","create_time":"2024-08-17T02:23:21.239436+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000188090"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000188090.data","create_time":"2024-08-17T02:23:21.337636+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000188090"}}}],"osds":[{"osd":0,"uuid":"606b9088-590e-4709-aa3a-b0f6e22972ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":24257},{"type":"v1","addr":"172.21.15.104:6809","nonce":24257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":24257},{"type":"v1","addr":"172.21.15.104:6811","nonce":24257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":24257},{"type":"v1","addr":"172.21.15.104:6815","nonce":24257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":24257},{"type":"v1","addr":"172.21.15.104:6813","nonce":24257}]},"public_addr":"172.21.15.104:6809/24257","cluster_addr":"172.21.15.104:6811/24257","heartbeat_back_addr":"172.21.15.104:6815/24257","heartbeat_front_addr":"172.21.15.104:6813/24257","state":["exists","up"]},{"osd":1,"uuid":"9bc6a909-0c2f-4889-afe7-4a47f89b0f64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":24256},{"type":"v1","addr":"172.21.15.104:6825","nonce":24256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":24256},{"type":"v1","addr":"172.21.15.104:6827","nonce":24256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":24256},{"type":"v1","addr":"172.21.15.104:6831","nonce":24256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":24256},{"type":"v1","addr":"172.21.15.104:6829","nonce":24256}]},"public_addr":"172.21.15.104:6825/24256","cluster_addr":"172.21.15.104:6827/24256","heartbeat_back_addr":"172.21.15.104:6831/24256","heartbeat_front_addr":"172.21.15.104:6829/24256","state":["exists","up"]},{"osd":2,"uuid":"23da31d5-aefb-4edb-b79d-fa05e1becef7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":24255},{"type":"v1","addr":"172.21.15.104:6817","nonce":24255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":24255},{"type":"v1","addr":"172.21.15.104:6819","nonce":24255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":24255},{"type":"v1","addr":"172.21.15.104:6823","nonce":24255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":24255},{"type":"v1","addr":"172.21.15.104:6821","nonce":24255}]},"public_addr":"172.21.15.104:6817/24255","cluster_addr":"172.21.15.104:6819/24255","heartbeat_back_addr":"172.21.15.104:6823/24255","heartbeat_front_addr":"172.21.15.104:6821/24255","state":["exists","up"]},{"osd":3,"uuid":"6e4a5ec2-b415-45ef-8381-61a59eb65224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":24254},{"type":"v1","addr":"172.21.15.104:6801","nonce":24254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":24254},{"type":"v1","addr":"172.21.15.104:6803","nonce":24254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":24254},{"type":"v1","addr":"172.21.15.104:6807","nonce":24254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":24254},{"type":"v1","addr":"172.21.15.104:6805","nonce":24254}]},"public_addr":"172.21.15.104:6801/24254","cluster_addr":"172.21.15.104:6803/24254","heartbeat_back_addr":"172.21.15.104:6807/24254","heartbeat_front_addr":"172.21.15.104:6805/24254","state":["exists","up"]},{"osd":4,"uuid":"8d5bea2d-9039-4013-8c99-2c046c5b8a17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":24421},{"type":"v1","addr":"172.21.15.117:6804","nonce":24421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":24421},{"type":"v1","addr":"172.21.15.117:6809","nonce":24421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":24421},{"type":"v1","addr":"172.21.15.117:6815","nonce":24421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":24421},{"type":"v1","addr":"172.21.15.117:6813","nonce":24421}]},"public_addr":"172.21.15.117:6804/24421","cluster_addr":"172.21.15.117:6809/24421","heartbeat_back_addr":"172.21.15.117:6815/24421","heartbeat_front_addr":"172.21.15.117:6813/24421","state":["exists","up"]},{"osd":5,"uuid":"de8b36fc-121c-4f05-8f5b-28f513d9f21f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":24422},{"type":"v1","addr":"172.21.15.117:6817","nonce":24422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":24422},{"type":"v1","addr":"172.21.15.117:6819","nonce":24422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":24422},{"type":"v1","addr":"172.21.15.117:6823","nonce":24422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":24422},{"type":"v1","addr":"172.21.15.117:6821","nonce":24422}]},"public_addr":"172.21.15.117:6817/24422","cluster_addr":"172.21.15.117:6819/24422","heartbeat_back_addr":"172.21.15.117:6823/24422","heartbeat_front_addr":"172.21.15.117:6821/24422","state":["exists","up"]},{"osd":6,"uuid":"6a87f09f-7bf7-4f7a-be87-530ac1ff8ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":24420},{"type":"v1","addr":"172.21.15.117:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6803","nonce":24420},{"type":"v1","addr":"172.21.15.117:6805","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":24420},{"type":"v1","addr":"172.21.15.117:6811","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":24420},{"type":"v1","addr":"172.21.15.117:6808","nonce":24420}]},"public_addr":"172.21.15.117:6801/24420","cluster_addr":"172.21.15.117:6805/24420","heartbeat_back_addr":"172.21.15.117:6811/24420","heartbeat_front_addr":"172.21.15.117:6808/24420","state":["exists","up"]},{"osd":7,"uuid":"e31d8041-1aa1-4b5d-83b3-0a373426dd9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":24423},{"type":"v1","addr":"172.21.15.117:6825","nonce":24423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":24423},{"type":"v1","addr":"172.21.15.117:6827","nonce":24423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":24423},{"type":"v1","addr":"172.21.15.117:6831","nonce":24423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":24423},{"type":"v1","addr":"172.21.15.117:6829","nonce":24423}]},"public_addr":"172.21.15.117:6825/24423","cluster_addr":"172.21.15.117:6827/24423","heartbeat_back_addr":"172.21.15.117:6831/24423","heartbeat_front_addr":"172.21.15.117:6829/24423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.220874+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.210039+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.434762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.247206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.184316+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.306325+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.035719+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.400303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.104:6835/38993094":"2024-08-18T02:25:28.820410+0000","172.21.15.104:6834/38993094":"2024-08-18T02:25:28.820410+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:33.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.728+0000 7f3696390700 1 -- 172.21.15.104:0/3286966417 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f367c060890 msgr2=0x7f367c062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:33.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.728+0000 7f3696390700 1 --2- 172.21.15.104:0/3286966417 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f367c060890 0x7f367c062d40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3680007fd0 tx=0x7f3680009040 comp rx=0 tx=0).stop 2024-08-17T02:25:33.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.728+0000 7f3696390700 1 -- 172.21.15.104:0/3286966417 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36900cb560 msgr2=0x7f36900aeb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:33.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.728+0000 7f3696390700 1 --2- 172.21.15.104:0/3286966417 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36900cb560 0x7f36900aeb80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f368c00cb20 tx=0x7f368c0027a0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.728+0000 7f3696390700 1 -- 172.21.15.104:0/3286966417 shutdown_connections 2024-08-17T02:25:33.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.728+0000 7f3696390700 1 --2- 172.21.15.104:0/3286966417 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f367c060890 0x7f367c062d40 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.728+0000 7f3696390700 1 --2- 172.21.15.104:0/3286966417 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3690154900 0x7f3690145360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.728+0000 7f3696390700 1 --2- 172.21.15.104:0/3286966417 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36900cb560 0x7f36900aeb80 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.728+0000 7f3696390700 1 --2- 172.21.15.104:0/3286966417 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36900b14a0 0x7f36901597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.728+0000 7f3696390700 1 -- 172.21.15.104:0/3286966417 >> 172.21.15.104:0/3286966417 conn(0x7f36900678d0 msgr2=0x7f36900ac990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:33.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.728+0000 7f3696390700 1 -- 172.21.15.104:0/3286966417 shutdown_connections 2024-08-17T02:25:33.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.728+0000 7f3696390700 1 -- 172.21.15.104:0/3286966417 wait complete. 2024-08-17T02:25:33.746 INFO:tasks.cephfs.filesystem:Destroying file system volume_0000000000188090 and related pools 2024-08-17T02:25:33.746 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:25:33.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.844+0000 7faec3fff700 1 Processor -- start 2024-08-17T02:25:33.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.844+0000 7faec3fff700 1 -- start start 2024-08-17T02:25:33.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.848+0000 7faec3fff700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7faec4154900 0x7faec40b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:33.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.848+0000 7faec3fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faec40cb560 0x7faec4160ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:33.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.848+0000 7faec3fff700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faec40b1730 con 0x7faec40b12d0 2024-08-17T02:25:33.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.848+0000 7faec3fff700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faec4068790 con 0x7faec4154900 2024-08-17T02:25:33.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.848+0000 7faec3fff700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec41583f0 con 0x7faec40cb560 2024-08-17T02:25:33.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.848+0000 7faec2ffd700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7faec4154900 0x7faec40b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:33.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.848+0000 7faec37fe700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faec40cb560 0x7faec4160ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:33.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.848+0000 7faec37fe700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faec40cb560 0x7faec4160ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.104:37034/0 (socket says 172.21.15.104:37034) 2024-08-17T02:25:33.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.848+0000 7faec2ffd700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7faec4154900 0x7faec40b0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.104:60496/0 (socket says 172.21.15.104:60496) 2024-08-17T02:25:33.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.848+0000 7faec37fe700 1 -- 172.21.15.104:0/2789224762 learned_addr learned my addr 172.21.15.104:0/2789224762 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:33.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.848+0000 7faec27fc700 1 --1- 172.21.15.104:0/2789224762 >> v1:172.21.15.117:6789/0 conn(0x7faec40b12d0 0x7faec40cae50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.104:57708/0 (socket says 172.21.15.104:57708) 2024-08-17T02:25:33.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.848+0000 7faec2ffd700 1 -- 172.21.15.104:0/2789224762 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faec40cb560 msgr2=0x7faec4160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:33.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.848+0000 7faec2ffd700 1 --2- 172.21.15.104:0/2789224762 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faec40cb560 0x7faec4160ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.848+0000 7faec2ffd700 1 -- 172.21.15.104:0/2789224762 >> v1:172.21.15.117:6789/0 conn(0x7faec40b12d0 legacy=0x7faec40cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:33.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.848+0000 7faec1ffb700 1 -- 172.21.15.104:0/2789224762 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 626192476 0 0) 0x7faebc001490 con 0x7faec40b12d0 2024-08-17T02:25:33.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.848+0000 7faec2ffd700 1 -- 172.21.15.104:0/2789224762 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec40cbaa0 con 0x7faec4154900 2024-08-17T02:25:33.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.848+0000 7faec37fe700 1 --2- 172.21.15.104:0/2789224762 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faec40cb560 0x7faec4160ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:33.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.848+0000 7faec2ffd700 1 --2- 172.21.15.104:0/2789224762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faec4154900 0x7faec40b0d90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7faeb40098e0 tx=0x7faeb40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9eb6daf572e8d69 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:33.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.848+0000 7faec1ffb700 1 -- 172.21.15.104:0/2789224762 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb400b640 con 0x7faec4154900 2024-08-17T02:25:33.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.848+0000 7faec1ffb700 1 -- 172.21.15.104:0/2789224762 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb400b7a0 con 0x7faec4154900 2024-08-17T02:25:33.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.848+0000 7faec1ffb700 1 -- 172.21.15.104:0/2789224762 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb400bb40 con 0x7faec4154900 2024-08-17T02:25:33.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.848+0000 7faec3fff700 1 -- 172.21.15.104:0/2789224762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faec4154900 msgr2=0x7faec40b0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:33.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.848+0000 7faec3fff700 1 --2- 172.21.15.104:0/2789224762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faec4154900 0x7faec40b0d90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7faeb40098e0 tx=0x7faeb40091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.848+0000 7faec3fff700 1 -- 172.21.15.104:0/2789224762 shutdown_connections 2024-08-17T02:25:33.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.848+0000 7faec3fff700 1 --2- 172.21.15.104:0/2789224762 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faec40cb560 0x7faec4160ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.848+0000 7faec3fff700 1 --2- 172.21.15.104:0/2789224762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faec4154900 0x7faec40b0d90 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.848+0000 7faec3fff700 1 -- 172.21.15.104:0/2789224762 >> 172.21.15.104:0/2789224762 conn(0x7faec40678d0 msgr2=0x7faec4067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:33.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.848+0000 7faec3fff700 1 -- 172.21.15.104:0/2789224762 shutdown_connections 2024-08-17T02:25:33.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.848+0000 7faec3fff700 1 -- 172.21.15.104:0/2789224762 wait complete. 2024-08-17T02:25:33.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.852+0000 7faec3fff700 1 Processor -- start 2024-08-17T02:25:33.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.852+0000 7faec3fff700 1 -- start start 2024-08-17T02:25:33.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.852+0000 7faec3fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faec40b12d0 0x7faec414b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:33.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.852+0000 7faec3fff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faec40cb560 0x7faec40a9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:33.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.852+0000 7faec3fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faec4154900 0x7faec40c1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:33.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.852+0000 7faec3fff700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec40ab200 con 0x7faec40cb560 2024-08-17T02:25:33.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.852+0000 7faec3fff700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec40aad70 con 0x7faec4154900 2024-08-17T02:25:33.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.852+0000 7faec3fff700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec40aa160 con 0x7faec40b12d0 2024-08-17T02:25:33.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.852+0000 7faec27fc700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faec40cb560 0x7faec40a9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:33.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.852+0000 7faec27fc700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faec40cb560 0x7faec40a9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33422/0 (socket says 172.21.15.104:33422) 2024-08-17T02:25:33.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.852+0000 7faec27fc700 1 -- 172.21.15.104:0/1102977384 learned_addr learned my addr 172.21.15.104:0/1102977384 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:33.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.852+0000 7faec37fe700 1 --2- 172.21.15.104:0/1102977384 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faec4154900 0x7faec40c1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:33.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.852+0000 7faec2ffd700 1 --2- 172.21.15.104:0/1102977384 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faec40b12d0 0x7faec414b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:33.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.852+0000 7faec27fc700 1 -- 172.21.15.104:0/1102977384 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faec40b12d0 msgr2=0x7faec414b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:33.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.852+0000 7faec27fc700 1 --2- 172.21.15.104:0/1102977384 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faec40b12d0 0x7faec414b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.852+0000 7faec27fc700 1 -- 172.21.15.104:0/1102977384 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faec4154900 msgr2=0x7faec40c1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:33.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.852+0000 7faec27fc700 1 --2- 172.21.15.104:0/1102977384 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faec4154900 0x7faec40c1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.852+0000 7faec27fc700 1 -- 172.21.15.104:0/1102977384 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeac0094f0 con 0x7faec40cb560 2024-08-17T02:25:33.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.852+0000 7faec37fe700 1 --2- 172.21.15.104:0/1102977384 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faec4154900 0x7faec40c1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:33.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.852+0000 7faec27fc700 1 --2- 172.21.15.104:0/1102977384 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faec40cb560 0x7faec40a9860 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7faebc002230 tx=0x7faebc001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:33.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.852+0000 7faebaffd700 1 -- 172.21.15.104:0/1102977384 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc005df0 con 0x7faec40cb560 2024-08-17T02:25:33.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.852+0000 7faebaffd700 1 -- 172.21.15.104:0/1102977384 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faebc00a960 con 0x7faec40cb560 2024-08-17T02:25:33.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.852+0000 7faebaffd700 1 -- 172.21.15.104:0/1102977384 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc00ad20 con 0x7faec40cb560 2024-08-17T02:25:33.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.852+0000 7faec3fff700 1 -- 172.21.15.104:0/1102977384 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeb4009420 con 0x7faec40cb560 2024-08-17T02:25:33.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.852+0000 7faec3fff700 1 -- 172.21.15.104:0/1102977384 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faec40aa7a0 con 0x7faec40cb560 2024-08-17T02:25:33.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.856+0000 7faec3fff700 1 -- 172.21.15.104:0/1102977384 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faec40aaee0 con 0x7faec40cb560 2024-08-17T02:25:33.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.856+0000 7faebaffd700 1 -- 172.21.15.104:0/1102977384 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7faebc007300 con 0x7faec40cb560 2024-08-17T02:25:33.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.856+0000 7faebaffd700 1 --2- 172.21.15.104:0/1102977384 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7faea8060860 0x7faea8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:33.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.860+0000 7faebaffd700 1 -- 172.21.15.104:0/1102977384 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5837+0+0 (secure 0 0 0) 0x7faebc07d7d0 con 0x7faec40cb560 2024-08-17T02:25:33.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.860+0000 7faec2ffd700 1 --2- 172.21.15.104:0/1102977384 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7faea8060860 0x7faea8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:33.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.860+0000 7faec2ffd700 1 --2- 172.21.15.104:0/1102977384 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7faea8060860 0x7faea8062d10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7faec40af410 tx=0x7faeb4017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:33.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:33.864+0000 7faebaffd700 1 -- 172.21.15.104:0/1102977384 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7faebc04dc40 con 0x7faec40cb560 2024-08-17T02:25:34.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.060+0000 7faec3fff700 1 -- 172.21.15.104:0/1102977384 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faec40b1730 con 0x7faec40cb560 2024-08-17T02:25:34.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.060+0000 7faebaffd700 1 -- 172.21.15.104:0/1102977384 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4627 (secure 0 0 0) 0x7faec40b1730 con 0x7faec40cb560 2024-08-17T02:25:34.065 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:25:34.065 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":20,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/3848434798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3848434798},{"type":"v1","addr":"172.21.15.117:6836","nonce":3848434798}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4894,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1461239637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1461239637},{"type":"v1","addr":"172.21.15.117:6837","nonce":1461239637}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5328,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/3001967297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":3001967297},{"type":"v1","addr":"172.21.15.104:6835","nonce":3001967297}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:23:22.321122+0000","modified":"2024-08-17T02:23:24.304353+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4959},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4959":{"gid":4959,"name":"c","rank":0,"incarnation":16,"state":"up:active","state_seq":8,"addr":"172.21.15.104:6833/4148924116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":4148924116},{"type":"v1","addr":"172.21.15.104:6833","nonce":4148924116}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000188090","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:25:34.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.064+0000 7faec3fff700 1 -- 172.21.15.104:0/1102977384 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7faea8060860 msgr2=0x7faea8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:34.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.064+0000 7faec3fff700 1 --2- 172.21.15.104:0/1102977384 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7faea8060860 0x7faea8062d10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7faec40af410 tx=0x7faeb4017000 comp rx=0 tx=0).stop 2024-08-17T02:25:34.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.064+0000 7faec3fff700 1 -- 172.21.15.104:0/1102977384 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faec40cb560 msgr2=0x7faec40a9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:34.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.064+0000 7faec3fff700 1 --2- 172.21.15.104:0/1102977384 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faec40cb560 0x7faec40a9860 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7faebc002230 tx=0x7faebc001b90 comp rx=0 tx=0).stop 2024-08-17T02:25:34.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.064+0000 7faec3fff700 1 -- 172.21.15.104:0/1102977384 shutdown_connections 2024-08-17T02:25:34.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.064+0000 7faec3fff700 1 --2- 172.21.15.104:0/1102977384 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7faea8060860 0x7faea8062d10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:34.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.064+0000 7faec3fff700 1 --2- 172.21.15.104:0/1102977384 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faec4154900 0x7faec40c1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:34.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.064+0000 7faec3fff700 1 --2- 172.21.15.104:0/1102977384 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faec40cb560 0x7faec40a9860 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:34.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.064+0000 7faec3fff700 1 --2- 172.21.15.104:0/1102977384 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faec40b12d0 0x7faec414b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:34.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.064+0000 7faec3fff700 1 -- 172.21.15.104:0/1102977384 >> 172.21.15.104:0/1102977384 conn(0x7faec40678d0 msgr2=0x7faec406d110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:34.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.064+0000 7faec3fff700 1 -- 172.21.15.104:0/1102977384 shutdown_connections 2024-08-17T02:25:34.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.064+0000 7faec3fff700 1 -- 172.21.15.104:0/1102977384 wait complete. 2024-08-17T02:25:34.069 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 20 2024-08-17T02:25:34.079 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:25:34.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.176+0000 7ff965892700 1 Processor -- start 2024-08-17T02:25:34.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.176+0000 7ff965892700 1 -- start start 2024-08-17T02:25:34.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.176+0000 7ff965892700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff960153a50 0x7ff9600687a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:34.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.176+0000 7ff965892700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9600ae000 0x7ff96006d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:34.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.176+0000 7ff965892700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff96015ce60 con 0x7ff9600ae430 2024-08-17T02:25:34.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.176+0000 7ff965892700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff96015d0b0 con 0x7ff960153a50 2024-08-17T02:25:34.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.176+0000 7ff965892700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff96015d390 con 0x7ff9600ae000 2024-08-17T02:25:34.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.176+0000 7ff95effd700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff960153a50 0x7ff9600687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:34.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.176+0000 7ff95e7fc700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9600ae000 0x7ff96006d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:34.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.176+0000 7ff95effd700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff960153a50 0x7ff9600687a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.104:60512/0 (socket says 172.21.15.104:60512) 2024-08-17T02:25:34.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.176+0000 7ff95effd700 1 -- 172.21.15.104:0/1206939161 learned_addr learned my addr 172.21.15.104:0/1206939161 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:34.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.176+0000 7ff95f7fe700 1 --1- 172.21.15.104:0/1206939161 >> v1:172.21.15.117:6789/0 conn(0x7ff9600ae430 0x7ff9600afe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.104:57718/0 (socket says 172.21.15.104:57718) 2024-08-17T02:25:34.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.176+0000 7ff95e7fc700 1 -- 172.21.15.104:0/1206939161 >> v2:172.21.15.117:3300/0 conn(0x7ff960153a50 msgr2=0x7ff9600687a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:34.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.176+0000 7ff95e7fc700 1 --2- 172.21.15.104:0/1206939161 >> v2:172.21.15.117:3300/0 conn(0x7ff960153a50 0x7ff9600687a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:34.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.176+0000 7ff95e7fc700 1 -- 172.21.15.104:0/1206939161 >> v1:172.21.15.117:6789/0 conn(0x7ff9600ae430 legacy=0x7ff9600afe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:34.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.176+0000 7ff95e7fc700 1 -- 172.21.15.104:0/1206939161 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff96015d670 con 0x7ff9600ae000 2024-08-17T02:25:34.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.176+0000 7ff95effd700 1 --2- 172.21.15.104:0/1206939161 >> v2:172.21.15.117:3300/0 conn(0x7ff960153a50 0x7ff9600687a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:34.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.176+0000 7ff95e7fc700 1 --2- 172.21.15.104:0/1206939161 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9600ae000 0x7ff96006d2f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff9540098e0 tx=0x7ff9540091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77a05560200a90b3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:34.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.176+0000 7ff95dffb700 1 -- 172.21.15.104:0/1206939161 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95400b640 con 0x7ff9600ae000 2024-08-17T02:25:34.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.176+0000 7ff95dffb700 1 -- 172.21.15.104:0/1206939161 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95400b7a0 con 0x7ff9600ae000 2024-08-17T02:25:34.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.176+0000 7ff95dffb700 1 -- 172.21.15.104:0/1206939161 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95400bb40 con 0x7ff9600ae000 2024-08-17T02:25:34.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.180+0000 7ff965892700 1 -- 172.21.15.104:0/1206939161 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9600ae000 msgr2=0x7ff96006d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:34.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.180+0000 7ff965892700 1 --2- 172.21.15.104:0/1206939161 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9600ae000 0x7ff96006d2f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff9540098e0 tx=0x7ff9540091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:34.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.180+0000 7ff965892700 1 -- 172.21.15.104:0/1206939161 shutdown_connections 2024-08-17T02:25:34.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.180+0000 7ff965892700 1 --2- 172.21.15.104:0/1206939161 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9600ae000 0x7ff96006d2f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:34.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.180+0000 7ff965892700 1 --2- 172.21.15.104:0/1206939161 >> v2:172.21.15.117:3300/0 conn(0x7ff960153a50 0x7ff9600687a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:34.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.180+0000 7ff965892700 1 -- 172.21.15.104:0/1206939161 >> 172.21.15.104:0/1206939161 conn(0x7ff9600ceb30 msgr2=0x7ff96006cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:34.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.180+0000 7ff965892700 1 -- 172.21.15.104:0/1206939161 shutdown_connections 2024-08-17T02:25:34.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.180+0000 7ff965892700 1 -- 172.21.15.104:0/1206939161 wait complete. 2024-08-17T02:25:34.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.180+0000 7ff965892700 1 Processor -- start 2024-08-17T02:25:34.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.180+0000 7ff965892700 1 -- start start 2024-08-17T02:25:34.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.180+0000 7ff965892700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9600ae000 0x7ff96014eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:34.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.180+0000 7ff965892700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9600ae430 0x7ff96016d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:34.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.180+0000 7ff965892700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff960153a50 0x7ff960149700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:34.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.180+0000 7ff965892700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff960152be0 con 0x7ff960153a50 2024-08-17T02:25:34.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.180+0000 7ff965892700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96016dec0 con 0x7ff9600ae430 2024-08-17T02:25:34.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.180+0000 7ff965892700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff960149c40 con 0x7ff9600ae000 2024-08-17T02:25:34.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.180+0000 7ff95f7fe700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff960153a50 0x7ff960149700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:34.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.180+0000 7ff95f7fe700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff960153a50 0x7ff960149700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33426/0 (socket says 172.21.15.104:33426) 2024-08-17T02:25:34.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.180+0000 7ff95f7fe700 1 -- 172.21.15.104:0/2864588375 learned_addr learned my addr 172.21.15.104:0/2864588375 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:34.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.180+0000 7ff95e7fc700 1 --2- 172.21.15.104:0/2864588375 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9600ae430 0x7ff96016d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:34.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.180+0000 7ff95effd700 1 --2- 172.21.15.104:0/2864588375 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9600ae000 0x7ff96014eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:34.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.184+0000 7ff95f7fe700 1 -- 172.21.15.104:0/2864588375 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9600ae000 msgr2=0x7ff96014eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:34.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.184+0000 7ff95f7fe700 1 --2- 172.21.15.104:0/2864588375 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9600ae000 0x7ff96014eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:34.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.184+0000 7ff95f7fe700 1 -- 172.21.15.104:0/2864588375 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9600ae430 msgr2=0x7ff96016d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:34.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.184+0000 7ff95f7fe700 1 --2- 172.21.15.104:0/2864588375 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9600ae430 0x7ff96016d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:34.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.184+0000 7ff95f7fe700 1 -- 172.21.15.104:0/2864588375 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff958009ae0 con 0x7ff960153a50 2024-08-17T02:25:34.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.184+0000 7ff95f7fe700 1 --2- 172.21.15.104:0/2864588375 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff960153a50 0x7ff960149700 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff95000c590 tx=0x7ff950007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:34.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.184+0000 7ff946ffd700 1 -- 172.21.15.104:0/2864588375 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff950005a70 con 0x7ff960153a50 2024-08-17T02:25:34.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.184+0000 7ff965892700 1 -- 172.21.15.104:0/2864588375 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff954009420 con 0x7ff960153a50 2024-08-17T02:25:34.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.184+0000 7ff946ffd700 1 -- 172.21.15.104:0/2864588375 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff950005bf0 con 0x7ff960153a50 2024-08-17T02:25:34.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.184+0000 7ff965892700 1 -- 172.21.15.104:0/2864588375 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff96016a1f0 con 0x7ff960153a50 2024-08-17T02:25:34.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.184+0000 7ff946ffd700 1 -- 172.21.15.104:0/2864588375 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9500070d0 con 0x7ff960153a50 2024-08-17T02:25:34.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.184+0000 7ff965892700 1 -- 172.21.15.104:0/2864588375 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff96014a910 con 0x7ff960153a50 2024-08-17T02:25:34.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.184+0000 7ff946ffd700 1 -- 172.21.15.104:0/2864588375 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff950007480 con 0x7ff960153a50 2024-08-17T02:25:34.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.184+0000 7ff946ffd700 1 --2- 172.21.15.104:0/2864588375 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff94c060860 0x7ff94c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:34.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.184+0000 7ff946ffd700 1 -- 172.21.15.104:0/2864588375 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5837+0+0 (secure 0 0 0) 0x7ff95007be70 con 0x7ff960153a50 2024-08-17T02:25:34.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.188+0000 7ff95effd700 1 --2- 172.21.15.104:0/2864588375 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff94c060860 0x7ff94c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:34.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.188+0000 7ff95effd700 1 --2- 172.21.15.104:0/2864588375 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff94c060860 0x7ff94c062d10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff9580072d0 tx=0x7ff95800b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:34.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.192+0000 7ff946ffd700 1 -- 172.21.15.104:0/2864588375 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff96014a910 con 0x7ff960153a50 2024-08-17T02:25:34.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.396+0000 7ff965892700 1 -- 172.21.15.104:0/2864588375 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff96014a910 con 0x7ff960153a50 2024-08-17T02:25:34.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.396+0000 7ff946ffd700 1 -- 172.21.15.104:0/2864588375 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4627 (secure 0 0 0) 0x7ff96014a910 con 0x7ff960153a50 2024-08-17T02:25:34.399 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:25:34.400 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":20,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/3848434798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3848434798},{"type":"v1","addr":"172.21.15.117:6836","nonce":3848434798}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4894,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1461239637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1461239637},{"type":"v1","addr":"172.21.15.117:6837","nonce":1461239637}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5328,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/3001967297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":3001967297},{"type":"v1","addr":"172.21.15.104:6835","nonce":3001967297}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:23:22.321122+0000","modified":"2024-08-17T02:23:24.304353+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4959},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4959":{"gid":4959,"name":"c","rank":0,"incarnation":16,"state":"up:active","state_seq":8,"addr":"172.21.15.104:6833/4148924116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":4148924116},{"type":"v1","addr":"172.21.15.104:6833","nonce":4148924116}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000188090","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:25:34.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.396+0000 7ff965892700 1 -- 172.21.15.104:0/2864588375 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff94c060860 msgr2=0x7ff94c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:34.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.396+0000 7ff965892700 1 --2- 172.21.15.104:0/2864588375 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff94c060860 0x7ff94c062d10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff9580072d0 tx=0x7ff95800b040 comp rx=0 tx=0).stop 2024-08-17T02:25:34.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.396+0000 7ff965892700 1 -- 172.21.15.104:0/2864588375 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff960153a50 msgr2=0x7ff960149700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:34.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.396+0000 7ff965892700 1 --2- 172.21.15.104:0/2864588375 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff960153a50 0x7ff960149700 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff95000c590 tx=0x7ff950007ef0 comp rx=0 tx=0).stop 2024-08-17T02:25:34.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.396+0000 7ff965892700 1 -- 172.21.15.104:0/2864588375 shutdown_connections 2024-08-17T02:25:34.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.396+0000 7ff965892700 1 --2- 172.21.15.104:0/2864588375 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ff94c060860 0x7ff94c062d10 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:34.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.396+0000 7ff965892700 1 --2- 172.21.15.104:0/2864588375 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff960153a50 0x7ff960149700 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:34.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.396+0000 7ff965892700 1 --2- 172.21.15.104:0/2864588375 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9600ae430 0x7ff96016d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:34.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.396+0000 7ff965892700 1 --2- 172.21.15.104:0/2864588375 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9600ae000 0x7ff96014eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:34.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.396+0000 7ff965892700 1 -- 172.21.15.104:0/2864588375 >> 172.21.15.104:0/2864588375 conn(0x7ff9600ceb30 msgr2=0x7ff96006a010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:34.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.396+0000 7ff965892700 1 -- 172.21.15.104:0/2864588375 shutdown_connections 2024-08-17T02:25:34.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.396+0000 7ff965892700 1 -- 172.21.15.104:0/2864588375 wait complete. 2024-08-17T02:25:34.404 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 20 2024-08-17T02:25:34.414 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:34.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.512+0000 7fc1bcd6f700 1 Processor -- start 2024-08-17T02:25:34.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.512+0000 7fc1bcd6f700 1 -- start start 2024-08-17T02:25:34.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.512+0000 7fc1bcd6f700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1b80b0d20 0x7fc1b806df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:34.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.512+0000 7fc1bcd6f700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b8141a00 con 0x7fc1b80b1800 2024-08-17T02:25:34.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.512+0000 7fc1bcd6f700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b806e8a0 con 0x7fc1b806e450 2024-08-17T02:25:34.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.512+0000 7fc1bcd6f700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b8140b10 con 0x7fc1b80b0d20 2024-08-17T02:25:34.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.512+0000 7fc1b7fff700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fc1b80b1800 0x7fc1b8141e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:39588/0 (socket says 172.21.15.104:39588) 2024-08-17T02:25:34.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.512+0000 7fc1b7fff700 1 -- 172.21.15.104:0/285126412 learned_addr learned my addr 172.21.15.104:0/285126412 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:25:34.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.512+0000 7fc1b77fe700 1 --2- 172.21.15.104:0/285126412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1b80b0d20 0x7fc1b806df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:34.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.512+0000 7fc1b67fc700 1 -- 172.21.15.104:0/285126412 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3863985403 0 0) 0x7fc1b8141a00 con 0x7fc1b80b1800 2024-08-17T02:25:34.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.512+0000 7fc1b67fc700 1 -- 172.21.15.104:0/285126412 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1a0003570 con 0x7fc1b80b1800 2024-08-17T02:25:34.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.512+0000 7fc1b67fc700 1 -- 172.21.15.104:0/285126412 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 928681465 0 0) 0x7fc1b806e8a0 con 0x7fc1b806e450 2024-08-17T02:25:34.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.512+0000 7fc1b67fc700 1 -- 172.21.15.104:0/285126412 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1b8141a00 con 0x7fc1b806e450 2024-08-17T02:25:34.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.512+0000 7fc1b67fc700 1 -- 172.21.15.104:0/285126412 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3759253087 0 0) 0x7fc1a0003570 con 0x7fc1b80b1800 2024-08-17T02:25:34.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.512+0000 7fc1b67fc700 1 -- 172.21.15.104:0/285126412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1b80b0d20 msgr2=0x7fc1b806df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:34.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.512+0000 7fc1b67fc700 1 --2- 172.21.15.104:0/285126412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1b80b0d20 0x7fc1b806df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:34.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.512+0000 7fc1b67fc700 1 -- 172.21.15.104:0/285126412 >> v1:172.21.15.117:6789/0 conn(0x7fc1b806e450 legacy=0x7fc1b80b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:34.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.512+0000 7fc1b67fc700 1 -- 172.21.15.104:0/285126412 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b8140df0 con 0x7fc1b80b1800 2024-08-17T02:25:34.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.512+0000 7fc1b67fc700 1 -- 172.21.15.104:0/285126412 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1279957748 0 0) 0x7fc1b00017f0 con 0x7fc1b80b1800 2024-08-17T02:25:34.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.512+0000 7fc1b67fc700 1 -- 172.21.15.104:0/285126412 >> v1:172.21.15.104:6789/0 conn(0x7fc1b80b1800 legacy=0x7fc1b8141e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:34.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.512+0000 7fc1b67fc700 1 --2- 172.21.15.104:0/285126412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1b80b0d20 0x7fc1a0003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:34.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.512+0000 7fc1b67fc700 1 --2- 172.21.15.104:0/285126412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1a0004180 0x7fc1a0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:34.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.512+0000 7fc1b67fc700 1 --2- 172.21.15.104:0/285126412 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1a0004d50 0x7fc1a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:34.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.512+0000 7fc1b67fc700 1 -- 172.21.15.104:0/285126412 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b8140b10 con 0x7fc1a0004d50 2024-08-17T02:25:34.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.512+0000 7fc1b67fc700 1 -- 172.21.15.104:0/285126412 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a000bba0 con 0x7fc1a0004180 2024-08-17T02:25:34.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.512+0000 7fc1b67fc700 1 -- 172.21.15.104:0/285126412 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a000bd60 con 0x7fc1b80b0d20 2024-08-17T02:25:34.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.512+0000 7fc1b7fff700 1 --2- 172.21.15.104:0/285126412 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1a0004d50 0x7fc1a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:34.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.512+0000 7fc1b77fe700 1 --2- 172.21.15.104:0/285126412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1b80b0d20 0x7fc1a0003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:34.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.512+0000 7fc1b6ffd700 1 --2- 172.21.15.104:0/285126412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1a0004180 0x7fc1a0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:34.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.512+0000 7fc1b7fff700 1 -- 172.21.15.104:0/285126412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1b80b0d20 msgr2=0x7fc1a0003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:34.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.512+0000 7fc1b7fff700 1 --2- 172.21.15.104:0/285126412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1b80b0d20 0x7fc1a0003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:34.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.512+0000 7fc1b7fff700 1 -- 172.21.15.104:0/285126412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1a0004180 msgr2=0x7fc1a0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:34.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.512+0000 7fc1b7fff700 1 --2- 172.21.15.104:0/285126412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1a0004180 0x7fc1a0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:34.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.512+0000 7fc1b7fff700 1 -- 172.21.15.104:0/285126412 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a0003570 con 0x7fc1a0004d50 2024-08-17T02:25:34.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.512+0000 7fc1b7fff700 1 --2- 172.21.15.104:0/285126412 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1a0004d50 0x7fc1a00051c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc1b000a8f0 tx=0x7fc1b0002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc2ef19d0b389050 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:34.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.512+0000 7fc1b67fc700 1 -- 172.21.15.104:0/285126412 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b00070d0 con 0x7fc1a0004d50 2024-08-17T02:25:34.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.512+0000 7fc1b67fc700 1 -- 172.21.15.104:0/285126412 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b0007230 con 0x7fc1a0004d50 2024-08-17T02:25:34.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.512+0000 7fc1b67fc700 1 -- 172.21.15.104:0/285126412 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b00075f0 con 0x7fc1a0004d50 2024-08-17T02:25:34.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.516+0000 7fc1bcd6f700 1 -- 172.21.15.104:0/285126412 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1a0004d50 msgr2=0x7fc1a00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:34.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.516+0000 7fc1bcd6f700 1 --2- 172.21.15.104:0/285126412 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1a0004d50 0x7fc1a00051c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc1b000a8f0 tx=0x7fc1b0002190 comp rx=0 tx=0).stop 2024-08-17T02:25:34.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.516+0000 7fc1b7fff700 1 -- 172.21.15.104:0/285126412 reap_dead start 2024-08-17T02:25:34.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.516+0000 7fc1bcd6f700 1 -- 172.21.15.104:0/285126412 shutdown_connections 2024-08-17T02:25:34.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.516+0000 7fc1bcd6f700 1 -- 172.21.15.104:0/285126412 >> 172.21.15.104:0/285126412 conn(0x7fc1b80678d0 msgr2=0x7fc1b8067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:34.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.516+0000 7fc1bcd6f700 1 -- 172.21.15.104:0/285126412 shutdown_connections 2024-08-17T02:25:34.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.516+0000 7fc1bcd6f700 1 -- 172.21.15.104:0/285126412 wait complete. 2024-08-17T02:25:34.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.516+0000 7fc1bcd6f700 1 Processor -- start 2024-08-17T02:25:34.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.516+0000 7fc1bcd6f700 1 -- start start 2024-08-17T02:25:34.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.516+0000 7fc1bcd6f700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1a0004d50 0x7fc1b816de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:34.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.516+0000 7fc1bcd6f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1b816e380 0x7fc1b80a6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:34.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.516+0000 7fc1bcd6f700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1b80a6b60 0x7fc1b816ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:34.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.516+0000 7fc1bcd6f700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b80a6190 con 0x7fc1a0004d50 2024-08-17T02:25:34.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.516+0000 7fc1bcd6f700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b80a5580 con 0x7fc1b816e380 2024-08-17T02:25:34.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.516+0000 7fc1bcd6f700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b80a5860 con 0x7fc1b80a6b60 2024-08-17T02:25:34.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.516+0000 7fc1b77fe700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1a0004d50 0x7fc1b816de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:34.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.516+0000 7fc1b77fe700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1a0004d50 0x7fc1b816de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33442/0 (socket says 172.21.15.104:33442) 2024-08-17T02:25:34.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.516+0000 7fc1b77fe700 1 -- 172.21.15.104:0/3971815179 learned_addr learned my addr 172.21.15.104:0/3971815179 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:34.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.516+0000 7fc1b7fff700 1 --2- 172.21.15.104:0/3971815179 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1b80a6b60 0x7fc1b816ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:34.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.516+0000 7fc1b6ffd700 1 --2- 172.21.15.104:0/3971815179 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1b816e380 0x7fc1b80a6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:34.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.516+0000 7fc1b77fe700 1 -- 172.21.15.104:0/3971815179 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1b80a6b60 msgr2=0x7fc1b816ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:34.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.516+0000 7fc1b77fe700 1 --2- 172.21.15.104:0/3971815179 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1b80a6b60 0x7fc1b816ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:34.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.516+0000 7fc1b77fe700 1 -- 172.21.15.104:0/3971815179 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1b816e380 msgr2=0x7fc1b80a6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:34.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.516+0000 7fc1b77fe700 1 --2- 172.21.15.104:0/3971815179 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1b816e380 0x7fc1b80a6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:34.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.516+0000 7fc1b77fe700 1 -- 172.21.15.104:0/3971815179 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b80a5b40 con 0x7fc1a0004d50 2024-08-17T02:25:34.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.520+0000 7fc1b77fe700 1 --2- 172.21.15.104:0/3971815179 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1a0004d50 0x7fc1b816de40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac006ac0 tx=0x7fc1ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:34.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.520+0000 7fc19f7fe700 1 -- 172.21.15.104:0/3971815179 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac00f940 con 0x7fc1a0004d50 2024-08-17T02:25:34.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.520+0000 7fc19f7fe700 1 -- 172.21.15.104:0/3971815179 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ac00faa0 con 0x7fc1a0004d50 2024-08-17T02:25:34.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.520+0000 7fc1bcd6f700 1 -- 172.21.15.104:0/3971815179 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1b80a5e20 con 0x7fc1a0004d50 2024-08-17T02:25:34.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.520+0000 7fc19f7fe700 1 -- 172.21.15.104:0/3971815179 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac00fe20 con 0x7fc1a0004d50 2024-08-17T02:25:34.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.520+0000 7fc1bcd6f700 1 -- 172.21.15.104:0/3971815179 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1b816f410 con 0x7fc1a0004d50 2024-08-17T02:25:34.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.520+0000 7fc1bcd6f700 1 -- 172.21.15.104:0/3971815179 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1b80643a0 con 0x7fc1a0004d50 2024-08-17T02:25:34.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.520+0000 7fc19f7fe700 1 -- 172.21.15.104:0/3971815179 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fc1ac014650 con 0x7fc1a0004d50 2024-08-17T02:25:34.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.524+0000 7fc19f7fe700 1 --2- 172.21.15.104:0/3971815179 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fc1a4060860 0x7fc1a4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:34.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.524+0000 7fc19f7fe700 1 -- 172.21.15.104:0/3971815179 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fc1ac018030 con 0x7fc1a0004d50 2024-08-17T02:25:34.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.524+0000 7fc1b6ffd700 1 --2- 172.21.15.104:0/3971815179 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fc1a4060860 0x7fc1a4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:34.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.524+0000 7fc1b6ffd700 1 --2- 172.21.15.104:0/3971815179 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fc1a4060860 0x7fc1a4062d10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8007e40 tx=0x7fc1a8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:34.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.528+0000 7fc19f7fe700 1 -- 172.21.15.104:0/3971815179 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fc1ac04d980 con 0x7fc1a0004d50 2024-08-17T02:25:34.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.692+0000 7fc1bcd6f700 1 -- 172.21.15.104:0/3971815179 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1b815c4b0 con 0x7fc1a0004d50 2024-08-17T02:25:34.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.692+0000 7fc19f7fe700 1 -- 172.21.15.104:0/3971815179 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+15558 (secure 0 0 0) 0x7fc1ac050fa0 con 0x7fc1a0004d50 2024-08-17T02:25:34.698 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:25:34.698 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":44,"fsid":"fd5f7fb8-d34b-49bb-89a8-62b7dad1bc25","created":"2024-08-17T02:21:57.891389+0000","modified":"2024-08-17T02:25:31.834848+0000","last_up_change":"2024-08-17T02:22:08.924546+0000","last_in_change":"2024-08-17T02:21:59.938028+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:22:10.143970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000188090.meta","create_time":"2024-08-17T02:23:21.239436+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000188090"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000188090.data","create_time":"2024-08-17T02:23:21.337636+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000188090"}}}],"osds":[{"osd":0,"uuid":"606b9088-590e-4709-aa3a-b0f6e22972ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":24257},{"type":"v1","addr":"172.21.15.104:6809","nonce":24257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":24257},{"type":"v1","addr":"172.21.15.104:6811","nonce":24257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":24257},{"type":"v1","addr":"172.21.15.104:6815","nonce":24257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":24257},{"type":"v1","addr":"172.21.15.104:6813","nonce":24257}]},"public_addr":"172.21.15.104:6809/24257","cluster_addr":"172.21.15.104:6811/24257","heartbeat_back_addr":"172.21.15.104:6815/24257","heartbeat_front_addr":"172.21.15.104:6813/24257","state":["exists","up"]},{"osd":1,"uuid":"9bc6a909-0c2f-4889-afe7-4a47f89b0f64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":24256},{"type":"v1","addr":"172.21.15.104:6825","nonce":24256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":24256},{"type":"v1","addr":"172.21.15.104:6827","nonce":24256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":24256},{"type":"v1","addr":"172.21.15.104:6831","nonce":24256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":24256},{"type":"v1","addr":"172.21.15.104:6829","nonce":24256}]},"public_addr":"172.21.15.104:6825/24256","cluster_addr":"172.21.15.104:6827/24256","heartbeat_back_addr":"172.21.15.104:6831/24256","heartbeat_front_addr":"172.21.15.104:6829/24256","state":["exists","up"]},{"osd":2,"uuid":"23da31d5-aefb-4edb-b79d-fa05e1becef7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":24255},{"type":"v1","addr":"172.21.15.104:6817","nonce":24255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":24255},{"type":"v1","addr":"172.21.15.104:6819","nonce":24255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":24255},{"type":"v1","addr":"172.21.15.104:6823","nonce":24255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":24255},{"type":"v1","addr":"172.21.15.104:6821","nonce":24255}]},"public_addr":"172.21.15.104:6817/24255","cluster_addr":"172.21.15.104:6819/24255","heartbeat_back_addr":"172.21.15.104:6823/24255","heartbeat_front_addr":"172.21.15.104:6821/24255","state":["exists","up"]},{"osd":3,"uuid":"6e4a5ec2-b415-45ef-8381-61a59eb65224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":24254},{"type":"v1","addr":"172.21.15.104:6801","nonce":24254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":24254},{"type":"v1","addr":"172.21.15.104:6803","nonce":24254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":24254},{"type":"v1","addr":"172.21.15.104:6807","nonce":24254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":24254},{"type":"v1","addr":"172.21.15.104:6805","nonce":24254}]},"public_addr":"172.21.15.104:6801/24254","cluster_addr":"172.21.15.104:6803/24254","heartbeat_back_addr":"172.21.15.104:6807/24254","heartbeat_front_addr":"172.21.15.104:6805/24254","state":["exists","up"]},{"osd":4,"uuid":"8d5bea2d-9039-4013-8c99-2c046c5b8a17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":24421},{"type":"v1","addr":"172.21.15.117:6804","nonce":24421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":24421},{"type":"v1","addr":"172.21.15.117:6809","nonce":24421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":24421},{"type":"v1","addr":"172.21.15.117:6815","nonce":24421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":24421},{"type":"v1","addr":"172.21.15.117:6813","nonce":24421}]},"public_addr":"172.21.15.117:6804/24421","cluster_addr":"172.21.15.117:6809/24421","heartbeat_back_addr":"172.21.15.117:6815/24421","heartbeat_front_addr":"172.21.15.117:6813/24421","state":["exists","up"]},{"osd":5,"uuid":"de8b36fc-121c-4f05-8f5b-28f513d9f21f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":24422},{"type":"v1","addr":"172.21.15.117:6817","nonce":24422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":24422},{"type":"v1","addr":"172.21.15.117:6819","nonce":24422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":24422},{"type":"v1","addr":"172.21.15.117:6823","nonce":24422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":24422},{"type":"v1","addr":"172.21.15.117:6821","nonce":24422}]},"public_addr":"172.21.15.117:6817/24422","cluster_addr":"172.21.15.117:6819/24422","heartbeat_back_addr":"172.21.15.117:6823/24422","heartbeat_front_addr":"172.21.15.117:6821/24422","state":["exists","up"]},{"osd":6,"uuid":"6a87f09f-7bf7-4f7a-be87-530ac1ff8ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":24420},{"type":"v1","addr":"172.21.15.117:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6803","nonce":24420},{"type":"v1","addr":"172.21.15.117:6805","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":24420},{"type":"v1","addr":"172.21.15.117:6811","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":24420},{"type":"v1","addr":"172.21.15.117:6808","nonce":24420}]},"public_addr":"172.21.15.117:6801/24420","cluster_addr":"172.21.15.117:6805/24420","heartbeat_back_addr":"172.21.15.117:6811/24420","heartbeat_front_addr":"172.21.15.117:6808/24420","state":["exists","up"]},{"osd":7,"uuid":"e31d8041-1aa1-4b5d-83b3-0a373426dd9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":24423},{"type":"v1","addr":"172.21.15.117:6825","nonce":24423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":24423},{"type":"v1","addr":"172.21.15.117:6827","nonce":24423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":24423},{"type":"v1","addr":"172.21.15.117:6831","nonce":24423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":24423},{"type":"v1","addr":"172.21.15.117:6829","nonce":24423}]},"public_addr":"172.21.15.117:6825/24423","cluster_addr":"172.21.15.117:6827/24423","heartbeat_back_addr":"172.21.15.117:6831/24423","heartbeat_front_addr":"172.21.15.117:6829/24423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.220874+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.210039+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.434762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.247206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.184316+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.306325+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.035719+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.400303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.104:6835/38993094":"2024-08-18T02:25:28.820410+0000","172.21.15.104:6834/38993094":"2024-08-18T02:25:28.820410+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:34.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.696+0000 7fc1bcd6f700 1 -- 172.21.15.104:0/3971815179 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fc1a4060860 msgr2=0x7fc1a4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:34.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.696+0000 7fc1bcd6f700 1 --2- 172.21.15.104:0/3971815179 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fc1a4060860 0x7fc1a4062d10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8007e40 tx=0x7fc1a8009040 comp rx=0 tx=0).stop 2024-08-17T02:25:34.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.696+0000 7fc1bcd6f700 1 -- 172.21.15.104:0/3971815179 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1a0004d50 msgr2=0x7fc1b816de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:34.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.696+0000 7fc1bcd6f700 1 --2- 172.21.15.104:0/3971815179 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1a0004d50 0x7fc1b816de40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac006ac0 tx=0x7fc1ac0091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:34.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.696+0000 7fc1bcd6f700 1 -- 172.21.15.104:0/3971815179 shutdown_connections 2024-08-17T02:25:34.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.696+0000 7fc1bcd6f700 1 --2- 172.21.15.104:0/3971815179 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fc1a4060860 0x7fc1a4062d10 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:34.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.696+0000 7fc1bcd6f700 1 --2- 172.21.15.104:0/3971815179 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1b80a6b60 0x7fc1b816ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:34.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.696+0000 7fc1bcd6f700 1 --2- 172.21.15.104:0/3971815179 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1b816e380 0x7fc1b80a6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:34.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.696+0000 7fc1bcd6f700 1 --2- 172.21.15.104:0/3971815179 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1a0004d50 0x7fc1b816de40 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:34.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.696+0000 7fc1bcd6f700 1 -- 172.21.15.104:0/3971815179 >> 172.21.15.104:0/3971815179 conn(0x7fc1b80678d0 msgr2=0x7fc1b815daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:34.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.696+0000 7fc1bcd6f700 1 -- 172.21.15.104:0/3971815179 shutdown_connections 2024-08-17T02:25:34.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.696+0000 7fc1bcd6f700 1 -- 172.21.15.104:0/3971815179 wait complete. 2024-08-17T02:25:34.713 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail volume_0000000000188090 2024-08-17T02:25:34.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.820+0000 7f73e516a700 1 Processor -- start 2024-08-17T02:25:34.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.820+0000 7f73e516a700 1 -- start start 2024-08-17T02:25:34.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.820+0000 7f73e516a700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f73e00aecc0 0x7f73e006df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:34.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.820+0000 7f73e516a700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73e0159280 0x7f73e006e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:34.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.820+0000 7f73e516a700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e00ac000 con 0x7f73e0158eb0 2024-08-17T02:25:34.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.820+0000 7f73e516a700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73e00ab190 con 0x7f73e00aecc0 2024-08-17T02:25:34.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.820+0000 7f73e516a700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e00ad4a0 con 0x7f73e0159280 2024-08-17T02:25:34.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.824+0000 7f73e4969700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73e0159280 0x7f73e006e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:34.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.824+0000 7f73d7fff700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f73e00aecc0 0x7f73e006df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:34.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.824+0000 7f73e4969700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73e0159280 0x7f73e006e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.104:37102/0 (socket says 172.21.15.104:37102) 2024-08-17T02:25:34.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.824+0000 7f73e4969700 1 -- 172.21.15.104:0/298403734 learned_addr learned my addr 172.21.15.104:0/298403734 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:34.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.824+0000 7f73dffff700 1 --1- 172.21.15.104:0/298403734 >> v1:172.21.15.117:6789/0 conn(0x7f73e0158eb0 0x7f73e00aaa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.104:57744/0 (socket says 172.21.15.104:57744) 2024-08-17T02:25:34.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.824+0000 7f73e4969700 1 -- 172.21.15.104:0/298403734 >> v2:172.21.15.117:3300/0 conn(0x7f73e00aecc0 msgr2=0x7f73e006df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:34.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.824+0000 7f73e4969700 1 --2- 172.21.15.104:0/298403734 >> v2:172.21.15.117:3300/0 conn(0x7f73e00aecc0 0x7f73e006df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:34.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.824+0000 7f73e4969700 1 -- 172.21.15.104:0/298403734 >> v1:172.21.15.117:6789/0 conn(0x7f73e0158eb0 legacy=0x7f73e00aaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:34.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.824+0000 7f73e4969700 1 -- 172.21.15.104:0/298403734 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e00ab3f0 con 0x7f73e0159280 2024-08-17T02:25:34.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.824+0000 7f73d7fff700 1 --2- 172.21.15.104:0/298403734 >> v2:172.21.15.117:3300/0 conn(0x7f73e00aecc0 0x7f73e006df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:34.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.824+0000 7f73e4969700 1 --2- 172.21.15.104:0/298403734 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73e0159280 0x7f73e006e450 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f73d8009f20 tx=0x7f73d8009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de390e92eef6e3ed server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:34.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.824+0000 7f73df7fe700 1 -- 172.21.15.104:0/298403734 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d800e070 con 0x7f73e0159280 2024-08-17T02:25:34.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.824+0000 7f73df7fe700 1 -- 172.21.15.104:0/298403734 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d800b9d0 con 0x7f73e0159280 2024-08-17T02:25:34.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.824+0000 7f73df7fe700 1 -- 172.21.15.104:0/298403734 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d80092e0 con 0x7f73e0159280 2024-08-17T02:25:34.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.824+0000 7f73e516a700 1 -- 172.21.15.104:0/298403734 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73e0159280 msgr2=0x7f73e006e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:34.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.824+0000 7f73e516a700 1 --2- 172.21.15.104:0/298403734 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73e0159280 0x7f73e006e450 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f73d8009f20 tx=0x7f73d8009840 comp rx=0 tx=0).stop 2024-08-17T02:25:34.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.824+0000 7f73e516a700 1 -- 172.21.15.104:0/298403734 shutdown_connections 2024-08-17T02:25:34.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.824+0000 7f73e516a700 1 --2- 172.21.15.104:0/298403734 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73e0159280 0x7f73e006e450 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:34.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.824+0000 7f73e516a700 1 --2- 172.21.15.104:0/298403734 >> v2:172.21.15.117:3300/0 conn(0x7f73e00aecc0 0x7f73e006df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:34.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.824+0000 7f73e516a700 1 -- 172.21.15.104:0/298403734 >> 172.21.15.104:0/298403734 conn(0x7f73e00678d0 msgr2=0x7f73e0067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:34.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.824+0000 7f73e516a700 1 -- 172.21.15.104:0/298403734 shutdown_connections 2024-08-17T02:25:34.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.824+0000 7f73e516a700 1 -- 172.21.15.104:0/298403734 wait complete. 2024-08-17T02:25:34.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.828+0000 7f73e516a700 1 Processor -- start 2024-08-17T02:25:34.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.828+0000 7f73e516a700 1 -- start start 2024-08-17T02:25:34.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.828+0000 7f73e516a700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73e00aecc0 0x7f73e013fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:34.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.828+0000 7f73e516a700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73e0158eb0 0x7f73e015bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:34.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.828+0000 7f73e516a700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f73e0159280 0x7f73e0069ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:34.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.828+0000 7f73e516a700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e015d380 con 0x7f73e0159280 2024-08-17T02:25:34.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.828+0000 7f73e516a700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e015c770 con 0x7f73e0158eb0 2024-08-17T02:25:34.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.828+0000 7f73e516a700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e015ca50 con 0x7f73e00aecc0 2024-08-17T02:25:34.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.828+0000 7f73e4969700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f73e0159280 0x7f73e0069ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:34.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.828+0000 7f73e4969700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f73e0159280 0x7f73e0069ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33452/0 (socket says 172.21.15.104:33452) 2024-08-17T02:25:34.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.828+0000 7f73e4969700 1 -- 172.21.15.104:0/2353545431 learned_addr learned my addr 172.21.15.104:0/2353545431 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:34.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.828+0000 7f73dffff700 1 --2- 172.21.15.104:0/2353545431 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73e00aecc0 0x7f73e013fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:34.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.828+0000 7f73d7fff700 1 --2- 172.21.15.104:0/2353545431 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73e0158eb0 0x7f73e015bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:34.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.828+0000 7f73e4969700 1 -- 172.21.15.104:0/2353545431 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73e00aecc0 msgr2=0x7f73e013fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:34.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.828+0000 7f73e4969700 1 --2- 172.21.15.104:0/2353545431 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73e00aecc0 0x7f73e013fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:34.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.828+0000 7f73e4969700 1 -- 172.21.15.104:0/2353545431 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73e0158eb0 msgr2=0x7f73e015bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:34.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.828+0000 7f73e4969700 1 --2- 172.21.15.104:0/2353545431 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73e0158eb0 0x7f73e015bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:34.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.828+0000 7f73e4969700 1 -- 172.21.15.104:0/2353545431 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c8009420 con 0x7f73e0159280 2024-08-17T02:25:34.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.828+0000 7f73dffff700 1 --2- 172.21.15.104:0/2353545431 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73e00aecc0 0x7f73e013fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:34.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.828+0000 7f73d7fff700 1 --2- 172.21.15.104:0/2353545431 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73e0158eb0 0x7f73e015bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:34.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.828+0000 7f73e4969700 1 --2- 172.21.15.104:0/2353545431 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f73e0159280 0x7f73e0069ff0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f73d800b610 tx=0x7f73d8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:34.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.828+0000 7f73dcff9700 1 -- 172.21.15.104:0/2353545431 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d8008c30 con 0x7f73e0159280 2024-08-17T02:25:34.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.828+0000 7f73dcff9700 1 -- 172.21.15.104:0/2353545431 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d8008d90 con 0x7f73e0159280 2024-08-17T02:25:34.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.828+0000 7f73dcff9700 1 -- 172.21.15.104:0/2353545431 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d801c640 con 0x7f73e0159280 2024-08-17T02:25:34.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.828+0000 7f73e516a700 1 -- 172.21.15.104:0/2353545431 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73d8009ae0 con 0x7f73e0159280 2024-08-17T02:25:34.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.828+0000 7f73e516a700 1 -- 172.21.15.104:0/2353545431 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73e015d010 con 0x7f73e0159280 2024-08-17T02:25:34.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.832+0000 7f73e516a700 1 -- 172.21.15.104:0/2353545431 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73e00643a0 con 0x7f73e0159280 2024-08-17T02:25:34.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.832+0000 7f73dcff9700 1 -- 172.21.15.104:0/2353545431 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f73d8003040 con 0x7f73e0159280 2024-08-17T02:25:34.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.832+0000 7f73dcff9700 1 --2- 172.21.15.104:0/2353545431 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f73c4060890 0x7f73c4062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:34.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.832+0000 7f73dcff9700 1 -- 172.21.15.104:0/2353545431 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f73d807ecb0 con 0x7f73e0159280 2024-08-17T02:25:34.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.832+0000 7f73dffff700 1 --2- 172.21.15.104:0/2353545431 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f73c4060890 0x7f73c4062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:34.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.832+0000 7f73dffff700 1 --2- 172.21.15.104:0/2353545431 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f73c4060890 0x7f73c4062d40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f73d0007fd0 tx=0x7f73d0007e10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:34.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:34.836+0000 7f73dcff9700 1 -- 172.21.15.104:0/2353545431 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f73d804f060 con 0x7f73e0159280 2024-08-17T02:25:35.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.036+0000 7f73e516a700 1 -- 172.21.15.104:0/2353545431 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "volume_0000000000188090"} v 0) v1 -- 0x7f73e006f5f0 con 0x7f73e0159280 2024-08-17T02:25:35.040 INFO:tasks.ceph.mon.a.smithi104.stderr:2024-08-17T02:25:35.036+0000 7f0dc6781700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:25:35.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.044+0000 7f73dcff9700 1 -- 172.21.15.104:0/2353545431 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "volume_0000000000188090"}]=0 volume_0000000000188090 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v21) v1 ==== 195+0+0 (secure 0 0 0) 0x7f73d8052680 con 0x7f73e0159280 2024-08-17T02:25:35.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.048+0000 7f73e516a700 1 -- 172.21.15.104:0/2353545431 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f73c4060890 msgr2=0x7f73c4062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:35.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.048+0000 7f73e516a700 1 --2- 172.21.15.104:0/2353545431 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f73c4060890 0x7f73c4062d40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f73d0007fd0 tx=0x7f73d0007e10 comp rx=0 tx=0).stop 2024-08-17T02:25:35.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.048+0000 7f73e516a700 1 -- 172.21.15.104:0/2353545431 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f73e0159280 msgr2=0x7f73e0069ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:35.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.048+0000 7f73e516a700 1 --2- 172.21.15.104:0/2353545431 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f73e0159280 0x7f73e0069ff0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f73d800b610 tx=0x7f73d8018000 comp rx=0 tx=0).stop 2024-08-17T02:25:35.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.048+0000 7f73e516a700 1 -- 172.21.15.104:0/2353545431 shutdown_connections 2024-08-17T02:25:35.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.048+0000 7f73e516a700 1 --2- 172.21.15.104:0/2353545431 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f73c4060890 0x7f73c4062d40 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:35.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.048+0000 7f73e516a700 1 --2- 172.21.15.104:0/2353545431 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f73e0159280 0x7f73e0069ff0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:35.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.048+0000 7f73e516a700 1 --2- 172.21.15.104:0/2353545431 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73e0158eb0 0x7f73e015bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:35.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.048+0000 7f73e516a700 1 --2- 172.21.15.104:0/2353545431 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73e00aecc0 0x7f73e013fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:35.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.048+0000 7f73e516a700 1 -- 172.21.15.104:0/2353545431 >> 172.21.15.104:0/2353545431 conn(0x7f73e00678d0 msgr2=0x7f73e00a9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:35.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.048+0000 7f73e516a700 1 -- 172.21.15.104:0/2353545431 shutdown_connections 2024-08-17T02:25:35.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.048+0000 7f73e516a700 1 -- 172.21.15.104:0/2353545431 wait complete. 2024-08-17T02:25:35.054 INFO:teuthology.orchestra.run.smithi104.stderr:volume_0000000000188090 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:25:35.054 INFO:tasks.ceph.mds.c.smithi104.stderr: -3144> 2024-08-17T02:23:25.486+0000 7fbd0588f700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:25:35.067 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm volume_0000000000188090 --yes-i-really-mean-it 2024-08-17T02:25:35.079 INFO:tasks.ceph.mds.c.smithi104.stdout:starting mds.c at 2024-08-17T02:25:35.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.172+0000 7f7581210700 1 Processor -- start 2024-08-17T02:25:35.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.172+0000 7f7581210700 1 -- start start 2024-08-17T02:25:35.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.172+0000 7f7581210700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f757c1501e0 0x7f757c0ab7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:35.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.172+0000 7f7581210700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f757c068db0 0x7f757c0af5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:35.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.172+0000 7f7581210700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f757c157160 con 0x7f757c0abd30 2024-08-17T02:25:35.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.172+0000 7f7581210700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f757c156550 con 0x7f757c068db0 2024-08-17T02:25:35.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.172+0000 7f7581210700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f757c156830 con 0x7f757c1501e0 2024-08-17T02:25:35.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.176+0000 7f7580a0f700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f757c068db0 0x7f757c0af5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:35.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.176+0000 7f757b7fe700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f757c0abd30 0x7f757c0686a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:39620/0 (socket says 172.21.15.104:39620) 2024-08-17T02:25:35.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.176+0000 7f757b7fe700 1 -- 172.21.15.104:0/8323097 learned_addr learned my addr 172.21.15.104:0/8323097 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:25:35.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.176+0000 7f757bfff700 1 --2- 172.21.15.104:0/8323097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f757c1501e0 0x7f757c0ab7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:35.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.176+0000 7f7580a0f700 1 -- 172.21.15.104:0/8323097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f757c1501e0 msgr2=0x7f757c0ab7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:35.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.176+0000 7f7580a0f700 1 --2- 172.21.15.104:0/8323097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f757c1501e0 0x7f757c0ab7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:35.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.176+0000 7f7580a0f700 1 -- 172.21.15.104:0/8323097 >> v1:172.21.15.104:6789/0 conn(0x7f757c0abd30 legacy=0x7f757c0686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:35.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.176+0000 7f7580a0f700 1 -- 172.21.15.104:0/8323097 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f757c156b10 con 0x7f757c068db0 2024-08-17T02:25:35.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.176+0000 7f757bfff700 1 --2- 172.21.15.104:0/8323097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f757c1501e0 0x7f757c0ab7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:35.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.176+0000 7f7580a0f700 1 --2- 172.21.15.104:0/8323097 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f757c068db0 0x7f757c0af5b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f7574009e60 tx=0x7f7574009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b32d5a380051b5f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:35.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.176+0000 7f757affd700 1 -- 172.21.15.104:0/8323097 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757400e070 con 0x7f757c068db0 2024-08-17T02:25:35.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.176+0000 7f757affd700 1 -- 172.21.15.104:0/8323097 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757400bb60 con 0x7f757c068db0 2024-08-17T02:25:35.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.176+0000 7f757affd700 1 -- 172.21.15.104:0/8323097 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7574012430 con 0x7f757c068db0 2024-08-17T02:25:35.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.176+0000 7f7581210700 1 -- 172.21.15.104:0/8323097 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f757c068db0 msgr2=0x7f757c0af5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:35.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.176+0000 7f7581210700 1 --2- 172.21.15.104:0/8323097 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f757c068db0 0x7f757c0af5b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f7574009e60 tx=0x7f7574009780 comp rx=0 tx=0).stop 2024-08-17T02:25:35.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.176+0000 7f7581210700 1 -- 172.21.15.104:0/8323097 shutdown_connections 2024-08-17T02:25:35.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.176+0000 7f7581210700 1 --2- 172.21.15.104:0/8323097 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f757c068db0 0x7f757c0af5b0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:35.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.176+0000 7f7581210700 1 --2- 172.21.15.104:0/8323097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f757c1501e0 0x7f757c0ab7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:35.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.176+0000 7f7581210700 1 -- 172.21.15.104:0/8323097 >> 172.21.15.104:0/8323097 conn(0x7f757c06e310 msgr2=0x7f757c06b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:35.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.176+0000 7f7581210700 1 -- 172.21.15.104:0/8323097 shutdown_connections 2024-08-17T02:25:35.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.176+0000 7f7581210700 1 -- 172.21.15.104:0/8323097 wait complete. 2024-08-17T02:25:35.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.180+0000 7f7581210700 1 Processor -- start 2024-08-17T02:25:35.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.180+0000 7f7581210700 1 -- start start 2024-08-17T02:25:35.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.184+0000 7f7581210700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f757c068db0 0x7f757c14bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:35.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.184+0000 7f7581210700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f757c0abd30 0x7f757c0674e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:35.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.184+0000 7f7581210700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f757c1501e0 0x7f757c067a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:35.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.184+0000 7f7581210700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757c153400 con 0x7f757c0abd30 2024-08-17T02:25:35.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.184+0000 7f7581210700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757c165df0 con 0x7f757c1501e0 2024-08-17T02:25:35.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.184+0000 7f7581210700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f757c1581d0 con 0x7f757c068db0 2024-08-17T02:25:35.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.184+0000 7f757b7fe700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f757c0abd30 0x7f757c0674e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:35.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.184+0000 7f757b7fe700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f757c0abd30 0x7f757c0674e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33500/0 (socket says 172.21.15.104:33500) 2024-08-17T02:25:35.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.184+0000 7f757b7fe700 1 -- 172.21.15.104:0/3510577833 learned_addr learned my addr 172.21.15.104:0/3510577833 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:35.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.184+0000 7f757bfff700 1 --2- 172.21.15.104:0/3510577833 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f757c068db0 0x7f757c14bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:35.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.184+0000 7f7580a0f700 1 --2- 172.21.15.104:0/3510577833 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f757c1501e0 0x7f757c067a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:35.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.184+0000 7f757b7fe700 1 -- 172.21.15.104:0/3510577833 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f757c068db0 msgr2=0x7f757c14bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:35.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.184+0000 7f757b7fe700 1 --2- 172.21.15.104:0/3510577833 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f757c068db0 0x7f757c14bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:35.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.184+0000 7f757b7fe700 1 -- 172.21.15.104:0/3510577833 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f757c1501e0 msgr2=0x7f757c067a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:35.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.184+0000 7f757b7fe700 1 --2- 172.21.15.104:0/3510577833 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f757c1501e0 0x7f757c067a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:35.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.184+0000 7f757b7fe700 1 -- 172.21.15.104:0/3510577833 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7564009420 con 0x7f757c0abd30 2024-08-17T02:25:35.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.184+0000 7f757b7fe700 1 --2- 172.21.15.104:0/3510577833 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f757c0abd30 0x7f757c0674e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f756c00e9d0 tx=0x7f756c00c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:35.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.184+0000 7f7573fff700 1 -- 172.21.15.104:0/3510577833 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c005b30 con 0x7f757c0abd30 2024-08-17T02:25:35.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.184+0000 7f7573fff700 1 -- 172.21.15.104:0/3510577833 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f756c005c90 con 0x7f757c0abd30 2024-08-17T02:25:35.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.184+0000 7f7573fff700 1 -- 172.21.15.104:0/3510577833 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c004a80 con 0x7f757c0abd30 2024-08-17T02:25:35.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.184+0000 7f7581210700 1 -- 172.21.15.104:0/3510577833 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7574009a20 con 0x7f757c0abd30 2024-08-17T02:25:35.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.184+0000 7f7581210700 1 -- 172.21.15.104:0/3510577833 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f757c158790 con 0x7f757c0abd30 2024-08-17T02:25:35.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.184+0000 7f7573fff700 1 -- 172.21.15.104:0/3510577833 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f756c0070f0 con 0x7f757c0abd30 2024-08-17T02:25:35.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.184+0000 7f7581210700 1 -- 172.21.15.104:0/3510577833 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f757c166010 con 0x7f757c0abd30 2024-08-17T02:25:35.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.184+0000 7f7573fff700 1 --2- 172.21.15.104:0/3510577833 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f755c060860 0x7f755c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:35.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.184+0000 7f7573fff700 1 -- 172.21.15.104:0/3510577833 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5923+0+0 (secure 0 0 0) 0x7f756c07f010 con 0x7f757c0abd30 2024-08-17T02:25:35.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.188+0000 7f757bfff700 1 --2- 172.21.15.104:0/3510577833 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f755c060860 0x7f755c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:35.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.188+0000 7f757bfff700 1 --2- 172.21.15.104:0/3510577833 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f755c060860 0x7f755c062d10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f75640093f0 tx=0x7f7564008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:35.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.192+0000 7f7573fff700 1 -- 172.21.15.104:0/3510577833 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f757c166010 con 0x7f757c0abd30 2024-08-17T02:25:35.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:35.396+0000 7f7581210700 1 -- 172.21.15.104:0/3510577833 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "volume_0000000000188090", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f757c166010 con 0x7f757c0abd30 2024-08-17T02:25:36.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.044+0000 7f7573fff700 1 -- 172.21.15.104:0/3510577833 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "volume_0000000000188090", "yes_i_really_mean_it": true}]=0 v22) v1 ==== 121+0+0 (secure 0 0 0) 0x7f757c166010 con 0x7f757c0abd30 2024-08-17T02:25:36.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.052+0000 7f7581210700 1 -- 172.21.15.104:0/3510577833 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f755c060860 msgr2=0x7f755c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:36.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.052+0000 7f7581210700 1 --2- 172.21.15.104:0/3510577833 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f755c060860 0x7f755c062d10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f75640093f0 tx=0x7f7564008040 comp rx=0 tx=0).stop 2024-08-17T02:25:36.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.052+0000 7f7581210700 1 -- 172.21.15.104:0/3510577833 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f757c0abd30 msgr2=0x7f757c0674e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:36.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.052+0000 7f7581210700 1 --2- 172.21.15.104:0/3510577833 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f757c0abd30 0x7f757c0674e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f756c00e9d0 tx=0x7f756c00c270 comp rx=0 tx=0).stop 2024-08-17T02:25:36.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.052+0000 7f7581210700 1 -- 172.21.15.104:0/3510577833 shutdown_connections 2024-08-17T02:25:36.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.052+0000 7f7581210700 1 --2- 172.21.15.104:0/3510577833 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f755c060860 0x7f755c062d10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.052+0000 7f7581210700 1 --2- 172.21.15.104:0/3510577833 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f757c1501e0 0x7f757c067a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.052+0000 7f7581210700 1 --2- 172.21.15.104:0/3510577833 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f757c0abd30 0x7f757c0674e0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.052+0000 7f7581210700 1 --2- 172.21.15.104:0/3510577833 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f757c068db0 0x7f757c14bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.052+0000 7f7581210700 1 -- 172.21.15.104:0/3510577833 >> 172.21.15.104:0/3510577833 conn(0x7f757c06e310 msgr2=0x7f757c14edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:36.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.052+0000 7f7581210700 1 -- 172.21.15.104:0/3510577833 shutdown_connections 2024-08-17T02:25:36.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.052+0000 7f7581210700 1 -- 172.21.15.104:0/3510577833 wait complete. 2024-08-17T02:25:36.071 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000188090.meta cephfs.volume_0000000000188090.meta --yes-i-really-really-mean-it 2024-08-17T02:25:36.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.184+0000 7f56e5d3c700 1 Processor -- start 2024-08-17T02:25:36.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.184+0000 7f56e5d3c700 1 -- start start 2024-08-17T02:25:36.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.184+0000 7f56e5d3c700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56e0159010 0x7f56e0068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:36.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.184+0000 7f56e5d3c700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f56e01593e0 0x7f56e00ad660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:36.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.184+0000 7f56e5d3c700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f56e0069220 0x7f56e00adba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:36.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.184+0000 7f56e5d3c700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56e00b2f40 con 0x7f56e0069220 2024-08-17T02:25:36.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.184+0000 7f56e5d3c700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56e0069790 con 0x7f56e01593e0 2024-08-17T02:25:36.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.184+0000 7f56e5d3c700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e0069a50 con 0x7f56e0159010 2024-08-17T02:25:36.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.184+0000 7f56e553b700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f56e0069220 0x7f56e00adba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:36.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.184+0000 7f56e553b700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f56e0069220 0x7f56e00adba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33506/0 (socket says 172.21.15.104:33506) 2024-08-17T02:25:36.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.184+0000 7f56e553b700 1 -- 172.21.15.104:0/1990921126 learned_addr learned my addr 172.21.15.104:0/1990921126 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:36.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.184+0000 7f56e4d3a700 1 --2- 172.21.15.104:0/1990921126 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56e0159010 0x7f56e0068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:36.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.184+0000 7f56dffff700 1 --2- 172.21.15.104:0/1990921126 >> v2:172.21.15.117:3300/0 conn(0x7f56e01593e0 0x7f56e00ad660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:36.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.184+0000 7f56e553b700 1 -- 172.21.15.104:0/1990921126 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56e0159010 msgr2=0x7f56e0068ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:36.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.184+0000 7f56e553b700 1 --2- 172.21.15.104:0/1990921126 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56e0159010 0x7f56e0068ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.184+0000 7f56e553b700 1 -- 172.21.15.104:0/1990921126 >> v2:172.21.15.117:3300/0 conn(0x7f56e01593e0 msgr2=0x7f56e00ad660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:36.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.184+0000 7f56e553b700 1 --2- 172.21.15.104:0/1990921126 >> v2:172.21.15.117:3300/0 conn(0x7f56e01593e0 0x7f56e00ad660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.184+0000 7f56e553b700 1 -- 172.21.15.104:0/1990921126 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e0069d30 con 0x7f56e0069220 2024-08-17T02:25:36.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.184+0000 7f56e553b700 1 --2- 172.21.15.104:0/1990921126 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56e0069220 0x7f56e00adba0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f56e0067de0 tx=0x7f56d8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30e82077ebb78027 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:36.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.184+0000 7f56df7fe700 1 -- 172.21.15.104:0/1990921126 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d800e070 con 0x7f56e0069220 2024-08-17T02:25:36.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.184+0000 7f56df7fe700 1 -- 172.21.15.104:0/1990921126 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d800ba50 con 0x7f56e0069220 2024-08-17T02:25:36.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.184+0000 7f56df7fe700 1 -- 172.21.15.104:0/1990921126 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d80092e0 con 0x7f56e0069220 2024-08-17T02:25:36.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.184+0000 7f56e5d3c700 1 -- 172.21.15.104:0/1990921126 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56e0069220 msgr2=0x7f56e00adba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:36.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.184+0000 7f56e5d3c700 1 --2- 172.21.15.104:0/1990921126 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56e0069220 0x7f56e00adba0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f56e0067de0 tx=0x7f56d8009840 comp rx=0 tx=0).stop 2024-08-17T02:25:36.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.184+0000 7f56e5d3c700 1 -- 172.21.15.104:0/1990921126 shutdown_connections 2024-08-17T02:25:36.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.184+0000 7f56e5d3c700 1 --2- 172.21.15.104:0/1990921126 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56e0069220 0x7f56e00adba0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.184+0000 7f56e5d3c700 1 --2- 172.21.15.104:0/1990921126 >> v2:172.21.15.117:3300/0 conn(0x7f56e01593e0 0x7f56e00ad660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.184+0000 7f56e5d3c700 1 --2- 172.21.15.104:0/1990921126 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56e0159010 0x7f56e0068ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.184+0000 7f56e5d3c700 1 -- 172.21.15.104:0/1990921126 >> 172.21.15.104:0/1990921126 conn(0x7f56e0099410 msgr2=0x7f56e0067590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:36.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.184+0000 7f56e5d3c700 1 -- 172.21.15.104:0/1990921126 shutdown_connections 2024-08-17T02:25:36.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.184+0000 7f56e5d3c700 1 -- 172.21.15.104:0/1990921126 wait complete. 2024-08-17T02:25:36.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.188+0000 7f56e5d3c700 1 Processor -- start 2024-08-17T02:25:36.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.188+0000 7f56e5d3c700 1 -- start start 2024-08-17T02:25:36.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.188+0000 7f56e5d3c700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56e0069220 0x7f56e0141740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:36.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.188+0000 7f56e5d3c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56e0159010 0x7f56e0156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:36.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.188+0000 7f56e5d3c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56e01593e0 0x7f56e00af600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:36.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.188+0000 7f56e5d3c700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e0155300 con 0x7f56e01593e0 2024-08-17T02:25:36.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.188+0000 7f56e5d3c700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e01560f0 con 0x7f56e0159010 2024-08-17T02:25:36.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.188+0000 7f56e5d3c700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e01554e0 con 0x7f56e0069220 2024-08-17T02:25:36.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.188+0000 7f56e553b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56e01593e0 0x7f56e00af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:36.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.188+0000 7f56e553b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56e01593e0 0x7f56e00af600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33514/0 (socket says 172.21.15.104:33514) 2024-08-17T02:25:36.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.188+0000 7f56e553b700 1 -- 172.21.15.104:0/3311523972 learned_addr learned my addr 172.21.15.104:0/3311523972 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:36.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.188+0000 7f56dffff700 1 --2- 172.21.15.104:0/3311523972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56e0159010 0x7f56e0156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:36.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.188+0000 7f56e4d3a700 1 --2- 172.21.15.104:0/3311523972 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56e0069220 0x7f56e0141740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:36.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.188+0000 7f56e553b700 1 -- 172.21.15.104:0/3311523972 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56e0069220 msgr2=0x7f56e0141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:36.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.188+0000 7f56e553b700 1 --2- 172.21.15.104:0/3311523972 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56e0069220 0x7f56e0141740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.188+0000 7f56e553b700 1 -- 172.21.15.104:0/3311523972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56e0159010 msgr2=0x7f56e0156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:36.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.188+0000 7f56e553b700 1 --2- 172.21.15.104:0/3311523972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56e0159010 0x7f56e0156580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.188+0000 7f56e553b700 1 -- 172.21.15.104:0/3311523972 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d8009ae0 con 0x7f56e01593e0 2024-08-17T02:25:36.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.188+0000 7f56e553b700 1 --2- 172.21.15.104:0/3311523972 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56e01593e0 0x7f56e00af600 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f56d8009fd0 tx=0x7f56d8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:36.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.188+0000 7f56dcff9700 1 -- 172.21.15.104:0/3311523972 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d80032f0 con 0x7f56e01593e0 2024-08-17T02:25:36.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.188+0000 7f56dcff9700 1 -- 172.21.15.104:0/3311523972 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d8008e70 con 0x7f56e01593e0 2024-08-17T02:25:36.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.188+0000 7f56e5d3c700 1 -- 172.21.15.104:0/3311523972 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56e01557c0 con 0x7f56e01593e0 2024-08-17T02:25:36.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.188+0000 7f56dcff9700 1 -- 172.21.15.104:0/3311523972 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d8026670 con 0x7f56e01593e0 2024-08-17T02:25:36.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.188+0000 7f56e5d3c700 1 -- 172.21.15.104:0/3311523972 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56e0155d80 con 0x7f56e01593e0 2024-08-17T02:25:36.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.192+0000 7f56e5d3c700 1 -- 172.21.15.104:0/3311523972 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56e0156280 con 0x7f56e01593e0 2024-08-17T02:25:36.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.192+0000 7f56dcff9700 1 -- 172.21.15.104:0/3311523972 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f56d8003040 con 0x7f56e01593e0 2024-08-17T02:25:36.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.192+0000 7f56dcff9700 1 --2- 172.21.15.104:0/3311523972 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f56cc060860 0x7f56cc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:36.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.192+0000 7f56dcff9700 1 -- 172.21.15.104:0/3311523972 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5923+0+0 (secure 0 0 0) 0x7f56d807eb20 con 0x7f56e01593e0 2024-08-17T02:25:36.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.192+0000 7f56e4d3a700 1 --2- 172.21.15.104:0/3311523972 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f56cc060860 0x7f56cc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:36.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.192+0000 7f56e4d3a700 1 --2- 172.21.15.104:0/3311523972 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f56cc060860 0x7f56cc062d10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f56d4006fd0 tx=0x7f56d4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:36.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.200+0000 7f56dcff9700 1 -- 172.21.15.104:0/3311523972 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f56d804edf0 con 0x7f56e01593e0 2024-08-17T02:25:36.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:36.364+0000 7f56e5d3c700 1 -- 172.21.15.104:0/3311523972 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000188090.meta", "pool2": "cephfs.volume_0000000000188090.meta", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f56e00644b0 con 0x7f56e01593e0 2024-08-17T02:25:37.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.056+0000 7f56dcff9700 1 -- 172.21.15.104:0/3311523972 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000188090.meta", "pool2": "cephfs.volume_0000000000188090.meta", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000188090.meta' removed v46) v1 ==== 241+0+0 (secure 0 0 0) 0x7f56d8052410 con 0x7f56e01593e0 2024-08-17T02:25:37.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.060+0000 7f56e5d3c700 1 -- 172.21.15.104:0/3311523972 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f56cc060860 msgr2=0x7f56cc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:37.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.060+0000 7f56e5d3c700 1 --2- 172.21.15.104:0/3311523972 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f56cc060860 0x7f56cc062d10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f56d4006fd0 tx=0x7f56d4008040 comp rx=0 tx=0).stop 2024-08-17T02:25:37.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.060+0000 7f56e5d3c700 1 -- 172.21.15.104:0/3311523972 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56e01593e0 msgr2=0x7f56e00af600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:37.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.060+0000 7f56e5d3c700 1 --2- 172.21.15.104:0/3311523972 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56e01593e0 0x7f56e00af600 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f56d8009fd0 tx=0x7f56d8018000 comp rx=0 tx=0).stop 2024-08-17T02:25:37.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.060+0000 7f56e5d3c700 1 -- 172.21.15.104:0/3311523972 shutdown_connections 2024-08-17T02:25:37.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.060+0000 7f56e5d3c700 1 --2- 172.21.15.104:0/3311523972 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f56cc060860 0x7f56cc062d10 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.060+0000 7f56e5d3c700 1 --2- 172.21.15.104:0/3311523972 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56e01593e0 0x7f56e00af600 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.060+0000 7f56e5d3c700 1 --2- 172.21.15.104:0/3311523972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56e0159010 0x7f56e0156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.060+0000 7f56e5d3c700 1 --2- 172.21.15.104:0/3311523972 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56e0069220 0x7f56e0141740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.060+0000 7f56e5d3c700 1 -- 172.21.15.104:0/3311523972 >> 172.21.15.104:0/3311523972 conn(0x7f56e0099410 msgr2=0x7f56e0154510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:37.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.060+0000 7f56e5d3c700 1 -- 172.21.15.104:0/3311523972 shutdown_connections 2024-08-17T02:25:37.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.060+0000 7f56e5d3c700 1 -- 172.21.15.104:0/3311523972 wait complete. 2024-08-17T02:25:37.065 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs.volume_0000000000188090.meta' removed 2024-08-17T02:25:37.080 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000188090.data cephfs.volume_0000000000188090.data --yes-i-really-really-mean-it 2024-08-17T02:25:37.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.196+0000 7f322928e700 1 Processor -- start 2024-08-17T02:25:37.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.196+0000 7f322928e700 1 -- start start 2024-08-17T02:25:37.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.196+0000 7f322928e700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f32240a8fd0 0x7f32240a93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:37.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.196+0000 7f322928e700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f32240a9fc0 0x7f32240aaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:37.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.196+0000 7f322928e700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32240c9f50 con 0x7f32240acd90 2024-08-17T02:25:37.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.196+0000 7f322928e700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32240a9c30 con 0x7f32240a8fd0 2024-08-17T02:25:37.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.196+0000 7f322928e700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32240ab3f0 con 0x7f32240a9fc0 2024-08-17T02:25:37.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.196+0000 7f3222ffd700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f32240a8fd0 0x7f32240a93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:37.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.196+0000 7f3222ffd700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f32240a8fd0 0x7f32240a93a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53724/0 (socket says 172.21.15.104:53724) 2024-08-17T02:25:37.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.196+0000 7f3222ffd700 1 -- 172.21.15.104:0/749049024 learned_addr learned my addr 172.21.15.104:0/749049024 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:37.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.196+0000 7f32227fc700 1 --2- 172.21.15.104:0/749049024 >> v2:172.21.15.117:3300/0 conn(0x7f32240a9fc0 0x7f32240aaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:37.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.196+0000 7f3222ffd700 1 -- 172.21.15.104:0/749049024 >> v2:172.21.15.117:3300/0 conn(0x7f32240a9fc0 msgr2=0x7f32240aaeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:37.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.196+0000 7f3222ffd700 1 --2- 172.21.15.104:0/749049024 >> v2:172.21.15.117:3300/0 conn(0x7f32240a9fc0 0x7f32240aaeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.196+0000 7f3222ffd700 1 -- 172.21.15.104:0/749049024 >> v1:172.21.15.117:6789/0 conn(0x7f32240acd90 legacy=0x7f3224156c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:37.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.196+0000 7f3222ffd700 1 -- 172.21.15.104:0/749049024 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32240ab8f0 con 0x7f32240a8fd0 2024-08-17T02:25:37.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.196+0000 7f3222ffd700 1 --2- 172.21.15.104:0/749049024 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f32240a8fd0 0x7f32240a93a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3224068e30 tx=0x7f3218009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aebdaf1c9372f42b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:37.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.196+0000 7f3221ffb700 1 -- 172.21.15.104:0/749049024 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3218009ea0 con 0x7f32240a8fd0 2024-08-17T02:25:37.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.196+0000 7f3221ffb700 1 -- 172.21.15.104:0/749049024 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f321800b820 con 0x7f32240a8fd0 2024-08-17T02:25:37.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.196+0000 7f3221ffb700 1 -- 172.21.15.104:0/749049024 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321800bbc0 con 0x7f32240a8fd0 2024-08-17T02:25:37.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.200+0000 7f322928e700 1 -- 172.21.15.104:0/749049024 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f32240a8fd0 msgr2=0x7f32240a93a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:37.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.200+0000 7f322928e700 1 --2- 172.21.15.104:0/749049024 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f32240a8fd0 0x7f32240a93a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3224068e30 tx=0x7f3218009250 comp rx=0 tx=0).stop 2024-08-17T02:25:37.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.200+0000 7f322928e700 1 -- 172.21.15.104:0/749049024 shutdown_connections 2024-08-17T02:25:37.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.200+0000 7f322928e700 1 --2- 172.21.15.104:0/749049024 >> v2:172.21.15.117:3300/0 conn(0x7f32240a9fc0 0x7f32240aaeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.200+0000 7f322928e700 1 --2- 172.21.15.104:0/749049024 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f32240a8fd0 0x7f32240a93a0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.200+0000 7f322928e700 1 -- 172.21.15.104:0/749049024 >> 172.21.15.104:0/749049024 conn(0x7f32240c93a0 msgr2=0x7f3224066e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:37.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.200+0000 7f322928e700 1 -- 172.21.15.104:0/749049024 shutdown_connections 2024-08-17T02:25:37.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.200+0000 7f322928e700 1 -- 172.21.15.104:0/749049024 wait complete. 2024-08-17T02:25:37.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.200+0000 7f322928e700 1 Processor -- start 2024-08-17T02:25:37.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.200+0000 7f322928e700 1 -- start start 2024-08-17T02:25:37.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.204+0000 7f322928e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f32240a8fd0 0x7f32241529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:37.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.204+0000 7f322928e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32240a9fc0 0x7f3224096a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:37.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.204+0000 7f322928e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32240acd90 0x7f3224096fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:37.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.204+0000 7f322928e700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322415de70 con 0x7f32240a8fd0 2024-08-17T02:25:37.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.204+0000 7f322928e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32240975f0 con 0x7f32240acd90 2024-08-17T02:25:37.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.204+0000 7f322928e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32240978d0 con 0x7f32240a9fc0 2024-08-17T02:25:37.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.204+0000 7f3222ffd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f32240a8fd0 0x7f32241529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:37.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.204+0000 7f3222ffd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f32240a8fd0 0x7f32241529b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53740/0 (socket says 172.21.15.104:53740) 2024-08-17T02:25:37.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.204+0000 7f3222ffd700 1 -- 172.21.15.104:0/781232765 learned_addr learned my addr 172.21.15.104:0/781232765 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:37.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.204+0000 7f32227fc700 1 --2- 172.21.15.104:0/781232765 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32240a9fc0 0x7f3224096a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:37.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.204+0000 7f32237fe700 1 --2- 172.21.15.104:0/781232765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32240acd90 0x7f3224096fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:37.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.204+0000 7f3222ffd700 1 -- 172.21.15.104:0/781232765 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32240a9fc0 msgr2=0x7f3224096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:37.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.204+0000 7f3222ffd700 1 --2- 172.21.15.104:0/781232765 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32240a9fc0 0x7f3224096a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.204+0000 7f3222ffd700 1 -- 172.21.15.104:0/781232765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32240acd90 msgr2=0x7f3224096fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:37.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.204+0000 7f3222ffd700 1 --2- 172.21.15.104:0/781232765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32240acd90 0x7f3224096fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.204+0000 7f3222ffd700 1 -- 172.21.15.104:0/781232765 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32180094f0 con 0x7f32240a8fd0 2024-08-17T02:25:37.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.204+0000 7f32237fe700 1 --2- 172.21.15.104:0/781232765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32240acd90 0x7f3224096fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:37.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.204+0000 7f3222ffd700 1 --2- 172.21.15.104:0/781232765 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f32240a8fd0 0x7f32241529b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f32180094c0 tx=0x7f3218017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:37.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.204+0000 7f320affd700 1 -- 172.21.15.104:0/781232765 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321800bba0 con 0x7f32240a8fd0 2024-08-17T02:25:37.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.204+0000 7f320affd700 1 -- 172.21.15.104:0/781232765 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3218011420 con 0x7f32240a8fd0 2024-08-17T02:25:37.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.204+0000 7f322928e700 1 -- 172.21.15.104:0/781232765 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3224097bb0 con 0x7f32240a8fd0 2024-08-17T02:25:37.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.204+0000 7f320affd700 1 -- 172.21.15.104:0/781232765 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32180117e0 con 0x7f32240a8fd0 2024-08-17T02:25:37.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.204+0000 7f322928e700 1 -- 172.21.15.104:0/781232765 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32240b0230 con 0x7f32240a8fd0 2024-08-17T02:25:37.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.208+0000 7f322928e700 1 -- 172.21.15.104:0/781232765 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32240b0450 con 0x7f32240a8fd0 2024-08-17T02:25:37.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.208+0000 7f320affd700 1 -- 172.21.15.104:0/781232765 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f3218011bd0 con 0x7f32240a8fd0 2024-08-17T02:25:37.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.208+0000 7f320affd700 1 --2- 172.21.15.104:0/781232765 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3210060860 0x7f3210062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:37.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.208+0000 7f320affd700 1 -- 172.21.15.104:0/781232765 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5448+0+0 (secure 0 0 0) 0x7f321807e470 con 0x7f32240a8fd0 2024-08-17T02:25:37.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.208+0000 7f32227fc700 1 --2- 172.21.15.104:0/781232765 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3210060860 0x7f3210062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:37.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.208+0000 7f32227fc700 1 --2- 172.21.15.104:0/781232765 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3210060860 0x7f3210062d10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f32240999f0 tx=0x7f321400b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:37.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.216+0000 7f320affd700 1 -- 172.21.15.104:0/781232765 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f32240b0450 con 0x7f32240a8fd0 2024-08-17T02:25:37.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:37.376+0000 7f322928e700 1 -- 172.21.15.104:0/781232765 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000188090.data", "pool2": "cephfs.volume_0000000000188090.data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f32240b0420 con 0x7f32240a8fd0 2024-08-17T02:25:38.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.056+0000 7f320affd700 1 -- 172.21.15.104:0/781232765 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000188090.data", "pool2": "cephfs.volume_0000000000188090.data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000188090.data' removed v47) v1 ==== 241+0+0 (secure 0 0 0) 0x7f3218052450 con 0x7f32240a8fd0 2024-08-17T02:25:38.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.064+0000 7f322928e700 1 -- 172.21.15.104:0/781232765 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3210060860 msgr2=0x7f3210062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.064+0000 7f322928e700 1 --2- 172.21.15.104:0/781232765 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3210060860 0x7f3210062d10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f32240999f0 tx=0x7f321400b040 comp rx=0 tx=0).stop 2024-08-17T02:25:38.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.064+0000 7f322928e700 1 -- 172.21.15.104:0/781232765 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f32240a8fd0 msgr2=0x7f32241529b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.064+0000 7f322928e700 1 --2- 172.21.15.104:0/781232765 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f32240a8fd0 0x7f32241529b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f32180094c0 tx=0x7f3218017000 comp rx=0 tx=0).stop 2024-08-17T02:25:38.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.064+0000 7f322928e700 1 -- 172.21.15.104:0/781232765 shutdown_connections 2024-08-17T02:25:38.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.064+0000 7f322928e700 1 --2- 172.21.15.104:0/781232765 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3210060860 0x7f3210062d10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.064+0000 7f322928e700 1 --2- 172.21.15.104:0/781232765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32240acd90 0x7f3224096fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.064+0000 7f322928e700 1 --2- 172.21.15.104:0/781232765 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32240a9fc0 0x7f3224096a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.064+0000 7f322928e700 1 --2- 172.21.15.104:0/781232765 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f32240a8fd0 0x7f32241529b0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.064+0000 7f322928e700 1 -- 172.21.15.104:0/781232765 >> 172.21.15.104:0/781232765 conn(0x7f32240c93a0 msgr2=0x7f322415b110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:38.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.064+0000 7f322928e700 1 -- 172.21.15.104:0/781232765 shutdown_connections 2024-08-17T02:25:38.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.064+0000 7f322928e700 1 -- 172.21.15.104:0/781232765 wait complete. 2024-08-17T02:25:38.068 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs.volume_0000000000188090.data' removed 2024-08-17T02:25:38.080 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-08-17T02:25:38.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.188+0000 7f34731f1700 1 Processor -- start 2024-08-17T02:25:38.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.188+0000 7f34731f1700 1 -- start start 2024-08-17T02:25:38.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.192+0000 7f34731f1700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f346c156cf0 0x7f346c1570c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.192+0000 7f34731f1700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f346c0ae9e0 0x7f346c068af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.192+0000 7f34731f1700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f346c0b23d0 con 0x7f346c0686a0 2024-08-17T02:25:38.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.192+0000 7f34731f1700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f346c0cc020 con 0x7f346c0ae9e0 2024-08-17T02:25:38.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.192+0000 7f34731f1700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f346c0b1850 con 0x7f346c156cf0 2024-08-17T02:25:38.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.192+0000 7f34729f0700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f346c0ae9e0 0x7f346c068af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.192+0000 7f34719ee700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f346c0686a0 0x7f346c0ae2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:43518/0 (socket says 172.21.15.104:43518) 2024-08-17T02:25:38.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.192+0000 7f34719ee700 1 -- 172.21.15.104:0/1474896834 learned_addr learned my addr 172.21.15.104:0/1474896834 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:25:38.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.192+0000 7f34721ef700 1 --2- 172.21.15.104:0/1474896834 >> v2:172.21.15.117:3300/0 conn(0x7f346c156cf0 0x7f346c1570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.192+0000 7f34729f0700 1 -- 172.21.15.104:0/1474896834 >> v2:172.21.15.117:3300/0 conn(0x7f346c156cf0 msgr2=0x7f346c1570c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:38.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.192+0000 7f34729f0700 1 --2- 172.21.15.104:0/1474896834 >> v2:172.21.15.117:3300/0 conn(0x7f346c156cf0 0x7f346c1570c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.192+0000 7f34729f0700 1 -- 172.21.15.104:0/1474896834 >> v1:172.21.15.104:6789/0 conn(0x7f346c0686a0 legacy=0x7f346c0ae2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.192+0000 7f34711ed700 1 -- 172.21.15.104:0/1474896834 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2803598639 0 0) 0x7f346c0b23d0 con 0x7f346c0686a0 2024-08-17T02:25:38.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.192+0000 7f34729f0700 1 -- 172.21.15.104:0/1474896834 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f346c069030 con 0x7f346c0ae9e0 2024-08-17T02:25:38.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.192+0000 7f34729f0700 1 --2- 172.21.15.104:0/1474896834 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f346c0ae9e0 0x7f346c068af0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f346c070d40 tx=0x7f3464009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d51d8810372d315d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:38.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.192+0000 7f34711ed700 1 -- 172.21.15.104:0/1474896834 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346400e070 con 0x7f346c0ae9e0 2024-08-17T02:25:38.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.192+0000 7f34711ed700 1 -- 172.21.15.104:0/1474896834 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f346400bb60 con 0x7f346c0ae9e0 2024-08-17T02:25:38.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.192+0000 7f34711ed700 1 -- 172.21.15.104:0/1474896834 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3464012430 con 0x7f346c0ae9e0 2024-08-17T02:25:38.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.196+0000 7f34731f1700 1 -- 172.21.15.104:0/1474896834 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f346c0ae9e0 msgr2=0x7f346c068af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.196+0000 7f34731f1700 1 --2- 172.21.15.104:0/1474896834 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f346c0ae9e0 0x7f346c068af0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f346c070d40 tx=0x7f3464009780 comp rx=0 tx=0).stop 2024-08-17T02:25:38.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.196+0000 7f34731f1700 1 -- 172.21.15.104:0/1474896834 shutdown_connections 2024-08-17T02:25:38.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.196+0000 7f34731f1700 1 --2- 172.21.15.104:0/1474896834 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f346c0ae9e0 0x7f346c068af0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.196+0000 7f34731f1700 1 --2- 172.21.15.104:0/1474896834 >> v2:172.21.15.117:3300/0 conn(0x7f346c156cf0 0x7f346c1570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.196+0000 7f34731f1700 1 -- 172.21.15.104:0/1474896834 >> 172.21.15.104:0/1474896834 conn(0x7f346c06e350 msgr2=0x7f346c06b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:38.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.196+0000 7f34731f1700 1 -- 172.21.15.104:0/1474896834 shutdown_connections 2024-08-17T02:25:38.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.196+0000 7f34731f1700 1 -- 172.21.15.104:0/1474896834 wait complete. 2024-08-17T02:25:38.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.196+0000 7f34731f1700 1 Processor -- start 2024-08-17T02:25:38.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.196+0000 7f34731f1700 1 -- start start 2024-08-17T02:25:38.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.196+0000 7f34731f1700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f346c0686a0 0x7f346c151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.196+0000 7f34731f1700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f346c0ae9e0 0x7f346c158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.196+0000 7f34731f1700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f346c156cf0 0x7f346c1594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.196+0000 7f34731f1700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346c166d90 con 0x7f346c0686a0 2024-08-17T02:25:38.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.196+0000 7f34731f1700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346c154120 con 0x7f346c0ae9e0 2024-08-17T02:25:38.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.196+0000 7f34731f1700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f346c154400 con 0x7f346c156cf0 2024-08-17T02:25:38.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.196+0000 7f34721ef700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f346c0686a0 0x7f346c151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.196+0000 7f34721ef700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f346c0686a0 0x7f346c151fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53756/0 (socket says 172.21.15.104:53756) 2024-08-17T02:25:38.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.196+0000 7f34721ef700 1 -- 172.21.15.104:0/2512055897 learned_addr learned my addr 172.21.15.104:0/2512055897 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:38.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.196+0000 7f34719ee700 1 --2- 172.21.15.104:0/2512055897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f346c0ae9e0 0x7f346c158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.196+0000 7f34729f0700 1 --2- 172.21.15.104:0/2512055897 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f346c156cf0 0x7f346c1594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.196+0000 7f34721ef700 1 -- 172.21.15.104:0/2512055897 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f346c156cf0 msgr2=0x7f346c1594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.196+0000 7f34721ef700 1 --2- 172.21.15.104:0/2512055897 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f346c156cf0 0x7f346c1594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.196+0000 7f34721ef700 1 -- 172.21.15.104:0/2512055897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f346c0ae9e0 msgr2=0x7f346c158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.196+0000 7f34721ef700 1 --2- 172.21.15.104:0/2512055897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f346c0ae9e0 0x7f346c158f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.196+0000 7f34721ef700 1 -- 172.21.15.104:0/2512055897 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3464009a20 con 0x7f346c0686a0 2024-08-17T02:25:38.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.196+0000 7f34721ef700 1 --2- 172.21.15.104:0/2512055897 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f346c0686a0 0x7f346c151fb0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f346800ec80 tx=0x7f34680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:38.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.200+0000 7f34627fc700 1 -- 172.21.15.104:0/2512055897 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346800c850 con 0x7f346c0686a0 2024-08-17T02:25:38.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.200+0000 7f34627fc700 1 -- 172.21.15.104:0/2512055897 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f346800c9b0 con 0x7f346c0686a0 2024-08-17T02:25:38.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.200+0000 7f34731f1700 1 -- 172.21.15.104:0/2512055897 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f346c1546e0 con 0x7f346c0686a0 2024-08-17T02:25:38.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.200+0000 7f34627fc700 1 -- 172.21.15.104:0/2512055897 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346800cd50 con 0x7f346c0686a0 2024-08-17T02:25:38.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.200+0000 7f34731f1700 1 -- 172.21.15.104:0/2512055897 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f346c1524f0 con 0x7f346c0686a0 2024-08-17T02:25:38.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.200+0000 7f34731f1700 1 -- 172.21.15.104:0/2512055897 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f346c154920 con 0x7f346c0686a0 2024-08-17T02:25:38.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.200+0000 7f34627fc700 1 -- 172.21.15.104:0/2512055897 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f3468013680 con 0x7f346c0686a0 2024-08-17T02:25:38.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.204+0000 7f34627fc700 1 --2- 172.21.15.104:0/2512055897 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3450060860 0x7f3450062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.204+0000 7f34627fc700 1 -- 172.21.15.104:0/2512055897 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f346807d140 con 0x7f346c0686a0 2024-08-17T02:25:38.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.204+0000 7f34719ee700 1 --2- 172.21.15.104:0/2512055897 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3450060860 0x7f3450062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.204+0000 7f34719ee700 1 --2- 172.21.15.104:0/2512055897 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3450060860 0x7f3450062d10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f346c068590 tx=0x7f345c007f50 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:38.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.208+0000 7f34627fc700 1 -- 172.21.15.104:0/2512055897 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f346804d890 con 0x7f346c0686a0 2024-08-17T02:25:38.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.372+0000 7f34731f1700 1 -- 172.21.15.104:0/2512055897 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f346c1548d0 con 0x7f346c0686a0 2024-08-17T02:25:38.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.376+0000 7f34627fc700 1 -- 172.21.15.104:0/2512055897 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3468050eb0 con 0x7f346c0686a0 2024-08-17T02:25:38.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.380+0000 7f34731f1700 1 -- 172.21.15.104:0/2512055897 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3450060860 msgr2=0x7f3450062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.380+0000 7f34731f1700 1 --2- 172.21.15.104:0/2512055897 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3450060860 0x7f3450062d10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f346c068590 tx=0x7f345c007f50 comp rx=0 tx=0).stop 2024-08-17T02:25:38.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.380+0000 7f34731f1700 1 -- 172.21.15.104:0/2512055897 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f346c0686a0 msgr2=0x7f346c151fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.380+0000 7f34731f1700 1 --2- 172.21.15.104:0/2512055897 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f346c0686a0 0x7f346c151fb0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f346800ec80 tx=0x7f34680091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.380+0000 7f34731f1700 1 -- 172.21.15.104:0/2512055897 shutdown_connections 2024-08-17T02:25:38.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.380+0000 7f34731f1700 1 --2- 172.21.15.104:0/2512055897 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3450060860 0x7f3450062d10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.380+0000 7f34731f1700 1 --2- 172.21.15.104:0/2512055897 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f346c156cf0 0x7f346c1594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.380+0000 7f34731f1700 1 --2- 172.21.15.104:0/2512055897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f346c0ae9e0 0x7f346c158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.380+0000 7f34731f1700 1 --2- 172.21.15.104:0/2512055897 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f346c0686a0 0x7f346c151fb0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.380+0000 7f34731f1700 1 -- 172.21.15.104:0/2512055897 >> 172.21.15.104:0/2512055897 conn(0x7f346c06e350 msgr2=0x7f346c069400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:38.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.380+0000 7f34731f1700 1 -- 172.21.15.104:0/2512055897 shutdown_connections 2024-08-17T02:25:38.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.380+0000 7f34731f1700 1 -- 172.21.15.104:0/2512055897 wait complete. 2024-08-17T02:25:38.399 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2024-08-17T02:25:38.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.496+0000 7fbe09972700 1 Processor -- start 2024-08-17T02:25:38.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.496+0000 7fbe09972700 1 -- start start 2024-08-17T02:25:38.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.496+0000 7fbe09972700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbe0415aed0 0x7fbe0415b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.496+0000 7fbe09972700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe040ca200 0x7fbe040cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.496+0000 7fbe09972700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe040ad6e0 con 0x7fbe041406a0 2024-08-17T02:25:38.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.496+0000 7fbe09972700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe040cde50 con 0x7fbe0415aed0 2024-08-17T02:25:38.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.496+0000 7fbe09972700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe040c86a0 con 0x7fbe040ca200 2024-08-17T02:25:38.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.496+0000 7fbe037fe700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fbe041406a0 0x7fbe040cbc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:43530/0 (socket says 172.21.15.104:43530) 2024-08-17T02:25:38.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.496+0000 7fbe037fe700 1 -- 172.21.15.104:0/2353834061 learned_addr learned my addr 172.21.15.104:0/2353834061 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:25:38.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.496+0000 7fbdfa7fc700 1 --2- 172.21.15.104:0/2353834061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe040ca200 0x7fbe040cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.496+0000 7fbe02ffd700 1 --2- 172.21.15.104:0/2353834061 >> v2:172.21.15.117:3300/0 conn(0x7fbe0415aed0 0x7fbe0415b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.496+0000 7fbe027fc700 1 -- 172.21.15.104:0/2353834061 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1348583951 0 0) 0x7fbe040ad6e0 con 0x7fbe041406a0 2024-08-17T02:25:38.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.496+0000 7fbe027fc700 1 -- 172.21.15.104:0/2353834061 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdf0003570 con 0x7fbe041406a0 2024-08-17T02:25:38.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.496+0000 7fbe027fc700 1 -- 172.21.15.104:0/2353834061 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2832912193 0 0) 0x7fbdf0003570 con 0x7fbe041406a0 2024-08-17T02:25:38.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.496+0000 7fbe027fc700 1 -- 172.21.15.104:0/2353834061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe040ca200 msgr2=0x7fbe040cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:38.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.496+0000 7fbe027fc700 1 --2- 172.21.15.104:0/2353834061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe040ca200 0x7fbe040cd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.496+0000 7fbe027fc700 1 -- 172.21.15.104:0/2353834061 >> v2:172.21.15.117:3300/0 conn(0x7fbe0415aed0 msgr2=0x7fbe0415b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:38.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.496+0000 7fbe027fc700 1 --2- 172.21.15.104:0/2353834061 >> v2:172.21.15.117:3300/0 conn(0x7fbe0415aed0 0x7fbe0415b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.496+0000 7fbe027fc700 1 -- 172.21.15.104:0/2353834061 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe040ca6e0 con 0x7fbe041406a0 2024-08-17T02:25:38.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.496+0000 7fbe027fc700 1 -- 172.21.15.104:0/2353834061 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1279957748 0 0) 0x7fbdfc0017f0 con 0x7fbe041406a0 2024-08-17T02:25:38.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.496+0000 7fbe027fc700 1 -- 172.21.15.104:0/2353834061 >> v1:172.21.15.104:6789/0 conn(0x7fbe041406a0 legacy=0x7fbe040cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.496+0000 7fbe027fc700 1 --2- 172.21.15.104:0/2353834061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbdf0003a60 0x7fbdf0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.496+0000 7fbe027fc700 1 --2- 172.21.15.104:0/2353834061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe040ca200 0x7fbdf0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.496+0000 7fbe027fc700 1 --2- 172.21.15.104:0/2353834061 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbdf0004d50 0x7fbdf00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.496+0000 7fbe027fc700 1 -- 172.21.15.104:0/2353834061 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe040cde50 con 0x7fbdf0004d50 2024-08-17T02:25:38.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.496+0000 7fbe027fc700 1 -- 172.21.15.104:0/2353834061 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe040c86a0 con 0x7fbdf0003a60 2024-08-17T02:25:38.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.496+0000 7fbe027fc700 1 -- 172.21.15.104:0/2353834061 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf000ba60 con 0x7fbe040ca200 2024-08-17T02:25:38.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.496+0000 7fbe037fe700 1 --2- 172.21.15.104:0/2353834061 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbdf0004d50 0x7fbdf00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.496+0000 7fbe02ffd700 1 --2- 172.21.15.104:0/2353834061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbdf0003a60 0x7fbdf0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.496+0000 7fbdfa7fc700 1 --2- 172.21.15.104:0/2353834061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe040ca200 0x7fbdf0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.496+0000 7fbe037fe700 1 -- 172.21.15.104:0/2353834061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe040ca200 msgr2=0x7fbdf0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:38.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.500+0000 7fbe037fe700 1 --2- 172.21.15.104:0/2353834061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe040ca200 0x7fbdf0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.500+0000 7fbe037fe700 1 -- 172.21.15.104:0/2353834061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbdf0003a60 msgr2=0x7fbdf0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:38.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.500+0000 7fbe037fe700 1 --2- 172.21.15.104:0/2353834061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbdf0003a60 0x7fbdf0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.500+0000 7fbe037fe700 1 -- 172.21.15.104:0/2353834061 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf0003570 con 0x7fbdf0004d50 2024-08-17T02:25:38.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.500+0000 7fbe037fe700 1 --2- 172.21.15.104:0/2353834061 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbdf0004d50 0x7fbdf00051c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc00a970 tx=0x7fbe040c87e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53e998fb4ad047df server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:38.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.500+0000 7fbe027fc700 1 -- 172.21.15.104:0/2353834061 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc0070d0 con 0x7fbdf0004d50 2024-08-17T02:25:38.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.500+0000 7fbe027fc700 1 -- 172.21.15.104:0/2353834061 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdfc007230 con 0x7fbdf0004d50 2024-08-17T02:25:38.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.500+0000 7fbe027fc700 1 -- 172.21.15.104:0/2353834061 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc0075f0 con 0x7fbdf0004d50 2024-08-17T02:25:38.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.500+0000 7fbe09972700 1 -- 172.21.15.104:0/2353834061 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbdf0004d50 msgr2=0x7fbdf00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.500+0000 7fbe09972700 1 --2- 172.21.15.104:0/2353834061 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbdf0004d50 0x7fbdf00051c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc00a970 tx=0x7fbe040c87e0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.500+0000 7fbe037fe700 1 -- 172.21.15.104:0/2353834061 reap_dead start 2024-08-17T02:25:38.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.500+0000 7fbe09972700 1 -- 172.21.15.104:0/2353834061 shutdown_connections 2024-08-17T02:25:38.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.500+0000 7fbe09972700 1 -- 172.21.15.104:0/2353834061 >> 172.21.15.104:0/2353834061 conn(0x7fbe040caad0 msgr2=0x7fbe040caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:38.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.500+0000 7fbe09972700 1 -- 172.21.15.104:0/2353834061 shutdown_connections 2024-08-17T02:25:38.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.500+0000 7fbe09972700 1 -- 172.21.15.104:0/2353834061 wait complete. 2024-08-17T02:25:38.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.500+0000 7fbe09972700 1 Processor -- start 2024-08-17T02:25:38.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.500+0000 7fbe09972700 1 -- start start 2024-08-17T02:25:38.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.504+0000 7fbe09972700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbdf0004d50 0x7fbe04156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.504+0000 7fbe09972700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe0413e060 0x7fbe040b15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.504+0000 7fbe09972700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe040b1b30 0x7fbe040b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.504+0000 7fbe09972700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe040c5740 con 0x7fbdf0004d50 2024-08-17T02:25:38.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.504+0000 7fbe09972700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0413dbd0 con 0x7fbe040b1b30 2024-08-17T02:25:38.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.504+0000 7fbe02ffd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbdf0004d50 0x7fbe04156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.504+0000 7fbe09972700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe040c5460 con 0x7fbe0413e060 2024-08-17T02:25:38.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.504+0000 7fbe02ffd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbdf0004d50 0x7fbe04156580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53774/0 (socket says 172.21.15.104:53774) 2024-08-17T02:25:38.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.504+0000 7fbe02ffd700 1 -- 172.21.15.104:0/1693790210 learned_addr learned my addr 172.21.15.104:0/1693790210 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:38.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.504+0000 7fbdfa7fc700 1 --2- 172.21.15.104:0/1693790210 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe0413e060 0x7fbe040b15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.504+0000 7fbe037fe700 1 --2- 172.21.15.104:0/1693790210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe040b1b30 0x7fbe040b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.504+0000 7fbe02ffd700 1 -- 172.21.15.104:0/1693790210 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe0413e060 msgr2=0x7fbe040b15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.504+0000 7fbe02ffd700 1 --2- 172.21.15.104:0/1693790210 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe0413e060 0x7fbe040b15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.504+0000 7fbe02ffd700 1 -- 172.21.15.104:0/1693790210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe040b1b30 msgr2=0x7fbe040b1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.504+0000 7fbe02ffd700 1 --2- 172.21.15.104:0/1693790210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe040b1b30 0x7fbe040b1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.504+0000 7fbe02ffd700 1 -- 172.21.15.104:0/1693790210 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0413d580 con 0x7fbdf0004d50 2024-08-17T02:25:38.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.504+0000 7fbe02ffd700 1 --2- 172.21.15.104:0/1693790210 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbdf0004d50 0x7fbe04156580 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4011b10 tx=0x7fbdf40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:38.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.504+0000 7fbdfb7fe700 1 -- 172.21.15.104:0/1693790210 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf400f940 con 0x7fbdf0004d50 2024-08-17T02:25:38.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.504+0000 7fbdfb7fe700 1 -- 172.21.15.104:0/1693790210 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf400faa0 con 0x7fbdf0004d50 2024-08-17T02:25:38.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.504+0000 7fbe09972700 1 -- 172.21.15.104:0/1693790210 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe0413d860 con 0x7fbdf0004d50 2024-08-17T02:25:38.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.504+0000 7fbdfb7fe700 1 -- 172.21.15.104:0/1693790210 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf400fe20 con 0x7fbdf0004d50 2024-08-17T02:25:38.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.504+0000 7fbe09972700 1 -- 172.21.15.104:0/1693790210 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe040c5110 con 0x7fbdf0004d50 2024-08-17T02:25:38.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.508+0000 7fbe09972700 1 -- 172.21.15.104:0/1693790210 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe040645c0 con 0x7fbdf0004d50 2024-08-17T02:25:38.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.508+0000 7fbdfb7fe700 1 -- 172.21.15.104:0/1693790210 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fbdf4014650 con 0x7fbdf0004d50 2024-08-17T02:25:38.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.508+0000 7fbdfb7fe700 1 --2- 172.21.15.104:0/1693790210 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fbde4060890 0x7fbde4062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.508+0000 7fbdfb7fe700 1 -- 172.21.15.104:0/1693790210 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fbdf4018030 con 0x7fbdf0004d50 2024-08-17T02:25:38.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.508+0000 7fbdfa7fc700 1 --2- 172.21.15.104:0/1693790210 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fbde4060890 0x7fbde4062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.508+0000 7fbdfa7fc700 1 --2- 172.21.15.104:0/1693790210 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fbde4060890 0x7fbde4062d40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbe0413c9c0 tx=0x7fbdec0091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:38.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.516+0000 7fbdfb7fe700 1 -- 172.21.15.104:0/1693790210 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fbdf404d7f0 con 0x7fbdf0004d50 2024-08-17T02:25:38.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:38.740+0000 7fbe09972700 1 -- 172.21.15.104:0/1693790210 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7fbe0415b7e0 con 0x7fbdf0004d50 2024-08-17T02:25:39.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.064+0000 7fbdfb7fe700 1 -- 172.21.15.104:0/1693790210 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v158) v1 ==== 135+0+0 (secure 0 0 0) 0x7fbdf40220c0 con 0x7fbdf0004d50 2024-08-17T02:25:39.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.068+0000 7fbe09972700 1 -- 172.21.15.104:0/1693790210 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fbde4060890 msgr2=0x7fbde4062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.068+0000 7fbe09972700 1 --2- 172.21.15.104:0/1693790210 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fbde4060890 0x7fbde4062d40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbe0413c9c0 tx=0x7fbdec0091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.068+0000 7fbe09972700 1 -- 172.21.15.104:0/1693790210 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbdf0004d50 msgr2=0x7fbe04156580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.068+0000 7fbe09972700 1 --2- 172.21.15.104:0/1693790210 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbdf0004d50 0x7fbe04156580 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4011b10 tx=0x7fbdf40091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.068+0000 7fbe09972700 1 -- 172.21.15.104:0/1693790210 shutdown_connections 2024-08-17T02:25:39.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.068+0000 7fbe09972700 1 --2- 172.21.15.104:0/1693790210 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fbde4060890 0x7fbde4062d40 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.068+0000 7fbe09972700 1 --2- 172.21.15.104:0/1693790210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe040b1b30 0x7fbe040b1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.068+0000 7fbe09972700 1 --2- 172.21.15.104:0/1693790210 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe0413e060 0x7fbe040b15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.068+0000 7fbe09972700 1 --2- 172.21.15.104:0/1693790210 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbdf0004d50 0x7fbe04156580 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.068+0000 7fbe09972700 1 -- 172.21.15.104:0/1693790210 >> 172.21.15.104:0/1693790210 conn(0x7fbe040caad0 msgr2=0x7fbe040afb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:39.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.068+0000 7fbe09972700 1 -- 172.21.15.104:0/1693790210 shutdown_connections 2024-08-17T02:25:39.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.068+0000 7fbe09972700 1 -- 172.21.15.104:0/1693790210 wait complete. 2024-08-17T02:25:39.088 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up ... ERROR 2024-08-17T02:25:39.089 INFO:tasks.cephfs_test_runner: 2024-08-17T02:25:39.089 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-17T02:25:39.089 INFO:tasks.cephfs_test_runner:ERROR: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:25:39.089 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up 2024-08-17T02:25:39.089 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:25:39.089 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-17T02:25:39.089 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 459, in test_volume_create 2024-08-17T02:25:39.089 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", volname, "--yes-i-really-mean-it") 2024-08-17T02:25:39.089 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2024-08-17T02:25:39.089 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-08-17T02:25:39.089 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-08-17T02:25:39.089 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-08-17T02:25:39.089 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-08-17T02:25:39.090 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-08-17T02:25:39.090 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_manager.py", line 1631, in run_cluster_cmd 2024-08-17T02:25:39.090 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-08-17T02:25:39.090 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-17T02:25:39.090 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-17T02:25:39.090 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-17T02:25:39.090 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-17T02:25:39.090 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-17T02:25:39.090 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-17T02:25:39.090 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-17T02:25:39.090 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-17T02:25:39.090 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi104 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000188090 --yes-i-really-mean-it' 2024-08-17T02:25:39.090 INFO:tasks.cephfs_test_runner: 2024-08-17T02:25:39.090 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:25:39.091 INFO:tasks.cephfs_test_runner:Ran 1 test in 170.318s 2024-08-17T02:25:39.091 INFO:tasks.cephfs_test_runner: 2024-08-17T02:25:39.091 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-08-17T02:25:39.091 INFO:tasks.cephfs_test_runner: 2024-08-17T02:25:39.091 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-17T02:25:39.091 INFO:tasks.cephfs_test_runner:ERROR: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:25:39.091 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up 2024-08-17T02:25:39.091 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:25:39.091 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-17T02:25:39.091 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 459, in test_volume_create 2024-08-17T02:25:39.091 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", volname, "--yes-i-really-mean-it") 2024-08-17T02:25:39.091 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2024-08-17T02:25:39.091 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-08-17T02:25:39.091 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-08-17T02:25:39.091 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-08-17T02:25:39.092 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-08-17T02:25:39.092 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-08-17T02:25:39.092 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_manager.py", line 1631, in run_cluster_cmd 2024-08-17T02:25:39.092 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-08-17T02:25:39.092 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-17T02:25:39.092 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-17T02:25:39.092 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-17T02:25:39.092 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-17T02:25:39.092 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-17T02:25:39.092 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-17T02:25:39.092 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-17T02:25:39.092 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-17T02:25:39.092 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi104 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000188090 --yes-i-really-mean-it' 2024-08-17T02:25:39.092 INFO:tasks.cephfs_test_runner: 2024-08-17T02:25:39.093 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:25:39.310 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=1b5c43da6a3a4880a16c74a97dfa0746 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:25:39.312 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-08-17T02:25:39.320 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-08-17T02:25:39.362 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-08-17T02:25:39.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:39.362 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2024-08-17T02:25:39.375 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-17T02:25:39.375 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:25:39.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:39.375 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:25:39.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:39.389 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:25:39.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:39.445 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link delete ceph-brx 2024-08-17T02:25:39.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:39.580 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2024-08-17T02:25:39.588 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-08-17T02:25:39.588 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:25:39.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:39.589 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:25:39.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:39.605 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:25:39.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:39.665 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link delete ceph-brx 2024-08-17T02:25:39.767 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-08-17T02:25:39.777 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2024-08-17T02:25:39.777 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:39.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.884+0000 7f49e6e46700 1 Processor -- start 2024-08-17T02:25:39.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.884+0000 7f49e6e46700 1 -- start start 2024-08-17T02:25:39.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.888+0000 7f49e6e46700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49e00aac50 0x7f49e015aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.888+0000 7f49e6e46700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f49e00b3b30 0x7f49e00b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.888+0000 7f49e6e46700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e00b4490 con 0x7f49e015a2e0 2024-08-17T02:25:39.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.888+0000 7f49e6e46700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e015bc90 con 0x7f49e00b3b30 2024-08-17T02:25:39.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.888+0000 7f49e6e46700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e015b010 con 0x7f49e00aac50 2024-08-17T02:25:39.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.888+0000 7f49dffff700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f49e015a2e0 0x7f49e01574a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:43542/0 (socket says 172.21.15.104:43542) 2024-08-17T02:25:39.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.888+0000 7f49dffff700 1 -- 172.21.15.104:0/2991217735 learned_addr learned my addr 172.21.15.104:0/2991217735 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:25:39.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.888+0000 7f49e53e3700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f49e00b3b30 0x7f49e00b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.888+0000 7f49e4be2700 1 --2- 172.21.15.104:0/2991217735 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49e00aac50 0x7f49e015aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.888+0000 7f49e53e3700 1 -- 172.21.15.104:0/2991217735 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49e00aac50 msgr2=0x7f49e015aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:39.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.888+0000 7f49e53e3700 1 --2- 172.21.15.104:0/2991217735 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49e00aac50 0x7f49e015aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.888+0000 7f49e53e3700 1 -- 172.21.15.104:0/2991217735 >> v1:172.21.15.104:6789/0 conn(0x7f49e015a2e0 legacy=0x7f49e01574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.888+0000 7f49df7fe700 1 -- 172.21.15.104:0/2991217735 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 940743561 0 0) 0x7f49e00b4490 con 0x7f49e015a2e0 2024-08-17T02:25:39.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.888+0000 7f49e53e3700 1 -- 172.21.15.104:0/2991217735 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e015b2f0 con 0x7f49e00b3b30 2024-08-17T02:25:39.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.888+0000 7f49e53e3700 1 --2- 172.21.15.104:0/2991217735 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f49e00b3b30 0x7f49e00b3f50 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f49d80098e0 tx=0x7f49d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71ec3c3f511fa5f5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:39.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.888+0000 7f49df7fe700 1 -- 172.21.15.104:0/2991217735 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d800b640 con 0x7f49e00b3b30 2024-08-17T02:25:39.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.888+0000 7f49df7fe700 1 -- 172.21.15.104:0/2991217735 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d800b7a0 con 0x7f49e00b3b30 2024-08-17T02:25:39.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.888+0000 7f49df7fe700 1 -- 172.21.15.104:0/2991217735 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d800bb40 con 0x7f49e00b3b30 2024-08-17T02:25:39.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.888+0000 7f49e6e46700 1 -- 172.21.15.104:0/2991217735 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f49e00b3b30 msgr2=0x7f49e00b3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.888+0000 7f49e6e46700 1 --2- 172.21.15.104:0/2991217735 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f49e00b3b30 0x7f49e00b3f50 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f49d80098e0 tx=0x7f49d80091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.888+0000 7f49e6e46700 1 -- 172.21.15.104:0/2991217735 shutdown_connections 2024-08-17T02:25:39.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.888+0000 7f49e6e46700 1 --2- 172.21.15.104:0/2991217735 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f49e00b3b30 0x7f49e00b3f50 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.888+0000 7f49e6e46700 1 --2- 172.21.15.104:0/2991217735 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49e00aac50 0x7f49e015aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.888+0000 7f49e6e46700 1 -- 172.21.15.104:0/2991217735 >> 172.21.15.104:0/2991217735 conn(0x7f49e00994d0 msgr2=0x7f49e00675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:39.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.888+0000 7f49e6e46700 1 -- 172.21.15.104:0/2991217735 shutdown_connections 2024-08-17T02:25:39.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.888+0000 7f49e6e46700 1 -- 172.21.15.104:0/2991217735 wait complete. 2024-08-17T02:25:39.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.892+0000 7f49e6e46700 1 Processor -- start 2024-08-17T02:25:39.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.892+0000 7f49e6e46700 1 -- start start 2024-08-17T02:25:39.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.892+0000 7f49e6e46700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49e00aac50 0x7f49e009a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.892+0000 7f49e6e46700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f49e00b3b30 0x7f49e016a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.892+0000 7f49e6e46700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49e015a2e0 0x7f49e00acc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.892+0000 7f49e6e46700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e016a630 con 0x7f49e00b3b30 2024-08-17T02:25:39.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.892+0000 7f49e6e46700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e016b470 con 0x7f49e015a2e0 2024-08-17T02:25:39.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.892+0000 7f49e6e46700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e016a860 con 0x7f49e00aac50 2024-08-17T02:25:39.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.892+0000 7f49dffff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f49e00b3b30 0x7f49e016a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.892+0000 7f49dffff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f49e00b3b30 0x7f49e016a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53800/0 (socket says 172.21.15.104:53800) 2024-08-17T02:25:39.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.892+0000 7f49dffff700 1 -- 172.21.15.104:0/163407802 learned_addr learned my addr 172.21.15.104:0/163407802 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:39.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.892+0000 7f49e4be2700 1 --2- 172.21.15.104:0/163407802 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49e00aac50 0x7f49e009a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.892+0000 7f49e53e3700 1 --2- 172.21.15.104:0/163407802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49e015a2e0 0x7f49e00acc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.892+0000 7f49dffff700 1 -- 172.21.15.104:0/163407802 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49e00aac50 msgr2=0x7f49e009a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.892+0000 7f49dffff700 1 --2- 172.21.15.104:0/163407802 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49e00aac50 0x7f49e009a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.892+0000 7f49dffff700 1 -- 172.21.15.104:0/163407802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49e015a2e0 msgr2=0x7f49e00acc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.892+0000 7f49dffff700 1 --2- 172.21.15.104:0/163407802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49e015a2e0 0x7f49e00acc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.892+0000 7f49dffff700 1 -- 172.21.15.104:0/163407802 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d8009420 con 0x7f49e00b3b30 2024-08-17T02:25:39.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.892+0000 7f49e53e3700 1 --2- 172.21.15.104:0/163407802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49e015a2e0 0x7f49e00acc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:39.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.892+0000 7f49dffff700 1 --2- 172.21.15.104:0/163407802 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f49e00b3b30 0x7f49e016a0f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f49c800c5b0 tx=0x7f49c8001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:39.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.892+0000 7f49dcff9700 1 -- 172.21.15.104:0/163407802 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c8005b30 con 0x7f49e00b3b30 2024-08-17T02:25:39.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.892+0000 7f49dcff9700 1 -- 172.21.15.104:0/163407802 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c8005c90 con 0x7f49e00b3b30 2024-08-17T02:25:39.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.892+0000 7f49e6e46700 1 -- 172.21.15.104:0/163407802 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e016ab40 con 0x7f49e00b3b30 2024-08-17T02:25:39.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.892+0000 7f49dcff9700 1 -- 172.21.15.104:0/163407802 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c8007300 con 0x7f49e00b3b30 2024-08-17T02:25:39.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.892+0000 7f49e6e46700 1 -- 172.21.15.104:0/163407802 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e016b100 con 0x7f49e00b3b30 2024-08-17T02:25:39.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.896+0000 7f49dcff9700 1 -- 172.21.15.104:0/163407802 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f49c801b3b0 con 0x7f49e00b3b30 2024-08-17T02:25:39.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.896+0000 7f49e6e46700 1 -- 172.21.15.104:0/163407802 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49e00645c0 con 0x7f49e00b3b30 2024-08-17T02:25:39.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.896+0000 7f49dcff9700 1 --2- 172.21.15.104:0/163407802 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f49c0060860 0x7f49c0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.896+0000 7f49dcff9700 1 -- 172.21.15.104:0/163407802 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f49c807bdc0 con 0x7f49e00b3b30 2024-08-17T02:25:39.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.896+0000 7f49e4be2700 1 --2- 172.21.15.104:0/163407802 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f49c0060860 0x7f49c0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.896+0000 7f49e4be2700 1 --2- 172.21.15.104:0/163407802 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f49c0060860 0x7f49c0062d10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f49d000f5b0 tx=0x7f49d000b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:39.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:39.908+0000 7f49dcff9700 1 -- 172.21.15.104:0/163407802 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f49c804c4b0 con 0x7f49e00b3b30 2024-08-17T02:25:40.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.068+0000 7f49e6e46700 1 -- 172.21.15.104:0/163407802 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49e0153c50 con 0x7f49e00b3b30 2024-08-17T02:25:40.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.068+0000 7f49dcff9700 1 -- 172.21.15.104:0/163407802 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+12441 (secure 0 0 0) 0x7f49c804fad0 con 0x7f49e00b3b30 2024-08-17T02:25:40.075 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:25:40.075 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":47,"fsid":"fd5f7fb8-d34b-49bb-89a8-62b7dad1bc25","created":"2024-08-17T02:21:57.891389+0000","modified":"2024-08-17T02:25:38.054060+0000","last_up_change":"2024-08-17T02:22:08.924546+0000","last_in_change":"2024-08-17T02:21:59.938028+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:22:10.143970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"606b9088-590e-4709-aa3a-b0f6e22972ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":24257},{"type":"v1","addr":"172.21.15.104:6809","nonce":24257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":24257},{"type":"v1","addr":"172.21.15.104:6811","nonce":24257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":24257},{"type":"v1","addr":"172.21.15.104:6815","nonce":24257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":24257},{"type":"v1","addr":"172.21.15.104:6813","nonce":24257}]},"public_addr":"172.21.15.104:6809/24257","cluster_addr":"172.21.15.104:6811/24257","heartbeat_back_addr":"172.21.15.104:6815/24257","heartbeat_front_addr":"172.21.15.104:6813/24257","state":["exists","up"]},{"osd":1,"uuid":"9bc6a909-0c2f-4889-afe7-4a47f89b0f64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":24256},{"type":"v1","addr":"172.21.15.104:6825","nonce":24256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":24256},{"type":"v1","addr":"172.21.15.104:6827","nonce":24256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":24256},{"type":"v1","addr":"172.21.15.104:6831","nonce":24256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":24256},{"type":"v1","addr":"172.21.15.104:6829","nonce":24256}]},"public_addr":"172.21.15.104:6825/24256","cluster_addr":"172.21.15.104:6827/24256","heartbeat_back_addr":"172.21.15.104:6831/24256","heartbeat_front_addr":"172.21.15.104:6829/24256","state":["exists","up"]},{"osd":2,"uuid":"23da31d5-aefb-4edb-b79d-fa05e1becef7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":24255},{"type":"v1","addr":"172.21.15.104:6817","nonce":24255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":24255},{"type":"v1","addr":"172.21.15.104:6819","nonce":24255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":24255},{"type":"v1","addr":"172.21.15.104:6823","nonce":24255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":24255},{"type":"v1","addr":"172.21.15.104:6821","nonce":24255}]},"public_addr":"172.21.15.104:6817/24255","cluster_addr":"172.21.15.104:6819/24255","heartbeat_back_addr":"172.21.15.104:6823/24255","heartbeat_front_addr":"172.21.15.104:6821/24255","state":["exists","up"]},{"osd":3,"uuid":"6e4a5ec2-b415-45ef-8381-61a59eb65224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":24254},{"type":"v1","addr":"172.21.15.104:6801","nonce":24254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":24254},{"type":"v1","addr":"172.21.15.104:6803","nonce":24254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":24254},{"type":"v1","addr":"172.21.15.104:6807","nonce":24254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":24254},{"type":"v1","addr":"172.21.15.104:6805","nonce":24254}]},"public_addr":"172.21.15.104:6801/24254","cluster_addr":"172.21.15.104:6803/24254","heartbeat_back_addr":"172.21.15.104:6807/24254","heartbeat_front_addr":"172.21.15.104:6805/24254","state":["exists","up"]},{"osd":4,"uuid":"8d5bea2d-9039-4013-8c99-2c046c5b8a17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":24421},{"type":"v1","addr":"172.21.15.117:6804","nonce":24421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":24421},{"type":"v1","addr":"172.21.15.117:6809","nonce":24421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":24421},{"type":"v1","addr":"172.21.15.117:6815","nonce":24421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":24421},{"type":"v1","addr":"172.21.15.117:6813","nonce":24421}]},"public_addr":"172.21.15.117:6804/24421","cluster_addr":"172.21.15.117:6809/24421","heartbeat_back_addr":"172.21.15.117:6815/24421","heartbeat_front_addr":"172.21.15.117:6813/24421","state":["exists","up"]},{"osd":5,"uuid":"de8b36fc-121c-4f05-8f5b-28f513d9f21f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":24422},{"type":"v1","addr":"172.21.15.117:6817","nonce":24422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":24422},{"type":"v1","addr":"172.21.15.117:6819","nonce":24422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":24422},{"type":"v1","addr":"172.21.15.117:6823","nonce":24422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":24422},{"type":"v1","addr":"172.21.15.117:6821","nonce":24422}]},"public_addr":"172.21.15.117:6817/24422","cluster_addr":"172.21.15.117:6819/24422","heartbeat_back_addr":"172.21.15.117:6823/24422","heartbeat_front_addr":"172.21.15.117:6821/24422","state":["exists","up"]},{"osd":6,"uuid":"6a87f09f-7bf7-4f7a-be87-530ac1ff8ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":24420},{"type":"v1","addr":"172.21.15.117:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6803","nonce":24420},{"type":"v1","addr":"172.21.15.117:6805","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":24420},{"type":"v1","addr":"172.21.15.117:6811","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":24420},{"type":"v1","addr":"172.21.15.117:6808","nonce":24420}]},"public_addr":"172.21.15.117:6801/24420","cluster_addr":"172.21.15.117:6805/24420","heartbeat_back_addr":"172.21.15.117:6811/24420","heartbeat_front_addr":"172.21.15.117:6808/24420","state":["exists","up"]},{"osd":7,"uuid":"e31d8041-1aa1-4b5d-83b3-0a373426dd9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":24423},{"type":"v1","addr":"172.21.15.117:6825","nonce":24423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":24423},{"type":"v1","addr":"172.21.15.117:6827","nonce":24423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":24423},{"type":"v1","addr":"172.21.15.117:6831","nonce":24423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":24423},{"type":"v1","addr":"172.21.15.117:6829","nonce":24423}]},"public_addr":"172.21.15.117:6825/24423","cluster_addr":"172.21.15.117:6827/24423","heartbeat_back_addr":"172.21.15.117:6831/24423","heartbeat_front_addr":"172.21.15.117:6829/24423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.220874+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.210039+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.434762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.247206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.184316+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.306325+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.035719+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.400303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.104:6832/4148924116":"2024-08-18T02:25:35.039929+0000","172.21.15.104:6833/4148924116":"2024-08-18T02:25:35.039929+0000","172.21.15.104:6835/38993094":"2024-08-18T02:25:28.820410+0000","172.21.15.104:6834/38993094":"2024-08-18T02:25:28.820410+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:40.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.072+0000 7f49e6e46700 1 -- 172.21.15.104:0/163407802 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f49c0060860 msgr2=0x7f49c0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.072+0000 7f49e6e46700 1 --2- 172.21.15.104:0/163407802 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f49c0060860 0x7f49c0062d10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f49d000f5b0 tx=0x7f49d000b040 comp rx=0 tx=0).stop 2024-08-17T02:25:40.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.072+0000 7f49e6e46700 1 -- 172.21.15.104:0/163407802 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f49e00b3b30 msgr2=0x7f49e016a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.072+0000 7f49e6e46700 1 --2- 172.21.15.104:0/163407802 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f49e00b3b30 0x7f49e016a0f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f49c800c5b0 tx=0x7f49c8001070 comp rx=0 tx=0).stop 2024-08-17T02:25:40.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.072+0000 7f49e6e46700 1 -- 172.21.15.104:0/163407802 shutdown_connections 2024-08-17T02:25:40.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.072+0000 7f49e6e46700 1 --2- 172.21.15.104:0/163407802 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f49c0060860 0x7f49c0062d10 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.072+0000 7f49e6e46700 1 --2- 172.21.15.104:0/163407802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49e015a2e0 0x7f49e00acc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.072+0000 7f49e6e46700 1 --2- 172.21.15.104:0/163407802 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f49e00b3b30 0x7f49e016a0f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.072+0000 7f49e6e46700 1 --2- 172.21.15.104:0/163407802 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49e00aac50 0x7f49e009a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.072+0000 7f49e6e46700 1 -- 172.21.15.104:0/163407802 >> 172.21.15.104:0/163407802 conn(0x7f49e00994d0 msgr2=0x7f49e0158200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:40.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.072+0000 7f49e6e46700 1 -- 172.21.15.104:0/163407802 shutdown_connections 2024-08-17T02:25:40.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.072+0000 7f49e6e46700 1 -- 172.21.15.104:0/163407802 wait complete. 2024-08-17T02:25:40.089 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-17T02:25:40.090 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:25:40.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.188+0000 7f68ffcd6700 1 Processor -- start 2024-08-17T02:25:40.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.188+0000 7f68ffcd6700 1 -- start start 2024-08-17T02:25:40.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.188+0000 7f68ffcd6700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68f8142910 0x7f68f80c7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.188+0000 7f68ffcd6700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f68f8142ce0 0x7f68f80c77a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.188+0000 7f68ffcd6700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f68f80cc940 0x7f68f80ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.188+0000 7f68ffcd6700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68f80ca840 con 0x7f68f80cc940 2024-08-17T02:25:40.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.188+0000 7f68ffcd6700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68f80c9990 con 0x7f68f8142ce0 2024-08-17T02:25:40.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.188+0000 7f68ffcd6700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f80c9c30 con 0x7f68f8142910 2024-08-17T02:25:40.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.192+0000 7f68fe273700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f68f80cc940 0x7f68f80ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.192+0000 7f68fda72700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68f8142910 0x7f68f80c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.192+0000 7f68fe273700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f68f80cc940 0x7f68f80ccdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53814/0 (socket says 172.21.15.104:53814) 2024-08-17T02:25:40.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.192+0000 7f68fe273700 1 -- 172.21.15.104:0/3852657839 learned_addr learned my addr 172.21.15.104:0/3852657839 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:40.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.192+0000 7f68fd271700 1 --2- 172.21.15.104:0/3852657839 >> v2:172.21.15.117:3300/0 conn(0x7f68f8142ce0 0x7f68f80c77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.192+0000 7f68fe273700 1 -- 172.21.15.104:0/3852657839 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68f8142910 msgr2=0x7f68f80c7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:40.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.192+0000 7f68fe273700 1 --2- 172.21.15.104:0/3852657839 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68f8142910 0x7f68f80c7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.192+0000 7f68fe273700 1 -- 172.21.15.104:0/3852657839 >> v2:172.21.15.117:3300/0 conn(0x7f68f8142ce0 msgr2=0x7f68f80c77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:40.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.192+0000 7f68fe273700 1 --2- 172.21.15.104:0/3852657839 >> v2:172.21.15.117:3300/0 conn(0x7f68f8142ce0 0x7f68f80c77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.192+0000 7f68fe273700 1 -- 172.21.15.104:0/3852657839 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f80c9f10 con 0x7f68f80cc940 2024-08-17T02:25:40.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.192+0000 7f68fe273700 1 --2- 172.21.15.104:0/3852657839 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68f80cc940 0x7f68f80ccdc0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f68f8070500 tx=0x7f68f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1d5530d712c5bf2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:40.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.192+0000 7f68fca70700 1 -- 172.21.15.104:0/3852657839 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f400b6d0 con 0x7f68f80cc940 2024-08-17T02:25:40.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.192+0000 7f68fca70700 1 -- 172.21.15.104:0/3852657839 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f400b830 con 0x7f68f80cc940 2024-08-17T02:25:40.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.192+0000 7f68fca70700 1 -- 172.21.15.104:0/3852657839 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f400bbf0 con 0x7f68f80cc940 2024-08-17T02:25:40.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.192+0000 7f68ffcd6700 1 -- 172.21.15.104:0/3852657839 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68f80cc940 msgr2=0x7f68f80ccdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.192+0000 7f68ffcd6700 1 --2- 172.21.15.104:0/3852657839 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68f80cc940 0x7f68f80ccdc0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f68f8070500 tx=0x7f68f4009250 comp rx=0 tx=0).stop 2024-08-17T02:25:40.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.192+0000 7f68ffcd6700 1 -- 172.21.15.104:0/3852657839 shutdown_connections 2024-08-17T02:25:40.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.192+0000 7f68ffcd6700 1 --2- 172.21.15.104:0/3852657839 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68f80cc940 0x7f68f80ccdc0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.192+0000 7f68ffcd6700 1 --2- 172.21.15.104:0/3852657839 >> v2:172.21.15.117:3300/0 conn(0x7f68f8142ce0 0x7f68f80c77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.192+0000 7f68ffcd6700 1 --2- 172.21.15.104:0/3852657839 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68f8142910 0x7f68f80c7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.192+0000 7f68ffcd6700 1 -- 172.21.15.104:0/3852657839 >> 172.21.15.104:0/3852657839 conn(0x7f68f80caa60 msgr2=0x7f68f80cae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:40.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.192+0000 7f68ffcd6700 1 -- 172.21.15.104:0/3852657839 shutdown_connections 2024-08-17T02:25:40.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.192+0000 7f68ffcd6700 1 -- 172.21.15.104:0/3852657839 wait complete. 2024-08-17T02:25:40.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.196+0000 7f68ffcd6700 1 Processor -- start 2024-08-17T02:25:40.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.196+0000 7f68ffcd6700 1 -- start start 2024-08-17T02:25:40.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.196+0000 7f68ffcd6700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68f80cc940 0x7f68f815e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.196+0000 7f68ffcd6700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68f8142910 0x7f68f815a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.196+0000 7f68ffcd6700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68f8142ce0 0x7f68f80a57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.196+0000 7f68ffcd6700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f81692c0 con 0x7f68f80cc940 2024-08-17T02:25:40.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.196+0000 7f68ffcd6700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f815b010 con 0x7f68f8142ce0 2024-08-17T02:25:40.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.196+0000 7f68ffcd6700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f815b2f0 con 0x7f68f8142910 2024-08-17T02:25:40.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.196+0000 7f68fda72700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68f80cc940 0x7f68f815e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.196+0000 7f68fda72700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68f80cc940 0x7f68f815e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53828/0 (socket says 172.21.15.104:53828) 2024-08-17T02:25:40.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.196+0000 7f68fda72700 1 -- 172.21.15.104:0/3689222745 learned_addr learned my addr 172.21.15.104:0/3689222745 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:40.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.196+0000 7f68fd271700 1 --2- 172.21.15.104:0/3689222745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68f8142910 0x7f68f815a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.196+0000 7f68fe273700 1 --2- 172.21.15.104:0/3689222745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68f8142ce0 0x7f68f80a57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.196+0000 7f68fda72700 1 -- 172.21.15.104:0/3689222745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68f8142910 msgr2=0x7f68f815a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.196+0000 7f68fda72700 1 --2- 172.21.15.104:0/3689222745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68f8142910 0x7f68f815a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.196+0000 7f68fda72700 1 -- 172.21.15.104:0/3689222745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68f8142ce0 msgr2=0x7f68f80a57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.196+0000 7f68fda72700 1 --2- 172.21.15.104:0/3689222745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68f8142ce0 0x7f68f80a57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.196+0000 7f68fda72700 1 -- 172.21.15.104:0/3689222745 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f40094f0 con 0x7f68f80cc940 2024-08-17T02:25:40.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.196+0000 7f68fd271700 1 --2- 172.21.15.104:0/3689222745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68f8142910 0x7f68f815a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:40.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.196+0000 7f68fda72700 1 --2- 172.21.15.104:0/3689222745 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68f80cc940 0x7f68f815e300 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f68f0009f10 tx=0x7f68f000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:40.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.196+0000 7f68edffb700 1 -- 172.21.15.104:0/3689222745 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f000cc80 con 0x7f68f80cc940 2024-08-17T02:25:40.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.196+0000 7f68edffb700 1 -- 172.21.15.104:0/3689222745 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f000f040 con 0x7f68f80cc940 2024-08-17T02:25:40.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.196+0000 7f68ffcd6700 1 -- 172.21.15.104:0/3689222745 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f815b5d0 con 0x7f68f80cc940 2024-08-17T02:25:40.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.196+0000 7f68edffb700 1 -- 172.21.15.104:0/3689222745 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f0014480 con 0x7f68f80cc940 2024-08-17T02:25:40.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.196+0000 7f68ffcd6700 1 -- 172.21.15.104:0/3689222745 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f815b8b0 con 0x7f68f80cc940 2024-08-17T02:25:40.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.200+0000 7f68ffcd6700 1 -- 172.21.15.104:0/3689222745 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68f80644b0 con 0x7f68f80cc940 2024-08-17T02:25:40.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.200+0000 7f68edffb700 1 -- 172.21.15.104:0/3689222745 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f68f0014830 con 0x7f68f80cc940 2024-08-17T02:25:40.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.200+0000 7f68edffb700 1 --2- 172.21.15.104:0/3689222745 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f68dc060860 0x7f68dc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.200+0000 7f68edffb700 1 -- 172.21.15.104:0/3689222745 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f68f007d470 con 0x7f68f80cc940 2024-08-17T02:25:40.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.200+0000 7f68fd271700 1 --2- 172.21.15.104:0/3689222745 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f68dc060860 0x7f68dc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.200+0000 7f68fd271700 1 --2- 172.21.15.104:0/3689222745 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f68dc060860 0x7f68dc062d10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f68f815ecc0 tx=0x7f68e8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:40.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.208+0000 7f68edffb700 1 -- 172.21.15.104:0/3689222745 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f68f004dac0 con 0x7f68f80cc940 2024-08-17T02:25:40.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.372+0000 7f68ffcd6700 1 -- 172.21.15.104:0/3689222745 --> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f68f806dd10 con 0x7f68dc060860 2024-08-17T02:25:40.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.376+0000 7f68edffb700 1 -- 172.21.15.104:0/3689222745 <== mgr.4111 v2:172.21.15.117:6832/24084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48902 (secure 0 0 0) 0x7f68f806dd10 con 0x7f68dc060860 2024-08-17T02:25:40.382 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:25:40.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.380+0000 7f68ffcd6700 1 -- 172.21.15.104:0/3689222745 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f68dc060860 msgr2=0x7f68dc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.380+0000 7f68ffcd6700 1 --2- 172.21.15.104:0/3689222745 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f68dc060860 0x7f68dc062d10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f68f815ecc0 tx=0x7f68e8008040 comp rx=0 tx=0).stop 2024-08-17T02:25:40.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.380+0000 7f68ffcd6700 1 -- 172.21.15.104:0/3689222745 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68f80cc940 msgr2=0x7f68f815e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.380+0000 7f68ffcd6700 1 --2- 172.21.15.104:0/3689222745 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68f80cc940 0x7f68f815e300 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f68f0009f10 tx=0x7f68f000b040 comp rx=0 tx=0).stop 2024-08-17T02:25:40.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.380+0000 7f68ffcd6700 1 -- 172.21.15.104:0/3689222745 shutdown_connections 2024-08-17T02:25:40.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.380+0000 7f68ffcd6700 1 --2- 172.21.15.104:0/3689222745 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f68dc060860 0x7f68dc062d10 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.380+0000 7f68ffcd6700 1 --2- 172.21.15.104:0/3689222745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68f8142ce0 0x7f68f80a57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.380+0000 7f68ffcd6700 1 --2- 172.21.15.104:0/3689222745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68f8142910 0x7f68f815a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.380+0000 7f68ffcd6700 1 --2- 172.21.15.104:0/3689222745 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68f80cc940 0x7f68f815e300 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.380+0000 7f68ffcd6700 1 -- 172.21.15.104:0/3689222745 >> 172.21.15.104:0/3689222745 conn(0x7f68f80caa60 msgr2=0x7f68f80b2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:40.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.380+0000 7f68ffcd6700 1 -- 172.21.15.104:0/3689222745 shutdown_connections 2024-08-17T02:25:40.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.380+0000 7f68ffcd6700 1 -- 172.21.15.104:0/3689222745 wait complete. 2024-08-17T02:25:40.388 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-08-17T02:25:40.396 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":146,"stamp":"2024-08-17T02:25:40.164796+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":116,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":2388432,"kb_used_data":5408,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752586288,"statfs":{"total":773094113280,"available":770648358912,"internally_reserved":0,"allocated":5537792,"data_stored":3009145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001918"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":184,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-08-17T02:25:37.986451+0000","last_change":"2024-08-17T02:22:11.967052+0000","last_active":"2024-08-17T02:25:37.986451+0000","last_peered":"2024-08-17T02:25:37.986451+0000","last_clean":"2024-08-17T02:25:37.986451+0000","last_became_active":"2024-08-17T02:22:11.965269+0000","last_became_peered":"2024-08-17T02:22:11.965269+0000","last_unstale":"2024-08-17T02:25:37.986451+0000","last_undegraded":"2024-08-17T02:25:37.986451+0000","last_fullsized":"2024-08-17T02:25:37.986451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:10.930862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:10.930862+0000","last_clean_scrub_stamp":"2024-08-17T02:22:10.930862+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:59:34.931003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509487,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297892,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073948,"statfs":{"total":96636764160,"available":96331722752,"internally_reserved":0,"allocated":552960,"data_stored":232065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.92800000000000005,"15min":0.90200000000000002},"min":{"1min":0.56799999999999995,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.2310000000000001,"5min":1.236,"15min":1.236},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.73299999999999998,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.2609999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.72699999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.88300000000000001,"15min":0.88900000000000001},"min":{"1min":0.629,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.90600000000000003,"15min":0.91000000000000003},"min":{"1min":0.70399999999999996,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1739999999999999,"5min":1.413,"15min":1.413},"last":1.423}]},{"osd":2,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.97599999999999998,"15min":0.96199999999999997},"min":{"1min":0.65800000000000003,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.2250000000000001,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":1.4770000000000001},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92800000000000005,"15min":0.92400000000000004},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.198,"5min":1.23,"15min":1.23},"last":1.0209999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.91400000000000003,"15min":0.91100000000000003},"min":{"1min":0.66500000000000004,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.1619999999999999,"5min":1.302,"15min":1.302},"last":1.04},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.96299999999999997,"15min":0.97299999999999998},"min":{"1min":0.74299999999999999,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.254,"5min":1.341,"15min":1.341},"last":1.2589999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.89000000000000001,"15min":0.90400000000000003},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.125,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.014,"5min":1.0529999999999999,"15min":1.0649999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.351,"5min":1.482,"15min":1.482},"last":1.121}]},{"osd":5,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":1.0109999999999999,"15min":1.0209999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.246,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.159,"5min":1.171,"15min":1.1890000000000001},"min":{"1min":0.99099999999999999,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.4159999999999999,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.165}]},{"osd":6,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.1240000000000001,"15min":1.1439999999999999},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.3400000000000001,"5min":1.393,"15min":1.393},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.141,"5min":1.1559999999999999,"15min":1.1639999999999999},"min":{"1min":0.78200000000000003,"5min":0.752,"15min":0.752},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":1.3220000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509486,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298480,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073360,"statfs":{"total":96636764160,"available":96331120640,"internally_reserved":0,"allocated":1146880,"data_stored":822433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.83399999999999996,"15min":0.82799999999999996},"min":{"1min":0.61799999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.92900000000000005,"15min":0.91800000000000004},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.216,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.97899999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.89900000000000002,"15min":0.879},"min":{"1min":0.67000000000000004,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.89900000000000002,"15min":0.90600000000000003},"min":{"1min":0.65600000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.1000000000000001,"5min":1.282,"15min":1.282},"last":1.0189999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.91600000000000004,"15min":0.91200000000000003},"min":{"1min":0.68200000000000005,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.879,"5min":0.874,"15min":0.88200000000000001},"min":{"1min":0.69499999999999995,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.079,"5min":1.216,"15min":1.216},"last":0.80500000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.92600000000000005,"15min":0.93100000000000005},"min":{"1min":0.64900000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":1.0169999999999999,"5min":0.95199999999999996,"15min":0.93899999999999995},"min":{"1min":0.82799999999999996,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.27,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":1.081}]},{"osd":4,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.93700000000000006,"15min":0.95799999999999996},"min":{"1min":0.61699999999999999,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.03,"5min":0.98699999999999999,"15min":0.97099999999999997},"min":{"1min":0.76000000000000001,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":1.0569999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":1.0049999999999999,"15min":1.0309999999999999},"min":{"1min":0.69999999999999996,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.226,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.0609999999999999,"15min":1.091},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.2110000000000001,"5min":1.371,"15min":1.371},"last":0.92900000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.0700000000000001,"15min":1.0609999999999999},"min":{"1min":0.90100000000000002,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.175,"15min":1.1819999999999999},"min":{"1min":0.95699999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":1.548,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.123}]}]},{"osd":4,"up_from":15,"seq":64424509486,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297884,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073956,"statfs":{"total":96636764160,"available":96331730944,"internally_reserved":0,"allocated":536576,"data_stored":226417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.83299999999999996,"15min":0.81200000000000006},"min":{"1min":0.58099999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.204,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85199999999999998,"15min":0.84199999999999997},"min":{"1min":0.64200000000000002,"5min":0.501,"15min":0.501},"max":{"1min":1.0820000000000001,"5min":2.0329999999999999,"15min":2.0329999999999999},"last":0.623}]},{"osd":1,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.86399999999999999,"15min":0.84399999999999997},"min":{"1min":0.64200000000000002,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.2170000000000001,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.95799999999999996,"15min":0.98599999999999999},"min":{"1min":0.71799999999999997,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.1040000000000001,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.56899999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.92700000000000005,"15min":0.95399999999999996},"min":{"1min":0.69599999999999995,"5min":0.621,"15min":0.621},"max":{"1min":1.0589999999999999,"5min":1.726,"15min":1.726},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.92700000000000005,"15min":0.91700000000000004},"min":{"1min":0.69099999999999995,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1930000000000001,"5min":1.367,"15min":1.367},"last":0.66300000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.87,"15min":0.879},"min":{"1min":0.69299999999999995,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.0089999999999999,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.86899999999999999,"5min":1.0069999999999999,"15min":1.05},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.173,"5min":1.653,"15min":1.653},"last":1.0389999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.91500000000000004,"15min":0.92900000000000005},"min":{"1min":0.60899999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.214,"5min":1.3,"15min":1.3},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.995,"15min":1.0329999999999999},"min":{"1min":0.64500000000000002,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.194,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.95999999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":1.069,"15min":1.097},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.2370000000000001,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.107,"15min":1.1140000000000001},"min":{"1min":0.77000000000000002,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.5109999999999999,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":1.0029999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.0449999999999999,"15min":1.0600000000000001},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.167,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.071,"5min":1.2070000000000001,"15min":1.2450000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.542,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":1.1459999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509486,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297900,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073940,"statfs":{"total":96636764160,"available":96331714560,"internally_reserved":0,"allocated":552960,"data_stored":232065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63300000000000001,"15min":0.64900000000000002},"min":{"1min":0.47299999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.77700000000000002,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.76700000000000002,"15min":0.754},"min":{"1min":0.66600000000000004,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.006,"5min":1.159,"15min":1.159},"last":0.60299999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.70299999999999996,"15min":0.68700000000000006},"min":{"1min":0.51700000000000002,"5min":0.443,"15min":0.443},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.81399999999999995,"15min":0.83099999999999996},"min":{"1min":0.54400000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0129999999999999,"5min":1.381,"15min":1.381},"last":0.79500000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.70299999999999996,"15min":0.69699999999999995},"min":{"1min":0.59199999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.873,"5min":0.876,"15min":0.88200000000000001},"min":{"1min":0.60999999999999999,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0189999999999999,"5min":1.45,"15min":1.45},"last":0.66100000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":0.93100000000000005,"15min":0.91100000000000003},"min":{"1min":0.85999999999999999,"5min":0.63,"15min":0.63},"max":{"1min":1.3100000000000001,"5min":1.526,"15min":1.526},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97499999999999998,"15min":0.98699999999999999},"min":{"1min":0.77700000000000002,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.306,"5min":2.04,"15min":2.04},"last":0.90100000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":1.006,"15min":1.0129999999999999},"min":{"1min":0.74099999999999999,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.272,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.034,"5min":1.0449999999999999,"15min":1.054},"min":{"1min":0.85599999999999998,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.2529999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.0469999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.093,"15min":1.1060000000000001},"min":{"1min":0.85599999999999998,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.248,"5min":1.577,"15min":1.577},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.081,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.97699999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.2629999999999999,"5min":1.448,"15min":1.448},"last":0.872}]},{"osd":7,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.0920000000000001,"15min":1.0880000000000001},"min":{"1min":0.94999999999999996,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.3620000000000001,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.121},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.131,"15min":1.125},"min":{"1min":0.90400000000000003,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.6799999999999999,"5min":2.109,"15min":2.109},"last":1.1839999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509486,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297880,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073960,"statfs":{"total":96636764160,"available":96331735040,"internally_reserved":0,"allocated":536576,"data_stored":226417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.62,"15min":0.627},"min":{"1min":0.40699999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90200000000000002,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":1.1299999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68799999999999994,"15min":0.67900000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.81799999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.747,"15min":0.73299999999999998},"min":{"1min":0.55000000000000004,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.77100000000000002,"15min":0.75600000000000001},"min":{"1min":0.52000000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.59799999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.752,"15min":0.746},"min":{"1min":0.55900000000000005,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0609999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.754},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.80800000000000005,"15min":0.81000000000000005},"min":{"1min":0.48099999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.3660000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.67200000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.94899999999999995,"15min":0.94799999999999995},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.2030000000000001,"5min":1.391,"15min":1.391},"last":1.288},{"interface":"front","average":{"1min":0.96299999999999997,"5min":1.0449999999999999,"15min":1.073},"min":{"1min":0.745,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.2370000000000001,"5min":1.974,"15min":1.974},"last":1.0920000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0820000000000001,"15min":1.1140000000000001},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.3280000000000001,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.999,"5min":1.0249999999999999,"15min":1.026},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.274,"5min":1.296,"15min":1.296},"last":1.4039999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.087,"15min":1.111},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.3080000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.079,"5min":1.1040000000000001,"15min":1.1259999999999999},"min":{"1min":0.76100000000000001,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.284,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.3759999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.141,"15min":1.165},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.3819999999999999,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":1.258},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.1279999999999999,"15min":1.1240000000000001},"min":{"1min":0.73199999999999998,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.411,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.325}]}]},{"osd":1,"up_from":15,"seq":64424509487,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298480,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073360,"statfs":{"total":96636764160,"available":96331120640,"internally_reserved":0,"allocated":1146880,"data_stored":822433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66000000000000003,"15min":0.67500000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.137,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.69399999999999995,"15min":0.68400000000000005},"min":{"1min":0.502,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.96799999999999997,"5min":1.016,"15min":1.016},"last":0.83899999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.72599999999999998,"15min":0.74199999999999999},"min":{"1min":0.55000000000000004,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.1419999999999999,"5min":1.194,"15min":1.194},"last":1.663},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.79800000000000004,"15min":0.79200000000000004},"min":{"1min":0.60799999999999998,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.083,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.494}]},{"osd":3,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.86599999999999999,"15min":0.879},"min":{"1min":0.63200000000000001,"5min":0.63,"15min":0.63},"max":{"1min":1.129,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.5860000000000001},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.86499999999999999,"15min":0.85099999999999998},"min":{"1min":0.624,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.91800000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.97699999999999998,"15min":0.97199999999999998},"min":{"1min":0.78900000000000003,"5min":0.746,"15min":0.746},"max":{"1min":1.1699999999999999,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":1.4299999999999999},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.0429999999999999,"15min":1.069},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.165,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":1.4119999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.018,"15min":1.024},"min":{"1min":0.79000000000000004,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.248,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":1.7190000000000001},{"interface":"front","average":{"1min":1.081,"5min":1.1419999999999999,"15min":1.1679999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.272,"5min":1.893,"15min":1.893},"last":1.5469999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.123,"15min":1.129},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.304,"5min":1.964,"15min":1.964},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.091,"5min":1.133,"15min":1.145},"min":{"1min":0.83399999999999996,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.282,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.772}]},{"osd":7,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.1859999999999999,"15min":1.194},"min":{"1min":0.96499999999999997,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.478,"5min":1.649,"15min":1.649},"last":1.6319999999999999},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.179,"15min":1.179},"min":{"1min":0.92000000000000004,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.3819999999999999,"5min":1.5,"15min":1.5},"last":1.514}]}]},{"osd":0,"up_from":15,"seq":64424509486,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297884,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073956,"statfs":{"total":96636764160,"available":96331730944,"internally_reserved":0,"allocated":536576,"data_stored":226417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:25:17 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.63900000000000001,"15min":0.63500000000000001},"min":{"1min":0.50800000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.97799999999999998,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71499999999999997,"15min":0.70299999999999996},"min":{"1min":0.56599999999999995,"5min":0.318,"15min":0.318},"max":{"1min":0.999,"5min":1.498,"15min":1.498},"last":0.55900000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:25:17 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.72599999999999998,"15min":0.69799999999999995},"min":{"1min":0.53900000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.71099999999999997,"15min":0.68100000000000005},"min":{"1min":0.56000000000000005,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.623}]},{"osd":3,"last update":"Sat Aug 17 02:25:17 2024","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.878,"15min":0.90100000000000002},"min":{"1min":0.56599999999999995,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.2110000000000001,"5min":5.0270000000000001,"15min":5.0270000000000001},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81200000000000006,"15min":0.80200000000000005},"min":{"1min":0.61099999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.69599999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:25:17 2024","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.98099999999999998,"15min":0.97499999999999998},"min":{"1min":0.80600000000000005,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.26,"5min":2.633,"15min":2.633},"last":1.1870000000000001},{"interface":"front","average":{"1min":0.94599999999999995,"5min":1.099,"15min":1.169},"min":{"1min":0.746,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.141,"5min":5.0700000000000003,"15min":5.0700000000000003},"last":1.0680000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:25:17 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.048,"15min":1.032},"min":{"1min":0.80000000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.365,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":1.236},{"interface":"front","average":{"1min":1.026,"5min":1.0620000000000001,"15min":1.0600000000000001},"min":{"1min":0.79500000000000004,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.333,"5min":1.915,"15min":1.915},"last":0.88600000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:25:17 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.1910000000000001,"15min":1.262},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.347,"5min":5.133,"15min":5.133},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.85499999999999998,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.323,"5min":1.702,"15min":1.702},"last":1.151}]},{"osd":7,"last update":"Sat Aug 17 02:25:17 2024","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.145,"15min":1.137},"min":{"1min":0.76600000000000001,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.4419999999999999,"5min":2.3759999999999999,"15min":2.3759999999999999},"last":1.016},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.254,"15min":1.3120000000000001},"min":{"1min":0.88100000000000001,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.3819999999999999,"5min":5.101,"15min":5.101},"last":0.92300000000000004}]}]},{"osd":6,"up_from":14,"seq":60129542191,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302032,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069808,"statfs":{"total":96636764160,"available":96327483392,"internally_reserved":0,"allocated":528384,"data_stored":220898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.90800000000000003,"15min":0.89600000000000002},"min":{"1min":0.64500000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.284,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.86899999999999999,"15min":0.84199999999999997},"min":{"1min":0.628,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.2370000000000001,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":1.02}]},{"osd":1,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.92800000000000005,"15min":0.94799999999999995},"min":{"1min":0.66300000000000003,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.097,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.95099999999999996,"15min":0.97899999999999998},"min":{"1min":0.61499999999999999,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.2529999999999999,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.94299999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.97999999999999998,"15min":1.016},"min":{"1min":0.65600000000000003,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.23,"5min":1.377,"15min":1.377},"last":0.58099999999999996},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.94799999999999995,"15min":0.92000000000000004},"min":{"1min":0.74299999999999999,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.323,"5min":1.635,"15min":1.635},"last":0.88600000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":1.024,"15min":1.018},"min":{"1min":0.65700000000000003,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.23,"5min":1.772,"15min":1.772},"last":0.74299999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0349999999999999,"15min":1.052},"min":{"1min":0.77900000000000003,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.196,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.65400000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.95699999999999996,"15min":0.96099999999999997},"min":{"1min":0.65100000000000002,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.198,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.0580000000000001},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.0720000000000001,"15min":1.0860000000000001},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.3680000000000001,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.085}]},{"osd":5,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":1.069,"15min":1.127},"min":{"1min":0.69299999999999995,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.2130000000000001,"5min":2.2759999999999998,"15min":2.2759999999999998},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.075,"5min":1.1659999999999999,"15min":1.202},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.409,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.153}]},{"osd":7,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.1930000000000001,"15min":1.2110000000000001},"min":{"1min":0.78700000000000003,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.365,"5min":2.5059999999999998,"15min":2.5059999999999998},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.218,"15min":1.268},"min":{"1min":0.84499999999999997,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.306,"5min":2.5779999999999998,"15min":2.5779999999999998},"last":0.995}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:25:40.398 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:25:40.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.500+0000 7f422d1a9700 1 Processor -- start 2024-08-17T02:25:40.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.500+0000 7f422d1a9700 1 -- start start 2024-08-17T02:25:40.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.504+0000 7f422d1a9700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f42280af3f0 0x7f4228068c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.504+0000 7f422d1a9700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42280b05e0 con 0x7f4228068840 2024-08-17T02:25:40.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.504+0000 7f422d1a9700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42280af9d0 con 0x7f42280b0a70 2024-08-17T02:25:40.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.504+0000 7f422d1a9700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42280afcb0 con 0x7f42280af3f0 2024-08-17T02:25:40.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.504+0000 7f4227fff700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f4228068840 0x7f42280ae2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:43556/0 (socket says 172.21.15.104:43556) 2024-08-17T02:25:40.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.504+0000 7f4227fff700 1 -- 172.21.15.104:0/1639707286 learned_addr learned my addr 172.21.15.104:0/1639707286 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:25:40.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.504+0000 7f42277fe700 1 --2- 172.21.15.104:0/1639707286 >> v2:172.21.15.104:3300/0 conn(0x7f42280af3f0 0x7f4228068c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.504+0000 7f4226ffd700 1 -- 172.21.15.104:0/1639707286 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1134123008 0 0) 0x7f42280b05e0 con 0x7f4228068840 2024-08-17T02:25:40.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.504+0000 7f4226ffd700 1 -- 172.21.15.104:0/1639707286 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4210003570 con 0x7f4228068840 2024-08-17T02:25:40.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.504+0000 7f42277fe700 1 -- 172.21.15.104:0/1639707286 >> v1:172.21.15.117:6789/0 conn(0x7f42280b0a70 legacy=0x7f4228155810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.504+0000 7f4226ffd700 1 -- 172.21.15.104:0/1639707286 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3005934871 0 0) 0x7f42280af9d0 con 0x7f42280b0a70 2024-08-17T02:25:40.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.504+0000 7f42277fe700 1 -- 172.21.15.104:0/1639707286 >> v1:172.21.15.104:6789/0 conn(0x7f4228068840 legacy=0x7f42280ae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.504+0000 7f42277fe700 1 -- 172.21.15.104:0/1639707286 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42280aff90 con 0x7f42280af3f0 2024-08-17T02:25:40.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.504+0000 7f42277fe700 1 --2- 172.21.15.104:0/1639707286 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42280af3f0 0x7f4228068c10 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f421c0098e0 tx=0x7f421c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a23de61a92a6c6c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:40.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.504+0000 7f4226ffd700 1 -- 172.21.15.104:0/1639707286 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42180013f0 con 0x7f42280af3f0 2024-08-17T02:25:40.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.504+0000 7f4226ffd700 1 -- 172.21.15.104:0/1639707286 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421c011420 con 0x7f42280af3f0 2024-08-17T02:25:40.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.504+0000 7f4226ffd700 1 -- 172.21.15.104:0/1639707286 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421c0117a0 con 0x7f42280af3f0 2024-08-17T02:25:40.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.504+0000 7f422d1a9700 1 -- 172.21.15.104:0/1639707286 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42280af3f0 msgr2=0x7f4228068c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.504+0000 7f422d1a9700 1 --2- 172.21.15.104:0/1639707286 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42280af3f0 0x7f4228068c10 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f421c0098e0 tx=0x7f421c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.504+0000 7f422d1a9700 1 -- 172.21.15.104:0/1639707286 shutdown_connections 2024-08-17T02:25:40.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.504+0000 7f422d1a9700 1 --2- 172.21.15.104:0/1639707286 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42280af3f0 0x7f4228068c10 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.504+0000 7f422d1a9700 1 -- 172.21.15.104:0/1639707286 >> 172.21.15.104:0/1639707286 conn(0x7f422806d800 msgr2=0x7f422806dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:40.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.504+0000 7f422d1a9700 1 -- 172.21.15.104:0/1639707286 shutdown_connections 2024-08-17T02:25:40.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.504+0000 7f422d1a9700 1 -- 172.21.15.104:0/1639707286 wait complete. 2024-08-17T02:25:40.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.508+0000 7f422d1a9700 1 Processor -- start 2024-08-17T02:25:40.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.508+0000 7f422d1a9700 1 -- start start 2024-08-17T02:25:40.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.508+0000 7f422d1a9700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4228068840 0x7f4228147050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.508+0000 7f422d1a9700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42280af3f0 0x7f4228154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.508+0000 7f422d1a9700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42280b0a70 0x7f4228152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.508+0000 7f422d1a9700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4228152140 con 0x7f42280b0a70 2024-08-17T02:25:40.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.508+0000 7f422d1a9700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4228147590 con 0x7f42280af3f0 2024-08-17T02:25:40.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.508+0000 7f422d1a9700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42280c67d0 con 0x7f4228068840 2024-08-17T02:25:40.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.508+0000 7f422c9a8700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42280b0a70 0x7f4228152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.508+0000 7f422c9a8700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42280b0a70 0x7f4228152b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53844/0 (socket says 172.21.15.104:53844) 2024-08-17T02:25:40.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.508+0000 7f422c9a8700 1 -- 172.21.15.104:0/1261690182 learned_addr learned my addr 172.21.15.104:0/1261690182 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:40.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.508+0000 7f4227fff700 1 --2- 172.21.15.104:0/1261690182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4228068840 0x7f4228147050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.508+0000 7f42277fe700 1 --2- 172.21.15.104:0/1261690182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42280af3f0 0x7f4228154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.508+0000 7f422c9a8700 1 -- 172.21.15.104:0/1261690182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4228068840 msgr2=0x7f4228147050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.508+0000 7f422c9a8700 1 --2- 172.21.15.104:0/1261690182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4228068840 0x7f4228147050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.508+0000 7f422c9a8700 1 -- 172.21.15.104:0/1261690182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42280af3f0 msgr2=0x7f4228154d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.508+0000 7f422c9a8700 1 --2- 172.21.15.104:0/1261690182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42280af3f0 0x7f4228154d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.508+0000 7f422c9a8700 1 -- 172.21.15.104:0/1261690182 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f421c009420 con 0x7f42280b0a70 2024-08-17T02:25:40.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.508+0000 7f4227fff700 1 --2- 172.21.15.104:0/1261690182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4228068840 0x7f4228147050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:40.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.508+0000 7f42277fe700 1 --2- 172.21.15.104:0/1261690182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42280af3f0 0x7f4228154d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:40.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.508+0000 7f422c9a8700 1 --2- 172.21.15.104:0/1261690182 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42280b0a70 0x7f4228152b50 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f422000c990 tx=0x7f42200016c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:40.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.508+0000 7f420ffff700 1 -- 172.21.15.104:0/1261690182 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422000a7a0 con 0x7f42280b0a70 2024-08-17T02:25:40.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.508+0000 7f420ffff700 1 -- 172.21.15.104:0/1261690182 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422000a920 con 0x7f42280b0a70 2024-08-17T02:25:40.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.508+0000 7f422d1a9700 1 -- 172.21.15.104:0/1261690182 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4228155260 con 0x7f42280b0a70 2024-08-17T02:25:40.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.508+0000 7f420ffff700 1 -- 172.21.15.104:0/1261690182 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422000ace0 con 0x7f42280b0a70 2024-08-17T02:25:40.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.508+0000 7f422d1a9700 1 -- 172.21.15.104:0/1261690182 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4228169c20 con 0x7f42280b0a70 2024-08-17T02:25:40.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.512+0000 7f422d1a9700 1 -- 172.21.15.104:0/1261690182 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42280638f0 con 0x7f42280b0a70 2024-08-17T02:25:40.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.512+0000 7f420ffff700 1 -- 172.21.15.104:0/1261690182 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f4220003030 con 0x7f42280b0a70 2024-08-17T02:25:40.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.512+0000 7f420ffff700 1 --2- 172.21.15.104:0/1261690182 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4214060860 0x7f4214062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.512+0000 7f420ffff700 1 -- 172.21.15.104:0/1261690182 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f422007c940 con 0x7f42280b0a70 2024-08-17T02:25:40.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.512+0000 7f4227fff700 1 --2- 172.21.15.104:0/1261690182 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4214060860 0x7f4214062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.512+0000 7f4227fff700 1 --2- 172.21.15.104:0/1261690182 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4214060860 0x7f4214062d10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f42180011e0 tx=0x7f4218009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:40.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.520+0000 7f420ffff700 1 -- 172.21.15.104:0/1261690182 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f422004d030 con 0x7f42280b0a70 2024-08-17T02:25:40.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.680+0000 7f422d1a9700 1 -- 172.21.15.104:0/1261690182 --> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f42280711a0 con 0x7f4214060860 2024-08-17T02:25:40.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.684+0000 7f420ffff700 1 -- 172.21.15.104:0/1261690182 <== mgr.4111 v2:172.21.15.117:6832/24084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48902 (secure 0 0 0) 0x7f42280711a0 con 0x7f4214060860 2024-08-17T02:25:40.690 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:25:40.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.688+0000 7f422d1a9700 1 -- 172.21.15.104:0/1261690182 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4214060860 msgr2=0x7f4214062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.688+0000 7f422d1a9700 1 --2- 172.21.15.104:0/1261690182 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4214060860 0x7f4214062d10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f42180011e0 tx=0x7f4218009040 comp rx=0 tx=0).stop 2024-08-17T02:25:40.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.688+0000 7f422d1a9700 1 -- 172.21.15.104:0/1261690182 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42280b0a70 msgr2=0x7f4228152b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.688+0000 7f422d1a9700 1 --2- 172.21.15.104:0/1261690182 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42280b0a70 0x7f4228152b50 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f422000c990 tx=0x7f42200016c0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.688+0000 7f422d1a9700 1 -- 172.21.15.104:0/1261690182 shutdown_connections 2024-08-17T02:25:40.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.688+0000 7f422d1a9700 1 --2- 172.21.15.104:0/1261690182 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4214060860 0x7f4214062d10 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.688+0000 7f422d1a9700 1 --2- 172.21.15.104:0/1261690182 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42280b0a70 0x7f4228152b50 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.688+0000 7f422d1a9700 1 --2- 172.21.15.104:0/1261690182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42280af3f0 0x7f4228154d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.688+0000 7f422d1a9700 1 --2- 172.21.15.104:0/1261690182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4228068840 0x7f4228147050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.688+0000 7f422d1a9700 1 -- 172.21.15.104:0/1261690182 >> 172.21.15.104:0/1261690182 conn(0x7f422806d800 msgr2=0x7f4228157210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:40.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.688+0000 7f422d1a9700 1 -- 172.21.15.104:0/1261690182 shutdown_connections 2024-08-17T02:25:40.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.688+0000 7f422d1a9700 1 -- 172.21.15.104:0/1261690182 wait complete. 2024-08-17T02:25:40.694 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-08-17T02:25:40.704 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":146,"stamp":"2024-08-17T02:25:40.164796+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":116,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":2388432,"kb_used_data":5408,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752586288,"statfs":{"total":773094113280,"available":770648358912,"internally_reserved":0,"allocated":5537792,"data_stored":3009145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001918"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":184,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-08-17T02:25:37.986451+0000","last_change":"2024-08-17T02:22:11.967052+0000","last_active":"2024-08-17T02:25:37.986451+0000","last_peered":"2024-08-17T02:25:37.986451+0000","last_clean":"2024-08-17T02:25:37.986451+0000","last_became_active":"2024-08-17T02:22:11.965269+0000","last_became_peered":"2024-08-17T02:22:11.965269+0000","last_unstale":"2024-08-17T02:25:37.986451+0000","last_undegraded":"2024-08-17T02:25:37.986451+0000","last_fullsized":"2024-08-17T02:25:37.986451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:10.930862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:10.930862+0000","last_clean_scrub_stamp":"2024-08-17T02:22:10.930862+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:59:34.931003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509487,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297892,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073948,"statfs":{"total":96636764160,"available":96331722752,"internally_reserved":0,"allocated":552960,"data_stored":232065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.92800000000000005,"15min":0.90200000000000002},"min":{"1min":0.56799999999999995,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.2310000000000001,"5min":1.236,"15min":1.236},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.73299999999999998,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.2609999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.72699999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.88300000000000001,"15min":0.88900000000000001},"min":{"1min":0.629,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.90600000000000003,"15min":0.91000000000000003},"min":{"1min":0.70399999999999996,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1739999999999999,"5min":1.413,"15min":1.413},"last":1.423}]},{"osd":2,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.97599999999999998,"15min":0.96199999999999997},"min":{"1min":0.65800000000000003,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.2250000000000001,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":1.4770000000000001},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92800000000000005,"15min":0.92400000000000004},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.198,"5min":1.23,"15min":1.23},"last":1.0209999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.91400000000000003,"15min":0.91100000000000003},"min":{"1min":0.66500000000000004,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.1619999999999999,"5min":1.302,"15min":1.302},"last":1.04},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.96299999999999997,"15min":0.97299999999999998},"min":{"1min":0.74299999999999999,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.254,"5min":1.341,"15min":1.341},"last":1.2589999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.89000000000000001,"15min":0.90400000000000003},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.125,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.014,"5min":1.0529999999999999,"15min":1.0649999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.351,"5min":1.482,"15min":1.482},"last":1.121}]},{"osd":5,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":1.0109999999999999,"15min":1.0209999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.246,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.159,"5min":1.171,"15min":1.1890000000000001},"min":{"1min":0.99099999999999999,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.4159999999999999,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.165}]},{"osd":6,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.1240000000000001,"15min":1.1439999999999999},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.3400000000000001,"5min":1.393,"15min":1.393},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.141,"5min":1.1559999999999999,"15min":1.1639999999999999},"min":{"1min":0.78200000000000003,"5min":0.752,"15min":0.752},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":1.3220000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509486,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298480,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073360,"statfs":{"total":96636764160,"available":96331120640,"internally_reserved":0,"allocated":1146880,"data_stored":822433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.83399999999999996,"15min":0.82799999999999996},"min":{"1min":0.61799999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.92900000000000005,"15min":0.91800000000000004},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.216,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.97899999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.89900000000000002,"15min":0.879},"min":{"1min":0.67000000000000004,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.89900000000000002,"15min":0.90600000000000003},"min":{"1min":0.65600000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.1000000000000001,"5min":1.282,"15min":1.282},"last":1.0189999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.91600000000000004,"15min":0.91200000000000003},"min":{"1min":0.68200000000000005,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.879,"5min":0.874,"15min":0.88200000000000001},"min":{"1min":0.69499999999999995,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.079,"5min":1.216,"15min":1.216},"last":0.80500000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.92600000000000005,"15min":0.93100000000000005},"min":{"1min":0.64900000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":1.0169999999999999,"5min":0.95199999999999996,"15min":0.93899999999999995},"min":{"1min":0.82799999999999996,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.27,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":1.081}]},{"osd":4,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.93700000000000006,"15min":0.95799999999999996},"min":{"1min":0.61699999999999999,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.03,"5min":0.98699999999999999,"15min":0.97099999999999997},"min":{"1min":0.76000000000000001,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":1.0569999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":1.0049999999999999,"15min":1.0309999999999999},"min":{"1min":0.69999999999999996,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.226,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.0609999999999999,"15min":1.091},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.2110000000000001,"5min":1.371,"15min":1.371},"last":0.92900000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.0700000000000001,"15min":1.0609999999999999},"min":{"1min":0.90100000000000002,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.175,"15min":1.1819999999999999},"min":{"1min":0.95699999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":1.548,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.123}]}]},{"osd":4,"up_from":15,"seq":64424509486,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297884,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073956,"statfs":{"total":96636764160,"available":96331730944,"internally_reserved":0,"allocated":536576,"data_stored":226417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.83299999999999996,"15min":0.81200000000000006},"min":{"1min":0.58099999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.204,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85199999999999998,"15min":0.84199999999999997},"min":{"1min":0.64200000000000002,"5min":0.501,"15min":0.501},"max":{"1min":1.0820000000000001,"5min":2.0329999999999999,"15min":2.0329999999999999},"last":0.623}]},{"osd":1,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.86399999999999999,"15min":0.84399999999999997},"min":{"1min":0.64200000000000002,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.2170000000000001,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.95799999999999996,"15min":0.98599999999999999},"min":{"1min":0.71799999999999997,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.1040000000000001,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.56899999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.92700000000000005,"15min":0.95399999999999996},"min":{"1min":0.69599999999999995,"5min":0.621,"15min":0.621},"max":{"1min":1.0589999999999999,"5min":1.726,"15min":1.726},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.92700000000000005,"15min":0.91700000000000004},"min":{"1min":0.69099999999999995,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1930000000000001,"5min":1.367,"15min":1.367},"last":0.66300000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.87,"15min":0.879},"min":{"1min":0.69299999999999995,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.0089999999999999,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.86899999999999999,"5min":1.0069999999999999,"15min":1.05},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.173,"5min":1.653,"15min":1.653},"last":1.0389999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.91500000000000004,"15min":0.92900000000000005},"min":{"1min":0.60899999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.214,"5min":1.3,"15min":1.3},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.995,"15min":1.0329999999999999},"min":{"1min":0.64500000000000002,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.194,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.95999999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":1.069,"15min":1.097},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.2370000000000001,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.107,"15min":1.1140000000000001},"min":{"1min":0.77000000000000002,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.5109999999999999,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":1.0029999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.0449999999999999,"15min":1.0600000000000001},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.167,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.071,"5min":1.2070000000000001,"15min":1.2450000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.542,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":1.1459999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509486,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297900,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073940,"statfs":{"total":96636764160,"available":96331714560,"internally_reserved":0,"allocated":552960,"data_stored":232065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63300000000000001,"15min":0.64900000000000002},"min":{"1min":0.47299999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.77700000000000002,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.76700000000000002,"15min":0.754},"min":{"1min":0.66600000000000004,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.006,"5min":1.159,"15min":1.159},"last":0.60299999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.70299999999999996,"15min":0.68700000000000006},"min":{"1min":0.51700000000000002,"5min":0.443,"15min":0.443},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.81399999999999995,"15min":0.83099999999999996},"min":{"1min":0.54400000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0129999999999999,"5min":1.381,"15min":1.381},"last":0.79500000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.70299999999999996,"15min":0.69699999999999995},"min":{"1min":0.59199999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.873,"5min":0.876,"15min":0.88200000000000001},"min":{"1min":0.60999999999999999,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0189999999999999,"5min":1.45,"15min":1.45},"last":0.66100000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":0.93100000000000005,"15min":0.91100000000000003},"min":{"1min":0.85999999999999999,"5min":0.63,"15min":0.63},"max":{"1min":1.3100000000000001,"5min":1.526,"15min":1.526},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97499999999999998,"15min":0.98699999999999999},"min":{"1min":0.77700000000000002,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.306,"5min":2.04,"15min":2.04},"last":0.90100000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":1.006,"15min":1.0129999999999999},"min":{"1min":0.74099999999999999,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.272,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.034,"5min":1.0449999999999999,"15min":1.054},"min":{"1min":0.85599999999999998,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.2529999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.0469999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.093,"15min":1.1060000000000001},"min":{"1min":0.85599999999999998,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.248,"5min":1.577,"15min":1.577},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.081,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.97699999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.2629999999999999,"5min":1.448,"15min":1.448},"last":0.872}]},{"osd":7,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.0920000000000001,"15min":1.0880000000000001},"min":{"1min":0.94999999999999996,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.3620000000000001,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.121},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.131,"15min":1.125},"min":{"1min":0.90400000000000003,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.6799999999999999,"5min":2.109,"15min":2.109},"last":1.1839999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509486,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297880,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073960,"statfs":{"total":96636764160,"available":96331735040,"internally_reserved":0,"allocated":536576,"data_stored":226417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.62,"15min":0.627},"min":{"1min":0.40699999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90200000000000002,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":1.1299999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68799999999999994,"15min":0.67900000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.81799999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.747,"15min":0.73299999999999998},"min":{"1min":0.55000000000000004,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.77100000000000002,"15min":0.75600000000000001},"min":{"1min":0.52000000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.59799999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.752,"15min":0.746},"min":{"1min":0.55900000000000005,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0609999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.754},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.80800000000000005,"15min":0.81000000000000005},"min":{"1min":0.48099999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.3660000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.67200000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.94899999999999995,"15min":0.94799999999999995},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.2030000000000001,"5min":1.391,"15min":1.391},"last":1.288},{"interface":"front","average":{"1min":0.96299999999999997,"5min":1.0449999999999999,"15min":1.073},"min":{"1min":0.745,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.2370000000000001,"5min":1.974,"15min":1.974},"last":1.0920000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0820000000000001,"15min":1.1140000000000001},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.3280000000000001,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.999,"5min":1.0249999999999999,"15min":1.026},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.274,"5min":1.296,"15min":1.296},"last":1.4039999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.087,"15min":1.111},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.3080000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.079,"5min":1.1040000000000001,"15min":1.1259999999999999},"min":{"1min":0.76100000000000001,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.284,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.3759999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.141,"15min":1.165},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.3819999999999999,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":1.258},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.1279999999999999,"15min":1.1240000000000001},"min":{"1min":0.73199999999999998,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.411,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.325}]}]},{"osd":1,"up_from":15,"seq":64424509487,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298480,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073360,"statfs":{"total":96636764160,"available":96331120640,"internally_reserved":0,"allocated":1146880,"data_stored":822433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66000000000000003,"15min":0.67500000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.137,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.69399999999999995,"15min":0.68400000000000005},"min":{"1min":0.502,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.96799999999999997,"5min":1.016,"15min":1.016},"last":0.83899999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.72599999999999998,"15min":0.74199999999999999},"min":{"1min":0.55000000000000004,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.1419999999999999,"5min":1.194,"15min":1.194},"last":1.663},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.79800000000000004,"15min":0.79200000000000004},"min":{"1min":0.60799999999999998,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.083,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.494}]},{"osd":3,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.86599999999999999,"15min":0.879},"min":{"1min":0.63200000000000001,"5min":0.63,"15min":0.63},"max":{"1min":1.129,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.5860000000000001},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.86499999999999999,"15min":0.85099999999999998},"min":{"1min":0.624,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.91800000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.97699999999999998,"15min":0.97199999999999998},"min":{"1min":0.78900000000000003,"5min":0.746,"15min":0.746},"max":{"1min":1.1699999999999999,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":1.4299999999999999},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.0429999999999999,"15min":1.069},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.165,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":1.4119999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.018,"15min":1.024},"min":{"1min":0.79000000000000004,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.248,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":1.7190000000000001},{"interface":"front","average":{"1min":1.081,"5min":1.1419999999999999,"15min":1.1679999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.272,"5min":1.893,"15min":1.893},"last":1.5469999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.123,"15min":1.129},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.304,"5min":1.964,"15min":1.964},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.091,"5min":1.133,"15min":1.145},"min":{"1min":0.83399999999999996,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.282,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.772}]},{"osd":7,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.1859999999999999,"15min":1.194},"min":{"1min":0.96499999999999997,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.478,"5min":1.649,"15min":1.649},"last":1.6319999999999999},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.179,"15min":1.179},"min":{"1min":0.92000000000000004,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.3819999999999999,"5min":1.5,"15min":1.5},"last":1.514}]}]},{"osd":0,"up_from":15,"seq":64424509486,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297884,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073956,"statfs":{"total":96636764160,"available":96331730944,"internally_reserved":0,"allocated":536576,"data_stored":226417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:25:17 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.63900000000000001,"15min":0.63500000000000001},"min":{"1min":0.50800000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.97799999999999998,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71499999999999997,"15min":0.70299999999999996},"min":{"1min":0.56599999999999995,"5min":0.318,"15min":0.318},"max":{"1min":0.999,"5min":1.498,"15min":1.498},"last":0.55900000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:25:17 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.72599999999999998,"15min":0.69799999999999995},"min":{"1min":0.53900000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.71099999999999997,"15min":0.68100000000000005},"min":{"1min":0.56000000000000005,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.623}]},{"osd":3,"last update":"Sat Aug 17 02:25:17 2024","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.878,"15min":0.90100000000000002},"min":{"1min":0.56599999999999995,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.2110000000000001,"5min":5.0270000000000001,"15min":5.0270000000000001},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81200000000000006,"15min":0.80200000000000005},"min":{"1min":0.61099999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.69599999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:25:17 2024","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.98099999999999998,"15min":0.97499999999999998},"min":{"1min":0.80600000000000005,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.26,"5min":2.633,"15min":2.633},"last":1.1870000000000001},{"interface":"front","average":{"1min":0.94599999999999995,"5min":1.099,"15min":1.169},"min":{"1min":0.746,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.141,"5min":5.0700000000000003,"15min":5.0700000000000003},"last":1.0680000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:25:17 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.048,"15min":1.032},"min":{"1min":0.80000000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.365,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":1.236},{"interface":"front","average":{"1min":1.026,"5min":1.0620000000000001,"15min":1.0600000000000001},"min":{"1min":0.79500000000000004,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.333,"5min":1.915,"15min":1.915},"last":0.88600000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:25:17 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.1910000000000001,"15min":1.262},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.347,"5min":5.133,"15min":5.133},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.85499999999999998,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.323,"5min":1.702,"15min":1.702},"last":1.151}]},{"osd":7,"last update":"Sat Aug 17 02:25:17 2024","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.145,"15min":1.137},"min":{"1min":0.76600000000000001,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.4419999999999999,"5min":2.3759999999999999,"15min":2.3759999999999999},"last":1.016},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.254,"15min":1.3120000000000001},"min":{"1min":0.88100000000000001,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.3819999999999999,"5min":5.101,"15min":5.101},"last":0.92300000000000004}]}]},{"osd":6,"up_from":14,"seq":60129542191,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302032,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069808,"statfs":{"total":96636764160,"available":96327483392,"internally_reserved":0,"allocated":528384,"data_stored":220898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.90800000000000003,"15min":0.89600000000000002},"min":{"1min":0.64500000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.284,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.86899999999999999,"15min":0.84199999999999997},"min":{"1min":0.628,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.2370000000000001,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":1.02}]},{"osd":1,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.92800000000000005,"15min":0.94799999999999995},"min":{"1min":0.66300000000000003,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.097,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.95099999999999996,"15min":0.97899999999999998},"min":{"1min":0.61499999999999999,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.2529999999999999,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.94299999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.97999999999999998,"15min":1.016},"min":{"1min":0.65600000000000003,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.23,"5min":1.377,"15min":1.377},"last":0.58099999999999996},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.94799999999999995,"15min":0.92000000000000004},"min":{"1min":0.74299999999999999,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.323,"5min":1.635,"15min":1.635},"last":0.88600000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":1.024,"15min":1.018},"min":{"1min":0.65700000000000003,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.23,"5min":1.772,"15min":1.772},"last":0.74299999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0349999999999999,"15min":1.052},"min":{"1min":0.77900000000000003,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.196,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.65400000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.95699999999999996,"15min":0.96099999999999997},"min":{"1min":0.65100000000000002,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.198,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.0580000000000001},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.0720000000000001,"15min":1.0860000000000001},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.3680000000000001,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.085}]},{"osd":5,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":1.069,"15min":1.127},"min":{"1min":0.69299999999999995,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.2130000000000001,"5min":2.2759999999999998,"15min":2.2759999999999998},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.075,"5min":1.1659999999999999,"15min":1.202},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.409,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.153}]},{"osd":7,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.1930000000000001,"15min":1.2110000000000001},"min":{"1min":0.78700000000000003,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.365,"5min":2.5059999999999998,"15min":2.5059999999999998},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.218,"15min":1.268},"min":{"1min":0.84499999999999997,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.306,"5min":2.5779999999999998,"15min":2.5779999999999998},"last":0.995}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:25:40.705 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-17T02:25:40.705 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:25:40.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.808+0000 7f2667444700 1 Processor -- start 2024-08-17T02:25:40.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.808+0000 7f2667444700 1 -- start start 2024-08-17T02:25:40.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.808+0000 7f2667444700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26600af030 0x7f26600a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.808+0000 7f2667444700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26600b0270 con 0x7f26600a9260 2024-08-17T02:25:40.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.808+0000 7f2667444700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26600af660 con 0x7f266015d540 2024-08-17T02:25:40.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.808+0000 7f2667444700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26600af480 con 0x7f26600af030 2024-08-17T02:25:40.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.808+0000 7f26659e1700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f26600a9260 0x7f26600b0700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:43570/0 (socket says 172.21.15.104:43570) 2024-08-17T02:25:40.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.808+0000 7f26659e1700 1 -- 172.21.15.104:0/2728453709 learned_addr learned my addr 172.21.15.104:0/2728453709 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:25:40.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.808+0000 7f26649df700 1 --2- 172.21.15.104:0/2728453709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26600af030 0x7f26600a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.808+0000 7f2657fff700 1 -- 172.21.15.104:0/2728453709 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3582232544 0 0) 0x7f26600b0270 con 0x7f26600a9260 2024-08-17T02:25:40.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.808+0000 7f2657fff700 1 -- 172.21.15.104:0/2728453709 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f264c003570 con 0x7f26600a9260 2024-08-17T02:25:40.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.808+0000 7f2657fff700 1 -- 172.21.15.104:0/2728453709 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 293450491 0 0) 0x7f26600af660 con 0x7f266015d540 2024-08-17T02:25:40.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.808+0000 7f2657fff700 1 -- 172.21.15.104:0/2728453709 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26600b0270 con 0x7f266015d540 2024-08-17T02:25:40.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.808+0000 7f2657fff700 1 -- 172.21.15.104:0/2728453709 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1623468276 0 0) 0x7f264c003570 con 0x7f26600a9260 2024-08-17T02:25:40.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.808+0000 7f26649df700 1 -- 172.21.15.104:0/2728453709 >> v1:172.21.15.117:6789/0 conn(0x7f266015d540 legacy=0x7f266006e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.808+0000 7f26649df700 1 -- 172.21.15.104:0/2728453709 >> v1:172.21.15.104:6789/0 conn(0x7f26600a9260 legacy=0x7f26600b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.808+0000 7f26649df700 1 -- 172.21.15.104:0/2728453709 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26600af940 con 0x7f26600af030 2024-08-17T02:25:40.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.808+0000 7f26649df700 1 --2- 172.21.15.104:0/2728453709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26600af030 0x7f26600a8d20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f265c009e90 tx=0x7f265c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8cac221ebf6f2b1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:40.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.808+0000 7f2657fff700 1 -- 172.21.15.104:0/2728453709 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265c00e070 con 0x7f26600af030 2024-08-17T02:25:40.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.808+0000 7f2657fff700 1 -- 172.21.15.104:0/2728453709 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f265c00b870 con 0x7f26600af030 2024-08-17T02:25:40.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.808+0000 7f2657fff700 1 -- 172.21.15.104:0/2728453709 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26580013f0 con 0x7f26600af030 2024-08-17T02:25:40.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.812+0000 7f2667444700 1 -- 172.21.15.104:0/2728453709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26600af030 msgr2=0x7f26600a8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.812+0000 7f2667444700 1 --2- 172.21.15.104:0/2728453709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26600af030 0x7f26600a8d20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f265c009e90 tx=0x7f265c009780 comp rx=0 tx=0).stop 2024-08-17T02:25:40.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.812+0000 7f2667444700 1 -- 172.21.15.104:0/2728453709 shutdown_connections 2024-08-17T02:25:40.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.812+0000 7f2667444700 1 --2- 172.21.15.104:0/2728453709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26600af030 0x7f26600a8d20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.812+0000 7f2667444700 1 -- 172.21.15.104:0/2728453709 >> 172.21.15.104:0/2728453709 conn(0x7f2660066e00 msgr2=0x7f2660067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:40.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.812+0000 7f2667444700 1 -- 172.21.15.104:0/2728453709 shutdown_connections 2024-08-17T02:25:40.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.812+0000 7f2667444700 1 -- 172.21.15.104:0/2728453709 wait complete. 2024-08-17T02:25:40.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.812+0000 7f2667444700 1 Processor -- start 2024-08-17T02:25:40.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.812+0000 7f2667444700 1 -- start start 2024-08-17T02:25:40.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.812+0000 7f2667444700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f26600a9260 0x7f2660160000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.812+0000 7f2667444700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26600af030 0x7f266015aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.812+0000 7f2667444700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f266015d540 0x7f2660156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.812+0000 7f2667444700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266015d950 con 0x7f26600a9260 2024-08-17T02:25:40.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.812+0000 7f2667444700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266015dea0 con 0x7f266015d540 2024-08-17T02:25:40.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.812+0000 7f2667444700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26600969f0 con 0x7f26600af030 2024-08-17T02:25:40.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.812+0000 7f26651e0700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f26600a9260 0x7f2660160000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.816+0000 7f26651e0700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f26600a9260 0x7f2660160000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53860/0 (socket says 172.21.15.104:53860) 2024-08-17T02:25:40.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.816+0000 7f26651e0700 1 -- 172.21.15.104:0/3995945536 learned_addr learned my addr 172.21.15.104:0/3995945536 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:40.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.816+0000 7f26649df700 1 --2- 172.21.15.104:0/3995945536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26600af030 0x7f266015aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.816+0000 7f26659e1700 1 --2- 172.21.15.104:0/3995945536 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f266015d540 0x7f2660156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.816+0000 7f26651e0700 1 -- 172.21.15.104:0/3995945536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26600af030 msgr2=0x7f266015aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.816+0000 7f26651e0700 1 --2- 172.21.15.104:0/3995945536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26600af030 0x7f266015aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.816+0000 7f26651e0700 1 -- 172.21.15.104:0/3995945536 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f266015d540 msgr2=0x7f2660156dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.816+0000 7f26651e0700 1 --2- 172.21.15.104:0/3995945536 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f266015d540 0x7f2660156dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.816+0000 7f26651e0700 1 -- 172.21.15.104:0/3995945536 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f265c009a20 con 0x7f26600a9260 2024-08-17T02:25:40.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.816+0000 7f26649df700 1 --2- 172.21.15.104:0/3995945536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26600af030 0x7f266015aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:40.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.816+0000 7f26659e1700 1 --2- 172.21.15.104:0/3995945536 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f266015d540 0x7f2660156dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:40.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.816+0000 7f26651e0700 1 --2- 172.21.15.104:0/3995945536 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f26600a9260 0x7f2660160000 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f265000c790 tx=0x7f2650007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:40.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.816+0000 7f26557fa700 1 -- 172.21.15.104:0/3995945536 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2650011590 con 0x7f26600a9260 2024-08-17T02:25:40.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.816+0000 7f26557fa700 1 -- 172.21.15.104:0/3995945536 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26500116f0 con 0x7f26600a9260 2024-08-17T02:25:40.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.816+0000 7f2667444700 1 -- 172.21.15.104:0/3995945536 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f266015b9d0 con 0x7f26600a9260 2024-08-17T02:25:40.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.816+0000 7f26557fa700 1 -- 172.21.15.104:0/3995945536 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2650011ab0 con 0x7f26600a9260 2024-08-17T02:25:40.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.816+0000 7f2667444700 1 -- 172.21.15.104:0/3995945536 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f266015db30 con 0x7f26600a9260 2024-08-17T02:25:40.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.816+0000 7f2667444700 1 -- 172.21.15.104:0/3995945536 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26600645c0 con 0x7f26600a9260 2024-08-17T02:25:40.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.816+0000 7f26557fa700 1 -- 172.21.15.104:0/3995945536 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f265001c460 con 0x7f26600a9260 2024-08-17T02:25:40.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.820+0000 7f26557fa700 1 --2- 172.21.15.104:0/3995945536 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f2644060860 0x7f2644062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.820+0000 7f26557fa700 1 -- 172.21.15.104:0/3995945536 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f265007c660 con 0x7f26600a9260 2024-08-17T02:25:40.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.820+0000 7f26649df700 1 --2- 172.21.15.104:0/3995945536 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f2644060860 0x7f2644062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.820+0000 7f26649df700 1 --2- 172.21.15.104:0/3995945536 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f2644060860 0x7f2644062d10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f265c0097c0 tx=0x7f265c017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:40.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.824+0000 7f26557fa700 1 -- 172.21.15.104:0/3995945536 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f265004cd50 con 0x7f26600a9260 2024-08-17T02:25:40.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.980+0000 7f2667444700 1 -- 172.21.15.104:0/3995945536 --> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2660160c90 con 0x7f2644060860 2024-08-17T02:25:40.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.984+0000 7f26557fa700 1 -- 172.21.15.104:0/3995945536 <== mgr.4111 v2:172.21.15.117:6832/24084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48902 (secure 0 0 0) 0x7f2660160c90 con 0x7f2644060860 2024-08-17T02:25:40.990 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:25:40.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.988+0000 7f2667444700 1 -- 172.21.15.104:0/3995945536 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f2644060860 msgr2=0x7f2644062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.988+0000 7f2667444700 1 --2- 172.21.15.104:0/3995945536 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f2644060860 0x7f2644062d10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f265c0097c0 tx=0x7f265c017000 comp rx=0 tx=0).stop 2024-08-17T02:25:40.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.988+0000 7f2667444700 1 -- 172.21.15.104:0/3995945536 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f26600a9260 msgr2=0x7f2660160000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.988+0000 7f2667444700 1 --2- 172.21.15.104:0/3995945536 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f26600a9260 0x7f2660160000 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f265000c790 tx=0x7f2650007ea0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.988+0000 7f2667444700 1 -- 172.21.15.104:0/3995945536 shutdown_connections 2024-08-17T02:25:40.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.988+0000 7f2667444700 1 --2- 172.21.15.104:0/3995945536 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f2644060860 0x7f2644062d10 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.988+0000 7f2667444700 1 --2- 172.21.15.104:0/3995945536 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f266015d540 0x7f2660156dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.988+0000 7f2667444700 1 --2- 172.21.15.104:0/3995945536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26600af030 0x7f266015aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.988+0000 7f2667444700 1 --2- 172.21.15.104:0/3995945536 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f26600a9260 0x7f2660160000 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.988+0000 7f2667444700 1 -- 172.21.15.104:0/3995945536 >> 172.21.15.104:0/3995945536 conn(0x7f2660066e00 msgr2=0x7f266006ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:40.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.988+0000 7f2667444700 1 -- 172.21.15.104:0/3995945536 shutdown_connections 2024-08-17T02:25:40.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:40.988+0000 7f2667444700 1 -- 172.21.15.104:0/3995945536 wait complete. 2024-08-17T02:25:40.995 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-08-17T02:25:41.005 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":146,"stamp":"2024-08-17T02:25:40.164796+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":116,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":2388432,"kb_used_data":5408,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752586288,"statfs":{"total":773094113280,"available":770648358912,"internally_reserved":0,"allocated":5537792,"data_stored":3009145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001918"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":184,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-08-17T02:25:37.986451+0000","last_change":"2024-08-17T02:22:11.967052+0000","last_active":"2024-08-17T02:25:37.986451+0000","last_peered":"2024-08-17T02:25:37.986451+0000","last_clean":"2024-08-17T02:25:37.986451+0000","last_became_active":"2024-08-17T02:22:11.965269+0000","last_became_peered":"2024-08-17T02:22:11.965269+0000","last_unstale":"2024-08-17T02:25:37.986451+0000","last_undegraded":"2024-08-17T02:25:37.986451+0000","last_fullsized":"2024-08-17T02:25:37.986451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:10.930862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:10.930862+0000","last_clean_scrub_stamp":"2024-08-17T02:22:10.930862+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:59:34.931003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509487,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297892,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073948,"statfs":{"total":96636764160,"available":96331722752,"internally_reserved":0,"allocated":552960,"data_stored":232065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.92800000000000005,"15min":0.90200000000000002},"min":{"1min":0.56799999999999995,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.2310000000000001,"5min":1.236,"15min":1.236},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.73299999999999998,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.2609999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.72699999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.88300000000000001,"15min":0.88900000000000001},"min":{"1min":0.629,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.90600000000000003,"15min":0.91000000000000003},"min":{"1min":0.70399999999999996,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1739999999999999,"5min":1.413,"15min":1.413},"last":1.423}]},{"osd":2,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.97599999999999998,"15min":0.96199999999999997},"min":{"1min":0.65800000000000003,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.2250000000000001,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":1.4770000000000001},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92800000000000005,"15min":0.92400000000000004},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.198,"5min":1.23,"15min":1.23},"last":1.0209999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.91400000000000003,"15min":0.91100000000000003},"min":{"1min":0.66500000000000004,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.1619999999999999,"5min":1.302,"15min":1.302},"last":1.04},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.96299999999999997,"15min":0.97299999999999998},"min":{"1min":0.74299999999999999,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.254,"5min":1.341,"15min":1.341},"last":1.2589999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.89000000000000001,"15min":0.90400000000000003},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.125,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.014,"5min":1.0529999999999999,"15min":1.0649999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.351,"5min":1.482,"15min":1.482},"last":1.121}]},{"osd":5,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":1.0109999999999999,"15min":1.0209999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.246,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.159,"5min":1.171,"15min":1.1890000000000001},"min":{"1min":0.99099999999999999,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.4159999999999999,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.165}]},{"osd":6,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.1240000000000001,"15min":1.1439999999999999},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.3400000000000001,"5min":1.393,"15min":1.393},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.141,"5min":1.1559999999999999,"15min":1.1639999999999999},"min":{"1min":0.78200000000000003,"5min":0.752,"15min":0.752},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":1.3220000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509486,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298480,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073360,"statfs":{"total":96636764160,"available":96331120640,"internally_reserved":0,"allocated":1146880,"data_stored":822433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.83399999999999996,"15min":0.82799999999999996},"min":{"1min":0.61799999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.92900000000000005,"15min":0.91800000000000004},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.216,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.97899999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.89900000000000002,"15min":0.879},"min":{"1min":0.67000000000000004,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.89900000000000002,"15min":0.90600000000000003},"min":{"1min":0.65600000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.1000000000000001,"5min":1.282,"15min":1.282},"last":1.0189999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.91600000000000004,"15min":0.91200000000000003},"min":{"1min":0.68200000000000005,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.879,"5min":0.874,"15min":0.88200000000000001},"min":{"1min":0.69499999999999995,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.079,"5min":1.216,"15min":1.216},"last":0.80500000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.92600000000000005,"15min":0.93100000000000005},"min":{"1min":0.64900000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":1.0169999999999999,"5min":0.95199999999999996,"15min":0.93899999999999995},"min":{"1min":0.82799999999999996,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.27,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":1.081}]},{"osd":4,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.93700000000000006,"15min":0.95799999999999996},"min":{"1min":0.61699999999999999,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.03,"5min":0.98699999999999999,"15min":0.97099999999999997},"min":{"1min":0.76000000000000001,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":1.0569999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":1.0049999999999999,"15min":1.0309999999999999},"min":{"1min":0.69999999999999996,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.226,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.0609999999999999,"15min":1.091},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.2110000000000001,"5min":1.371,"15min":1.371},"last":0.92900000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.0700000000000001,"15min":1.0609999999999999},"min":{"1min":0.90100000000000002,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.175,"15min":1.1819999999999999},"min":{"1min":0.95699999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":1.548,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.123}]}]},{"osd":4,"up_from":15,"seq":64424509486,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297884,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073956,"statfs":{"total":96636764160,"available":96331730944,"internally_reserved":0,"allocated":536576,"data_stored":226417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.83299999999999996,"15min":0.81200000000000006},"min":{"1min":0.58099999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.204,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85199999999999998,"15min":0.84199999999999997},"min":{"1min":0.64200000000000002,"5min":0.501,"15min":0.501},"max":{"1min":1.0820000000000001,"5min":2.0329999999999999,"15min":2.0329999999999999},"last":0.623}]},{"osd":1,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.86399999999999999,"15min":0.84399999999999997},"min":{"1min":0.64200000000000002,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.2170000000000001,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.95799999999999996,"15min":0.98599999999999999},"min":{"1min":0.71799999999999997,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.1040000000000001,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.56899999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.92700000000000005,"15min":0.95399999999999996},"min":{"1min":0.69599999999999995,"5min":0.621,"15min":0.621},"max":{"1min":1.0589999999999999,"5min":1.726,"15min":1.726},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.92700000000000005,"15min":0.91700000000000004},"min":{"1min":0.69099999999999995,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1930000000000001,"5min":1.367,"15min":1.367},"last":0.66300000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.87,"15min":0.879},"min":{"1min":0.69299999999999995,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.0089999999999999,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.86899999999999999,"5min":1.0069999999999999,"15min":1.05},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.173,"5min":1.653,"15min":1.653},"last":1.0389999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.91500000000000004,"15min":0.92900000000000005},"min":{"1min":0.60899999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.214,"5min":1.3,"15min":1.3},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.995,"15min":1.0329999999999999},"min":{"1min":0.64500000000000002,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.194,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.95999999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":1.069,"15min":1.097},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.2370000000000001,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.107,"15min":1.1140000000000001},"min":{"1min":0.77000000000000002,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.5109999999999999,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":1.0029999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.0449999999999999,"15min":1.0600000000000001},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.167,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.071,"5min":1.2070000000000001,"15min":1.2450000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.542,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":1.1459999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509486,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297900,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073940,"statfs":{"total":96636764160,"available":96331714560,"internally_reserved":0,"allocated":552960,"data_stored":232065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63300000000000001,"15min":0.64900000000000002},"min":{"1min":0.47299999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.77700000000000002,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.76700000000000002,"15min":0.754},"min":{"1min":0.66600000000000004,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.006,"5min":1.159,"15min":1.159},"last":0.60299999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.70299999999999996,"15min":0.68700000000000006},"min":{"1min":0.51700000000000002,"5min":0.443,"15min":0.443},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.81399999999999995,"15min":0.83099999999999996},"min":{"1min":0.54400000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0129999999999999,"5min":1.381,"15min":1.381},"last":0.79500000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.70299999999999996,"15min":0.69699999999999995},"min":{"1min":0.59199999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.873,"5min":0.876,"15min":0.88200000000000001},"min":{"1min":0.60999999999999999,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0189999999999999,"5min":1.45,"15min":1.45},"last":0.66100000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":0.93100000000000005,"15min":0.91100000000000003},"min":{"1min":0.85999999999999999,"5min":0.63,"15min":0.63},"max":{"1min":1.3100000000000001,"5min":1.526,"15min":1.526},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97499999999999998,"15min":0.98699999999999999},"min":{"1min":0.77700000000000002,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.306,"5min":2.04,"15min":2.04},"last":0.90100000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":1.006,"15min":1.0129999999999999},"min":{"1min":0.74099999999999999,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.272,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.034,"5min":1.0449999999999999,"15min":1.054},"min":{"1min":0.85599999999999998,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.2529999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.0469999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.093,"15min":1.1060000000000001},"min":{"1min":0.85599999999999998,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.248,"5min":1.577,"15min":1.577},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.081,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.97699999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.2629999999999999,"5min":1.448,"15min":1.448},"last":0.872}]},{"osd":7,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.0920000000000001,"15min":1.0880000000000001},"min":{"1min":0.94999999999999996,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.3620000000000001,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.121},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.131,"15min":1.125},"min":{"1min":0.90400000000000003,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.6799999999999999,"5min":2.109,"15min":2.109},"last":1.1839999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509486,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297880,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073960,"statfs":{"total":96636764160,"available":96331735040,"internally_reserved":0,"allocated":536576,"data_stored":226417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.62,"15min":0.627},"min":{"1min":0.40699999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90200000000000002,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":1.1299999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68799999999999994,"15min":0.67900000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.81799999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.747,"15min":0.73299999999999998},"min":{"1min":0.55000000000000004,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.77100000000000002,"15min":0.75600000000000001},"min":{"1min":0.52000000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.59799999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.752,"15min":0.746},"min":{"1min":0.55900000000000005,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0609999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.754},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.80800000000000005,"15min":0.81000000000000005},"min":{"1min":0.48099999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.3660000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.67200000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.94899999999999995,"15min":0.94799999999999995},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.2030000000000001,"5min":1.391,"15min":1.391},"last":1.288},{"interface":"front","average":{"1min":0.96299999999999997,"5min":1.0449999999999999,"15min":1.073},"min":{"1min":0.745,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.2370000000000001,"5min":1.974,"15min":1.974},"last":1.0920000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0820000000000001,"15min":1.1140000000000001},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.3280000000000001,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.999,"5min":1.0249999999999999,"15min":1.026},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.274,"5min":1.296,"15min":1.296},"last":1.4039999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.087,"15min":1.111},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.3080000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.079,"5min":1.1040000000000001,"15min":1.1259999999999999},"min":{"1min":0.76100000000000001,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.284,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.3759999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.141,"15min":1.165},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.3819999999999999,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":1.258},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.1279999999999999,"15min":1.1240000000000001},"min":{"1min":0.73199999999999998,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.411,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.325}]}]},{"osd":1,"up_from":15,"seq":64424509487,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298480,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073360,"statfs":{"total":96636764160,"available":96331120640,"internally_reserved":0,"allocated":1146880,"data_stored":822433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66000000000000003,"15min":0.67500000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.137,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.69399999999999995,"15min":0.68400000000000005},"min":{"1min":0.502,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.96799999999999997,"5min":1.016,"15min":1.016},"last":0.83899999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.72599999999999998,"15min":0.74199999999999999},"min":{"1min":0.55000000000000004,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.1419999999999999,"5min":1.194,"15min":1.194},"last":1.663},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.79800000000000004,"15min":0.79200000000000004},"min":{"1min":0.60799999999999998,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.083,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.494}]},{"osd":3,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.86599999999999999,"15min":0.879},"min":{"1min":0.63200000000000001,"5min":0.63,"15min":0.63},"max":{"1min":1.129,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.5860000000000001},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.86499999999999999,"15min":0.85099999999999998},"min":{"1min":0.624,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.91800000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.97699999999999998,"15min":0.97199999999999998},"min":{"1min":0.78900000000000003,"5min":0.746,"15min":0.746},"max":{"1min":1.1699999999999999,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":1.4299999999999999},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.0429999999999999,"15min":1.069},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.165,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":1.4119999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.018,"15min":1.024},"min":{"1min":0.79000000000000004,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.248,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":1.7190000000000001},{"interface":"front","average":{"1min":1.081,"5min":1.1419999999999999,"15min":1.1679999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.272,"5min":1.893,"15min":1.893},"last":1.5469999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.123,"15min":1.129},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.304,"5min":1.964,"15min":1.964},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.091,"5min":1.133,"15min":1.145},"min":{"1min":0.83399999999999996,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.282,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.772}]},{"osd":7,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.1859999999999999,"15min":1.194},"min":{"1min":0.96499999999999997,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.478,"5min":1.649,"15min":1.649},"last":1.6319999999999999},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.179,"15min":1.179},"min":{"1min":0.92000000000000004,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.3819999999999999,"5min":1.5,"15min":1.5},"last":1.514}]}]},{"osd":0,"up_from":15,"seq":64424509486,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297884,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073956,"statfs":{"total":96636764160,"available":96331730944,"internally_reserved":0,"allocated":536576,"data_stored":226417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:25:17 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.63900000000000001,"15min":0.63500000000000001},"min":{"1min":0.50800000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.97799999999999998,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71499999999999997,"15min":0.70299999999999996},"min":{"1min":0.56599999999999995,"5min":0.318,"15min":0.318},"max":{"1min":0.999,"5min":1.498,"15min":1.498},"last":0.55900000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:25:17 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.72599999999999998,"15min":0.69799999999999995},"min":{"1min":0.53900000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.71099999999999997,"15min":0.68100000000000005},"min":{"1min":0.56000000000000005,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.623}]},{"osd":3,"last update":"Sat Aug 17 02:25:17 2024","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.878,"15min":0.90100000000000002},"min":{"1min":0.56599999999999995,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.2110000000000001,"5min":5.0270000000000001,"15min":5.0270000000000001},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81200000000000006,"15min":0.80200000000000005},"min":{"1min":0.61099999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.69599999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:25:17 2024","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.98099999999999998,"15min":0.97499999999999998},"min":{"1min":0.80600000000000005,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.26,"5min":2.633,"15min":2.633},"last":1.1870000000000001},{"interface":"front","average":{"1min":0.94599999999999995,"5min":1.099,"15min":1.169},"min":{"1min":0.746,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.141,"5min":5.0700000000000003,"15min":5.0700000000000003},"last":1.0680000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:25:17 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.048,"15min":1.032},"min":{"1min":0.80000000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.365,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":1.236},{"interface":"front","average":{"1min":1.026,"5min":1.0620000000000001,"15min":1.0600000000000001},"min":{"1min":0.79500000000000004,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.333,"5min":1.915,"15min":1.915},"last":0.88600000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:25:17 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.1910000000000001,"15min":1.262},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.347,"5min":5.133,"15min":5.133},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.85499999999999998,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.323,"5min":1.702,"15min":1.702},"last":1.151}]},{"osd":7,"last update":"Sat Aug 17 02:25:17 2024","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.145,"15min":1.137},"min":{"1min":0.76600000000000001,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.4419999999999999,"5min":2.3759999999999999,"15min":2.3759999999999999},"last":1.016},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.254,"15min":1.3120000000000001},"min":{"1min":0.88100000000000001,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.3819999999999999,"5min":5.101,"15min":5.101},"last":0.92300000000000004}]}]},{"osd":6,"up_from":14,"seq":60129542191,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302032,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069808,"statfs":{"total":96636764160,"available":96327483392,"internally_reserved":0,"allocated":528384,"data_stored":220898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.90800000000000003,"15min":0.89600000000000002},"min":{"1min":0.64500000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.284,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.86899999999999999,"15min":0.84199999999999997},"min":{"1min":0.628,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.2370000000000001,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":1.02}]},{"osd":1,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.92800000000000005,"15min":0.94799999999999995},"min":{"1min":0.66300000000000003,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.097,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.95099999999999996,"15min":0.97899999999999998},"min":{"1min":0.61499999999999999,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.2529999999999999,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.94299999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.97999999999999998,"15min":1.016},"min":{"1min":0.65600000000000003,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.23,"5min":1.377,"15min":1.377},"last":0.58099999999999996},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.94799999999999995,"15min":0.92000000000000004},"min":{"1min":0.74299999999999999,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.323,"5min":1.635,"15min":1.635},"last":0.88600000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":1.024,"15min":1.018},"min":{"1min":0.65700000000000003,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.23,"5min":1.772,"15min":1.772},"last":0.74299999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0349999999999999,"15min":1.052},"min":{"1min":0.77900000000000003,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.196,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.65400000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.95699999999999996,"15min":0.96099999999999997},"min":{"1min":0.65100000000000002,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.198,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.0580000000000001},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.0720000000000001,"15min":1.0860000000000001},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.3680000000000001,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.085}]},{"osd":5,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":1.069,"15min":1.127},"min":{"1min":0.69299999999999995,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.2130000000000001,"5min":2.2759999999999998,"15min":2.2759999999999998},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.075,"5min":1.1659999999999999,"15min":1.202},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.409,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.153}]},{"osd":7,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.1930000000000001,"15min":1.2110000000000001},"min":{"1min":0.78700000000000003,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.365,"5min":2.5059999999999998,"15min":2.5059999999999998},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.218,"15min":1.268},"min":{"1min":0.84499999999999997,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.306,"5min":2.5779999999999998,"15min":2.5779999999999998},"last":0.995}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:25:41.006 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:41.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.104+0000 7f86c5d01700 1 Processor -- start 2024-08-17T02:25:41.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.104+0000 7f86c5d01700 1 -- start start 2024-08-17T02:25:41.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.104+0000 7f86c5d01700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86c00b0350 0x7f86c00ad7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:41.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.104+0000 7f86c5d01700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f86c006df10 0x7f86c006e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:41.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.104+0000 7f86c5d01700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c00af2b0 con 0x7f86c0155d20 2024-08-17T02:25:41.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.104+0000 7f86c5d01700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86c00b07a0 con 0x7f86c006df10 2024-08-17T02:25:41.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.104+0000 7f86c5d01700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c006e8d0 con 0x7f86c00b0350 2024-08-17T02:25:41.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.104+0000 7f86bffff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86c00b0350 0x7f86c00ad7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:41.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.104+0000 7f86c5500700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f86c006df10 0x7f86c006e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:41.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.104+0000 7f86bffff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86c00b0350 0x7f86c00ad7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.104:41232/0 (socket says 172.21.15.104:41232) 2024-08-17T02:25:41.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.104+0000 7f86bffff700 1 -- 172.21.15.104:0/4271388215 learned_addr learned my addr 172.21.15.104:0/4271388215 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:41.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.104+0000 7f86bffff700 1 -- 172.21.15.104:0/4271388215 >> v2:172.21.15.117:3300/0 conn(0x7f86c006df10 msgr2=0x7f86c006e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:41.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.104+0000 7f86bffff700 1 --2- 172.21.15.104:0/4271388215 >> v2:172.21.15.117:3300/0 conn(0x7f86c006df10 0x7f86c006e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.104+0000 7f86bffff700 1 -- 172.21.15.104:0/4271388215 >> v1:172.21.15.117:6789/0 conn(0x7f86c0155d20 legacy=0x7f86c00aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:41.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.104+0000 7f86bffff700 1 -- 172.21.15.104:0/4271388215 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c00af590 con 0x7f86c00b0350 2024-08-17T02:25:41.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.104+0000 7f86bffff700 1 --2- 172.21.15.104:0/4271388215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86c00b0350 0x7f86c00ad7c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f86b40099b0 tx=0x7f86b4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a47547580d6b5d52 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:41.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.104+0000 7f86bf7fe700 1 -- 172.21.15.104:0/4271388215 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b4009ea0 con 0x7f86c00b0350 2024-08-17T02:25:41.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.104+0000 7f86bf7fe700 1 -- 172.21.15.104:0/4271388215 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b400b860 con 0x7f86c00b0350 2024-08-17T02:25:41.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.104+0000 7f86bf7fe700 1 -- 172.21.15.104:0/4271388215 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b400bc00 con 0x7f86c00b0350 2024-08-17T02:25:41.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.104+0000 7f86c5d01700 1 -- 172.21.15.104:0/4271388215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86c00b0350 msgr2=0x7f86c00ad7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:41.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.104+0000 7f86c5d01700 1 --2- 172.21.15.104:0/4271388215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86c00b0350 0x7f86c00ad7c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f86b40099b0 tx=0x7f86b4009250 comp rx=0 tx=0).stop 2024-08-17T02:25:41.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.104+0000 7f86c5d01700 1 -- 172.21.15.104:0/4271388215 shutdown_connections 2024-08-17T02:25:41.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.104+0000 7f86c5d01700 1 --2- 172.21.15.104:0/4271388215 >> v2:172.21.15.117:3300/0 conn(0x7f86c006df10 0x7f86c006e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.104+0000 7f86c5d01700 1 --2- 172.21.15.104:0/4271388215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86c00b0350 0x7f86c00ad7c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.104+0000 7f86c5d01700 1 -- 172.21.15.104:0/4271388215 >> 172.21.15.104:0/4271388215 conn(0x7f86c00678d0 msgr2=0x7f86c0067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:41.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.104+0000 7f86c5d01700 1 -- 172.21.15.104:0/4271388215 shutdown_connections 2024-08-17T02:25:41.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.104+0000 7f86c5d01700 1 -- 172.21.15.104:0/4271388215 wait complete. 2024-08-17T02:25:41.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.108+0000 7f86c5d01700 1 Processor -- start 2024-08-17T02:25:41.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.108+0000 7f86c5d01700 1 -- start start 2024-08-17T02:25:41.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.108+0000 7f86c5d01700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86c006df10 0x7f86c013c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:41.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.108+0000 7f86c5d01700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86c00b0350 0x7f86c0157910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:41.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.108+0000 7f86c5d01700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86c0155d20 0x7f86c0157e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:41.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.108+0000 7f86c5d01700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c015b780 con 0x7f86c00b0350 2024-08-17T02:25:41.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.108+0000 7f86c5d01700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c015b2f0 con 0x7f86c006df10 2024-08-17T02:25:41.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.108+0000 7f86c5d01700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c0148d20 con 0x7f86c0155d20 2024-08-17T02:25:41.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.108+0000 7f86bffff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86c00b0350 0x7f86c0157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:41.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.108+0000 7f86bffff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86c00b0350 0x7f86c0157910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53866/0 (socket says 172.21.15.104:53866) 2024-08-17T02:25:41.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.108+0000 7f86bffff700 1 -- 172.21.15.104:0/2894548109 learned_addr learned my addr 172.21.15.104:0/2894548109 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:41.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.108+0000 7f86c5500700 1 --2- 172.21.15.104:0/2894548109 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86c0155d20 0x7f86c0157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:41.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.108+0000 7f86c4cff700 1 --2- 172.21.15.104:0/2894548109 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86c006df10 0x7f86c013c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:41.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.108+0000 7f86bffff700 1 -- 172.21.15.104:0/2894548109 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86c0155d20 msgr2=0x7f86c0157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:41.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.108+0000 7f86bffff700 1 --2- 172.21.15.104:0/2894548109 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86c0155d20 0x7f86c0157e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.108+0000 7f86bffff700 1 -- 172.21.15.104:0/2894548109 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86c006df10 msgr2=0x7f86c013c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:41.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.108+0000 7f86bffff700 1 --2- 172.21.15.104:0/2894548109 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86c006df10 0x7f86c013c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.108+0000 7f86bffff700 1 -- 172.21.15.104:0/2894548109 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b40094f0 con 0x7f86c00b0350 2024-08-17T02:25:41.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.108+0000 7f86c4cff700 1 --2- 172.21.15.104:0/2894548109 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86c006df10 0x7f86c013c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:41.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.108+0000 7f86c5500700 1 --2- 172.21.15.104:0/2894548109 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86c0155d20 0x7f86c0157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:41.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.108+0000 7f86bffff700 1 --2- 172.21.15.104:0/2894548109 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86c00b0350 0x7f86c0157910 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f86b4006fd0 tx=0x7f86b4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:41.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.108+0000 7f86bcff9700 1 -- 172.21.15.104:0/2894548109 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b400bbe0 con 0x7f86c00b0350 2024-08-17T02:25:41.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.108+0000 7f86bcff9700 1 -- 172.21.15.104:0/2894548109 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b4011420 con 0x7f86c00b0350 2024-08-17T02:25:41.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.108+0000 7f86c5d01700 1 -- 172.21.15.104:0/2894548109 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86c015a9c0 con 0x7f86c00b0350 2024-08-17T02:25:41.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.108+0000 7f86bcff9700 1 -- 172.21.15.104:0/2894548109 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b40117e0 con 0x7f86c00b0350 2024-08-17T02:25:41.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.108+0000 7f86c5d01700 1 -- 172.21.15.104:0/2894548109 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c015af80 con 0x7f86c00b0350 2024-08-17T02:25:41.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.108+0000 7f86c5d01700 1 -- 172.21.15.104:0/2894548109 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86c00643a0 con 0x7f86c00b0350 2024-08-17T02:25:41.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.112+0000 7f86bcff9700 1 -- 172.21.15.104:0/2894548109 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f86b4011bd0 con 0x7f86c00b0350 2024-08-17T02:25:41.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.112+0000 7f86bcff9700 1 --2- 172.21.15.104:0/2894548109 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f86ac060860 0x7f86ac062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:41.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.112+0000 7f86bcff9700 1 -- 172.21.15.104:0/2894548109 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f86b407e2a0 con 0x7f86c00b0350 2024-08-17T02:25:41.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.112+0000 7f86c4cff700 1 --2- 172.21.15.104:0/2894548109 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f86ac060860 0x7f86ac062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:41.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.112+0000 7f86c4cff700 1 --2- 172.21.15.104:0/2894548109 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f86ac060860 0x7f86ac062d10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f86b0007fd0 tx=0x7f86b0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:41.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.116+0000 7f86bcff9700 1 -- 172.21.15.104:0/2894548109 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f86b404e970 con 0x7f86c00b0350 2024-08-17T02:25:41.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.276+0000 7f86c5d01700 1 -- 172.21.15.104:0/2894548109 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86c006f5f0 con 0x7f86c00b0350 2024-08-17T02:25:41.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.276+0000 7f86bcff9700 1 -- 172.21.15.104:0/2894548109 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+12441 (secure 0 0 0) 0x7f86b407ce60 con 0x7f86c00b0350 2024-08-17T02:25:41.283 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:25:41.283 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":47,"fsid":"fd5f7fb8-d34b-49bb-89a8-62b7dad1bc25","created":"2024-08-17T02:21:57.891389+0000","modified":"2024-08-17T02:25:38.054060+0000","last_up_change":"2024-08-17T02:22:08.924546+0000","last_in_change":"2024-08-17T02:21:59.938028+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:22:10.143970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"606b9088-590e-4709-aa3a-b0f6e22972ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":24257},{"type":"v1","addr":"172.21.15.104:6809","nonce":24257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":24257},{"type":"v1","addr":"172.21.15.104:6811","nonce":24257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":24257},{"type":"v1","addr":"172.21.15.104:6815","nonce":24257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":24257},{"type":"v1","addr":"172.21.15.104:6813","nonce":24257}]},"public_addr":"172.21.15.104:6809/24257","cluster_addr":"172.21.15.104:6811/24257","heartbeat_back_addr":"172.21.15.104:6815/24257","heartbeat_front_addr":"172.21.15.104:6813/24257","state":["exists","up"]},{"osd":1,"uuid":"9bc6a909-0c2f-4889-afe7-4a47f89b0f64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":24256},{"type":"v1","addr":"172.21.15.104:6825","nonce":24256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":24256},{"type":"v1","addr":"172.21.15.104:6827","nonce":24256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":24256},{"type":"v1","addr":"172.21.15.104:6831","nonce":24256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":24256},{"type":"v1","addr":"172.21.15.104:6829","nonce":24256}]},"public_addr":"172.21.15.104:6825/24256","cluster_addr":"172.21.15.104:6827/24256","heartbeat_back_addr":"172.21.15.104:6831/24256","heartbeat_front_addr":"172.21.15.104:6829/24256","state":["exists","up"]},{"osd":2,"uuid":"23da31d5-aefb-4edb-b79d-fa05e1becef7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":24255},{"type":"v1","addr":"172.21.15.104:6817","nonce":24255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":24255},{"type":"v1","addr":"172.21.15.104:6819","nonce":24255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":24255},{"type":"v1","addr":"172.21.15.104:6823","nonce":24255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":24255},{"type":"v1","addr":"172.21.15.104:6821","nonce":24255}]},"public_addr":"172.21.15.104:6817/24255","cluster_addr":"172.21.15.104:6819/24255","heartbeat_back_addr":"172.21.15.104:6823/24255","heartbeat_front_addr":"172.21.15.104:6821/24255","state":["exists","up"]},{"osd":3,"uuid":"6e4a5ec2-b415-45ef-8381-61a59eb65224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":24254},{"type":"v1","addr":"172.21.15.104:6801","nonce":24254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":24254},{"type":"v1","addr":"172.21.15.104:6803","nonce":24254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":24254},{"type":"v1","addr":"172.21.15.104:6807","nonce":24254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":24254},{"type":"v1","addr":"172.21.15.104:6805","nonce":24254}]},"public_addr":"172.21.15.104:6801/24254","cluster_addr":"172.21.15.104:6803/24254","heartbeat_back_addr":"172.21.15.104:6807/24254","heartbeat_front_addr":"172.21.15.104:6805/24254","state":["exists","up"]},{"osd":4,"uuid":"8d5bea2d-9039-4013-8c99-2c046c5b8a17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":24421},{"type":"v1","addr":"172.21.15.117:6804","nonce":24421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":24421},{"type":"v1","addr":"172.21.15.117:6809","nonce":24421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":24421},{"type":"v1","addr":"172.21.15.117:6815","nonce":24421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":24421},{"type":"v1","addr":"172.21.15.117:6813","nonce":24421}]},"public_addr":"172.21.15.117:6804/24421","cluster_addr":"172.21.15.117:6809/24421","heartbeat_back_addr":"172.21.15.117:6815/24421","heartbeat_front_addr":"172.21.15.117:6813/24421","state":["exists","up"]},{"osd":5,"uuid":"de8b36fc-121c-4f05-8f5b-28f513d9f21f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":24422},{"type":"v1","addr":"172.21.15.117:6817","nonce":24422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":24422},{"type":"v1","addr":"172.21.15.117:6819","nonce":24422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":24422},{"type":"v1","addr":"172.21.15.117:6823","nonce":24422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":24422},{"type":"v1","addr":"172.21.15.117:6821","nonce":24422}]},"public_addr":"172.21.15.117:6817/24422","cluster_addr":"172.21.15.117:6819/24422","heartbeat_back_addr":"172.21.15.117:6823/24422","heartbeat_front_addr":"172.21.15.117:6821/24422","state":["exists","up"]},{"osd":6,"uuid":"6a87f09f-7bf7-4f7a-be87-530ac1ff8ea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":24420},{"type":"v1","addr":"172.21.15.117:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6803","nonce":24420},{"type":"v1","addr":"172.21.15.117:6805","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":24420},{"type":"v1","addr":"172.21.15.117:6811","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":24420},{"type":"v1","addr":"172.21.15.117:6808","nonce":24420}]},"public_addr":"172.21.15.117:6801/24420","cluster_addr":"172.21.15.117:6805/24420","heartbeat_back_addr":"172.21.15.117:6811/24420","heartbeat_front_addr":"172.21.15.117:6808/24420","state":["exists","up"]},{"osd":7,"uuid":"e31d8041-1aa1-4b5d-83b3-0a373426dd9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":24423},{"type":"v1","addr":"172.21.15.117:6825","nonce":24423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":24423},{"type":"v1","addr":"172.21.15.117:6827","nonce":24423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":24423},{"type":"v1","addr":"172.21.15.117:6831","nonce":24423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":24423},{"type":"v1","addr":"172.21.15.117:6829","nonce":24423}]},"public_addr":"172.21.15.117:6825/24423","cluster_addr":"172.21.15.117:6827/24423","heartbeat_back_addr":"172.21.15.117:6831/24423","heartbeat_front_addr":"172.21.15.117:6829/24423","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.220874+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.210039+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.434762+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.247206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.184316+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.306325+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.035719+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:22:05.400303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.104:6832/4148924116":"2024-08-18T02:25:35.039929+0000","172.21.15.104:6833/4148924116":"2024-08-18T02:25:35.039929+0000","172.21.15.104:6835/38993094":"2024-08-18T02:25:28.820410+0000","172.21.15.104:6834/38993094":"2024-08-18T02:25:28.820410+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:41.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.280+0000 7f86c5d01700 1 -- 172.21.15.104:0/2894548109 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f86ac060860 msgr2=0x7f86ac062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:41.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.280+0000 7f86c5d01700 1 --2- 172.21.15.104:0/2894548109 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f86ac060860 0x7f86ac062d10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f86b0007fd0 tx=0x7f86b0009040 comp rx=0 tx=0).stop 2024-08-17T02:25:41.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.280+0000 7f86c5d01700 1 -- 172.21.15.104:0/2894548109 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86c00b0350 msgr2=0x7f86c0157910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:41.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.280+0000 7f86c5d01700 1 --2- 172.21.15.104:0/2894548109 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86c00b0350 0x7f86c0157910 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f86b4006fd0 tx=0x7f86b4017000 comp rx=0 tx=0).stop 2024-08-17T02:25:41.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.280+0000 7f86c5d01700 1 -- 172.21.15.104:0/2894548109 shutdown_connections 2024-08-17T02:25:41.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.280+0000 7f86c5d01700 1 --2- 172.21.15.104:0/2894548109 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f86ac060860 0x7f86ac062d10 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.280+0000 7f86c5d01700 1 --2- 172.21.15.104:0/2894548109 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86c0155d20 0x7f86c0157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.280+0000 7f86c5d01700 1 --2- 172.21.15.104:0/2894548109 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86c00b0350 0x7f86c0157910 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.280+0000 7f86c5d01700 1 --2- 172.21.15.104:0/2894548109 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86c006df10 0x7f86c013c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.280+0000 7f86c5d01700 1 -- 172.21.15.104:0/2894548109 >> 172.21.15.104:0/2894548109 conn(0x7f86c00678d0 msgr2=0x7f86c014b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:41.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.280+0000 7f86c5d01700 1 -- 172.21.15.104:0/2894548109 shutdown_connections 2024-08-17T02:25:41.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:41.284+0000 7f86c5d01700 1 -- 172.21.15.104:0/2894548109 wait complete. 2024-08-17T02:25:42.305 INFO:tasks.ceph:Scrubbing osd.0 2024-08-17T02:25:42.305 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:25:42.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.424+0000 7f7931c51700 1 Processor -- start 2024-08-17T02:25:42.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.424+0000 7f7931c51700 1 -- start start 2024-08-17T02:25:42.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.428+0000 7f7931c51700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f792c157050 0x7f792c06d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:42.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.428+0000 7f7931c51700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f792c0ac0d0 0x7f792c0ac520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:42.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.428+0000 7f7931c51700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f792c0ad940 0x7f792c0adde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:42.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.428+0000 7f7931c51700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f792c0ca0b0 con 0x7f792c157050 2024-08-17T02:25:42.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.428+0000 7f7931c51700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f792c0ae320 con 0x7f792c0ad940 2024-08-17T02:25:42.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.428+0000 7f7931c51700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f792c0c97c0 con 0x7f792c0ac0d0 2024-08-17T02:25:42.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.428+0000 7f7930c4f700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f792c157050 0x7f792c06d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:42.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.428+0000 7f7930c4f700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f792c157050 0x7f792c06d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53868/0 (socket says 172.21.15.104:53868) 2024-08-17T02:25:42.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.428+0000 7f7930c4f700 1 -- 172.21.15.104:0/2890339667 learned_addr learned my addr 172.21.15.104:0/2890339667 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:42.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.428+0000 7f7931450700 1 --2- 172.21.15.104:0/2890339667 >> v2:172.21.15.117:3300/0 conn(0x7f792c0ad940 0x7f792c0adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:42.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.428+0000 7f792bfff700 1 --2- 172.21.15.104:0/2890339667 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f792c0ac0d0 0x7f792c0ac520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:42.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.428+0000 7f7930c4f700 1 -- 172.21.15.104:0/2890339667 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f792c0ac0d0 msgr2=0x7f792c0ac520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:42.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.428+0000 7f7930c4f700 1 --2- 172.21.15.104:0/2890339667 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f792c0ac0d0 0x7f792c0ac520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.428+0000 7f7930c4f700 1 -- 172.21.15.104:0/2890339667 >> v2:172.21.15.117:3300/0 conn(0x7f792c0ad940 msgr2=0x7f792c0adde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:42.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.428+0000 7f7930c4f700 1 --2- 172.21.15.104:0/2890339667 >> v2:172.21.15.117:3300/0 conn(0x7f792c0ad940 0x7f792c0adde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.428+0000 7f7930c4f700 1 -- 172.21.15.104:0/2890339667 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f792c0acb20 con 0x7f792c157050 2024-08-17T02:25:42.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.428+0000 7f7930c4f700 1 --2- 172.21.15.104:0/2890339667 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f792c157050 0x7f792c06d120 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f792c068ed0 tx=0x7f7920009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ad17d98d3e8ed3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:42.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.428+0000 7f792b7fe700 1 -- 172.21.15.104:0/2890339667 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792000b640 con 0x7f792c157050 2024-08-17T02:25:42.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.428+0000 7f792b7fe700 1 -- 172.21.15.104:0/2890339667 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f792000b7a0 con 0x7f792c157050 2024-08-17T02:25:42.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.428+0000 7f792b7fe700 1 -- 172.21.15.104:0/2890339667 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792000bb60 con 0x7f792c157050 2024-08-17T02:25:42.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.428+0000 7f7931c51700 1 -- 172.21.15.104:0/2890339667 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f792c157050 msgr2=0x7f792c06d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:42.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.428+0000 7f7931c51700 1 --2- 172.21.15.104:0/2890339667 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f792c157050 0x7f792c06d120 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f792c068ed0 tx=0x7f7920009250 comp rx=0 tx=0).stop 2024-08-17T02:25:42.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.428+0000 7f7931c51700 1 -- 172.21.15.104:0/2890339667 shutdown_connections 2024-08-17T02:25:42.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.428+0000 7f7931c51700 1 --2- 172.21.15.104:0/2890339667 >> v2:172.21.15.117:3300/0 conn(0x7f792c0ad940 0x7f792c0adde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.428+0000 7f7931c51700 1 --2- 172.21.15.104:0/2890339667 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f792c0ac0d0 0x7f792c0ac520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.428+0000 7f7931c51700 1 --2- 172.21.15.104:0/2890339667 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f792c157050 0x7f792c06d120 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.428+0000 7f7931c51700 1 -- 172.21.15.104:0/2890339667 >> 172.21.15.104:0/2890339667 conn(0x7f792c066e00 msgr2=0x7f792c067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:42.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.432+0000 7f7931c51700 1 -- 172.21.15.104:0/2890339667 shutdown_connections 2024-08-17T02:25:42.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.432+0000 7f7931c51700 1 -- 172.21.15.104:0/2890339667 wait complete. 2024-08-17T02:25:42.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.432+0000 7f7931c51700 1 Processor -- start 2024-08-17T02:25:42.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.432+0000 7f7931c51700 1 -- start start 2024-08-17T02:25:42.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.432+0000 7f7931c51700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f792c0ac0d0 0x7f792c152810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:42.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.432+0000 7f7931c51700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f792c0ad940 0x7f792c142f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:42.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.432+0000 7f7931c51700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f792c1434c0 0x7f792c157970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:42.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.432+0000 7f7931c51700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792c150c50 con 0x7f792c0ad940 2024-08-17T02:25:42.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.432+0000 7f7931c51700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792c152d50 con 0x7f792c0ac0d0 2024-08-17T02:25:42.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.432+0000 7f7931c51700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f792c153b90 con 0x7f792c1434c0 2024-08-17T02:25:42.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.432+0000 7f792bfff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f792c0ad940 0x7f792c142f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:42.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.432+0000 7f792bfff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f792c0ad940 0x7f792c142f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53870/0 (socket says 172.21.15.104:53870) 2024-08-17T02:25:42.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.432+0000 7f792bfff700 1 -- 172.21.15.104:0/3871887493 learned_addr learned my addr 172.21.15.104:0/3871887493 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:42.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.432+0000 7f7931450700 1 --2- 172.21.15.104:0/3871887493 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f792c1434c0 0x7f792c157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:42.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.432+0000 7f7930c4f700 1 --2- 172.21.15.104:0/3871887493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f792c0ac0d0 0x7f792c152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:42.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.432+0000 7f792bfff700 1 -- 172.21.15.104:0/3871887493 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f792c1434c0 msgr2=0x7f792c157970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:42.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.432+0000 7f792bfff700 1 --2- 172.21.15.104:0/3871887493 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f792c1434c0 0x7f792c157970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.432+0000 7f792bfff700 1 -- 172.21.15.104:0/3871887493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f792c0ac0d0 msgr2=0x7f792c152810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:42.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.432+0000 7f792bfff700 1 --2- 172.21.15.104:0/3871887493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f792c0ac0d0 0x7f792c152810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.432+0000 7f792bfff700 1 -- 172.21.15.104:0/3871887493 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79200094f0 con 0x7f792c0ad940 2024-08-17T02:25:42.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.432+0000 7f7930c4f700 1 --2- 172.21.15.104:0/3871887493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f792c0ac0d0 0x7f792c152810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:42.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.432+0000 7f792bfff700 1 --2- 172.21.15.104:0/3871887493 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f792c0ad940 0x7f792c142f80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f791c00e980 tx=0x7f791c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:42.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.436+0000 7f7928ff9700 1 -- 172.21.15.104:0/3871887493 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c00ee70 con 0x7f792c0ad940 2024-08-17T02:25:42.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.436+0000 7f7928ff9700 1 -- 172.21.15.104:0/3871887493 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f791c00c8e0 con 0x7f792c0ad940 2024-08-17T02:25:42.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.436+0000 7f7931c51700 1 -- 172.21.15.104:0/3871887493 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f792c152f80 con 0x7f792c0ad940 2024-08-17T02:25:42.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.436+0000 7f7928ff9700 1 -- 172.21.15.104:0/3871887493 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c00cca0 con 0x7f792c0ad940 2024-08-17T02:25:42.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.436+0000 7f7931c51700 1 -- 172.21.15.104:0/3871887493 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f792c153540 con 0x7f792c0ad940 2024-08-17T02:25:42.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.436+0000 7f7931c51700 1 -- 172.21.15.104:0/3871887493 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f792c0644b0 con 0x7f792c0ad940 2024-08-17T02:25:42.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.436+0000 7f7928ff9700 1 -- 172.21.15.104:0/3871887493 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f791c013680 con 0x7f792c0ad940 2024-08-17T02:25:42.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.436+0000 7f7928ff9700 1 --2- 172.21.15.104:0/3871887493 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7918060860 0x7f7918062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:42.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.436+0000 7f7928ff9700 1 -- 172.21.15.104:0/3871887493 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f791c07cee0 con 0x7f792c0ad940 2024-08-17T02:25:42.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.436+0000 7f7928ff9700 1 --2- 172.21.15.104:0/3871887493 >> [v2:172.21.15.104:6808/24257,v1:172.21.15.104:6809/24257] conn(0x7f7918066750 0x7f7918068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:42.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.436+0000 7f7928ff9700 1 -- 172.21.15.104:0/3871887493 --> [v2:172.21.15.104:6808/24257,v1:172.21.15.104:6809/24257] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7918069210 con 0x7f7918066750 2024-08-17T02:25:42.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.436+0000 7f7928ff9700 1 -- 172.21.15.104:0/3871887493 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f791c07d2b0 con 0x7f792c0ad940 2024-08-17T02:25:42.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.436+0000 7f7930c4f700 1 --2- 172.21.15.104:0/3871887493 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7918060860 0x7f7918062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:42.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.440+0000 7f7931450700 1 --2- 172.21.15.104:0/3871887493 >> [v2:172.21.15.104:6808/24257,v1:172.21.15.104:6809/24257] conn(0x7f7918066750 0x7f7918068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:42.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.440+0000 7f7931450700 1 --2- 172.21.15.104:0/3871887493 >> [v2:172.21.15.104:6808/24257,v1:172.21.15.104:6809/24257] conn(0x7f7918066750 0x7f7918068b60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:42.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.440+0000 7f7930c4f700 1 --2- 172.21.15.104:0/3871887493 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7918060860 0x7f7918062d10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f792c068ed0 tx=0x7f7920017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:42.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.440+0000 7f7928ff9700 1 -- 172.21.15.104:0/3871887493 <== osd.0 v2:172.21.15.104:6808/24257 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f7918069210 con 0x7f7918066750 2024-08-17T02:25:42.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.460+0000 7f7931c51700 1 -- 172.21.15.104:0/3871887493 --> [v2:172.21.15.104:6808/24257,v1:172.21.15.104:6809/24257] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f792c06eff0 con 0x7f7918066750 2024-08-17T02:25:42.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.460+0000 7f7928ff9700 1 -- 172.21.15.104:0/3871887493 <== osd.0 v2:172.21.15.104:6808/24257 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f792c06eff0 con 0x7f7918066750 2024-08-17T02:25:42.465 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-08-17T02:25:42.466 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:25:42.466 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-08-17T02:25:42.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.460+0000 7f7931c51700 1 -- 172.21.15.104:0/3871887493 >> [v2:172.21.15.104:6808/24257,v1:172.21.15.104:6809/24257] conn(0x7f7918066750 msgr2=0x7f7918068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:42.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.460+0000 7f7931c51700 1 --2- 172.21.15.104:0/3871887493 >> [v2:172.21.15.104:6808/24257,v1:172.21.15.104:6809/24257] conn(0x7f7918066750 0x7f7918068b60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.460+0000 7f7931c51700 1 -- 172.21.15.104:0/3871887493 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7918060860 msgr2=0x7f7918062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:42.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.460+0000 7f7931c51700 1 --2- 172.21.15.104:0/3871887493 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7918060860 0x7f7918062d10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f792c068ed0 tx=0x7f7920017000 comp rx=0 tx=0).stop 2024-08-17T02:25:42.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.460+0000 7f7931c51700 1 -- 172.21.15.104:0/3871887493 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f792c0ad940 msgr2=0x7f792c142f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:42.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.460+0000 7f7931c51700 1 --2- 172.21.15.104:0/3871887493 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f792c0ad940 0x7f792c142f80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f791c00e980 tx=0x7f791c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.460+0000 7f7931450700 1 -- 172.21.15.104:0/3871887493 reap_dead start 2024-08-17T02:25:42.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.460+0000 7f7931c51700 1 -- 172.21.15.104:0/3871887493 shutdown_connections 2024-08-17T02:25:42.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.460+0000 7f7931c51700 1 -- 172.21.15.104:0/3871887493 >> 172.21.15.104:0/3871887493 conn(0x7f792c066e00 msgr2=0x7f792c06ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:42.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.464+0000 7f7931c51700 1 -- 172.21.15.104:0/3871887493 shutdown_connections 2024-08-17T02:25:42.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.464+0000 7f7931c51700 1 -- 172.21.15.104:0/3871887493 wait complete. 2024-08-17T02:25:42.482 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-08-17T02:25:42.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.592+0000 7f47691d3700 1 Processor -- start 2024-08-17T02:25:42.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.592+0000 7f47691d3700 1 -- start start 2024-08-17T02:25:42.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.592+0000 7f47691d3700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f47640adf10 0x7f47640ae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:42.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.592+0000 7f47691d3700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f47640cb450 0x7f476406e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:42.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.596+0000 7f47691d3700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47640cb870 con 0x7f476406e470 2024-08-17T02:25:42.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.596+0000 7f47691d3700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4764158290 con 0x7f47640adf10 2024-08-17T02:25:42.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.596+0000 7f47691d3700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47641610c0 con 0x7f47640cb450 2024-08-17T02:25:42.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.596+0000 7f476259c700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f476406e470 0x7f47640cad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:43576/0 (socket says 172.21.15.104:43576) 2024-08-17T02:25:42.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.596+0000 7f476259c700 1 -- 172.21.15.104:0/782838405 learned_addr learned my addr 172.21.15.104:0/782838405 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:25:42.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.596+0000 7f4762d9d700 1 --2- 172.21.15.104:0/782838405 >> v2:172.21.15.104:3300/0 conn(0x7f47640adf10 0x7f47640ae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:42.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.596+0000 7f476359e700 1 --2- 172.21.15.104:0/782838405 >> v2:172.21.15.117:3300/0 conn(0x7f47640cb450 0x7f476406e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:42.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.596+0000 7f4761d9b700 1 -- 172.21.15.104:0/782838405 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2625375691 0 0) 0x7f47640cb870 con 0x7f476406e470 2024-08-17T02:25:42.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.596+0000 7f4761d9b700 1 -- 172.21.15.104:0/782838405 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f474c003570 con 0x7f476406e470 2024-08-17T02:25:42.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.596+0000 7f4762d9d700 1 -- 172.21.15.104:0/782838405 >> v2:172.21.15.117:3300/0 conn(0x7f47640cb450 msgr2=0x7f476406e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:42.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.596+0000 7f4762d9d700 1 --2- 172.21.15.104:0/782838405 >> v2:172.21.15.117:3300/0 conn(0x7f47640cb450 0x7f476406e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.596+0000 7f4762d9d700 1 -- 172.21.15.104:0/782838405 >> v1:172.21.15.104:6789/0 conn(0x7f476406e470 legacy=0x7f47640cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:42.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.596+0000 7f4762d9d700 1 -- 172.21.15.104:0/782838405 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47640ae820 con 0x7f47640adf10 2024-08-17T02:25:42.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.596+0000 7f4762d9d700 1 --2- 172.21.15.104:0/782838405 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f47640adf10 0x7f47640ae2e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f47640cbe40 tx=0x7f47580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2bb418e7cb0a9cf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:42.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.596+0000 7f4761d9b700 1 -- 172.21.15.104:0/782838405 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4758011630 con 0x7f47640adf10 2024-08-17T02:25:42.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.596+0000 7f4761d9b700 1 -- 172.21.15.104:0/782838405 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47580117b0 con 0x7f47640adf10 2024-08-17T02:25:42.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.596+0000 7f4761d9b700 1 -- 172.21.15.104:0/782838405 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4758011b70 con 0x7f47640adf10 2024-08-17T02:25:42.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.596+0000 7f47691d3700 1 -- 172.21.15.104:0/782838405 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f47640adf10 msgr2=0x7f47640ae2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:42.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.596+0000 7f47691d3700 1 --2- 172.21.15.104:0/782838405 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f47640adf10 0x7f47640ae2e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f47640cbe40 tx=0x7f47580091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.596+0000 7f47691d3700 1 -- 172.21.15.104:0/782838405 shutdown_connections 2024-08-17T02:25:42.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.596+0000 7f47691d3700 1 --2- 172.21.15.104:0/782838405 >> v2:172.21.15.117:3300/0 conn(0x7f47640cb450 0x7f476406e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.596+0000 7f47691d3700 1 --2- 172.21.15.104:0/782838405 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f47640adf10 0x7f47640ae2e0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.596+0000 7f47691d3700 1 -- 172.21.15.104:0/782838405 >> 172.21.15.104:0/782838405 conn(0x7f4764067810 msgr2=0x7f4764067c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:42.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.596+0000 7f47691d3700 1 -- 172.21.15.104:0/782838405 shutdown_connections 2024-08-17T02:25:42.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.596+0000 7f47691d3700 1 -- 172.21.15.104:0/782838405 wait complete. 2024-08-17T02:25:42.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.600+0000 7f47691d3700 1 Processor -- start 2024-08-17T02:25:42.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.600+0000 7f47691d3700 1 -- start start 2024-08-17T02:25:42.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.600+0000 7f47691d3700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f476406e470 0x7f47641556c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:42.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.600+0000 7f47691d3700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47640adf10 0x7f4764159920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:42.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.600+0000 7f47691d3700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f47640cb450 0x7f4764148f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:42.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.600+0000 7f47691d3700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476415a190 con 0x7f47640cb450 2024-08-17T02:25:42.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.600+0000 7f47691d3700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476415a470 con 0x7f476406e470 2024-08-17T02:25:42.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.600+0000 7f47691d3700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f476415a750 con 0x7f47640adf10 2024-08-17T02:25:42.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.600+0000 7f476359e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f47640cb450 0x7f4764148f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:42.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.600+0000 7f476359e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f47640cb450 0x7f4764148f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53878/0 (socket says 172.21.15.104:53878) 2024-08-17T02:25:42.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.600+0000 7f476359e700 1 -- 172.21.15.104:0/936781796 learned_addr learned my addr 172.21.15.104:0/936781796 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:42.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.600+0000 7f476259c700 1 --2- 172.21.15.104:0/936781796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47640adf10 0x7f4764159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:42.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.600+0000 7f4762d9d700 1 --2- 172.21.15.104:0/936781796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f476406e470 0x7f47641556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:42.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.600+0000 7f476359e700 1 -- 172.21.15.104:0/936781796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47640adf10 msgr2=0x7f4764159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:42.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.600+0000 7f476359e700 1 --2- 172.21.15.104:0/936781796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47640adf10 0x7f4764159920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.600+0000 7f476359e700 1 -- 172.21.15.104:0/936781796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f476406e470 msgr2=0x7f47641556c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:42.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.600+0000 7f476359e700 1 --2- 172.21.15.104:0/936781796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f476406e470 0x7f47641556c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.600+0000 7f476359e700 1 -- 172.21.15.104:0/936781796 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4758009420 con 0x7f47640cb450 2024-08-17T02:25:42.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.600+0000 7f476259c700 1 --2- 172.21.15.104:0/936781796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47640adf10 0x7f4764159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:42.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.600+0000 7f476359e700 1 --2- 172.21.15.104:0/936781796 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f47640cb450 0x7f4764148f90 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f475c00e8d0 tx=0x7f475c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:42.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.600+0000 7f474affd700 1 -- 172.21.15.104:0/936781796 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c00ee70 con 0x7f47640cb450 2024-08-17T02:25:42.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.600+0000 7f474affd700 1 -- 172.21.15.104:0/936781796 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475c00c850 con 0x7f47640cb450 2024-08-17T02:25:42.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.600+0000 7f47691d3700 1 -- 172.21.15.104:0/936781796 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f476415aa30 con 0x7f47640cb450 2024-08-17T02:25:42.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.600+0000 7f474affd700 1 -- 172.21.15.104:0/936781796 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c00cc50 con 0x7f47640cb450 2024-08-17T02:25:42.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.600+0000 7f47691d3700 1 -- 172.21.15.104:0/936781796 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47641494d0 con 0x7f47640cb450 2024-08-17T02:25:42.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.604+0000 7f47691d3700 1 -- 172.21.15.104:0/936781796 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f476415af50 con 0x7f47640cb450 2024-08-17T02:25:42.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.604+0000 7f474affd700 1 -- 172.21.15.104:0/936781796 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f475c013680 con 0x7f47640cb450 2024-08-17T02:25:42.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.604+0000 7f474affd700 1 --2- 172.21.15.104:0/936781796 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4750060860 0x7f4750062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:42.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.604+0000 7f474affd700 1 -- 172.21.15.104:0/936781796 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f475c07cac0 con 0x7f47640cb450 2024-08-17T02:25:42.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.604+0000 7f4762d9d700 1 --2- 172.21.15.104:0/936781796 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4750060860 0x7f4750062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:42.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.608+0000 7f4762d9d700 1 --2- 172.21.15.104:0/936781796 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4750060860 0x7f4750062d10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f47640cbe40 tx=0x7f4758017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:42.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.612+0000 7f474affd700 1 -- 172.21.15.104:0/936781796 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f476415af50 con 0x7f47640cb450 2024-08-17T02:25:42.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.776+0000 7f47691d3700 1 -- 172.21.15.104:0/936781796 --> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f476415af50 con 0x7f4750060860 2024-08-17T02:25:42.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.776+0000 7f474affd700 1 -- 172.21.15.104:0/936781796 <== mgr.4111 v2:172.21.15.117:6832/24084 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f476415af50 con 0x7f4750060860 2024-08-17T02:25:42.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.776+0000 7f47691d3700 1 -- 172.21.15.104:0/936781796 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4750060860 msgr2=0x7f4750062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:42.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.776+0000 7f47691d3700 1 --2- 172.21.15.104:0/936781796 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4750060860 0x7f4750062d10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f47640cbe40 tx=0x7f4758017000 comp rx=0 tx=0).stop 2024-08-17T02:25:42.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.776+0000 7f47691d3700 1 -- 172.21.15.104:0/936781796 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f47640cb450 msgr2=0x7f4764148f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:42.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.776+0000 7f47691d3700 1 --2- 172.21.15.104:0/936781796 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f47640cb450 0x7f4764148f90 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f475c00e8d0 tx=0x7f475c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.776+0000 7f47691d3700 1 -- 172.21.15.104:0/936781796 shutdown_connections 2024-08-17T02:25:42.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.776+0000 7f47691d3700 1 --2- 172.21.15.104:0/936781796 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4750060860 0x7f4750062d10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.776+0000 7f47691d3700 1 --2- 172.21.15.104:0/936781796 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f47640cb450 0x7f4764148f90 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.776+0000 7f47691d3700 1 --2- 172.21.15.104:0/936781796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47640adf10 0x7f4764159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.776+0000 7f47691d3700 1 --2- 172.21.15.104:0/936781796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f476406e470 0x7f47641556c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.776+0000 7f47691d3700 1 -- 172.21.15.104:0/936781796 >> 172.21.15.104:0/936781796 conn(0x7f4764067810 msgr2=0x7f476415cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:42.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.776+0000 7f47691d3700 1 -- 172.21.15.104:0/936781796 shutdown_connections 2024-08-17T02:25:42.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.776+0000 7f47691d3700 1 -- 172.21.15.104:0/936781796 wait complete. 2024-08-17T02:25:42.785 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 0 to deep-scrub 2024-08-17T02:25:42.794 INFO:tasks.ceph:Scrubbing osd.1 2024-08-17T02:25:42.794 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:25:42.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.904+0000 7ffa76297700 1 Processor -- start 2024-08-17T02:25:42.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.904+0000 7ffa76297700 1 -- start start 2024-08-17T02:25:42.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.904+0000 7ffa76297700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ffa700b2800 0x7ffa700687a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:42.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.904+0000 7ffa76297700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa70069a70 con 0x7ffa70155d70 2024-08-17T02:25:42.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.904+0000 7ffa76297700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa70068e60 con 0x7ffa70069f00 2024-08-17T02:25:42.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.904+0000 7ffa76297700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa70069140 con 0x7ffa700b2800 2024-08-17T02:25:42.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.904+0000 7ffa75295700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7ffa70155d70 0x7ffa700b20f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:43580/0 (socket says 172.21.15.104:43580) 2024-08-17T02:25:42.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.904+0000 7ffa75295700 1 -- 172.21.15.104:0/586105656 learned_addr learned my addr 172.21.15.104:0/586105656 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:25:42.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.904+0000 7ffa75a96700 1 --2- 172.21.15.104:0/586105656 >> v2:172.21.15.117:3300/0 conn(0x7ffa700b2800 0x7ffa700687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:42.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.904+0000 7ffa67fff700 1 -- 172.21.15.104:0/586105656 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 854995111 0 0) 0x7ffa70069a70 con 0x7ffa70155d70 2024-08-17T02:25:42.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.904+0000 7ffa67fff700 1 -- 172.21.15.104:0/586105656 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa5c003570 con 0x7ffa70155d70 2024-08-17T02:25:42.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.904+0000 7ffa75a96700 1 -- 172.21.15.104:0/586105656 >> v1:172.21.15.117:6789/0 conn(0x7ffa70069f00 legacy=0x7ffa700ca900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:42.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.904+0000 7ffa75a96700 1 -- 172.21.15.104:0/586105656 >> v1:172.21.15.104:6789/0 conn(0x7ffa70155d70 legacy=0x7ffa700b20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:42.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.904+0000 7ffa75a96700 1 -- 172.21.15.104:0/586105656 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa70069420 con 0x7ffa700b2800 2024-08-17T02:25:42.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.908+0000 7ffa75a96700 1 --2- 172.21.15.104:0/586105656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa700b2800 0x7ffa700687a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ffa68009e60 tx=0x7ffa68009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9c608f389d7033a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:42.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.908+0000 7ffa67fff700 1 -- 172.21.15.104:0/586105656 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6800e070 con 0x7ffa700b2800 2024-08-17T02:25:42.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.908+0000 7ffa67fff700 1 -- 172.21.15.104:0/586105656 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6800bb60 con 0x7ffa700b2800 2024-08-17T02:25:42.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.908+0000 7ffa67fff700 1 -- 172.21.15.104:0/586105656 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa68012430 con 0x7ffa700b2800 2024-08-17T02:25:42.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.908+0000 7ffa76297700 1 -- 172.21.15.104:0/586105656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa700b2800 msgr2=0x7ffa700687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:42.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.908+0000 7ffa76297700 1 --2- 172.21.15.104:0/586105656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa700b2800 0x7ffa700687a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ffa68009e60 tx=0x7ffa68009780 comp rx=0 tx=0).stop 2024-08-17T02:25:42.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.908+0000 7ffa76297700 1 -- 172.21.15.104:0/586105656 shutdown_connections 2024-08-17T02:25:42.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.908+0000 7ffa76297700 1 --2- 172.21.15.104:0/586105656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa700b2800 0x7ffa700687a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.908+0000 7ffa76297700 1 -- 172.21.15.104:0/586105656 >> 172.21.15.104:0/586105656 conn(0x7ffa7006a700 msgr2=0x7ffa700aeb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:42.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.908+0000 7ffa76297700 1 -- 172.21.15.104:0/586105656 shutdown_connections 2024-08-17T02:25:42.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.908+0000 7ffa76297700 1 -- 172.21.15.104:0/586105656 wait complete. 2024-08-17T02:25:42.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.908+0000 7ffa76297700 1 Processor -- start 2024-08-17T02:25:42.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.908+0000 7ffa76297700 1 -- start start 2024-08-17T02:25:42.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.912+0000 7ffa76297700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffa70069f00 0x7ffa701589a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:42.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.912+0000 7ffa76297700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa700b2800 0x7ffa70143640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:42.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.912+0000 7ffa76297700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa70155d70 0x7ffa700a6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:42.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.912+0000 7ffa76297700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa70158ee0 con 0x7ffa70069f00 2024-08-17T02:25:42.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.912+0000 7ffa76297700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7016a580 con 0x7ffa70155d70 2024-08-17T02:25:42.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.912+0000 7ffa76297700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa70158300 con 0x7ffa700b2800 2024-08-17T02:25:42.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.912+0000 7ffa75295700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffa70069f00 0x7ffa701589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:42.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.912+0000 7ffa75295700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffa70069f00 0x7ffa701589a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53882/0 (socket says 172.21.15.104:53882) 2024-08-17T02:25:42.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.912+0000 7ffa75a96700 1 --2- 172.21.15.104:0/995867198 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa70155d70 0x7ffa700a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:42.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.912+0000 7ffa75295700 1 -- 172.21.15.104:0/995867198 learned_addr learned my addr 172.21.15.104:0/995867198 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:42.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.912+0000 7ffa74a94700 1 --2- 172.21.15.104:0/995867198 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa700b2800 0x7ffa70143640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:42.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.912+0000 7ffa75295700 1 -- 172.21.15.104:0/995867198 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa700b2800 msgr2=0x7ffa70143640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:42.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.912+0000 7ffa75295700 1 --2- 172.21.15.104:0/995867198 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa700b2800 0x7ffa70143640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.912+0000 7ffa75295700 1 -- 172.21.15.104:0/995867198 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa70155d70 msgr2=0x7ffa700a6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:42.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.912+0000 7ffa75295700 1 --2- 172.21.15.104:0/995867198 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa70155d70 0x7ffa700a6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.912+0000 7ffa75295700 1 -- 172.21.15.104:0/995867198 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa68009a20 con 0x7ffa70069f00 2024-08-17T02:25:42.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.912+0000 7ffa75295700 1 --2- 172.21.15.104:0/995867198 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffa70069f00 0x7ffa701589a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c00c590 tx=0x7ffa6c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:42.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.912+0000 7ffa657fa700 1 -- 172.21.15.104:0/995867198 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c005b30 con 0x7ffa70069f00 2024-08-17T02:25:42.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.912+0000 7ffa657fa700 1 -- 172.21.15.104:0/995867198 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6c005cb0 con 0x7ffa70069f00 2024-08-17T02:25:42.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.912+0000 7ffa76297700 1 -- 172.21.15.104:0/995867198 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa70153700 con 0x7ffa70069f00 2024-08-17T02:25:42.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.912+0000 7ffa657fa700 1 -- 172.21.15.104:0/995867198 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c007320 con 0x7ffa70069f00 2024-08-17T02:25:42.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.912+0000 7ffa76297700 1 -- 172.21.15.104:0/995867198 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa70153cc0 con 0x7ffa70069f00 2024-08-17T02:25:42.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.912+0000 7ffa76297700 1 -- 172.21.15.104:0/995867198 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffa700644b0 con 0x7ffa70069f00 2024-08-17T02:25:42.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.916+0000 7ffa657fa700 1 -- 172.21.15.104:0/995867198 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ffa6c01b3b0 con 0x7ffa70069f00 2024-08-17T02:25:42.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.916+0000 7ffa657fa700 1 --2- 172.21.15.104:0/995867198 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ffa54060860 0x7ffa54062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:42.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.916+0000 7ffa657fa700 1 -- 172.21.15.104:0/995867198 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5025+0+0 (secure 0 0 0) 0x7ffa6c07bd50 con 0x7ffa70069f00 2024-08-17T02:25:42.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.916+0000 7ffa74a94700 1 --2- 172.21.15.104:0/995867198 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ffa54060860 0x7ffa54062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:42.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.916+0000 7ffa657fa700 1 --2- 172.21.15.104:0/995867198 >> [v2:172.21.15.104:6824/24256,v1:172.21.15.104:6825/24256] conn(0x7ffa54066750 0x7ffa54068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:42.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.916+0000 7ffa657fa700 1 -- 172.21.15.104:0/995867198 --> [v2:172.21.15.104:6824/24256,v1:172.21.15.104:6825/24256] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffa54069210 con 0x7ffa54066750 2024-08-17T02:25:42.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.916+0000 7ffa657fa700 1 -- 172.21.15.104:0/995867198 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa6c07e390 con 0x7ffa70069f00 2024-08-17T02:25:42.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.916+0000 7ffa75a96700 1 --2- 172.21.15.104:0/995867198 >> [v2:172.21.15.104:6824/24256,v1:172.21.15.104:6825/24256] conn(0x7ffa54066750 0x7ffa54068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:42.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.916+0000 7ffa74a94700 1 --2- 172.21.15.104:0/995867198 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ffa54060860 0x7ffa54062d10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ffa700cc320 tx=0x7ffa60007ec0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:42.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.916+0000 7ffa75a96700 1 --2- 172.21.15.104:0/995867198 >> [v2:172.21.15.104:6824/24256,v1:172.21.15.104:6825/24256] conn(0x7ffa54066750 0x7ffa54068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:42.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.916+0000 7ffa657fa700 1 -- 172.21.15.104:0/995867198 <== osd.1 v2:172.21.15.104:6824/24256 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7ffa54069210 con 0x7ffa54066750 2024-08-17T02:25:42.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.936+0000 7ffa76297700 1 -- 172.21.15.104:0/995867198 --> [v2:172.21.15.104:6824/24256,v1:172.21.15.104:6825/24256] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ffa700ac890 con 0x7ffa54066750 2024-08-17T02:25:42.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.936+0000 7ffa657fa700 1 -- 172.21.15.104:0/995867198 <== osd.1 v2:172.21.15.104:6824/24256 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ffa700ac890 con 0x7ffa54066750 2024-08-17T02:25:42.939 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-08-17T02:25:42.940 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:25:42.940 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-08-17T02:25:42.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.936+0000 7ffa76297700 1 -- 172.21.15.104:0/995867198 >> [v2:172.21.15.104:6824/24256,v1:172.21.15.104:6825/24256] conn(0x7ffa54066750 msgr2=0x7ffa54068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:42.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.936+0000 7ffa76297700 1 --2- 172.21.15.104:0/995867198 >> [v2:172.21.15.104:6824/24256,v1:172.21.15.104:6825/24256] conn(0x7ffa54066750 0x7ffa54068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.936+0000 7ffa76297700 1 -- 172.21.15.104:0/995867198 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ffa54060860 msgr2=0x7ffa54062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:42.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.936+0000 7ffa76297700 1 --2- 172.21.15.104:0/995867198 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7ffa54060860 0x7ffa54062d10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ffa700cc320 tx=0x7ffa60007ec0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.936+0000 7ffa76297700 1 -- 172.21.15.104:0/995867198 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffa70069f00 msgr2=0x7ffa701589a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:42.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.936+0000 7ffa76297700 1 --2- 172.21.15.104:0/995867198 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffa70069f00 0x7ffa701589a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c00c590 tx=0x7ffa6c007e00 comp rx=0 tx=0).stop 2024-08-17T02:25:42.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.936+0000 7ffa75a96700 1 -- 172.21.15.104:0/995867198 reap_dead start 2024-08-17T02:25:42.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.936+0000 7ffa76297700 1 -- 172.21.15.104:0/995867198 shutdown_connections 2024-08-17T02:25:42.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.936+0000 7ffa76297700 1 -- 172.21.15.104:0/995867198 >> 172.21.15.104:0/995867198 conn(0x7ffa7006a700 msgr2=0x7ffa700aeb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:42.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.936+0000 7ffa76297700 1 -- 172.21.15.104:0/995867198 shutdown_connections 2024-08-17T02:25:42.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:42.936+0000 7ffa76297700 1 -- 172.21.15.104:0/995867198 wait complete. 2024-08-17T02:25:42.955 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-08-17T02:25:43.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.064+0000 7fb08759e700 1 Processor -- start 2024-08-17T02:25:43.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.064+0000 7fb08759e700 1 -- start start 2024-08-17T02:25:43.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.064+0000 7fb08759e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0880b0d20 0x7fb08806df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.064+0000 7fb08759e700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb0880b1800 0x7fb088141e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.064+0000 7fb08759e700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb088141a00 con 0x7fb08806e450 2024-08-17T02:25:43.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.064+0000 7fb08759e700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb08806e8a0 con 0x7fb0880b1800 2024-08-17T02:25:43.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.064+0000 7fb08759e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb088140b10 con 0x7fb0880b0d20 2024-08-17T02:25:43.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.064+0000 7fb08659c700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0880b0d20 0x7fb08806df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.064+0000 7fb086d9d700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb0880b1800 0x7fb088141e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.064+0000 7fb08659c700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0880b0d20 0x7fb08806df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.104:41294/0 (socket says 172.21.15.104:41294) 2024-08-17T02:25:43.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.064+0000 7fb085d9b700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fb08806e450 0x7fb0880b10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.104:34560/0 (socket says 172.21.15.104:34560) 2024-08-17T02:25:43.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.064+0000 7fb086d9d700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb0880b1800 0x7fb088141e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.104:60750/0 (socket says 172.21.15.104:60750) 2024-08-17T02:25:43.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.064+0000 7fb08659c700 1 -- 172.21.15.104:0/835813159 learned_addr learned my addr 172.21.15.104:0/835813159 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:43.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.064+0000 7fb08559a700 1 -- 172.21.15.104:0/835813159 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 352905671 0 0) 0x7fb088141a00 con 0x7fb08806e450 2024-08-17T02:25:43.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.064+0000 7fb08559a700 1 -- 172.21.15.104:0/835813159 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb070003570 con 0x7fb08806e450 2024-08-17T02:25:43.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.064+0000 7fb086d9d700 1 -- 172.21.15.104:0/835813159 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0880b0d20 msgr2=0x7fb08806df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:43.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.064+0000 7fb086d9d700 1 --2- 172.21.15.104:0/835813159 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0880b0d20 0x7fb08806df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.064+0000 7fb086d9d700 1 -- 172.21.15.104:0/835813159 >> v1:172.21.15.117:6789/0 conn(0x7fb08806e450 legacy=0x7fb0880b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.064+0000 7fb086d9d700 1 -- 172.21.15.104:0/835813159 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb088140df0 con 0x7fb0880b1800 2024-08-17T02:25:43.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.064+0000 7fb08659c700 1 --2- 172.21.15.104:0/835813159 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0880b0d20 0x7fb08806df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:43.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.068+0000 7fb086d9d700 1 --2- 172.21.15.104:0/835813159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0880b1800 0x7fb088141e90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb0800098e0 tx=0x7fb0800091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0c67bc38ab7831e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:43.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.068+0000 7fb08559a700 1 -- 172.21.15.104:0/835813159 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb080011630 con 0x7fb0880b1800 2024-08-17T02:25:43.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.068+0000 7fb08559a700 1 -- 172.21.15.104:0/835813159 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb080011790 con 0x7fb0880b1800 2024-08-17T02:25:43.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.068+0000 7fb08559a700 1 -- 172.21.15.104:0/835813159 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb080011b30 con 0x7fb0880b1800 2024-08-17T02:25:43.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.068+0000 7fb08759e700 1 -- 172.21.15.104:0/835813159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0880b1800 msgr2=0x7fb088141e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.068+0000 7fb08759e700 1 --2- 172.21.15.104:0/835813159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0880b1800 0x7fb088141e90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb0800098e0 tx=0x7fb0800091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.068+0000 7fb08759e700 1 -- 172.21.15.104:0/835813159 shutdown_connections 2024-08-17T02:25:43.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.068+0000 7fb08759e700 1 --2- 172.21.15.104:0/835813159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0880b1800 0x7fb088141e90 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.068+0000 7fb08759e700 1 --2- 172.21.15.104:0/835813159 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0880b0d20 0x7fb08806df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.068+0000 7fb08759e700 1 -- 172.21.15.104:0/835813159 >> 172.21.15.104:0/835813159 conn(0x7fb0880678d0 msgr2=0x7fb088067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:43.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.068+0000 7fb08759e700 1 -- 172.21.15.104:0/835813159 shutdown_connections 2024-08-17T02:25:43.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.068+0000 7fb08759e700 1 -- 172.21.15.104:0/835813159 wait complete. 2024-08-17T02:25:43.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.068+0000 7fb08759e700 1 Processor -- start 2024-08-17T02:25:43.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.068+0000 7fb08759e700 1 -- start start 2024-08-17T02:25:43.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.072+0000 7fb08759e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb08806e450 0x7fb08813fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.072+0000 7fb08759e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0880b0d20 0x7fb0881467b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.072+0000 7fb08759e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0880b1800 0x7fb088158740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.072+0000 7fb08759e700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb088144a90 con 0x7fb0880b0d20 2024-08-17T02:25:43.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.072+0000 7fb08759e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb088144d70 con 0x7fb0880b1800 2024-08-17T02:25:43.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.072+0000 7fb08759e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb088145050 con 0x7fb08806e450 2024-08-17T02:25:43.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.072+0000 7fb085d9b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0880b0d20 0x7fb0881467b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.072+0000 7fb085d9b700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0880b0d20 0x7fb0881467b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53894/0 (socket says 172.21.15.104:53894) 2024-08-17T02:25:43.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.072+0000 7fb085d9b700 1 -- 172.21.15.104:0/3270653956 learned_addr learned my addr 172.21.15.104:0/3270653956 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:43.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.072+0000 7fb08659c700 1 --2- 172.21.15.104:0/3270653956 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb08806e450 0x7fb08813fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.072+0000 7fb086d9d700 1 --2- 172.21.15.104:0/3270653956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0880b1800 0x7fb088158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.072+0000 7fb085d9b700 1 -- 172.21.15.104:0/3270653956 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb08806e450 msgr2=0x7fb08813fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.072+0000 7fb085d9b700 1 --2- 172.21.15.104:0/3270653956 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb08806e450 0x7fb08813fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.072+0000 7fb085d9b700 1 -- 172.21.15.104:0/3270653956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0880b1800 msgr2=0x7fb088158740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.072+0000 7fb085d9b700 1 --2- 172.21.15.104:0/3270653956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0880b1800 0x7fb088158740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.072+0000 7fb085d9b700 1 -- 172.21.15.104:0/3270653956 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb07c0094f0 con 0x7fb0880b0d20 2024-08-17T02:25:43.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.072+0000 7fb086d9d700 1 --2- 172.21.15.104:0/3270653956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0880b1800 0x7fb088158740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:43.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.072+0000 7fb085d9b700 1 --2- 172.21.15.104:0/3270653956 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0880b0d20 0x7fb0881467b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb07800cd00 tx=0x7fb078001b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:43.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.072+0000 7fb0767fc700 1 -- 172.21.15.104:0/3270653956 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07800ce60 con 0x7fb0880b0d20 2024-08-17T02:25:43.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.072+0000 7fb0767fc700 1 -- 172.21.15.104:0/3270653956 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb078005df0 con 0x7fb0880b0d20 2024-08-17T02:25:43.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.072+0000 7fb08759e700 1 -- 172.21.15.104:0/3270653956 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb080009420 con 0x7fb0880b0d20 2024-08-17T02:25:43.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.072+0000 7fb0767fc700 1 -- 172.21.15.104:0/3270653956 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07800abb0 con 0x7fb0880b0d20 2024-08-17T02:25:43.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.072+0000 7fb08759e700 1 -- 172.21.15.104:0/3270653956 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb088145610 con 0x7fb0880b0d20 2024-08-17T02:25:43.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.072+0000 7fb08759e700 1 -- 172.21.15.104:0/3270653956 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0880643a0 con 0x7fb0880b0d20 2024-08-17T02:25:43.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.072+0000 7fb0767fc700 1 -- 172.21.15.104:0/3270653956 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb0780070f0 con 0x7fb0880b0d20 2024-08-17T02:25:43.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.072+0000 7fb0767fc700 1 --2- 172.21.15.104:0/3270653956 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb068060860 0x7fb068062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.072+0000 7fb0767fc700 1 -- 172.21.15.104:0/3270653956 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fb07807d4e0 con 0x7fb0880b0d20 2024-08-17T02:25:43.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.076+0000 7fb08659c700 1 --2- 172.21.15.104:0/3270653956 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb068060860 0x7fb068062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.076+0000 7fb08659c700 1 --2- 172.21.15.104:0/3270653956 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb068060860 0x7fb068062d10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb088153700 tx=0x7fb07c009250 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:43.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.084+0000 7fb0767fc700 1 -- 172.21.15.104:0/3270653956 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb07804dc50 con 0x7fb0880b0d20 2024-08-17T02:25:43.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.252+0000 7fb08759e700 1 -- 172.21.15.104:0/3270653956 --> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fb08806f5f0 con 0x7fb068060860 2024-08-17T02:25:43.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.256+0000 7fb0767fc700 1 -- 172.21.15.104:0/3270653956 <== mgr.4111 v2:172.21.15.117:6832/24084 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb08806f5f0 con 0x7fb068060860 2024-08-17T02:25:43.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.256+0000 7fb08759e700 1 -- 172.21.15.104:0/3270653956 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb068060860 msgr2=0x7fb068062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.256+0000 7fb08759e700 1 --2- 172.21.15.104:0/3270653956 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb068060860 0x7fb068062d10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb088153700 tx=0x7fb07c009250 comp rx=0 tx=0).stop 2024-08-17T02:25:43.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.256+0000 7fb08759e700 1 -- 172.21.15.104:0/3270653956 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0880b0d20 msgr2=0x7fb0881467b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.256+0000 7fb08759e700 1 --2- 172.21.15.104:0/3270653956 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0880b0d20 0x7fb0881467b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb07800cd00 tx=0x7fb078001b30 comp rx=0 tx=0).stop 2024-08-17T02:25:43.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.256+0000 7fb08759e700 1 -- 172.21.15.104:0/3270653956 shutdown_connections 2024-08-17T02:25:43.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.256+0000 7fb08759e700 1 --2- 172.21.15.104:0/3270653956 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb068060860 0x7fb068062d10 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.256+0000 7fb08759e700 1 --2- 172.21.15.104:0/3270653956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0880b1800 0x7fb088158740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.256+0000 7fb08759e700 1 --2- 172.21.15.104:0/3270653956 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0880b0d20 0x7fb0881467b0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.256+0000 7fb08759e700 1 --2- 172.21.15.104:0/3270653956 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb08806e450 0x7fb08813fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.256+0000 7fb08759e700 1 -- 172.21.15.104:0/3270653956 >> 172.21.15.104:0/3270653956 conn(0x7fb0880678d0 msgr2=0x7fb08815db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:43.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.256+0000 7fb08759e700 1 -- 172.21.15.104:0/3270653956 shutdown_connections 2024-08-17T02:25:43.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.256+0000 7fb08759e700 1 -- 172.21.15.104:0/3270653956 wait complete. 2024-08-17T02:25:43.264 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 1 to deep-scrub 2024-08-17T02:25:43.272 INFO:tasks.ceph:Scrubbing osd.2 2024-08-17T02:25:43.272 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:25:43.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.376+0000 7f32ba9b2700 1 Processor -- start 2024-08-17T02:25:43.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.376+0000 7f32ba9b2700 1 -- start start 2024-08-17T02:25:43.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.380+0000 7f32ba9b2700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f32b40b2e70 0x7f32b40cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.380+0000 7f32ba9b2700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32b40cc230 0x7f32b40c6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.380+0000 7f32ba9b2700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32b40c5bb0 con 0x7f32b40ce640 2024-08-17T02:25:43.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.380+0000 7f32ba9b2700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32b40b32f0 con 0x7f32b40b2e70 2024-08-17T02:25:43.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.380+0000 7f32ba9b2700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b40cc650 con 0x7f32b40cc230 2024-08-17T02:25:43.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.380+0000 7f32b99b0700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f32b40ce640 0x7f32b40cea10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:43590/0 (socket says 172.21.15.104:43590) 2024-08-17T02:25:43.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.380+0000 7f32b99b0700 1 -- 172.21.15.104:0/1134546883 learned_addr learned my addr 172.21.15.104:0/1134546883 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:25:43.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.380+0000 7f32ba1b1700 1 --2- 172.21.15.104:0/1134546883 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32b40cc230 0x7f32b40c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.380+0000 7f32b91af700 1 --2- 172.21.15.104:0/1134546883 >> v2:172.21.15.117:3300/0 conn(0x7f32b40b2e70 0x7f32b40cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.380+0000 7f32b89ae700 1 -- 172.21.15.104:0/1134546883 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2295545229 0 0) 0x7f32b40c5bb0 con 0x7f32b40ce640 2024-08-17T02:25:43.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.380+0000 7f32b89ae700 1 -- 172.21.15.104:0/1134546883 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32a0003570 con 0x7f32b40ce640 2024-08-17T02:25:43.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.380+0000 7f32ba1b1700 1 -- 172.21.15.104:0/1134546883 >> v2:172.21.15.117:3300/0 conn(0x7f32b40b2e70 msgr2=0x7f32b40cbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:43.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.380+0000 7f32ba1b1700 1 --2- 172.21.15.104:0/1134546883 >> v2:172.21.15.117:3300/0 conn(0x7f32b40b2e70 0x7f32b40cbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.380+0000 7f32ba1b1700 1 -- 172.21.15.104:0/1134546883 >> v1:172.21.15.104:6789/0 conn(0x7f32b40ce640 legacy=0x7f32b40cea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.380+0000 7f32ba1b1700 1 -- 172.21.15.104:0/1134546883 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b40c4fa0 con 0x7f32b40cc230 2024-08-17T02:25:43.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.380+0000 7f32b91af700 1 --2- 172.21.15.104:0/1134546883 >> v2:172.21.15.117:3300/0 conn(0x7f32b40b2e70 0x7f32b40cbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:43.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.380+0000 7f32ba1b1700 1 --2- 172.21.15.104:0/1134546883 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32b40cc230 0x7f32b40c6040 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f32ac009e60 tx=0x7f32ac009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=738c314223be8d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:43.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.380+0000 7f32b89ae700 1 -- 172.21.15.104:0/1134546883 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ac00e070 con 0x7f32b40cc230 2024-08-17T02:25:43.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.380+0000 7f32b89ae700 1 -- 172.21.15.104:0/1134546883 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32ac00bab0 con 0x7f32b40cc230 2024-08-17T02:25:43.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.380+0000 7f32b89ae700 1 -- 172.21.15.104:0/1134546883 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ac00be50 con 0x7f32b40cc230 2024-08-17T02:25:43.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.380+0000 7f32ba9b2700 1 -- 172.21.15.104:0/1134546883 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32b40cc230 msgr2=0x7f32b40c6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.380+0000 7f32ba9b2700 1 --2- 172.21.15.104:0/1134546883 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32b40cc230 0x7f32b40c6040 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f32ac009e60 tx=0x7f32ac009780 comp rx=0 tx=0).stop 2024-08-17T02:25:43.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.384+0000 7f32ba9b2700 1 -- 172.21.15.104:0/1134546883 shutdown_connections 2024-08-17T02:25:43.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.384+0000 7f32ba9b2700 1 --2- 172.21.15.104:0/1134546883 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32b40cc230 0x7f32b40c6040 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.384+0000 7f32ba9b2700 1 --2- 172.21.15.104:0/1134546883 >> v2:172.21.15.117:3300/0 conn(0x7f32b40b2e70 0x7f32b40cbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.384+0000 7f32ba9b2700 1 -- 172.21.15.104:0/1134546883 >> 172.21.15.104:0/1134546883 conn(0x7f32b4099410 msgr2=0x7f32b40675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:43.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.384+0000 7f32ba9b2700 1 -- 172.21.15.104:0/1134546883 shutdown_connections 2024-08-17T02:25:43.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.384+0000 7f32ba9b2700 1 -- 172.21.15.104:0/1134546883 wait complete. 2024-08-17T02:25:43.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.384+0000 7f32ba9b2700 1 Processor -- start 2024-08-17T02:25:43.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.384+0000 7f32ba9b2700 1 -- start start 2024-08-17T02:25:43.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.388+0000 7f32ba9b2700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32b40b2e70 0x7f32b4143470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.388+0000 7f32ba9b2700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f32b40cc230 0x7f32b40c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.388+0000 7f32ba9b2700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32b40ce640 0x7f32b40c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.388+0000 7f32ba9b2700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b4159050 con 0x7f32b40cc230 2024-08-17T02:25:43.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.388+0000 7f32ba9b2700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b41587b0 con 0x7f32b40ce640 2024-08-17T02:25:43.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.388+0000 7f32ba9b2700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b4158a90 con 0x7f32b40b2e70 2024-08-17T02:25:43.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.388+0000 7f32b91af700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f32b40cc230 0x7f32b40c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.388+0000 7f32b91af700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f32b40cc230 0x7f32b40c92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53900/0 (socket says 172.21.15.104:53900) 2024-08-17T02:25:43.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.388+0000 7f32b91af700 1 -- 172.21.15.104:0/3212874247 learned_addr learned my addr 172.21.15.104:0/3212874247 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:43.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.388+0000 7f32b99b0700 1 --2- 172.21.15.104:0/3212874247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32b40b2e70 0x7f32b4143470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.388+0000 7f32ba1b1700 1 --2- 172.21.15.104:0/3212874247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32b40ce640 0x7f32b40c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.388+0000 7f32b91af700 1 -- 172.21.15.104:0/3212874247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32b40b2e70 msgr2=0x7f32b4143470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.388+0000 7f32b91af700 1 --2- 172.21.15.104:0/3212874247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32b40b2e70 0x7f32b4143470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.388+0000 7f32b91af700 1 -- 172.21.15.104:0/3212874247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32b40ce640 msgr2=0x7f32b40c9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.388+0000 7f32b91af700 1 --2- 172.21.15.104:0/3212874247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32b40ce640 0x7f32b40c9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.388+0000 7f32b91af700 1 -- 172.21.15.104:0/3212874247 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b0009420 con 0x7f32b40cc230 2024-08-17T02:25:43.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.388+0000 7f32ba1b1700 1 --2- 172.21.15.104:0/3212874247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32b40ce640 0x7f32b40c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:43.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.388+0000 7f32b91af700 1 --2- 172.21.15.104:0/3212874247 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f32b40cc230 0x7f32b40c92d0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f32b000ec80 tx=0x7f32b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:43.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.388+0000 7f32a9ffb700 1 -- 172.21.15.104:0/3212874247 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b000c850 con 0x7f32b40cc230 2024-08-17T02:25:43.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.388+0000 7f32ba9b2700 1 -- 172.21.15.104:0/3212874247 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32ac009a20 con 0x7f32b40cc230 2024-08-17T02:25:43.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.388+0000 7f32a9ffb700 1 -- 172.21.15.104:0/3212874247 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b000c9b0 con 0x7f32b40cc230 2024-08-17T02:25:43.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.388+0000 7f32a9ffb700 1 -- 172.21.15.104:0/3212874247 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b000cd30 con 0x7f32b40cc230 2024-08-17T02:25:43.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.388+0000 7f32ba9b2700 1 -- 172.21.15.104:0/3212874247 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32b4143eb0 con 0x7f32b40cc230 2024-08-17T02:25:43.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.388+0000 7f32ba9b2700 1 -- 172.21.15.104:0/3212874247 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f32b40644b0 con 0x7f32b40cc230 2024-08-17T02:25:43.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.392+0000 7f32a9ffb700 1 -- 172.21.15.104:0/3212874247 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f32b0013680 con 0x7f32b40cc230 2024-08-17T02:25:43.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.392+0000 7f32a9ffb700 1 --2- 172.21.15.104:0/3212874247 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3298060860 0x7f3298062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.392+0000 7f32a9ffb700 1 -- 172.21.15.104:0/3212874247 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f32b007ccf0 con 0x7f32b40cc230 2024-08-17T02:25:43.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.392+0000 7f32a9ffb700 1 --2- 172.21.15.104:0/3212874247 >> [v2:172.21.15.104:6816/24255,v1:172.21.15.104:6817/24255] conn(0x7f3298066750 0x7f3298068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.392+0000 7f32a9ffb700 1 -- 172.21.15.104:0/3212874247 --> [v2:172.21.15.104:6816/24255,v1:172.21.15.104:6817/24255] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3298069210 con 0x7f3298066750 2024-08-17T02:25:43.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.392+0000 7f32a9ffb700 1 -- 172.21.15.104:0/3212874247 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32b007f250 con 0x7f32b40cc230 2024-08-17T02:25:43.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.392+0000 7f32b99b0700 1 --2- 172.21.15.104:0/3212874247 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3298060860 0x7f3298062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.392+0000 7f32ba1b1700 1 --2- 172.21.15.104:0/3212874247 >> [v2:172.21.15.104:6816/24255,v1:172.21.15.104:6817/24255] conn(0x7f3298066750 0x7f3298068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.392+0000 7f32ba1b1700 1 --2- 172.21.15.104:0/3212874247 >> [v2:172.21.15.104:6816/24255,v1:172.21.15.104:6817/24255] conn(0x7f3298066750 0x7f3298068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:43.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.392+0000 7f32b99b0700 1 --2- 172.21.15.104:0/3212874247 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3298060860 0x7f3298062d10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f32a4007fd0 tx=0x7f32a4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:43.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.392+0000 7f32a9ffb700 1 -- 172.21.15.104:0/3212874247 <== osd.2 v2:172.21.15.104:6816/24255 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f3298069210 con 0x7f3298066750 2024-08-17T02:25:43.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.412+0000 7f32ba9b2700 1 -- 172.21.15.104:0/3212874247 --> [v2:172.21.15.104:6816/24255,v1:172.21.15.104:6817/24255] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f32b41439b0 con 0x7f3298066750 2024-08-17T02:25:43.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.412+0000 7f32a9ffb700 1 -- 172.21.15.104:0/3212874247 <== osd.2 v2:172.21.15.104:6816/24255 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f32b41439b0 con 0x7f3298066750 2024-08-17T02:25:43.416 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-08-17T02:25:43.417 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:25:43.417 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-08-17T02:25:43.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.412+0000 7f32ba9b2700 1 -- 172.21.15.104:0/3212874247 >> [v2:172.21.15.104:6816/24255,v1:172.21.15.104:6817/24255] conn(0x7f3298066750 msgr2=0x7f3298068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.412+0000 7f32ba9b2700 1 --2- 172.21.15.104:0/3212874247 >> [v2:172.21.15.104:6816/24255,v1:172.21.15.104:6817/24255] conn(0x7f3298066750 0x7f3298068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.412+0000 7f32ba9b2700 1 -- 172.21.15.104:0/3212874247 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3298060860 msgr2=0x7f3298062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.412+0000 7f32ba9b2700 1 --2- 172.21.15.104:0/3212874247 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f3298060860 0x7f3298062d10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f32a4007fd0 tx=0x7f32a4009040 comp rx=0 tx=0).stop 2024-08-17T02:25:43.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.412+0000 7f32ba9b2700 1 -- 172.21.15.104:0/3212874247 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f32b40cc230 msgr2=0x7f32b40c92d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.412+0000 7f32ba9b2700 1 --2- 172.21.15.104:0/3212874247 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f32b40cc230 0x7f32b40c92d0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f32b000ec80 tx=0x7f32b00091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.412+0000 7f32ba1b1700 1 -- 172.21.15.104:0/3212874247 reap_dead start 2024-08-17T02:25:43.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.412+0000 7f32ba9b2700 1 -- 172.21.15.104:0/3212874247 shutdown_connections 2024-08-17T02:25:43.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.412+0000 7f32ba9b2700 1 -- 172.21.15.104:0/3212874247 >> 172.21.15.104:0/3212874247 conn(0x7f32b4099410 msgr2=0x7f32b40cc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:43.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.412+0000 7f32ba9b2700 1 -- 172.21.15.104:0/3212874247 shutdown_connections 2024-08-17T02:25:43.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.412+0000 7f32ba9b2700 1 -- 172.21.15.104:0/3212874247 wait complete. 2024-08-17T02:25:43.429 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-08-17T02:25:43.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.536+0000 7f231759e700 1 Processor -- start 2024-08-17T02:25:43.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.536+0000 7f231759e700 1 -- start start 2024-08-17T02:25:43.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.536+0000 7f231759e700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f231806e620 0x7f23180b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.536+0000 7f231759e700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2318141a00 con 0x7f23180b1630 2024-08-17T02:25:43.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.536+0000 7f231759e700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2318140b10 con 0x7f23180b0d20 2024-08-17T02:25:43.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.536+0000 7f231759e700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2318140df0 con 0x7f231806e620 2024-08-17T02:25:43.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.536+0000 7f230ffff700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f231806e620 0x7f23180b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.536+0000 7f2316d9d700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f23180b1630 0x7f2318141e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:43600/0 (socket says 172.21.15.104:43600) 2024-08-17T02:25:43.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.536+0000 7f2316d9d700 1 -- 172.21.15.104:0/308683174 learned_addr learned my addr 172.21.15.104:0/308683174 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:25:43.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.536+0000 7f230ffff700 1 -- 172.21.15.104:0/308683174 >> v1:172.21.15.117:6789/0 conn(0x7f23180b0d20 legacy=0x7f231806df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.536+0000 7f230ffff700 1 -- 172.21.15.104:0/308683174 >> v1:172.21.15.104:6789/0 conn(0x7f23180b1630 legacy=0x7f2318141e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.536+0000 7f230ffff700 1 -- 172.21.15.104:0/308683174 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23181410d0 con 0x7f231806e620 2024-08-17T02:25:43.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.536+0000 7f230ffff700 1 --2- 172.21.15.104:0/308683174 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f231806e620 0x7f23180b10f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f23080098e0 tx=0x7f23080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63952a761dda5680 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:43.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.536+0000 7f2315d9b700 1 -- 172.21.15.104:0/308683174 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2308009e80 con 0x7f231806e620 2024-08-17T02:25:43.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.536+0000 7f2315d9b700 1 -- 172.21.15.104:0/308683174 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230800b860 con 0x7f231806e620 2024-08-17T02:25:43.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.536+0000 7f2315d9b700 1 -- 172.21.15.104:0/308683174 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230800bbe0 con 0x7f231806e620 2024-08-17T02:25:43.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.540+0000 7f231759e700 1 -- 172.21.15.104:0/308683174 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f231806e620 msgr2=0x7f23180b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.540+0000 7f231759e700 1 --2- 172.21.15.104:0/308683174 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f231806e620 0x7f23180b10f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f23080098e0 tx=0x7f23080091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.540+0000 7f231759e700 1 -- 172.21.15.104:0/308683174 shutdown_connections 2024-08-17T02:25:43.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.540+0000 7f231759e700 1 --2- 172.21.15.104:0/308683174 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f231806e620 0x7f23180b10f0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.540+0000 7f231759e700 1 -- 172.21.15.104:0/308683174 >> 172.21.15.104:0/308683174 conn(0x7f23180678d0 msgr2=0x7f2318067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:43.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.540+0000 7f231759e700 1 -- 172.21.15.104:0/308683174 shutdown_connections 2024-08-17T02:25:43.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.540+0000 7f231759e700 1 -- 172.21.15.104:0/308683174 wait complete. 2024-08-17T02:25:43.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.540+0000 7f231759e700 1 Processor -- start 2024-08-17T02:25:43.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.540+0000 7f231759e700 1 -- start start 2024-08-17T02:25:43.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.544+0000 7f231759e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f231806e620 0x7f2318069940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.544+0000 7f231759e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23180b0d20 0x7f2318156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.544+0000 7f231759e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23180b1630 0x7f23181567d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.544+0000 7f231759e700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2318158b70 con 0x7f23180b1630 2024-08-17T02:25:43.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.544+0000 7f231759e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2318157f60 con 0x7f231806e620 2024-08-17T02:25:43.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.544+0000 7f231759e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2318158240 con 0x7f23180b0d20 2024-08-17T02:25:43.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.544+0000 7f2316d9d700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23180b1630 0x7f23181567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.544+0000 7f2316d9d700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23180b1630 0x7f23181567d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53918/0 (socket says 172.21.15.104:53918) 2024-08-17T02:25:43.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.544+0000 7f231659c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f231806e620 0x7f2318069940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.544+0000 7f2316d9d700 1 -- 172.21.15.104:0/4036495172 learned_addr learned my addr 172.21.15.104:0/4036495172 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:43.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.544+0000 7f230ffff700 1 --2- 172.21.15.104:0/4036495172 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23180b0d20 0x7f2318156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.544+0000 7f231659c700 1 -- 172.21.15.104:0/4036495172 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23180b0d20 msgr2=0x7f2318156290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.544+0000 7f231659c700 1 --2- 172.21.15.104:0/4036495172 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23180b0d20 0x7f2318156290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.544+0000 7f231659c700 1 -- 172.21.15.104:0/4036495172 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23180b1630 msgr2=0x7f23181567d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.544+0000 7f231659c700 1 --2- 172.21.15.104:0/4036495172 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23180b1630 0x7f23181567d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.544+0000 7f231659c700 1 -- 172.21.15.104:0/4036495172 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2308009420 con 0x7f231806e620 2024-08-17T02:25:43.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.544+0000 7f2316d9d700 1 --2- 172.21.15.104:0/4036495172 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23180b1630 0x7f23181567d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:43.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.544+0000 7f231659c700 1 --2- 172.21.15.104:0/4036495172 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f231806e620 0x7f2318069940 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f230000c490 tx=0x7f2300007ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:43.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.544+0000 7f230e7fc700 1 -- 172.21.15.104:0/4036495172 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230000ce40 con 0x7f231806e620 2024-08-17T02:25:43.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.544+0000 7f230e7fc700 1 -- 172.21.15.104:0/4036495172 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2300011590 con 0x7f231806e620 2024-08-17T02:25:43.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.544+0000 7f230e7fc700 1 -- 172.21.15.104:0/4036495172 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2300011950 con 0x7f231806e620 2024-08-17T02:25:43.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.544+0000 7f231759e700 1 -- 172.21.15.104:0/4036495172 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2318158520 con 0x7f231806e620 2024-08-17T02:25:43.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.544+0000 7f231759e700 1 -- 172.21.15.104:0/4036495172 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2318069e80 con 0x7f231806e620 2024-08-17T02:25:43.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.548+0000 7f231759e700 1 -- 172.21.15.104:0/4036495172 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23180643a0 con 0x7f231806e620 2024-08-17T02:25:43.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.548+0000 7f230e7fc700 1 -- 172.21.15.104:0/4036495172 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2300011cc0 con 0x7f231806e620 2024-08-17T02:25:43.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.548+0000 7f230e7fc700 1 --2- 172.21.15.104:0/4036495172 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f22f8060860 0x7f22f8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.548+0000 7f230e7fc700 1 -- 172.21.15.104:0/4036495172 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f230007bc20 con 0x7f231806e620 2024-08-17T02:25:43.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.548+0000 7f230ffff700 1 --2- 172.21.15.104:0/4036495172 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f22f8060860 0x7f22f8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.548+0000 7f230ffff700 1 --2- 172.21.15.104:0/4036495172 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f22f8060860 0x7f22f8062d10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f23080093f0 tx=0x7f2308017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:43.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.560+0000 7f230e7fc700 1 -- 172.21.15.104:0/4036495172 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f230004c390 con 0x7f231806e620 2024-08-17T02:25:43.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.724+0000 7f231759e700 1 -- 172.21.15.104:0/4036495172 --> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f231806f5f0 con 0x7f22f8060860 2024-08-17T02:25:43.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.724+0000 7f230e7fc700 1 -- 172.21.15.104:0/4036495172 <== mgr.4111 v2:172.21.15.117:6832/24084 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f231806f5f0 con 0x7f22f8060860 2024-08-17T02:25:43.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.724+0000 7f231759e700 1 -- 172.21.15.104:0/4036495172 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f22f8060860 msgr2=0x7f22f8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.724+0000 7f231759e700 1 --2- 172.21.15.104:0/4036495172 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f22f8060860 0x7f22f8062d10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f23080093f0 tx=0x7f2308017000 comp rx=0 tx=0).stop 2024-08-17T02:25:43.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.728+0000 7f231759e700 1 -- 172.21.15.104:0/4036495172 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f231806e620 msgr2=0x7f2318069940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.728+0000 7f231759e700 1 --2- 172.21.15.104:0/4036495172 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f231806e620 0x7f2318069940 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f230000c490 tx=0x7f2300007ec0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.728+0000 7f231759e700 1 -- 172.21.15.104:0/4036495172 shutdown_connections 2024-08-17T02:25:43.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.728+0000 7f231759e700 1 --2- 172.21.15.104:0/4036495172 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f22f8060860 0x7f22f8062d10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.728+0000 7f231759e700 1 --2- 172.21.15.104:0/4036495172 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23180b1630 0x7f23181567d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.728+0000 7f231759e700 1 --2- 172.21.15.104:0/4036495172 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23180b0d20 0x7f2318156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.728+0000 7f231759e700 1 --2- 172.21.15.104:0/4036495172 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f231806e620 0x7f2318069940 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.728+0000 7f231759e700 1 -- 172.21.15.104:0/4036495172 >> 172.21.15.104:0/4036495172 conn(0x7f23180678d0 msgr2=0x7f231815e120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:43.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.728+0000 7f231759e700 1 -- 172.21.15.104:0/4036495172 shutdown_connections 2024-08-17T02:25:43.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.728+0000 7f231759e700 1 -- 172.21.15.104:0/4036495172 wait complete. 2024-08-17T02:25:43.733 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 2 to deep-scrub 2024-08-17T02:25:43.742 INFO:tasks.ceph:Scrubbing osd.3 2024-08-17T02:25:43.742 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:25:43.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.852+0000 7faccb59e700 1 Processor -- start 2024-08-17T02:25:43.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.852+0000 7faccb59e700 1 -- start start 2024-08-17T02:25:43.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.852+0000 7faccb59e700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7faccc0ce640 0x7faccc0b2e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.852+0000 7faccb59e700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7faccc0cea10 0x7faccc0cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.852+0000 7faccb59e700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faccc0c5bb0 con 0x7faccc0cc230 2024-08-17T02:25:43.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.852+0000 7faccb59e700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faccc0c4fa0 con 0x7faccc0ce640 2024-08-17T02:25:43.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.852+0000 7faccb59e700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faccc0c5280 con 0x7faccc0cea10 2024-08-17T02:25:43.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.852+0000 7facca59c700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7faccc0ce640 0x7faccc0b2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.852+0000 7facca59c700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7faccc0ce640 0x7faccc0b2e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53932/0 (socket says 172.21.15.104:53932) 2024-08-17T02:25:43.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.852+0000 7facca59c700 1 -- 172.21.15.104:0/2997200660 learned_addr learned my addr 172.21.15.104:0/2997200660 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:43.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.852+0000 7facc9d9b700 1 --2- 172.21.15.104:0/2997200660 >> v2:172.21.15.117:3300/0 conn(0x7faccc0cea10 0x7faccc0cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.852+0000 7facca59c700 1 -- 172.21.15.104:0/2997200660 >> v2:172.21.15.117:3300/0 conn(0x7faccc0cea10 msgr2=0x7faccc0cbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:43.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.852+0000 7facca59c700 1 --2- 172.21.15.104:0/2997200660 >> v2:172.21.15.117:3300/0 conn(0x7faccc0cea10 0x7faccc0cbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.852+0000 7facca59c700 1 -- 172.21.15.104:0/2997200660 >> v1:172.21.15.117:6789/0 conn(0x7faccc0cc230 legacy=0x7faccc0c6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.852+0000 7facca59c700 1 -- 172.21.15.104:0/2997200660 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faccc0c5560 con 0x7faccc0ce640 2024-08-17T02:25:43.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.852+0000 7facca59c700 1 --2- 172.21.15.104:0/2997200660 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faccc0ce640 0x7faccc0b2e70 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7faccc0ca6a0 tx=0x7facbc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da627eb70753b665 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:43.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.852+0000 7facc959a700 1 -- 172.21.15.104:0/2997200660 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc009e70 con 0x7faccc0ce640 2024-08-17T02:25:43.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.852+0000 7facc959a700 1 -- 172.21.15.104:0/2997200660 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facbc00b860 con 0x7faccc0ce640 2024-08-17T02:25:43.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.852+0000 7facc959a700 1 -- 172.21.15.104:0/2997200660 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc00bc00 con 0x7faccc0ce640 2024-08-17T02:25:43.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.856+0000 7faccb59e700 1 -- 172.21.15.104:0/2997200660 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faccc0ce640 msgr2=0x7faccc0b2e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.856+0000 7faccb59e700 1 --2- 172.21.15.104:0/2997200660 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faccc0ce640 0x7faccc0b2e70 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7faccc0ca6a0 tx=0x7facbc009250 comp rx=0 tx=0).stop 2024-08-17T02:25:43.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.856+0000 7faccb59e700 1 -- 172.21.15.104:0/2997200660 shutdown_connections 2024-08-17T02:25:43.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.856+0000 7faccb59e700 1 --2- 172.21.15.104:0/2997200660 >> v2:172.21.15.117:3300/0 conn(0x7faccc0cea10 0x7faccc0cbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.856+0000 7faccb59e700 1 --2- 172.21.15.104:0/2997200660 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faccc0ce640 0x7faccc0b2e70 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.856+0000 7faccb59e700 1 -- 172.21.15.104:0/2997200660 >> 172.21.15.104:0/2997200660 conn(0x7faccc099410 msgr2=0x7faccc0675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:43.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.856+0000 7faccb59e700 1 -- 172.21.15.104:0/2997200660 shutdown_connections 2024-08-17T02:25:43.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.856+0000 7faccb59e700 1 -- 172.21.15.104:0/2997200660 wait complete. 2024-08-17T02:25:43.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.856+0000 7faccb59e700 1 Processor -- start 2024-08-17T02:25:43.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.856+0000 7faccb59e700 1 -- start start 2024-08-17T02:25:43.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.856+0000 7faccb59e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faccc0cc230 0x7faccc147b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.856+0000 7faccb59e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faccc0ce640 0x7faccc0c8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.856+0000 7faccb59e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faccc0cea10 0x7faccc0b48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.856+0000 7faccb59e700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faccc0ca030 con 0x7faccc0cc230 2024-08-17T02:25:43.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.856+0000 7faccb59e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faccc148060 con 0x7faccc0ce640 2024-08-17T02:25:43.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.856+0000 7faccb59e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faccc0c9420 con 0x7faccc0cea10 2024-08-17T02:25:43.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.856+0000 7facca59c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faccc0cc230 0x7faccc147b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.856+0000 7facca59c700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faccc0cc230 0x7faccc147b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53934/0 (socket says 172.21.15.104:53934) 2024-08-17T02:25:43.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.856+0000 7facca59c700 1 -- 172.21.15.104:0/3970341445 learned_addr learned my addr 172.21.15.104:0/3970341445 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:43.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.856+0000 7faccad9d700 1 --2- 172.21.15.104:0/3970341445 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faccc0cea10 0x7faccc0b48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.856+0000 7facc9d9b700 1 --2- 172.21.15.104:0/3970341445 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faccc0ce640 0x7faccc0c8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.860+0000 7facca59c700 1 -- 172.21.15.104:0/3970341445 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faccc0cea10 msgr2=0x7faccc0b48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.860+0000 7facca59c700 1 --2- 172.21.15.104:0/3970341445 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faccc0cea10 0x7faccc0b48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.860+0000 7facca59c700 1 -- 172.21.15.104:0/3970341445 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faccc0ce640 msgr2=0x7faccc0c8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.860+0000 7facca59c700 1 --2- 172.21.15.104:0/3970341445 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faccc0ce640 0x7faccc0c8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.860+0000 7facca59c700 1 -- 172.21.15.104:0/3970341445 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facbc0094f0 con 0x7faccc0cc230 2024-08-17T02:25:43.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.860+0000 7facca59c700 1 --2- 172.21.15.104:0/3970341445 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faccc0cc230 0x7faccc147b20 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7faccc067de0 tx=0x7facbc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:43.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.860+0000 7facc27fc700 1 -- 172.21.15.104:0/3970341445 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc00bbe0 con 0x7faccc0cc230 2024-08-17T02:25:43.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.860+0000 7facc27fc700 1 -- 172.21.15.104:0/3970341445 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facbc000c90 con 0x7faccc0cc230 2024-08-17T02:25:43.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.860+0000 7faccb59e700 1 -- 172.21.15.104:0/3970341445 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faccc0c9700 con 0x7faccc0cc230 2024-08-17T02:25:43.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.860+0000 7facc27fc700 1 -- 172.21.15.104:0/3970341445 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc011670 con 0x7faccc0cc230 2024-08-17T02:25:43.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.860+0000 7faccb59e700 1 -- 172.21.15.104:0/3970341445 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faccc0c9cc0 con 0x7faccc0cc230 2024-08-17T02:25:43.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.860+0000 7faccb59e700 1 -- 172.21.15.104:0/3970341445 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faccc0644b0 con 0x7faccc0cc230 2024-08-17T02:25:43.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.860+0000 7facc27fc700 1 -- 172.21.15.104:0/3970341445 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7facbc011a60 con 0x7faccc0cc230 2024-08-17T02:25:43.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.860+0000 7facc27fc700 1 --2- 172.21.15.104:0/3970341445 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7facac060860 0x7facac062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.860+0000 7facc27fc700 1 -- 172.21.15.104:0/3970341445 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5025+0+0 (secure 0 0 0) 0x7facbc07e580 con 0x7faccc0cc230 2024-08-17T02:25:43.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.860+0000 7facc27fc700 1 --2- 172.21.15.104:0/3970341445 >> [v2:172.21.15.104:6800/24254,v1:172.21.15.104:6801/24254] conn(0x7facac066750 0x7facac068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.860+0000 7facc27fc700 1 -- 172.21.15.104:0/3970341445 --> [v2:172.21.15.104:6800/24254,v1:172.21.15.104:6801/24254] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7facac069210 con 0x7facac066750 2024-08-17T02:25:43.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.860+0000 7facc27fc700 1 -- 172.21.15.104:0/3970341445 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7facbc07e950 con 0x7faccc0cc230 2024-08-17T02:25:43.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.860+0000 7facc9d9b700 1 --2- 172.21.15.104:0/3970341445 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7facac060860 0x7facac062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.860+0000 7faccad9d700 1 --2- 172.21.15.104:0/3970341445 >> [v2:172.21.15.104:6800/24254,v1:172.21.15.104:6801/24254] conn(0x7facac066750 0x7facac068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.864+0000 7faccad9d700 1 --2- 172.21.15.104:0/3970341445 >> [v2:172.21.15.104:6800/24254,v1:172.21.15.104:6801/24254] conn(0x7facac066750 0x7facac068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:43.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.864+0000 7facc9d9b700 1 --2- 172.21.15.104:0/3970341445 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7facac060860 0x7facac062d10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7faccc152c60 tx=0x7facb40091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:43.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.864+0000 7facc27fc700 1 -- 172.21.15.104:0/3970341445 <== osd.3 v2:172.21.15.104:6800/24254 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7facac069210 con 0x7facac066750 2024-08-17T02:25:43.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.876+0000 7faccb59e700 1 -- 172.21.15.104:0/3970341445 --> [v2:172.21.15.104:6800/24254,v1:172.21.15.104:6801/24254] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7faccc063c30 con 0x7facac066750 2024-08-17T02:25:43.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.880+0000 7facc27fc700 1 -- 172.21.15.104:0/3970341445 <== osd.3 v2:172.21.15.104:6800/24254 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7faccc063c30 con 0x7facac066750 2024-08-17T02:25:43.883 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-08-17T02:25:43.883 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:25:43.883 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-08-17T02:25:43.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.880+0000 7faccb59e700 1 -- 172.21.15.104:0/3970341445 >> [v2:172.21.15.104:6800/24254,v1:172.21.15.104:6801/24254] conn(0x7facac066750 msgr2=0x7facac068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.880+0000 7faccb59e700 1 --2- 172.21.15.104:0/3970341445 >> [v2:172.21.15.104:6800/24254,v1:172.21.15.104:6801/24254] conn(0x7facac066750 0x7facac068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.880+0000 7faccb59e700 1 -- 172.21.15.104:0/3970341445 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7facac060860 msgr2=0x7facac062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.880+0000 7faccb59e700 1 --2- 172.21.15.104:0/3970341445 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7facac060860 0x7facac062d10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7faccc152c60 tx=0x7facb40091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.880+0000 7faccb59e700 1 -- 172.21.15.104:0/3970341445 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faccc0cc230 msgr2=0x7faccc147b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.880+0000 7faccb59e700 1 --2- 172.21.15.104:0/3970341445 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faccc0cc230 0x7faccc147b20 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7faccc067de0 tx=0x7facbc017000 comp rx=0 tx=0).stop 2024-08-17T02:25:43.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.880+0000 7faccad9d700 1 -- 172.21.15.104:0/3970341445 reap_dead start 2024-08-17T02:25:43.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.880+0000 7faccb59e700 1 -- 172.21.15.104:0/3970341445 shutdown_connections 2024-08-17T02:25:43.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.880+0000 7faccb59e700 1 -- 172.21.15.104:0/3970341445 >> 172.21.15.104:0/3970341445 conn(0x7faccc099410 msgr2=0x7faccc152080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:43.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.880+0000 7faccb59e700 1 -- 172.21.15.104:0/3970341445 shutdown_connections 2024-08-17T02:25:43.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:43.880+0000 7faccb59e700 1 -- 172.21.15.104:0/3970341445 wait complete. 2024-08-17T02:25:43.895 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-08-17T02:25:44.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.000+0000 7fb21a799700 1 Processor -- start 2024-08-17T02:25:44.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.000+0000 7fb21a799700 1 -- start start 2024-08-17T02:25:44.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.000+0000 7fb21a799700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb214155d80 0x7fb2140aeee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.000+0000 7fb21a799700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2140af880 con 0x7fb2140ad260 2024-08-17T02:25:44.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.000+0000 7fb21a799700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2140ad8a0 con 0x7fb2140af420 2024-08-17T02:25:44.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.000+0000 7fb21a799700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2140adb80 con 0x7fb214155d80 2024-08-17T02:25:44.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.000+0000 7fb219797700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb214155d80 0x7fb2140aeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.000+0000 7fb219f98700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fb2140ad260 0x7fb214157a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:43610/0 (socket says 172.21.15.104:43610) 2024-08-17T02:25:44.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.000+0000 7fb219f98700 1 -- 172.21.15.104:0/3884773689 learned_addr learned my addr 172.21.15.104:0/3884773689 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:25:44.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.000+0000 7fb219797700 1 -- 172.21.15.104:0/3884773689 >> v1:172.21.15.117:6789/0 conn(0x7fb2140af420 legacy=0x7fb2140acb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.000+0000 7fb219797700 1 -- 172.21.15.104:0/3884773689 >> v1:172.21.15.104:6789/0 conn(0x7fb2140ad260 legacy=0x7fb214157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.000+0000 7fb20bfff700 1 -- 172.21.15.104:0/3884773689 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1941545629 0 0) 0x7fb20c001490 con 0x7fb2140ad260 2024-08-17T02:25:44.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.000+0000 7fb219797700 1 -- 172.21.15.104:0/3884773689 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2140ade60 con 0x7fb214155d80 2024-08-17T02:25:44.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.000+0000 7fb219797700 1 --2- 172.21.15.104:0/3884773689 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb214155d80 0x7fb2140aeee0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb2100098e0 tx=0x7fb2100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c02ba5fa62903ddf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:44.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.000+0000 7fb20bfff700 1 -- 172.21.15.104:0/3884773689 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb210009e80 con 0x7fb214155d80 2024-08-17T02:25:44.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.004+0000 7fb20bfff700 1 -- 172.21.15.104:0/3884773689 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb21000b860 con 0x7fb214155d80 2024-08-17T02:25:44.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.004+0000 7fb20bfff700 1 -- 172.21.15.104:0/3884773689 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21000bbe0 con 0x7fb214155d80 2024-08-17T02:25:44.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.004+0000 7fb21a799700 1 -- 172.21.15.104:0/3884773689 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb214155d80 msgr2=0x7fb2140aeee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.004+0000 7fb21a799700 1 --2- 172.21.15.104:0/3884773689 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb214155d80 0x7fb2140aeee0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb2100098e0 tx=0x7fb2100091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.004+0000 7fb21a799700 1 -- 172.21.15.104:0/3884773689 shutdown_connections 2024-08-17T02:25:44.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.004+0000 7fb21a799700 1 --2- 172.21.15.104:0/3884773689 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb214155d80 0x7fb2140aeee0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.004+0000 7fb21a799700 1 -- 172.21.15.104:0/3884773689 >> 172.21.15.104:0/3884773689 conn(0x7fb21406e070 msgr2=0x7fb2140b1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:44.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.004+0000 7fb21a799700 1 -- 172.21.15.104:0/3884773689 shutdown_connections 2024-08-17T02:25:44.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.004+0000 7fb21a799700 1 -- 172.21.15.104:0/3884773689 wait complete. 2024-08-17T02:25:44.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.004+0000 7fb21a799700 1 Processor -- start 2024-08-17T02:25:44.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.004+0000 7fb21a799700 1 -- start start 2024-08-17T02:25:44.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.008+0000 7fb21a799700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2140ad260 0x7fb21413ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.008+0000 7fb21a799700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb2140af420 0x7fb2140c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.008+0000 7fb21a799700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb214155d80 0x7fb2140ca220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.008+0000 7fb21a799700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb214151ae0 con 0x7fb2140af420 2024-08-17T02:25:44.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.008+0000 7fb21a799700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2141528d0 con 0x7fb214155d80 2024-08-17T02:25:44.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.008+0000 7fb21a799700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb214155390 con 0x7fb2140ad260 2024-08-17T02:25:44.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.008+0000 7fb218f96700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb2140af420 0x7fb2140c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.008+0000 7fb218f96700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb2140af420 0x7fb2140c9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53942/0 (socket says 172.21.15.104:53942) 2024-08-17T02:25:44.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.008+0000 7fb218f96700 1 -- 172.21.15.104:0/4100000525 learned_addr learned my addr 172.21.15.104:0/4100000525 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:44.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.008+0000 7fb219797700 1 --2- 172.21.15.104:0/4100000525 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2140ad260 0x7fb21413ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.008+0000 7fb219f98700 1 --2- 172.21.15.104:0/4100000525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb214155d80 0x7fb2140ca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.008+0000 7fb218f96700 1 -- 172.21.15.104:0/4100000525 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2140ad260 msgr2=0x7fb21413ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.008+0000 7fb218f96700 1 --2- 172.21.15.104:0/4100000525 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2140ad260 0x7fb21413ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.008+0000 7fb218f96700 1 -- 172.21.15.104:0/4100000525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb214155d80 msgr2=0x7fb2140ca220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.008+0000 7fb218f96700 1 --2- 172.21.15.104:0/4100000525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb214155d80 0x7fb2140ca220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.008+0000 7fb218f96700 1 -- 172.21.15.104:0/4100000525 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb210009420 con 0x7fb2140af420 2024-08-17T02:25:44.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.008+0000 7fb219f98700 1 --2- 172.21.15.104:0/4100000525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb214155d80 0x7fb2140ca220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:44.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.008+0000 7fb218f96700 1 --2- 172.21.15.104:0/4100000525 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb2140af420 0x7fb2140c9ce0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb20400c5c0 tx=0x7fb20400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:44.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.008+0000 7fb2097fa700 1 -- 172.21.15.104:0/4100000525 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb204011590 con 0x7fb2140af420 2024-08-17T02:25:44.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.008+0000 7fb2097fa700 1 -- 172.21.15.104:0/4100000525 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb204011710 con 0x7fb2140af420 2024-08-17T02:25:44.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.008+0000 7fb2097fa700 1 -- 172.21.15.104:0/4100000525 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb204011ad0 con 0x7fb2140af420 2024-08-17T02:25:44.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.008+0000 7fb21a799700 1 -- 172.21.15.104:0/4100000525 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb214151cc0 con 0x7fb2140af420 2024-08-17T02:25:44.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.008+0000 7fb21a799700 1 -- 172.21.15.104:0/4100000525 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb214152280 con 0x7fb2140af420 2024-08-17T02:25:44.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.008+0000 7fb21a799700 1 -- 172.21.15.104:0/4100000525 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2140638f0 con 0x7fb2140af420 2024-08-17T02:25:44.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.008+0000 7fb2097fa700 1 -- 172.21.15.104:0/4100000525 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb20401b3b0 con 0x7fb2140af420 2024-08-17T02:25:44.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.012+0000 7fb2097fa700 1 --2- 172.21.15.104:0/4100000525 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb1f8060860 0x7fb1f8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.012+0000 7fb2097fa700 1 -- 172.21.15.104:0/4100000525 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fb20407bdd0 con 0x7fb2140af420 2024-08-17T02:25:44.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.012+0000 7fb219797700 1 --2- 172.21.15.104:0/4100000525 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb1f8060860 0x7fb1f8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.012+0000 7fb219797700 1 --2- 172.21.15.104:0/4100000525 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb1f8060860 0x7fb1f8062d10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb2100093f0 tx=0x7fb210017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:44.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.020+0000 7fb2097fa700 1 -- 172.21.15.104:0/4100000525 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb20404c4c0 con 0x7fb2140af420 2024-08-17T02:25:44.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.184+0000 7fb21a799700 1 -- 172.21.15.104:0/4100000525 --> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fb214152a10 con 0x7fb1f8060860 2024-08-17T02:25:44.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.188+0000 7fb2097fa700 1 -- 172.21.15.104:0/4100000525 <== mgr.4111 v2:172.21.15.117:6832/24084 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb214152a10 con 0x7fb1f8060860 2024-08-17T02:25:44.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.188+0000 7fb21a799700 1 -- 172.21.15.104:0/4100000525 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb1f8060860 msgr2=0x7fb1f8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.188+0000 7fb21a799700 1 --2- 172.21.15.104:0/4100000525 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb1f8060860 0x7fb1f8062d10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb2100093f0 tx=0x7fb210017000 comp rx=0 tx=0).stop 2024-08-17T02:25:44.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.188+0000 7fb21a799700 1 -- 172.21.15.104:0/4100000525 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb2140af420 msgr2=0x7fb2140c9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.188+0000 7fb21a799700 1 --2- 172.21.15.104:0/4100000525 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb2140af420 0x7fb2140c9ce0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb20400c5c0 tx=0x7fb20400c8d0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.188+0000 7fb21a799700 1 -- 172.21.15.104:0/4100000525 shutdown_connections 2024-08-17T02:25:44.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.188+0000 7fb21a799700 1 --2- 172.21.15.104:0/4100000525 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fb1f8060860 0x7fb1f8062d10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.188+0000 7fb21a799700 1 --2- 172.21.15.104:0/4100000525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb214155d80 0x7fb2140ca220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.188+0000 7fb21a799700 1 --2- 172.21.15.104:0/4100000525 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb2140af420 0x7fb2140c9ce0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.188+0000 7fb21a799700 1 --2- 172.21.15.104:0/4100000525 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2140ad260 0x7fb21413ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.188+0000 7fb21a799700 1 -- 172.21.15.104:0/4100000525 >> 172.21.15.104:0/4100000525 conn(0x7fb21406e070 msgr2=0x7fb2141402d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:44.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.188+0000 7fb21a799700 1 -- 172.21.15.104:0/4100000525 shutdown_connections 2024-08-17T02:25:44.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.188+0000 7fb21a799700 1 -- 172.21.15.104:0/4100000525 wait complete. 2024-08-17T02:25:44.196 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 3 to deep-scrub 2024-08-17T02:25:44.206 INFO:tasks.ceph:Scrubbing osd.4 2024-08-17T02:25:44.206 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:25:44.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.316+0000 7fe81e37e700 1 Processor -- start 2024-08-17T02:25:44.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.316+0000 7fe81e37e700 1 -- start start 2024-08-17T02:25:44.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.320+0000 7fe81e37e700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe8180686a0 0x7fe818068af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.320+0000 7fe81e37e700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe8180af6d0 0x7fe8180afad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.320+0000 7fe81e37e700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8180b0f30 con 0x7fe818155680 2024-08-17T02:25:44.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.320+0000 7fe81e37e700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8180af140 con 0x7fe8180686a0 2024-08-17T02:25:44.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.320+0000 7fe81e37e700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe818069030 con 0x7fe8180af6d0 2024-08-17T02:25:44.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.320+0000 7fe8177fe700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe8180686a0 0x7fe818068af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.320+0000 7fe8177fe700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe8180686a0 0x7fe818068af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53944/0 (socket says 172.21.15.104:53944) 2024-08-17T02:25:44.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.320+0000 7fe8177fe700 1 -- 172.21.15.104:0/1802968333 learned_addr learned my addr 172.21.15.104:0/1802968333 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:44.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.320+0000 7fe81c91b700 1 --2- 172.21.15.104:0/1802968333 >> v2:172.21.15.117:3300/0 conn(0x7fe8180af6d0 0x7fe8180afad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.320+0000 7fe8177fe700 1 -- 172.21.15.104:0/1802968333 >> v2:172.21.15.117:3300/0 conn(0x7fe8180af6d0 msgr2=0x7fe8180afad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:44.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.320+0000 7fe8177fe700 1 --2- 172.21.15.104:0/1802968333 >> v2:172.21.15.117:3300/0 conn(0x7fe8180af6d0 0x7fe8180afad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.320+0000 7fe8177fe700 1 -- 172.21.15.104:0/1802968333 >> v1:172.21.15.117:6789/0 conn(0x7fe818155680 legacy=0x7fe8180b13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.320+0000 7fe8177fe700 1 -- 172.21.15.104:0/1802968333 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8180b1ad0 con 0x7fe8180686a0 2024-08-17T02:25:44.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.320+0000 7fe8177fe700 1 --2- 172.21.15.104:0/1802968333 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8180686a0 0x7fe818068af0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe8180ac9f0 tx=0x7fe800009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2f56d3051d42647 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:44.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.320+0000 7fe816ffd700 1 -- 172.21.15.104:0/1802968333 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe800009e70 con 0x7fe8180686a0 2024-08-17T02:25:44.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.320+0000 7fe816ffd700 1 -- 172.21.15.104:0/1802968333 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80000b860 con 0x7fe8180686a0 2024-08-17T02:25:44.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.320+0000 7fe816ffd700 1 -- 172.21.15.104:0/1802968333 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80000bc00 con 0x7fe8180686a0 2024-08-17T02:25:44.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.320+0000 7fe81e37e700 1 -- 172.21.15.104:0/1802968333 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8180686a0 msgr2=0x7fe818068af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.320+0000 7fe81e37e700 1 --2- 172.21.15.104:0/1802968333 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8180686a0 0x7fe818068af0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe8180ac9f0 tx=0x7fe800009250 comp rx=0 tx=0).stop 2024-08-17T02:25:44.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.320+0000 7fe81e37e700 1 -- 172.21.15.104:0/1802968333 shutdown_connections 2024-08-17T02:25:44.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.320+0000 7fe81e37e700 1 --2- 172.21.15.104:0/1802968333 >> v2:172.21.15.117:3300/0 conn(0x7fe8180af6d0 0x7fe8180afad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.320+0000 7fe81e37e700 1 --2- 172.21.15.104:0/1802968333 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8180686a0 0x7fe818068af0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.320+0000 7fe81e37e700 1 -- 172.21.15.104:0/1802968333 >> 172.21.15.104:0/1802968333 conn(0x7fe8180cd1b0 msgr2=0x7fe81806dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:44.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.320+0000 7fe81e37e700 1 -- 172.21.15.104:0/1802968333 shutdown_connections 2024-08-17T02:25:44.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.320+0000 7fe81e37e700 1 -- 172.21.15.104:0/1802968333 wait complete. 2024-08-17T02:25:44.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.324+0000 7fe81e37e700 1 Processor -- start 2024-08-17T02:25:44.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.324+0000 7fe81e37e700 1 -- start start 2024-08-17T02:25:44.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.324+0000 7fe81e37e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8180686a0 0x7fe818144080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.324+0000 7fe81e37e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8180af6d0 0x7fe8180ab5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.324+0000 7fe81e37e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe818155680 0x7fe818157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.324+0000 7fe81e37e700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8180a5450 con 0x7fe8180af6d0 2024-08-17T02:25:44.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.328+0000 7fe81e37e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8180a59d0 con 0x7fe818155680 2024-08-17T02:25:44.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.328+0000 7fe81e37e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8180abf50 con 0x7fe8180686a0 2024-08-17T02:25:44.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.328+0000 7fe8177fe700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8180af6d0 0x7fe8180ab5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.328+0000 7fe817fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8180686a0 0x7fe818144080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.328+0000 7fe8177fe700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8180af6d0 0x7fe8180ab5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53958/0 (socket says 172.21.15.104:53958) 2024-08-17T02:25:44.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.328+0000 7fe8177fe700 1 -- 172.21.15.104:0/4173730062 learned_addr learned my addr 172.21.15.104:0/4173730062 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:44.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.328+0000 7fe81c91b700 1 --2- 172.21.15.104:0/4173730062 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe818155680 0x7fe818157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.328+0000 7fe8177fe700 1 -- 172.21.15.104:0/4173730062 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8180686a0 msgr2=0x7fe818144080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.328+0000 7fe8177fe700 1 --2- 172.21.15.104:0/4173730062 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8180686a0 0x7fe818144080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.328+0000 7fe8177fe700 1 -- 172.21.15.104:0/4173730062 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe818155680 msgr2=0x7fe818157480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.328+0000 7fe8177fe700 1 --2- 172.21.15.104:0/4173730062 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe818155680 0x7fe818157480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.328+0000 7fe8177fe700 1 -- 172.21.15.104:0/4173730062 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8000094f0 con 0x7fe8180af6d0 2024-08-17T02:25:44.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.328+0000 7fe817fff700 1 --2- 172.21.15.104:0/4173730062 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8180686a0 0x7fe818144080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:44.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.328+0000 7fe8177fe700 1 --2- 172.21.15.104:0/4173730062 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8180af6d0 0x7fe8180ab5e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe8180705c0 tx=0x7fe800017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:44.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.328+0000 7fe80ffff700 1 -- 172.21.15.104:0/4173730062 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80000bbe0 con 0x7fe8180af6d0 2024-08-17T02:25:44.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.328+0000 7fe80ffff700 1 -- 172.21.15.104:0/4173730062 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe800011420 con 0x7fe8180af6d0 2024-08-17T02:25:44.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.328+0000 7fe81e37e700 1 -- 172.21.15.104:0/4173730062 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8180ac230 con 0x7fe8180af6d0 2024-08-17T02:25:44.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.328+0000 7fe80ffff700 1 -- 172.21.15.104:0/4173730062 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8000117e0 con 0x7fe8180af6d0 2024-08-17T02:25:44.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.328+0000 7fe81e37e700 1 -- 172.21.15.104:0/4173730062 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8181445c0 con 0x7fe8180af6d0 2024-08-17T02:25:44.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.328+0000 7fe81e37e700 1 -- 172.21.15.104:0/4173730062 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe8180638f0 con 0x7fe8180af6d0 2024-08-17T02:25:44.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.332+0000 7fe80ffff700 1 -- 172.21.15.104:0/4173730062 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe800011bd0 con 0x7fe8180af6d0 2024-08-17T02:25:44.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.332+0000 7fe80ffff700 1 --2- 172.21.15.104:0/4173730062 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fe7f8060860 0x7fe7f8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.332+0000 7fe80ffff700 1 -- 172.21.15.104:0/4173730062 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fe80007dd30 con 0x7fe8180af6d0 2024-08-17T02:25:44.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.332+0000 7fe817fff700 1 --2- 172.21.15.104:0/4173730062 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fe7f8060860 0x7fe7f8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.332+0000 7fe80ffff700 1 --2- 172.21.15.104:0/4173730062 >> [v2:172.21.15.117:6802/24421,v1:172.21.15.117:6804/24421] conn(0x7fe7f8066750 0x7fe7f8068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.332+0000 7fe80ffff700 1 -- 172.21.15.104:0/4173730062 --> [v2:172.21.15.117:6802/24421,v1:172.21.15.117:6804/24421] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe7f8069210 con 0x7fe7f8066750 2024-08-17T02:25:44.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.332+0000 7fe80ffff700 1 -- 172.21.15.104:0/4173730062 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe800080310 con 0x7fe8180af6d0 2024-08-17T02:25:44.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.332+0000 7fe81c91b700 1 --2- 172.21.15.104:0/4173730062 >> [v2:172.21.15.117:6802/24421,v1:172.21.15.117:6804/24421] conn(0x7fe7f8066750 0x7fe7f8068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.332+0000 7fe817fff700 1 --2- 172.21.15.104:0/4173730062 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fe7f8060860 0x7fe7f8062d10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe810007fd0 tx=0x7fe810009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:44.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.332+0000 7fe81c91b700 1 --2- 172.21.15.104:0/4173730062 >> [v2:172.21.15.117:6802/24421,v1:172.21.15.117:6804/24421] conn(0x7fe7f8066750 0x7fe7f8068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:44.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.336+0000 7fe80ffff700 1 -- 172.21.15.104:0/4173730062 <== osd.4 v2:172.21.15.117:6802/24421 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fe7f8069210 con 0x7fe7f8066750 2024-08-17T02:25:44.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.348+0000 7fe81e37e700 1 -- 172.21.15.104:0/4173730062 --> [v2:172.21.15.117:6802/24421,v1:172.21.15.117:6804/24421] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe8180a5800 con 0x7fe7f8066750 2024-08-17T02:25:44.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.348+0000 7fe80ffff700 1 -- 172.21.15.104:0/4173730062 <== osd.4 v2:172.21.15.117:6802/24421 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fe808013440 con 0x7fe7f8066750 2024-08-17T02:25:44.353 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-08-17T02:25:44.353 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:25:44.353 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-08-17T02:25:44.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.348+0000 7fe81e37e700 1 -- 172.21.15.104:0/4173730062 >> [v2:172.21.15.117:6802/24421,v1:172.21.15.117:6804/24421] conn(0x7fe7f8066750 msgr2=0x7fe7f8068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.348+0000 7fe81e37e700 1 --2- 172.21.15.104:0/4173730062 >> [v2:172.21.15.117:6802/24421,v1:172.21.15.117:6804/24421] conn(0x7fe7f8066750 0x7fe7f8068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.348+0000 7fe81e37e700 1 -- 172.21.15.104:0/4173730062 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fe7f8060860 msgr2=0x7fe7f8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.348+0000 7fe81e37e700 1 --2- 172.21.15.104:0/4173730062 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fe7f8060860 0x7fe7f8062d10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe810007fd0 tx=0x7fe810009040 comp rx=0 tx=0).stop 2024-08-17T02:25:44.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.348+0000 7fe81e37e700 1 -- 172.21.15.104:0/4173730062 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8180af6d0 msgr2=0x7fe8180ab5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.348+0000 7fe81e37e700 1 --2- 172.21.15.104:0/4173730062 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8180af6d0 0x7fe8180ab5e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe8180705c0 tx=0x7fe800017000 comp rx=0 tx=0).stop 2024-08-17T02:25:44.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.348+0000 7fe81c91b700 1 -- 172.21.15.104:0/4173730062 reap_dead start 2024-08-17T02:25:44.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.348+0000 7fe81e37e700 1 -- 172.21.15.104:0/4173730062 shutdown_connections 2024-08-17T02:25:44.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.348+0000 7fe81e37e700 1 -- 172.21.15.104:0/4173730062 >> 172.21.15.104:0/4173730062 conn(0x7fe8180cd1b0 msgr2=0x7fe8180acc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:44.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.348+0000 7fe81e37e700 1 -- 172.21.15.104:0/4173730062 shutdown_connections 2024-08-17T02:25:44.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.348+0000 7fe81e37e700 1 -- 172.21.15.104:0/4173730062 wait complete. 2024-08-17T02:25:44.369 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-08-17T02:25:44.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.476+0000 7fea448ce700 1 Processor -- start 2024-08-17T02:25:44.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.476+0000 7fea448ce700 1 -- start start 2024-08-17T02:25:44.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.480+0000 7fea448ce700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fea400adf10 0x7fea400ae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.480+0000 7fea448ce700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea400cb870 con 0x7fea400cb450 2024-08-17T02:25:44.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.480+0000 7fea448ce700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea401610c0 con 0x7fea4006e470 2024-08-17T02:25:44.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.480+0000 7fea448ce700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea40158290 con 0x7fea400adf10 2024-08-17T02:25:44.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.480+0000 7fea3ed9d700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fea400cb450 0x7fea400b0d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:43612/0 (socket says 172.21.15.104:43612) 2024-08-17T02:25:44.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.480+0000 7fea3ed9d700 1 -- 172.21.15.104:0/3665029852 learned_addr learned my addr 172.21.15.104:0/3665029852 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:25:44.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.480+0000 7fea3e59c700 1 --2- 172.21.15.104:0/3665029852 >> v2:172.21.15.117:3300/0 conn(0x7fea400adf10 0x7fea400ae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.480+0000 7fea3d59a700 1 -- 172.21.15.104:0/3665029852 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3795873727 0 0) 0x7fea400cb870 con 0x7fea400cb450 2024-08-17T02:25:44.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.480+0000 7fea3d59a700 1 -- 172.21.15.104:0/3665029852 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea2c003570 con 0x7fea400cb450 2024-08-17T02:25:44.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.480+0000 7fea3e59c700 1 -- 172.21.15.104:0/3665029852 >> v1:172.21.15.117:6789/0 conn(0x7fea4006e470 legacy=0x7fea400cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.480+0000 7fea3e59c700 1 -- 172.21.15.104:0/3665029852 >> v1:172.21.15.104:6789/0 conn(0x7fea400cb450 legacy=0x7fea400b0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.480+0000 7fea3e59c700 1 -- 172.21.15.104:0/3665029852 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea400ae820 con 0x7fea400adf10 2024-08-17T02:25:44.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.480+0000 7fea3e59c700 1 --2- 172.21.15.104:0/3665029852 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea400adf10 0x7fea400ae2e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fea280098e0 tx=0x7fea280091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffd827409095745c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:44.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.480+0000 7fea3d59a700 1 -- 172.21.15.104:0/3665029852 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2800b640 con 0x7fea400adf10 2024-08-17T02:25:44.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.480+0000 7fea3d59a700 1 -- 172.21.15.104:0/3665029852 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea2800b7a0 con 0x7fea400adf10 2024-08-17T02:25:44.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.480+0000 7fea3d59a700 1 -- 172.21.15.104:0/3665029852 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2800bb40 con 0x7fea400adf10 2024-08-17T02:25:44.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.484+0000 7fea448ce700 1 -- 172.21.15.104:0/3665029852 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea400adf10 msgr2=0x7fea400ae2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.484+0000 7fea448ce700 1 --2- 172.21.15.104:0/3665029852 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea400adf10 0x7fea400ae2e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fea280098e0 tx=0x7fea280091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.484+0000 7fea448ce700 1 -- 172.21.15.104:0/3665029852 shutdown_connections 2024-08-17T02:25:44.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.484+0000 7fea448ce700 1 --2- 172.21.15.104:0/3665029852 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea400adf10 0x7fea400ae2e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.484+0000 7fea448ce700 1 -- 172.21.15.104:0/3665029852 >> 172.21.15.104:0/3665029852 conn(0x7fea40067810 msgr2=0x7fea40067c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:44.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.484+0000 7fea448ce700 1 -- 172.21.15.104:0/3665029852 shutdown_connections 2024-08-17T02:25:44.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.484+0000 7fea448ce700 1 -- 172.21.15.104:0/3665029852 wait complete. 2024-08-17T02:25:44.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.484+0000 7fea448ce700 1 Processor -- start 2024-08-17T02:25:44.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.484+0000 7fea448ce700 1 -- start start 2024-08-17T02:25:44.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.488+0000 7fea448ce700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea4006e470 0x7fea4014b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.488+0000 7fea448ce700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea400adf10 0x7fea4006a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.488+0000 7fea448ce700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea400cb450 0x7fea4006ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.488+0000 7fea448ce700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea400a8d20 con 0x7fea400cb450 2024-08-17T02:25:44.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.488+0000 7fea448ce700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea401524d0 con 0x7fea4006e470 2024-08-17T02:25:44.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.488+0000 7fea448ce700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea401527b0 con 0x7fea400adf10 2024-08-17T02:25:44.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.488+0000 7fea3ed9d700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea400cb450 0x7fea4006ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.488+0000 7fea3ed9d700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea400cb450 0x7fea4006ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53960/0 (socket says 172.21.15.104:53960) 2024-08-17T02:25:44.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.488+0000 7fea3ed9d700 1 -- 172.21.15.104:0/2378576687 learned_addr learned my addr 172.21.15.104:0/2378576687 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:44.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.488+0000 7fea3e59c700 1 --2- 172.21.15.104:0/2378576687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea4006e470 0x7fea4014b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.488+0000 7fea3dd9b700 1 --2- 172.21.15.104:0/2378576687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea400adf10 0x7fea4006a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.488+0000 7fea3ed9d700 1 -- 172.21.15.104:0/2378576687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea400adf10 msgr2=0x7fea4006a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.488+0000 7fea3ed9d700 1 --2- 172.21.15.104:0/2378576687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea400adf10 0x7fea4006a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.488+0000 7fea3ed9d700 1 -- 172.21.15.104:0/2378576687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea4006e470 msgr2=0x7fea4014b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.488+0000 7fea3ed9d700 1 --2- 172.21.15.104:0/2378576687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea4006e470 0x7fea4014b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.488+0000 7fea3ed9d700 1 -- 172.21.15.104:0/2378576687 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea28009420 con 0x7fea400cb450 2024-08-17T02:25:44.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.488+0000 7fea3ed9d700 1 --2- 172.21.15.104:0/2378576687 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea400cb450 0x7fea4006ac10 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fea380010e0 tx=0x7fea38007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:44.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.488+0000 7fea367fc700 1 -- 172.21.15.104:0/2378576687 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea38005b30 con 0x7fea400cb450 2024-08-17T02:25:44.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.488+0000 7fea367fc700 1 -- 172.21.15.104:0/2378576687 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea38005c90 con 0x7fea400cb450 2024-08-17T02:25:44.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.488+0000 7fea448ce700 1 -- 172.21.15.104:0/2378576687 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea40152a90 con 0x7fea400cb450 2024-08-17T02:25:44.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.488+0000 7fea367fc700 1 -- 172.21.15.104:0/2378576687 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea380072e0 con 0x7fea400cb450 2024-08-17T02:25:44.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.488+0000 7fea448ce700 1 -- 172.21.15.104:0/2378576687 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea40153050 con 0x7fea400cb450 2024-08-17T02:25:44.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.488+0000 7fea448ce700 1 -- 172.21.15.104:0/2378576687 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea400645c0 con 0x7fea400cb450 2024-08-17T02:25:44.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.488+0000 7fea367fc700 1 -- 172.21.15.104:0/2378576687 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fea38012400 con 0x7fea400cb450 2024-08-17T02:25:44.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.492+0000 7fea367fc700 1 --2- 172.21.15.104:0/2378576687 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fea20060860 0x7fea20062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.492+0000 7fea367fc700 1 -- 172.21.15.104:0/2378576687 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fea3807bc60 con 0x7fea400cb450 2024-08-17T02:25:44.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.492+0000 7fea3e59c700 1 --2- 172.21.15.104:0/2378576687 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fea20060860 0x7fea20062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.492+0000 7fea3e59c700 1 --2- 172.21.15.104:0/2378576687 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fea20060860 0x7fea20062d10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fea280093f0 tx=0x7fea28017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:44.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.500+0000 7fea367fc700 1 -- 172.21.15.104:0/2378576687 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fea3804c400 con 0x7fea400cb450 2024-08-17T02:25:44.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.664+0000 7fea448ce700 1 -- 172.21.15.104:0/2378576687 --> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fea4015c2e0 con 0x7fea20060860 2024-08-17T02:25:44.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.664+0000 7fea367fc700 1 -- 172.21.15.104:0/2378576687 <== mgr.4111 v2:172.21.15.117:6832/24084 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fea4015c2e0 con 0x7fea20060860 2024-08-17T02:25:44.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.664+0000 7fea448ce700 1 -- 172.21.15.104:0/2378576687 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fea20060860 msgr2=0x7fea20062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.664+0000 7fea448ce700 1 --2- 172.21.15.104:0/2378576687 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fea20060860 0x7fea20062d10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fea280093f0 tx=0x7fea28017000 comp rx=0 tx=0).stop 2024-08-17T02:25:44.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.664+0000 7fea448ce700 1 -- 172.21.15.104:0/2378576687 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea400cb450 msgr2=0x7fea4006ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.664+0000 7fea448ce700 1 --2- 172.21.15.104:0/2378576687 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea400cb450 0x7fea4006ac10 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fea380010e0 tx=0x7fea38007dd0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.664+0000 7fea448ce700 1 -- 172.21.15.104:0/2378576687 shutdown_connections 2024-08-17T02:25:44.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.664+0000 7fea448ce700 1 --2- 172.21.15.104:0/2378576687 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fea20060860 0x7fea20062d10 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.664+0000 7fea448ce700 1 --2- 172.21.15.104:0/2378576687 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea400cb450 0x7fea4006ac10 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.664+0000 7fea448ce700 1 --2- 172.21.15.104:0/2378576687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea400adf10 0x7fea4006a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.664+0000 7fea448ce700 1 --2- 172.21.15.104:0/2378576687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea4006e470 0x7fea4014b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.664+0000 7fea448ce700 1 -- 172.21.15.104:0/2378576687 >> 172.21.15.104:0/2378576687 conn(0x7fea40067810 msgr2=0x7fea40157100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:44.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.664+0000 7fea448ce700 1 -- 172.21.15.104:0/2378576687 shutdown_connections 2024-08-17T02:25:44.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.664+0000 7fea448ce700 1 -- 172.21.15.104:0/2378576687 wait complete. 2024-08-17T02:25:44.672 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 4 to deep-scrub 2024-08-17T02:25:44.682 INFO:tasks.ceph:Scrubbing osd.5 2024-08-17T02:25:44.682 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:25:44.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.792+0000 7f22fd54a700 1 Processor -- start 2024-08-17T02:25:44.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.792+0000 7f22fd54a700 1 -- start start 2024-08-17T02:25:44.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.792+0000 7f22fd54a700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f22f8159500 0x7f22f80cebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.792+0000 7f22fd54a700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22f80ca850 0x7f22f80cac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.792+0000 7f22fd54a700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22f80d09c0 con 0x7f22f80cf110 2024-08-17T02:25:44.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.792+0000 7f22fd54a700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22f815aab0 con 0x7f22f8159500 2024-08-17T02:25:44.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.792+0000 7f22fd54a700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f80d0c10 con 0x7f22f80ca850 2024-08-17T02:25:44.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.792+0000 7f22f67fc700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f22f80cf110 0x7f22f80cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:43624/0 (socket says 172.21.15.104:43624) 2024-08-17T02:25:44.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.792+0000 7f22f67fc700 1 -- 172.21.15.104:0/2958846491 learned_addr learned my addr 172.21.15.104:0/2958846491 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:25:44.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.792+0000 7f22f6ffd700 1 --2- 172.21.15.104:0/2958846491 >> v2:172.21.15.117:3300/0 conn(0x7f22f8159500 0x7f22f80cebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.792+0000 7f22f77fe700 1 --2- 172.21.15.104:0/2958846491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22f80ca850 0x7f22f80cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.792+0000 7f22f5ffb700 1 -- 172.21.15.104:0/2958846491 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 339565913 0 0) 0x7f22f80d09c0 con 0x7f22f80cf110 2024-08-17T02:25:44.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.792+0000 7f22f5ffb700 1 -- 172.21.15.104:0/2958846491 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22e4003570 con 0x7f22f80cf110 2024-08-17T02:25:44.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.792+0000 7f22f5ffb700 1 -- 172.21.15.104:0/2958846491 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1943998295 0 0) 0x7f22e4003570 con 0x7f22f80cf110 2024-08-17T02:25:44.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.792+0000 7f22f5ffb700 1 -- 172.21.15.104:0/2958846491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22f80ca850 msgr2=0x7f22f80cac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:44.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.792+0000 7f22f5ffb700 1 --2- 172.21.15.104:0/2958846491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22f80ca850 0x7f22f80cac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.792+0000 7f22f5ffb700 1 -- 172.21.15.104:0/2958846491 >> v2:172.21.15.117:3300/0 conn(0x7f22f8159500 msgr2=0x7f22f80cebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:44.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.792+0000 7f22f5ffb700 1 --2- 172.21.15.104:0/2958846491 >> v2:172.21.15.117:3300/0 conn(0x7f22f8159500 0x7f22f80cebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.792+0000 7f22f5ffb700 1 -- 172.21.15.104:0/2958846491 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f80d0ef0 con 0x7f22f80cf110 2024-08-17T02:25:44.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.792+0000 7f22f5ffb700 1 -- 172.21.15.104:0/2958846491 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1279957748 0 0) 0x7f22e8001470 con 0x7f22f80cf110 2024-08-17T02:25:44.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.792+0000 7f22f5ffb700 1 -- 172.21.15.104:0/2958846491 >> v1:172.21.15.104:6789/0 conn(0x7f22f80cf110 legacy=0x7f22f80cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.792+0000 7f22f5ffb700 1 --2- 172.21.15.104:0/2958846491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22e4003a60 0x7f22e4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.792+0000 7f22f5ffb700 1 --2- 172.21.15.104:0/2958846491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22f80ca850 0x7f22e4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.792+0000 7f22f5ffb700 1 --2- 172.21.15.104:0/2958846491 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22e4004d50 0x7f22e40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.792+0000 7f22f5ffb700 1 -- 172.21.15.104:0/2958846491 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f815aab0 con 0x7f22e4004d50 2024-08-17T02:25:44.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.792+0000 7f22f5ffb700 1 -- 172.21.15.104:0/2958846491 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f80d0c10 con 0x7f22e4003a60 2024-08-17T02:25:44.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.792+0000 7f22f5ffb700 1 -- 172.21.15.104:0/2958846491 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e400ba60 con 0x7f22f80ca850 2024-08-17T02:25:44.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.792+0000 7f22f77fe700 1 --2- 172.21.15.104:0/2958846491 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22e4004d50 0x7f22e40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.792+0000 7f22f6ffd700 1 --2- 172.21.15.104:0/2958846491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22e4003a60 0x7f22e4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.792+0000 7f22f67fc700 1 --2- 172.21.15.104:0/2958846491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22f80ca850 0x7f22e4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.792+0000 7f22f77fe700 1 -- 172.21.15.104:0/2958846491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22f80ca850 msgr2=0x7f22e4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:44.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.792+0000 7f22f77fe700 1 --2- 172.21.15.104:0/2958846491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22f80ca850 0x7f22e4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.792+0000 7f22f77fe700 1 -- 172.21.15.104:0/2958846491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22e4003a60 msgr2=0x7f22e4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:44.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.792+0000 7f22f77fe700 1 --2- 172.21.15.104:0/2958846491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22e4003a60 0x7f22e4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.792+0000 7f22f77fe700 1 -- 172.21.15.104:0/2958846491 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e4003570 con 0x7f22e4004d50 2024-08-17T02:25:44.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.792+0000 7f22f67fc700 1 --2- 172.21.15.104:0/2958846491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22f80ca850 0x7f22e4004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:44.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.792+0000 7f22f77fe700 1 --2- 172.21.15.104:0/2958846491 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22e4004d50 0x7f22e40051c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f22f000e210 tx=0x7f22f000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b600edca95f623ea server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:44.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.792+0000 7f22f5ffb700 1 -- 172.21.15.104:0/2958846491 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f000ea60 con 0x7f22e4004d50 2024-08-17T02:25:44.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.792+0000 7f22f5ffb700 1 -- 172.21.15.104:0/2958846491 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f000f040 con 0x7f22e4004d50 2024-08-17T02:25:44.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.792+0000 7f22f5ffb700 1 -- 172.21.15.104:0/2958846491 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f000ee10 con 0x7f22e4004d50 2024-08-17T02:25:44.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.796+0000 7f22fd54a700 1 -- 172.21.15.104:0/2958846491 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22e4004d50 msgr2=0x7f22e40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.796+0000 7f22fd54a700 1 --2- 172.21.15.104:0/2958846491 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22e4004d50 0x7f22e40051c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f22f000e210 tx=0x7f22f000b040 comp rx=0 tx=0).stop 2024-08-17T02:25:44.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.796+0000 7f22f77fe700 1 -- 172.21.15.104:0/2958846491 reap_dead start 2024-08-17T02:25:44.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.796+0000 7f22fd54a700 1 -- 172.21.15.104:0/2958846491 shutdown_connections 2024-08-17T02:25:44.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.796+0000 7f22fd54a700 1 -- 172.21.15.104:0/2958846491 >> 172.21.15.104:0/2958846491 conn(0x7f22f8067590 msgr2=0x7f22f80d02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:44.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.796+0000 7f22fd54a700 1 -- 172.21.15.104:0/2958846491 shutdown_connections 2024-08-17T02:25:44.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.796+0000 7f22fd54a700 1 -- 172.21.15.104:0/2958846491 wait complete. 2024-08-17T02:25:44.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.796+0000 7f22fd54a700 1 Processor -- start 2024-08-17T02:25:44.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.796+0000 7f22fd54a700 1 -- start start 2024-08-17T02:25:44.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.796+0000 7f22fd54a700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22e4004d50 0x7f22f80c3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.796+0000 7f22fd54a700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22f80c83d0 0x7f22f80c5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.796+0000 7f22fd54a700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22f80c4250 0x7f22f80c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.796+0000 7f22fd54a700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f80c93f0 con 0x7f22e4004d50 2024-08-17T02:25:44.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.796+0000 7f22fd54a700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f80c8870 con 0x7f22f80c83d0 2024-08-17T02:25:44.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.796+0000 7f22fd54a700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f80c8b50 con 0x7f22f80c4250 2024-08-17T02:25:44.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.796+0000 7f22f6ffd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22e4004d50 0x7f22f80c3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.796+0000 7f22f6ffd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22e4004d50 0x7f22f80c3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53974/0 (socket says 172.21.15.104:53974) 2024-08-17T02:25:44.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.796+0000 7f22f6ffd700 1 -- 172.21.15.104:0/3487656358 learned_addr learned my addr 172.21.15.104:0/3487656358 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:44.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.796+0000 7f22f67fc700 1 --2- 172.21.15.104:0/3487656358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22f80c83d0 0x7f22f80c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.800+0000 7f22f77fe700 1 --2- 172.21.15.104:0/3487656358 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22f80c4250 0x7f22f80c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.800+0000 7f22f6ffd700 1 -- 172.21.15.104:0/3487656358 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22f80c4250 msgr2=0x7f22f80c5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.800+0000 7f22f6ffd700 1 --2- 172.21.15.104:0/3487656358 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22f80c4250 0x7f22f80c5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.800+0000 7f22f6ffd700 1 -- 172.21.15.104:0/3487656358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22f80c83d0 msgr2=0x7f22f80c5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.800+0000 7f22f6ffd700 1 --2- 172.21.15.104:0/3487656358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22f80c83d0 0x7f22f80c5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.800+0000 7f22f6ffd700 1 -- 172.21.15.104:0/3487656358 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f80c8e30 con 0x7f22e4004d50 2024-08-17T02:25:44.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.800+0000 7f22f6ffd700 1 --2- 172.21.15.104:0/3487656358 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22e4004d50 0x7f22f80c3d10 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f22e0006ac0 tx=0x7f22e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:44.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.800+0000 7f22eeffd700 1 -- 172.21.15.104:0/3487656358 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e000f940 con 0x7f22e4004d50 2024-08-17T02:25:44.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.800+0000 7f22eeffd700 1 -- 172.21.15.104:0/3487656358 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e000faa0 con 0x7f22e4004d50 2024-08-17T02:25:44.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.800+0000 7f22fd54a700 1 -- 172.21.15.104:0/3487656358 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22f80c9110 con 0x7f22e4004d50 2024-08-17T02:25:44.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.800+0000 7f22eeffd700 1 -- 172.21.15.104:0/3487656358 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e000fe20 con 0x7f22e4004d50 2024-08-17T02:25:44.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.800+0000 7f22fd54a700 1 -- 172.21.15.104:0/3487656358 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22f8158340 con 0x7f22e4004d50 2024-08-17T02:25:44.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.800+0000 7f22fd54a700 1 -- 172.21.15.104:0/3487656358 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f22f815c6a0 con 0x7f22e4004d50 2024-08-17T02:25:44.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.800+0000 7f22eeffd700 1 -- 172.21.15.104:0/3487656358 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f22e0014650 con 0x7f22e4004d50 2024-08-17T02:25:44.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.804+0000 7f22eeffd700 1 --2- 172.21.15.104:0/3487656358 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f22d8060860 0x7f22d8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.804+0000 7f22eeffd700 1 -- 172.21.15.104:0/3487656358 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f22e0018030 con 0x7f22e4004d50 2024-08-17T02:25:44.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.804+0000 7f22eeffd700 1 --2- 172.21.15.104:0/3487656358 >> [v2:172.21.15.117:6816/24422,v1:172.21.15.117:6817/24422] conn(0x7f22d8066750 0x7f22d8068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.804+0000 7f22eeffd700 1 -- 172.21.15.104:0/3487656358 --> [v2:172.21.15.117:6816/24422,v1:172.21.15.117:6817/24422] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f22d8069210 con 0x7f22d8066750 2024-08-17T02:25:44.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.804+0000 7f22eeffd700 1 -- 172.21.15.104:0/3487656358 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22e007d9d0 con 0x7f22e4004d50 2024-08-17T02:25:44.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.804+0000 7f22f67fc700 1 --2- 172.21.15.104:0/3487656358 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f22d8060860 0x7f22d8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.804+0000 7f22f77fe700 1 --2- 172.21.15.104:0/3487656358 >> [v2:172.21.15.117:6816/24422,v1:172.21.15.117:6817/24422] conn(0x7f22d8066750 0x7f22d8068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.804+0000 7f22f67fc700 1 --2- 172.21.15.104:0/3487656358 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f22d8060860 0x7f22d8062d10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f22f80c87a0 tx=0x7f22e8001e90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:44.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.804+0000 7f22f77fe700 1 --2- 172.21.15.104:0/3487656358 >> [v2:172.21.15.117:6816/24422,v1:172.21.15.117:6817/24422] conn(0x7f22d8066750 0x7f22d8068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:44.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.804+0000 7f22eeffd700 1 -- 172.21.15.104:0/3487656358 <== osd.5 v2:172.21.15.117:6816/24422 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f22d8069210 con 0x7f22d8066750 2024-08-17T02:25:44.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.824+0000 7f22fd54a700 1 -- 172.21.15.104:0/3487656358 --> [v2:172.21.15.117:6816/24422,v1:172.21.15.117:6817/24422] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f22f80638f0 con 0x7f22d8066750 2024-08-17T02:25:44.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.824+0000 7f22eeffd700 1 -- 172.21.15.104:0/3487656358 <== osd.5 v2:172.21.15.117:6816/24422 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f22f80638f0 con 0x7f22d8066750 2024-08-17T02:25:44.827 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-08-17T02:25:44.828 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:25:44.828 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-08-17T02:25:44.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.824+0000 7f22fd54a700 1 -- 172.21.15.104:0/3487656358 >> [v2:172.21.15.117:6816/24422,v1:172.21.15.117:6817/24422] conn(0x7f22d8066750 msgr2=0x7f22d8068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.824+0000 7f22fd54a700 1 --2- 172.21.15.104:0/3487656358 >> [v2:172.21.15.117:6816/24422,v1:172.21.15.117:6817/24422] conn(0x7f22d8066750 0x7f22d8068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.824+0000 7f22fd54a700 1 -- 172.21.15.104:0/3487656358 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f22d8060860 msgr2=0x7f22d8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.824+0000 7f22fd54a700 1 --2- 172.21.15.104:0/3487656358 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f22d8060860 0x7f22d8062d10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f22f80c87a0 tx=0x7f22e8001e90 comp rx=0 tx=0).stop 2024-08-17T02:25:44.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.824+0000 7f22fd54a700 1 -- 172.21.15.104:0/3487656358 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22e4004d50 msgr2=0x7f22f80c3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.824+0000 7f22fd54a700 1 --2- 172.21.15.104:0/3487656358 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22e4004d50 0x7f22f80c3d10 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f22e0006ac0 tx=0x7f22e00091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.824+0000 7f22f77fe700 1 -- 172.21.15.104:0/3487656358 reap_dead start 2024-08-17T02:25:44.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.824+0000 7f22fd54a700 1 -- 172.21.15.104:0/3487656358 shutdown_connections 2024-08-17T02:25:44.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.824+0000 7f22fd54a700 1 -- 172.21.15.104:0/3487656358 >> 172.21.15.104:0/3487656358 conn(0x7f22f8067590 msgr2=0x7f22f815bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:44.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.824+0000 7f22fd54a700 1 -- 172.21.15.104:0/3487656358 shutdown_connections 2024-08-17T02:25:44.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.824+0000 7f22fd54a700 1 -- 172.21.15.104:0/3487656358 wait complete. 2024-08-17T02:25:44.839 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-08-17T02:25:44.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.940+0000 7fa420f70700 1 Processor -- start 2024-08-17T02:25:44.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.940+0000 7fa420f70700 1 -- start start 2024-08-17T02:25:44.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.940+0000 7fa420f70700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa41c159570 0x7fa41c0b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.940+0000 7fa420f70700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa41c159940 0x7fa41c0b0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.940+0000 7fa420f70700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa41c0b0fc0 con 0x7fa41c0b3d20 2024-08-17T02:25:44.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.940+0000 7fa420f70700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa41c0b1860 con 0x7fa41c159570 2024-08-17T02:25:44.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.940+0000 7fa420f70700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c0b12a0 con 0x7fa41c159940 2024-08-17T02:25:44.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.940+0000 7fa41a59c700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa41c159570 0x7fa41c0b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.944+0000 7fa41a59c700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa41c159570 0x7fa41c0b5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53990/0 (socket says 172.21.15.104:53990) 2024-08-17T02:25:44.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.944+0000 7fa41a59c700 1 -- 172.21.15.104:0/3414691035 learned_addr learned my addr 172.21.15.104:0/3414691035 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:44.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.944+0000 7fa419d9b700 1 --2- 172.21.15.104:0/3414691035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa41c159940 0x7fa41c0b0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.944+0000 7fa41a59c700 1 -- 172.21.15.104:0/3414691035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa41c159940 msgr2=0x7fa41c0b0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:44.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.944+0000 7fa41a59c700 1 --2- 172.21.15.104:0/3414691035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa41c159940 0x7fa41c0b0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.944+0000 7fa41a59c700 1 -- 172.21.15.104:0/3414691035 >> v1:172.21.15.117:6789/0 conn(0x7fa41c0b3d20 legacy=0x7fa41c0cf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.944+0000 7fa41a59c700 1 -- 172.21.15.104:0/3414691035 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa41c0b1580 con 0x7fa41c159570 2024-08-17T02:25:44.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.944+0000 7fa41a59c700 1 --2- 172.21.15.104:0/3414691035 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa41c159570 0x7fa41c0b5e60 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa4100099b0 tx=0x7fa410009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fb97459d2277b46 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:44.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.944+0000 7fa41959a700 1 -- 172.21.15.104:0/3414691035 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa410009ea0 con 0x7fa41c159570 2024-08-17T02:25:44.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.944+0000 7fa41959a700 1 -- 172.21.15.104:0/3414691035 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa41000b860 con 0x7fa41c159570 2024-08-17T02:25:44.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.944+0000 7fa41959a700 1 -- 172.21.15.104:0/3414691035 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41000bc00 con 0x7fa41c159570 2024-08-17T02:25:44.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.944+0000 7fa420f70700 1 -- 172.21.15.104:0/3414691035 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa41c159570 msgr2=0x7fa41c0b5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.944+0000 7fa420f70700 1 --2- 172.21.15.104:0/3414691035 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa41c159570 0x7fa41c0b5e60 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa4100099b0 tx=0x7fa410009250 comp rx=0 tx=0).stop 2024-08-17T02:25:44.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.944+0000 7fa420f70700 1 -- 172.21.15.104:0/3414691035 shutdown_connections 2024-08-17T02:25:44.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.944+0000 7fa420f70700 1 --2- 172.21.15.104:0/3414691035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa41c159940 0x7fa41c0b0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.944+0000 7fa420f70700 1 --2- 172.21.15.104:0/3414691035 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa41c159570 0x7fa41c0b5e60 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.944+0000 7fa420f70700 1 -- 172.21.15.104:0/3414691035 >> 172.21.15.104:0/3414691035 conn(0x7fa41c0996f0 msgr2=0x7fa41c067590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:44.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.944+0000 7fa420f70700 1 -- 172.21.15.104:0/3414691035 shutdown_connections 2024-08-17T02:25:44.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.944+0000 7fa420f70700 1 -- 172.21.15.104:0/3414691035 wait complete. 2024-08-17T02:25:44.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.948+0000 7fa420f70700 1 Processor -- start 2024-08-17T02:25:44.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.948+0000 7fa420f70700 1 -- start start 2024-08-17T02:25:44.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.948+0000 7fa420f70700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa41c0b3d20 0x7fa41c1587a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.948+0000 7fa420f70700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa41c159570 0x7fa41c15a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.948+0000 7fa420f70700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa41c159940 0x7fa41c15a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.948+0000 7fa420f70700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c15eca0 con 0x7fa41c159940 2024-08-17T02:25:44.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.948+0000 7fa420f70700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c15bbb0 con 0x7fa41c0b3d20 2024-08-17T02:25:44.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.948+0000 7fa420f70700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c0d0c30 con 0x7fa41c159570 2024-08-17T02:25:44.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.948+0000 7fa41ad9d700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa41c159940 0x7fa41c15a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.948+0000 7fa41a59c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa41c0b3d20 0x7fa41c1587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.948+0000 7fa41ad9d700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa41c159940 0x7fa41c15a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53998/0 (socket says 172.21.15.104:53998) 2024-08-17T02:25:44.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.948+0000 7fa41ad9d700 1 -- 172.21.15.104:0/3683215002 learned_addr learned my addr 172.21.15.104:0/3683215002 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:44.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.948+0000 7fa419d9b700 1 --2- 172.21.15.104:0/3683215002 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa41c159570 0x7fa41c15a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.952+0000 7fa41ad9d700 1 -- 172.21.15.104:0/3683215002 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa41c159570 msgr2=0x7fa41c15a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.952+0000 7fa41ad9d700 1 --2- 172.21.15.104:0/3683215002 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa41c159570 0x7fa41c15a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.952+0000 7fa41ad9d700 1 -- 172.21.15.104:0/3683215002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa41c0b3d20 msgr2=0x7fa41c1587a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.952+0000 7fa41ad9d700 1 --2- 172.21.15.104:0/3683215002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa41c0b3d20 0x7fa41c1587a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.952+0000 7fa41ad9d700 1 -- 172.21.15.104:0/3683215002 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4100094f0 con 0x7fa41c159940 2024-08-17T02:25:44.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.952+0000 7fa41ad9d700 1 --2- 172.21.15.104:0/3683215002 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa41c159940 0x7fa41c15a7b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa41400c4c0 tx=0x7fa414007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:44.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.952+0000 7fa40a7fc700 1 -- 172.21.15.104:0/3683215002 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41400ce30 con 0x7fa41c159940 2024-08-17T02:25:44.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.952+0000 7fa40a7fc700 1 -- 172.21.15.104:0/3683215002 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa414011590 con 0x7fa41c159940 2024-08-17T02:25:44.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.952+0000 7fa420f70700 1 -- 172.21.15.104:0/3683215002 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa41c15ade0 con 0x7fa41c159940 2024-08-17T02:25:44.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.952+0000 7fa40a7fc700 1 -- 172.21.15.104:0/3683215002 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa414011950 con 0x7fa41c159940 2024-08-17T02:25:44.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.952+0000 7fa420f70700 1 -- 172.21.15.104:0/3683215002 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa41c15b840 con 0x7fa41c159940 2024-08-17T02:25:44.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.952+0000 7fa420f70700 1 -- 172.21.15.104:0/3683215002 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa41c15bd20 con 0x7fa41c159940 2024-08-17T02:25:44.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.952+0000 7fa40a7fc700 1 -- 172.21.15.104:0/3683215002 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa414011d00 con 0x7fa41c159940 2024-08-17T02:25:44.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.952+0000 7fa40a7fc700 1 --2- 172.21.15.104:0/3683215002 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fa3fc060860 0x7fa3fc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.952+0000 7fa40a7fc700 1 -- 172.21.15.104:0/3683215002 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fa41407bb80 con 0x7fa41c159940 2024-08-17T02:25:44.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.956+0000 7fa41a59c700 1 --2- 172.21.15.104:0/3683215002 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fa3fc060860 0x7fa3fc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.956+0000 7fa41a59c700 1 --2- 172.21.15.104:0/3683215002 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fa3fc060860 0x7fa3fc062d10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa4100099b0 tx=0x7fa410017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:44.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:44.960+0000 7fa40a7fc700 1 -- 172.21.15.104:0/3683215002 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa41404c270 con 0x7fa41c159940 2024-08-17T02:25:45.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.128+0000 7fa420f70700 1 -- 172.21.15.104:0/3683215002 --> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fa41c0645c0 con 0x7fa3fc060860 2024-08-17T02:25:45.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.128+0000 7fa40a7fc700 1 -- 172.21.15.104:0/3683215002 <== mgr.4111 v2:172.21.15.117:6832/24084 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa41c0645c0 con 0x7fa3fc060860 2024-08-17T02:25:45.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.132+0000 7fa420f70700 1 -- 172.21.15.104:0/3683215002 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fa3fc060860 msgr2=0x7fa3fc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.132+0000 7fa420f70700 1 --2- 172.21.15.104:0/3683215002 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fa3fc060860 0x7fa3fc062d10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa4100099b0 tx=0x7fa410017000 comp rx=0 tx=0).stop 2024-08-17T02:25:45.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.132+0000 7fa420f70700 1 -- 172.21.15.104:0/3683215002 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa41c159940 msgr2=0x7fa41c15a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.132+0000 7fa420f70700 1 --2- 172.21.15.104:0/3683215002 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa41c159940 0x7fa41c15a7b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa41400c4c0 tx=0x7fa414007f00 comp rx=0 tx=0).stop 2024-08-17T02:25:45.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.132+0000 7fa420f70700 1 -- 172.21.15.104:0/3683215002 shutdown_connections 2024-08-17T02:25:45.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.132+0000 7fa420f70700 1 --2- 172.21.15.104:0/3683215002 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fa3fc060860 0x7fa3fc062d10 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.132+0000 7fa420f70700 1 --2- 172.21.15.104:0/3683215002 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa41c159940 0x7fa41c15a7b0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.132+0000 7fa420f70700 1 --2- 172.21.15.104:0/3683215002 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa41c159570 0x7fa41c15a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.132+0000 7fa420f70700 1 --2- 172.21.15.104:0/3683215002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa41c0b3d20 0x7fa41c1587a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.132+0000 7fa420f70700 1 -- 172.21.15.104:0/3683215002 >> 172.21.15.104:0/3683215002 conn(0x7fa41c0996f0 msgr2=0x7fa41c0afd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:45.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.132+0000 7fa420f70700 1 -- 172.21.15.104:0/3683215002 shutdown_connections 2024-08-17T02:25:45.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.132+0000 7fa420f70700 1 -- 172.21.15.104:0/3683215002 wait complete. 2024-08-17T02:25:45.138 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 5 to deep-scrub 2024-08-17T02:25:45.150 INFO:tasks.ceph:Scrubbing osd.6 2024-08-17T02:25:45.150 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:25:45.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.256+0000 7efdf3fff700 1 Processor -- start 2024-08-17T02:25:45.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.256+0000 7efdf3fff700 1 -- start start 2024-08-17T02:25:45.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.256+0000 7efdf3fff700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7efdf406d120 0x7efdf40ad940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.256+0000 7efdf3fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdf40ade80 0x7efdf40ca540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.256+0000 7efdf3fff700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdf40ca0b0 con 0x7efdf4157050 2024-08-17T02:25:45.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.256+0000 7efdf3fff700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdf40ae300 con 0x7efdf406d120 2024-08-17T02:25:45.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.256+0000 7efdf3fff700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf406d5a0 con 0x7efdf40ade80 2024-08-17T02:25:45.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.256+0000 7efdf2ffd700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7efdf4157050 0x7efdf40ac0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:43626/0 (socket says 172.21.15.104:43626) 2024-08-17T02:25:45.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.256+0000 7efdf2ffd700 1 -- 172.21.15.104:0/2747329852 learned_addr learned my addr 172.21.15.104:0/2747329852 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:25:45.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.256+0000 7efdf37fe700 1 --2- 172.21.15.104:0/2747329852 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdf40ade80 0x7efdf40ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.256+0000 7efdf27fc700 1 --2- 172.21.15.104:0/2747329852 >> v2:172.21.15.117:3300/0 conn(0x7efdf406d120 0x7efdf40ad940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.256+0000 7efdf1ffb700 1 -- 172.21.15.104:0/2747329852 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3120627557 0 0) 0x7efdf40ca0b0 con 0x7efdf4157050 2024-08-17T02:25:45.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.260+0000 7efdf1ffb700 1 -- 172.21.15.104:0/2747329852 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdd4003570 con 0x7efdf4157050 2024-08-17T02:25:45.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.260+0000 7efdf27fc700 1 -- 172.21.15.104:0/2747329852 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdf40ade80 msgr2=0x7efdf40ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:45.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.260+0000 7efdf27fc700 1 --2- 172.21.15.104:0/2747329852 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdf40ade80 0x7efdf40ca540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.260+0000 7efdf27fc700 1 -- 172.21.15.104:0/2747329852 >> v1:172.21.15.104:6789/0 conn(0x7efdf4157050 legacy=0x7efdf40ac0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.260+0000 7efdf27fc700 1 -- 172.21.15.104:0/2747329852 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf40c97c0 con 0x7efdf406d120 2024-08-17T02:25:45.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.260+0000 7efdf27fc700 1 --2- 172.21.15.104:0/2747329852 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdf406d120 0x7efdf40ad940 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7efddc0098e0 tx=0x7efddc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfcb7da992232311 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:45.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.260+0000 7efdf1ffb700 1 -- 172.21.15.104:0/2747329852 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efddc011630 con 0x7efdf406d120 2024-08-17T02:25:45.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.260+0000 7efdf1ffb700 1 -- 172.21.15.104:0/2747329852 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efddc011790 con 0x7efdf406d120 2024-08-17T02:25:45.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.260+0000 7efdf1ffb700 1 -- 172.21.15.104:0/2747329852 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efddc011b30 con 0x7efdf406d120 2024-08-17T02:25:45.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.260+0000 7efdf3fff700 1 -- 172.21.15.104:0/2747329852 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdf406d120 msgr2=0x7efdf40ad940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.260+0000 7efdf3fff700 1 --2- 172.21.15.104:0/2747329852 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdf406d120 0x7efdf40ad940 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7efddc0098e0 tx=0x7efddc0091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.260+0000 7efdf3fff700 1 -- 172.21.15.104:0/2747329852 shutdown_connections 2024-08-17T02:25:45.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.260+0000 7efdf3fff700 1 --2- 172.21.15.104:0/2747329852 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdf40ade80 0x7efdf40ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.260+0000 7efdf3fff700 1 --2- 172.21.15.104:0/2747329852 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdf406d120 0x7efdf40ad940 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.260+0000 7efdf3fff700 1 -- 172.21.15.104:0/2747329852 >> 172.21.15.104:0/2747329852 conn(0x7efdf4066e00 msgr2=0x7efdf4067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:45.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.260+0000 7efdf3fff700 1 -- 172.21.15.104:0/2747329852 shutdown_connections 2024-08-17T02:25:45.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.260+0000 7efdf3fff700 1 -- 172.21.15.104:0/2747329852 wait complete. 2024-08-17T02:25:45.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.260+0000 7efdf3fff700 1 Processor -- start 2024-08-17T02:25:45.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.260+0000 7efdf3fff700 1 -- start start 2024-08-17T02:25:45.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.264+0000 7efdf3fff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efdf406d120 0x7efdf40ab900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.264+0000 7efdf3fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdf40ade80 0x7efdf4157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.264+0000 7efdf3fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdf4157050 0x7efdf4155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.264+0000 7efdf3fff700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf40a5bb0 con 0x7efdf406d120 2024-08-17T02:25:45.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.264+0000 7efdf3fff700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf40a55f0 con 0x7efdf4157050 2024-08-17T02:25:45.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.264+0000 7efdf3fff700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf40a58d0 con 0x7efdf40ade80 2024-08-17T02:25:45.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.264+0000 7efdf2ffd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efdf406d120 0x7efdf40ab900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.264+0000 7efdf2ffd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efdf406d120 0x7efdf40ab900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54006/0 (socket says 172.21.15.104:54006) 2024-08-17T02:25:45.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.264+0000 7efdf2ffd700 1 -- 172.21.15.104:0/3093320767 learned_addr learned my addr 172.21.15.104:0/3093320767 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:45.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.264+0000 7efdf27fc700 1 --2- 172.21.15.104:0/3093320767 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdf40ade80 0x7efdf4157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.264+0000 7efdf37fe700 1 --2- 172.21.15.104:0/3093320767 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdf4157050 0x7efdf4155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.264+0000 7efdf2ffd700 1 -- 172.21.15.104:0/3093320767 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdf40ade80 msgr2=0x7efdf4157de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.264+0000 7efdf2ffd700 1 --2- 172.21.15.104:0/3093320767 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdf40ade80 0x7efdf4157de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.264+0000 7efdf2ffd700 1 -- 172.21.15.104:0/3093320767 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdf4157050 msgr2=0x7efdf4155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.264+0000 7efdf2ffd700 1 --2- 172.21.15.104:0/3093320767 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdf4157050 0x7efdf4155800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.264+0000 7efdf2ffd700 1 -- 172.21.15.104:0/3093320767 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efddc009420 con 0x7efdf406d120 2024-08-17T02:25:45.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.264+0000 7efdf2ffd700 1 --2- 172.21.15.104:0/3093320767 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efdf406d120 0x7efdf40ab900 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7efde400c590 tx=0x7efde4007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:45.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.264+0000 7efdeaffd700 1 -- 172.21.15.104:0/3093320767 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde4005b30 con 0x7efdf406d120 2024-08-17T02:25:45.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.264+0000 7efdeaffd700 1 -- 172.21.15.104:0/3093320767 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde4005cb0 con 0x7efdf406d120 2024-08-17T02:25:45.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.264+0000 7efdf3fff700 1 -- 172.21.15.104:0/3093320767 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdf4159b10 con 0x7efdf406d120 2024-08-17T02:25:45.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.264+0000 7efdeaffd700 1 -- 172.21.15.104:0/3093320767 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde4007320 con 0x7efdf406d120 2024-08-17T02:25:45.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.264+0000 7efdf3fff700 1 -- 172.21.15.104:0/3093320767 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdf40abe40 con 0x7efdf406d120 2024-08-17T02:25:45.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.268+0000 7efdf3fff700 1 -- 172.21.15.104:0/3093320767 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efdf40644b0 con 0x7efdf406d120 2024-08-17T02:25:45.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.268+0000 7efdeaffd700 1 -- 172.21.15.104:0/3093320767 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7efde401b3b0 con 0x7efdf406d120 2024-08-17T02:25:45.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.268+0000 7efdeaffd700 1 --2- 172.21.15.104:0/3093320767 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7efdd8060860 0x7efdd8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.268+0000 7efdeaffd700 1 -- 172.21.15.104:0/3093320767 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5025+0+0 (secure 0 0 0) 0x7efde407bd70 con 0x7efdf406d120 2024-08-17T02:25:45.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.268+0000 7efdf27fc700 1 --2- 172.21.15.104:0/3093320767 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7efdd8060860 0x7efdd8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.268+0000 7efdeaffd700 1 --2- 172.21.15.104:0/3093320767 >> [v2:172.21.15.117:6800/24420,v1:172.21.15.117:6801/24420] conn(0x7efdd8066750 0x7efdd8068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.268+0000 7efdeaffd700 1 -- 172.21.15.104:0/3093320767 --> [v2:172.21.15.117:6800/24420,v1:172.21.15.117:6801/24420] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efdd8069210 con 0x7efdd8066750 2024-08-17T02:25:45.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.268+0000 7efdeaffd700 1 -- 172.21.15.104:0/3093320767 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7efde407e320 con 0x7efdf406d120 2024-08-17T02:25:45.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.268+0000 7efdf37fe700 1 --2- 172.21.15.104:0/3093320767 >> [v2:172.21.15.117:6800/24420,v1:172.21.15.117:6801/24420] conn(0x7efdd8066750 0x7efdd8068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.272+0000 7efdf37fe700 1 --2- 172.21.15.104:0/3093320767 >> [v2:172.21.15.117:6800/24420,v1:172.21.15.117:6801/24420] conn(0x7efdd8066750 0x7efdd8068b60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:45.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.272+0000 7efdf27fc700 1 --2- 172.21.15.104:0/3093320767 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7efdd8060860 0x7efdd8062d10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7efddc0091e0 tx=0x7efddc017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:45.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.272+0000 7efdeaffd700 1 -- 172.21.15.104:0/3093320767 <== osd.6 v2:172.21.15.117:6800/24420 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7efdd8069210 con 0x7efdd8066750 2024-08-17T02:25:45.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.288+0000 7efdf3fff700 1 -- 172.21.15.104:0/3093320767 --> [v2:172.21.15.117:6800/24420,v1:172.21.15.117:6801/24420] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7efdf406b140 con 0x7efdd8066750 2024-08-17T02:25:45.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.292+0000 7efdeaffd700 1 -- 172.21.15.104:0/3093320767 <== osd.6 v2:172.21.15.117:6800/24420 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7efdf406b140 con 0x7efdd8066750 2024-08-17T02:25:45.296 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-08-17T02:25:45.296 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:25:45.296 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-08-17T02:25:45.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.292+0000 7efdf3fff700 1 -- 172.21.15.104:0/3093320767 >> [v2:172.21.15.117:6800/24420,v1:172.21.15.117:6801/24420] conn(0x7efdd8066750 msgr2=0x7efdd8068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.292+0000 7efdf3fff700 1 --2- 172.21.15.104:0/3093320767 >> [v2:172.21.15.117:6800/24420,v1:172.21.15.117:6801/24420] conn(0x7efdd8066750 0x7efdd8068b60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.292+0000 7efdf3fff700 1 -- 172.21.15.104:0/3093320767 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7efdd8060860 msgr2=0x7efdd8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.292+0000 7efdf3fff700 1 --2- 172.21.15.104:0/3093320767 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7efdd8060860 0x7efdd8062d10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7efddc0091e0 tx=0x7efddc017000 comp rx=0 tx=0).stop 2024-08-17T02:25:45.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.292+0000 7efdf3fff700 1 -- 172.21.15.104:0/3093320767 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efdf406d120 msgr2=0x7efdf40ab900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.292+0000 7efdf3fff700 1 --2- 172.21.15.104:0/3093320767 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efdf406d120 0x7efdf40ab900 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7efde400c590 tx=0x7efde4007e00 comp rx=0 tx=0).stop 2024-08-17T02:25:45.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.292+0000 7efdf37fe700 1 -- 172.21.15.104:0/3093320767 reap_dead start 2024-08-17T02:25:45.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.292+0000 7efdf3fff700 1 -- 172.21.15.104:0/3093320767 shutdown_connections 2024-08-17T02:25:45.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.292+0000 7efdf3fff700 1 -- 172.21.15.104:0/3093320767 >> 172.21.15.104:0/3093320767 conn(0x7efdf4066e00 msgr2=0x7efdf406aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:45.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.292+0000 7efdf3fff700 1 -- 172.21.15.104:0/3093320767 shutdown_connections 2024-08-17T02:25:45.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.292+0000 7efdf3fff700 1 -- 172.21.15.104:0/3093320767 wait complete. 2024-08-17T02:25:45.308 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-08-17T02:25:45.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.416+0000 7fc831945700 1 Processor -- start 2024-08-17T02:25:45.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.416+0000 7fc831945700 1 -- start start 2024-08-17T02:25:45.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.416+0000 7fc831945700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc82c155d20 0x7fc82c0b0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.416+0000 7fc831945700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc82c06df10 0x7fc82c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.416+0000 7fc831945700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc82c06e8b0 con 0x7fc82c0ad7c0 2024-08-17T02:25:45.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.416+0000 7fc831945700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc82c0adc10 con 0x7fc82c155d20 2024-08-17T02:25:45.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.416+0000 7fc831945700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c0af2b0 con 0x7fc82c06df10 2024-08-17T02:25:45.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.416+0000 7fc82bfff700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fc82c0ad7c0 0x7fc82c0aea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:43634/0 (socket says 172.21.15.104:43634) 2024-08-17T02:25:45.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.416+0000 7fc82bfff700 1 -- 172.21.15.104:0/1168317502 learned_addr learned my addr 172.21.15.104:0/1168317502 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:25:45.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.416+0000 7fc830943700 1 --2- 172.21.15.104:0/1168317502 >> v2:172.21.15.117:3300/0 conn(0x7fc82c155d20 0x7fc82c0b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.416+0000 7fc831144700 1 --2- 172.21.15.104:0/1168317502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc82c06df10 0x7fc82c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.416+0000 7fc82b7fe700 1 -- 172.21.15.104:0/1168317502 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2770192526 0 0) 0x7fc81c001110 con 0x7fc82c0ad7c0 2024-08-17T02:25:45.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.416+0000 7fc82b7fe700 1 -- 172.21.15.104:0/1168317502 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc814003570 con 0x7fc82c0ad7c0 2024-08-17T02:25:45.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.416+0000 7fc82b7fe700 1 -- 172.21.15.104:0/1168317502 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2033708947 0 0) 0x7fc814003570 con 0x7fc82c0ad7c0 2024-08-17T02:25:45.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.416+0000 7fc82b7fe700 1 -- 172.21.15.104:0/1168317502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc82c06df10 msgr2=0x7fc82c06e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:45.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.416+0000 7fc82b7fe700 1 --2- 172.21.15.104:0/1168317502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc82c06df10 0x7fc82c06e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.416+0000 7fc82b7fe700 1 -- 172.21.15.104:0/1168317502 >> v2:172.21.15.117:3300/0 conn(0x7fc82c155d20 msgr2=0x7fc82c0b0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:45.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.416+0000 7fc82b7fe700 1 --2- 172.21.15.104:0/1168317502 >> v2:172.21.15.117:3300/0 conn(0x7fc82c155d20 0x7fc82c0b0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.416+0000 7fc82b7fe700 1 -- 172.21.15.104:0/1168317502 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc82c0af590 con 0x7fc82c0ad7c0 2024-08-17T02:25:45.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.416+0000 7fc82b7fe700 1 -- 172.21.15.104:0/1168317502 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1279957748 0 0) 0x7fc81c001600 con 0x7fc82c0ad7c0 2024-08-17T02:25:45.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.420+0000 7fc82b7fe700 1 -- 172.21.15.104:0/1168317502 >> v1:172.21.15.104:6789/0 conn(0x7fc82c0ad7c0 legacy=0x7fc82c0aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.420+0000 7fc82b7fe700 1 --2- 172.21.15.104:0/1168317502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc814003a60 0x7fc814003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.420+0000 7fc82b7fe700 1 --2- 172.21.15.104:0/1168317502 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc814004810 0x7fc814004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.420+0000 7fc82b7fe700 1 --2- 172.21.15.104:0/1168317502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc82c06df10 0x7fc8140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.420+0000 7fc82b7fe700 1 -- 172.21.15.104:0/1168317502 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c0adc10 con 0x7fc814004810 2024-08-17T02:25:45.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.420+0000 7fc82b7fe700 1 -- 172.21.15.104:0/1168317502 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c0af2b0 con 0x7fc814003a60 2024-08-17T02:25:45.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.420+0000 7fc82b7fe700 1 -- 172.21.15.104:0/1168317502 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc81400ba60 con 0x7fc82c06df10 2024-08-17T02:25:45.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.420+0000 7fc82bfff700 1 --2- 172.21.15.104:0/1168317502 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc814004810 0x7fc814004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.420+0000 7fc831144700 1 --2- 172.21.15.104:0/1168317502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc82c06df10 0x7fc8140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.420+0000 7fc830943700 1 --2- 172.21.15.104:0/1168317502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc814003a60 0x7fc814003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.420+0000 7fc82bfff700 1 -- 172.21.15.104:0/1168317502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc82c06df10 msgr2=0x7fc8140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:45.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.420+0000 7fc82bfff700 1 --2- 172.21.15.104:0/1168317502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc82c06df10 0x7fc8140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.420+0000 7fc82bfff700 1 -- 172.21.15.104:0/1168317502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc814003a60 msgr2=0x7fc814003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:45.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.420+0000 7fc82bfff700 1 --2- 172.21.15.104:0/1168317502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc814003a60 0x7fc814003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.420+0000 7fc82bfff700 1 -- 172.21.15.104:0/1168317502 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc814003570 con 0x7fc814004810 2024-08-17T02:25:45.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.420+0000 7fc831144700 1 --2- 172.21.15.104:0/1168317502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc82c06df10 0x7fc8140051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:45.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.420+0000 7fc82bfff700 1 --2- 172.21.15.104:0/1168317502 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc814004810 0x7fc814004c80 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc81c00c620 tx=0x7fc81c007a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7865f224f89f782 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:45.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.420+0000 7fc82b7fe700 1 -- 172.21.15.104:0/1168317502 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c00cde0 con 0x7fc814004810 2024-08-17T02:25:45.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.420+0000 7fc82b7fe700 1 -- 172.21.15.104:0/1168317502 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81c005920 con 0x7fc814004810 2024-08-17T02:25:45.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.420+0000 7fc82b7fe700 1 -- 172.21.15.104:0/1168317502 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c005ce0 con 0x7fc814004810 2024-08-17T02:25:45.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.420+0000 7fc831945700 1 -- 172.21.15.104:0/1168317502 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc814004810 msgr2=0x7fc814004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.420+0000 7fc831945700 1 --2- 172.21.15.104:0/1168317502 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc814004810 0x7fc814004c80 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc81c00c620 tx=0x7fc81c007a80 comp rx=0 tx=0).stop 2024-08-17T02:25:45.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.420+0000 7fc831144700 1 -- 172.21.15.104:0/1168317502 reap_dead start 2024-08-17T02:25:45.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.420+0000 7fc831945700 1 -- 172.21.15.104:0/1168317502 shutdown_connections 2024-08-17T02:25:45.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.420+0000 7fc831945700 1 -- 172.21.15.104:0/1168317502 >> 172.21.15.104:0/1168317502 conn(0x7fc82c0678d0 msgr2=0x7fc82c067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:45.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.420+0000 7fc831945700 1 -- 172.21.15.104:0/1168317502 shutdown_connections 2024-08-17T02:25:45.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.420+0000 7fc831945700 1 -- 172.21.15.104:0/1168317502 wait complete. 2024-08-17T02:25:45.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.420+0000 7fc831945700 1 Processor -- start 2024-08-17T02:25:45.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.420+0000 7fc831945700 1 -- start start 2024-08-17T02:25:45.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.424+0000 7fc831945700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc814004810 0x7fc82c144c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.424+0000 7fc831945700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc82c14b470 0x7fc82c1675a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.424+0000 7fc831945700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc82c167ae0 0x7fc82c167f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.424+0000 7fc831945700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c156200 con 0x7fc82c14b470 2024-08-17T02:25:45.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.424+0000 7fc831945700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c14a5a0 con 0x7fc814004810 2024-08-17T02:25:45.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.424+0000 7fc831945700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c14b900 con 0x7fc82c167ae0 2024-08-17T02:25:45.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.424+0000 7fc82bfff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc82c14b470 0x7fc82c1675a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.424+0000 7fc82bfff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc82c14b470 0x7fc82c1675a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54036/0 (socket says 172.21.15.104:54036) 2024-08-17T02:25:45.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.424+0000 7fc82bfff700 1 -- 172.21.15.104:0/29196623 learned_addr learned my addr 172.21.15.104:0/29196623 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:45.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.424+0000 7fc831144700 1 --2- 172.21.15.104:0/29196623 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc82c167ae0 0x7fc82c167f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.424+0000 7fc830943700 1 --2- 172.21.15.104:0/29196623 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc814004810 0x7fc82c144c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.424+0000 7fc82bfff700 1 -- 172.21.15.104:0/29196623 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc82c167ae0 msgr2=0x7fc82c167f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.424+0000 7fc82bfff700 1 --2- 172.21.15.104:0/29196623 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc82c167ae0 0x7fc82c167f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.424+0000 7fc82bfff700 1 -- 172.21.15.104:0/29196623 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc814004810 msgr2=0x7fc82c144c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.424+0000 7fc82bfff700 1 --2- 172.21.15.104:0/29196623 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc814004810 0x7fc82c144c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.424+0000 7fc82bfff700 1 -- 172.21.15.104:0/29196623 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc82c149c70 con 0x7fc82c14b470 2024-08-17T02:25:45.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.424+0000 7fc830943700 1 --2- 172.21.15.104:0/29196623 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc814004810 0x7fc82c144c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:45.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.424+0000 7fc831144700 1 --2- 172.21.15.104:0/29196623 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc82c167ae0 0x7fc82c167f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:45.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.424+0000 7fc82bfff700 1 --2- 172.21.15.104:0/29196623 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc82c14b470 0x7fc82c1675a0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fc81c011000 tx=0x7fc81c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:45.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.424+0000 7fc828ff9700 1 -- 172.21.15.104:0/29196623 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c0074f0 con 0x7fc82c14b470 2024-08-17T02:25:45.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.424+0000 7fc828ff9700 1 -- 172.21.15.104:0/29196623 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81c007650 con 0x7fc82c14b470 2024-08-17T02:25:45.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.424+0000 7fc831945700 1 -- 172.21.15.104:0/29196623 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc82c149f50 con 0x7fc82c14b470 2024-08-17T02:25:45.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.424+0000 7fc828ff9700 1 -- 172.21.15.104:0/29196623 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c004a80 con 0x7fc82c14b470 2024-08-17T02:25:45.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.424+0000 7fc831945700 1 -- 172.21.15.104:0/29196623 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc82c145140 con 0x7fc82c14b470 2024-08-17T02:25:45.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.424+0000 7fc831945700 1 -- 172.21.15.104:0/29196623 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc82c14a730 con 0x7fc82c14b470 2024-08-17T02:25:45.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.424+0000 7fc828ff9700 1 -- 172.21.15.104:0/29196623 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fc81c019070 con 0x7fc82c14b470 2024-08-17T02:25:45.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.428+0000 7fc828ff9700 1 --2- 172.21.15.104:0/29196623 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fc818060890 0x7fc818062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.428+0000 7fc828ff9700 1 -- 172.21.15.104:0/29196623 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fc81c07d670 con 0x7fc82c14b470 2024-08-17T02:25:45.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.428+0000 7fc830943700 1 --2- 172.21.15.104:0/29196623 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fc818060890 0x7fc818062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.428+0000 7fc830943700 1 --2- 172.21.15.104:0/29196623 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fc818060890 0x7fc818062d40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc820009de0 tx=0x7fc820008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:45.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.432+0000 7fc828ff9700 1 -- 172.21.15.104:0/29196623 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fc81c04dd60 con 0x7fc82c14b470 2024-08-17T02:25:45.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.592+0000 7fc831945700 1 -- 172.21.15.104:0/29196623 --> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fc82c06e8b0 con 0x7fc818060890 2024-08-17T02:25:45.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.592+0000 7fc828ff9700 1 -- 172.21.15.104:0/29196623 <== mgr.4111 v2:172.21.15.117:6832/24084 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc82c06e8b0 con 0x7fc818060890 2024-08-17T02:25:45.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.592+0000 7fc831945700 1 -- 172.21.15.104:0/29196623 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fc818060890 msgr2=0x7fc818062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.592+0000 7fc831945700 1 --2- 172.21.15.104:0/29196623 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fc818060890 0x7fc818062d40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc820009de0 tx=0x7fc820008040 comp rx=0 tx=0).stop 2024-08-17T02:25:45.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.592+0000 7fc831945700 1 -- 172.21.15.104:0/29196623 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc82c14b470 msgr2=0x7fc82c1675a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.592+0000 7fc831945700 1 --2- 172.21.15.104:0/29196623 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc82c14b470 0x7fc82c1675a0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fc81c011000 tx=0x7fc81c015000 comp rx=0 tx=0).stop 2024-08-17T02:25:45.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.592+0000 7fc831945700 1 -- 172.21.15.104:0/29196623 shutdown_connections 2024-08-17T02:25:45.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.592+0000 7fc831945700 1 --2- 172.21.15.104:0/29196623 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fc818060890 0x7fc818062d40 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.592+0000 7fc831945700 1 --2- 172.21.15.104:0/29196623 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc82c167ae0 0x7fc82c167f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.592+0000 7fc831945700 1 --2- 172.21.15.104:0/29196623 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc82c14b470 0x7fc82c1675a0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.592+0000 7fc831945700 1 --2- 172.21.15.104:0/29196623 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc814004810 0x7fc82c144c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.592+0000 7fc831945700 1 -- 172.21.15.104:0/29196623 >> 172.21.15.104:0/29196623 conn(0x7fc82c0678d0 msgr2=0x7fc82c063060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:45.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.592+0000 7fc831945700 1 -- 172.21.15.104:0/29196623 shutdown_connections 2024-08-17T02:25:45.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.592+0000 7fc831945700 1 -- 172.21.15.104:0/29196623 wait complete. 2024-08-17T02:25:45.600 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 6 to deep-scrub 2024-08-17T02:25:45.609 INFO:tasks.ceph:Scrubbing osd.7 2024-08-17T02:25:45.609 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:25:45.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.708+0000 7fbd47fff700 1 Processor -- start 2024-08-17T02:25:45.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.708+0000 7fbd47fff700 1 -- start start 2024-08-17T02:25:45.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.712+0000 7fbd47fff700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbd481591a0 0x7fbd48068320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.712+0000 7fbd47fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd48159570 0x7fbd480b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.712+0000 7fbd47fff700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fbd480699f0 0x7fbd48069df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.712+0000 7fbd47fff700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd480b2a20 con 0x7fbd480699f0 2024-08-17T02:25:45.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.712+0000 7fbd47fff700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd48069560 con 0x7fbd481591a0 2024-08-17T02:25:45.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.712+0000 7fbd47fff700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd48068950 con 0x7fbd48159570 2024-08-17T02:25:45.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.712+0000 7fbd477fe700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fbd480699f0 0x7fbd48069df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.712+0000 7fbd467fc700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd48159570 0x7fbd480b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.712+0000 7fbd46ffd700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbd481591a0 0x7fbd48068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.712+0000 7fbd477fe700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fbd480699f0 0x7fbd48069df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54046/0 (socket says 172.21.15.104:54046) 2024-08-17T02:25:45.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.712+0000 7fbd477fe700 1 -- 172.21.15.104:0/2325643503 learned_addr learned my addr 172.21.15.104:0/2325643503 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:45.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.712+0000 7fbd477fe700 1 -- 172.21.15.104:0/2325643503 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd48159570 msgr2=0x7fbd480b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:45.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.712+0000 7fbd477fe700 1 --2- 172.21.15.104:0/2325643503 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd48159570 0x7fbd480b24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.712+0000 7fbd477fe700 1 -- 172.21.15.104:0/2325643503 >> v2:172.21.15.117:3300/0 conn(0x7fbd481591a0 msgr2=0x7fbd48068320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:45.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.712+0000 7fbd477fe700 1 --2- 172.21.15.104:0/2325643503 >> v2:172.21.15.117:3300/0 conn(0x7fbd481591a0 0x7fbd48068320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.712+0000 7fbd477fe700 1 -- 172.21.15.104:0/2325643503 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd48068c30 con 0x7fbd480699f0 2024-08-17T02:25:45.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.712+0000 7fbd46ffd700 1 --2- 172.21.15.104:0/2325643503 >> v2:172.21.15.117:3300/0 conn(0x7fbd481591a0 0x7fbd48068320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:45.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.712+0000 7fbd477fe700 1 --2- 172.21.15.104:0/2325643503 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd480699f0 0x7fbd48069df0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fbd4809df70 tx=0x7fbd40009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cde3f4b92a49c6c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:45.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.712+0000 7fbd45ffb700 1 -- 172.21.15.104:0/2325643503 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4000e070 con 0x7fbd480699f0 2024-08-17T02:25:45.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.712+0000 7fbd45ffb700 1 -- 172.21.15.104:0/2325643503 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4000b970 con 0x7fbd480699f0 2024-08-17T02:25:45.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.712+0000 7fbd45ffb700 1 -- 172.21.15.104:0/2325643503 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd400092e0 con 0x7fbd480699f0 2024-08-17T02:25:45.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.712+0000 7fbd47fff700 1 -- 172.21.15.104:0/2325643503 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd480699f0 msgr2=0x7fbd48069df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.712+0000 7fbd47fff700 1 --2- 172.21.15.104:0/2325643503 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd480699f0 0x7fbd48069df0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fbd4809df70 tx=0x7fbd40009840 comp rx=0 tx=0).stop 2024-08-17T02:25:45.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.716+0000 7fbd47fff700 1 -- 172.21.15.104:0/2325643503 shutdown_connections 2024-08-17T02:25:45.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.716+0000 7fbd47fff700 1 --2- 172.21.15.104:0/2325643503 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd480699f0 0x7fbd48069df0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.716+0000 7fbd47fff700 1 --2- 172.21.15.104:0/2325643503 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd48159570 0x7fbd480b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.716+0000 7fbd47fff700 1 --2- 172.21.15.104:0/2325643503 >> v2:172.21.15.117:3300/0 conn(0x7fbd481591a0 0x7fbd48068320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.716+0000 7fbd47fff700 1 -- 172.21.15.104:0/2325643503 >> 172.21.15.104:0/2325643503 conn(0x7fbd48099430 msgr2=0x7fbd48067590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:45.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.716+0000 7fbd47fff700 1 -- 172.21.15.104:0/2325643503 shutdown_connections 2024-08-17T02:25:45.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.716+0000 7fbd47fff700 1 -- 172.21.15.104:0/2325643503 wait complete. 2024-08-17T02:25:45.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.716+0000 7fbd47fff700 1 Processor -- start 2024-08-17T02:25:45.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.716+0000 7fbd47fff700 1 -- start start 2024-08-17T02:25:45.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.716+0000 7fbd47fff700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd480699f0 0x7fbd480aa7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.716+0000 7fbd47fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd481591a0 0x7fbd48157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.716+0000 7fbd47fff700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd48159570 0x7fbd480ae270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.716+0000 7fbd47fff700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd480ab9c0 con 0x7fbd480699f0 2024-08-17T02:25:45.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.716+0000 7fbd47fff700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd480ac350 con 0x7fbd481591a0 2024-08-17T02:25:45.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.716+0000 7fbd47fff700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd48158710 con 0x7fbd48159570 2024-08-17T02:25:45.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.720+0000 7fbd46ffd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd480699f0 0x7fbd480aa7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.720+0000 7fbd46ffd700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd480699f0 0x7fbd480aa7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54052/0 (socket says 172.21.15.104:54052) 2024-08-17T02:25:45.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.720+0000 7fbd46ffd700 1 -- 172.21.15.104:0/2422973080 learned_addr learned my addr 172.21.15.104:0/2422973080 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:45.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.720+0000 7fbd467fc700 1 --2- 172.21.15.104:0/2422973080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd481591a0 0x7fbd48157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.720+0000 7fbd477fe700 1 --2- 172.21.15.104:0/2422973080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd48159570 0x7fbd480ae270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.720+0000 7fbd46ffd700 1 -- 172.21.15.104:0/2422973080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd48159570 msgr2=0x7fbd480ae270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.720+0000 7fbd46ffd700 1 --2- 172.21.15.104:0/2422973080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd48159570 0x7fbd480ae270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.720+0000 7fbd46ffd700 1 -- 172.21.15.104:0/2422973080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd481591a0 msgr2=0x7fbd48157690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.720+0000 7fbd46ffd700 1 --2- 172.21.15.104:0/2422973080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd481591a0 0x7fbd48157690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.720+0000 7fbd46ffd700 1 -- 172.21.15.104:0/2422973080 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd38009420 con 0x7fbd480699f0 2024-08-17T02:25:45.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.720+0000 7fbd467fc700 1 --2- 172.21.15.104:0/2422973080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd481591a0 0x7fbd48157690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:45.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.720+0000 7fbd46ffd700 1 --2- 172.21.15.104:0/2422973080 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd480699f0 0x7fbd480aa7c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fbd3800ec80 tx=0x7fbd380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:45.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.720+0000 7fbd3effd700 1 -- 172.21.15.104:0/2422973080 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3800c9d0 con 0x7fbd480699f0 2024-08-17T02:25:45.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.720+0000 7fbd3effd700 1 -- 172.21.15.104:0/2422973080 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3800cb30 con 0x7fbd480699f0 2024-08-17T02:25:45.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.720+0000 7fbd47fff700 1 -- 172.21.15.104:0/2422973080 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd40009ae0 con 0x7fbd480699f0 2024-08-17T02:25:45.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.720+0000 7fbd3effd700 1 -- 172.21.15.104:0/2422973080 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3800ceb0 con 0x7fbd480699f0 2024-08-17T02:25:45.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.720+0000 7fbd47fff700 1 -- 172.21.15.104:0/2422973080 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd480ac5f0 con 0x7fbd480699f0 2024-08-17T02:25:45.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.720+0000 7fbd47fff700 1 -- 172.21.15.104:0/2422973080 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbd480644b0 con 0x7fbd480699f0 2024-08-17T02:25:45.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.724+0000 7fbd3effd700 1 -- 172.21.15.104:0/2422973080 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fbd38013680 con 0x7fbd480699f0 2024-08-17T02:25:45.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.724+0000 7fbd3effd700 1 --2- 172.21.15.104:0/2422973080 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fbd30060860 0x7fbd30062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.724+0000 7fbd3effd700 1 -- 172.21.15.104:0/2422973080 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fbd3807cd30 con 0x7fbd480699f0 2024-08-17T02:25:45.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.724+0000 7fbd3effd700 1 --2- 172.21.15.104:0/2422973080 >> [v2:172.21.15.117:6824/24423,v1:172.21.15.117:6825/24423] conn(0x7fbd30066750 0x7fbd30068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.724+0000 7fbd3effd700 1 -- 172.21.15.104:0/2422973080 --> [v2:172.21.15.117:6824/24423,v1:172.21.15.117:6825/24423] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbd30069210 con 0x7fbd30066750 2024-08-17T02:25:45.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.724+0000 7fbd3effd700 1 -- 172.21.15.104:0/2422973080 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd3807f370 con 0x7fbd480699f0 2024-08-17T02:25:45.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.724+0000 7fbd467fc700 1 --2- 172.21.15.104:0/2422973080 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fbd30060860 0x7fbd30062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.724+0000 7fbd477fe700 1 --2- 172.21.15.104:0/2422973080 >> [v2:172.21.15.117:6824/24423,v1:172.21.15.117:6825/24423] conn(0x7fbd30066750 0x7fbd30068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.724+0000 7fbd467fc700 1 --2- 172.21.15.104:0/2422973080 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fbd30060860 0x7fbd30062d10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fbd4816c5a0 tx=0x7fbd34008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:45.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.724+0000 7fbd477fe700 1 --2- 172.21.15.104:0/2422973080 >> [v2:172.21.15.117:6824/24423,v1:172.21.15.117:6825/24423] conn(0x7fbd30066750 0x7fbd30068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:45.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.724+0000 7fbd3effd700 1 -- 172.21.15.104:0/2422973080 <== osd.7 v2:172.21.15.117:6824/24423 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fbd30069210 con 0x7fbd30066750 2024-08-17T02:25:45.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.744+0000 7fbd47fff700 1 -- 172.21.15.104:0/2422973080 --> [v2:172.21.15.117:6824/24423,v1:172.21.15.117:6825/24423] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbd48067f10 con 0x7fbd30066750 2024-08-17T02:25:45.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.744+0000 7fbd3effd700 1 -- 172.21.15.104:0/2422973080 <== osd.7 v2:172.21.15.117:6824/24423 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fbd48067f10 con 0x7fbd30066750 2024-08-17T02:25:45.749 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-08-17T02:25:45.749 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:25:45.749 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-08-17T02:25:45.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.744+0000 7fbd47fff700 1 -- 172.21.15.104:0/2422973080 >> [v2:172.21.15.117:6824/24423,v1:172.21.15.117:6825/24423] conn(0x7fbd30066750 msgr2=0x7fbd30068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.744+0000 7fbd47fff700 1 --2- 172.21.15.104:0/2422973080 >> [v2:172.21.15.117:6824/24423,v1:172.21.15.117:6825/24423] conn(0x7fbd30066750 0x7fbd30068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.744+0000 7fbd47fff700 1 -- 172.21.15.104:0/2422973080 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fbd30060860 msgr2=0x7fbd30062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.744+0000 7fbd47fff700 1 --2- 172.21.15.104:0/2422973080 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7fbd30060860 0x7fbd30062d10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fbd4816c5a0 tx=0x7fbd34008040 comp rx=0 tx=0).stop 2024-08-17T02:25:45.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.744+0000 7fbd47fff700 1 -- 172.21.15.104:0/2422973080 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd480699f0 msgr2=0x7fbd480aa7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.744+0000 7fbd47fff700 1 --2- 172.21.15.104:0/2422973080 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd480699f0 0x7fbd480aa7c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fbd3800ec80 tx=0x7fbd380091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.744+0000 7fbd477fe700 1 -- 172.21.15.104:0/2422973080 reap_dead start 2024-08-17T02:25:45.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.744+0000 7fbd47fff700 1 -- 172.21.15.104:0/2422973080 shutdown_connections 2024-08-17T02:25:45.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.744+0000 7fbd47fff700 1 -- 172.21.15.104:0/2422973080 >> 172.21.15.104:0/2422973080 conn(0x7fbd48099430 msgr2=0x7fbd480ce010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:45.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.744+0000 7fbd47fff700 1 -- 172.21.15.104:0/2422973080 shutdown_connections 2024-08-17T02:25:45.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.744+0000 7fbd47fff700 1 -- 172.21.15.104:0/2422973080 wait complete. 2024-08-17T02:25:45.761 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-08-17T02:25:45.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.864+0000 7f72379f4700 1 Processor -- start 2024-08-17T02:25:45.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.864+0000 7f72379f4700 1 -- start start 2024-08-17T02:25:45.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.868+0000 7f72379f4700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7230159340 0x7f7230159710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.868+0000 7f72379f4700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7230159c50 0x7f72300b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.868+0000 7f72379f4700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72300b1cf0 con 0x7f72300b4160 2024-08-17T02:25:45.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.868+0000 7f72379f4700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72300b45e0 con 0x7f7230159340 2024-08-17T02:25:45.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.868+0000 7f72379f4700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72300b60d0 con 0x7f7230159c50 2024-08-17T02:25:45.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.868+0000 7f7235790700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7230159340 0x7f7230159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.868+0000 7f7235790700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7230159340 0x7f7230159710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54068/0 (socket says 172.21.15.104:54068) 2024-08-17T02:25:45.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.868+0000 7f7234f8f700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7230159c50 0x7f72300b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.868+0000 7f7235790700 1 -- 172.21.15.104:0/629673970 learned_addr learned my addr 172.21.15.104:0/629673970 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:45.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.868+0000 7f7235790700 1 -- 172.21.15.104:0/629673970 >> v2:172.21.15.117:3300/0 conn(0x7f7230159c50 msgr2=0x7f72300b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:45.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.868+0000 7f7235790700 1 --2- 172.21.15.104:0/629673970 >> v2:172.21.15.117:3300/0 conn(0x7f7230159c50 0x7f72300b3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.868+0000 7f7235790700 1 -- 172.21.15.104:0/629673970 >> v1:172.21.15.117:6789/0 conn(0x7f72300b4160 legacy=0x7f72300b04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.868+0000 7f7235790700 1 -- 172.21.15.104:0/629673970 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72300b10e0 con 0x7f7230159340 2024-08-17T02:25:45.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.868+0000 7f7235790700 1 --2- 172.21.15.104:0/629673970 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7230159340 0x7f7230159710 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7230088f20 tx=0x7f722c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc7a916df3dcc671 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:45.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.868+0000 7f7227fff700 1 -- 172.21.15.104:0/629673970 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722c009e70 con 0x7f7230159340 2024-08-17T02:25:45.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.868+0000 7f7227fff700 1 -- 172.21.15.104:0/629673970 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f722c00b760 con 0x7f7230159340 2024-08-17T02:25:45.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.868+0000 7f7227fff700 1 -- 172.21.15.104:0/629673970 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722c00bb00 con 0x7f7230159340 2024-08-17T02:25:45.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.868+0000 7f72379f4700 1 -- 172.21.15.104:0/629673970 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7230159340 msgr2=0x7f7230159710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.868+0000 7f72379f4700 1 --2- 172.21.15.104:0/629673970 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7230159340 0x7f7230159710 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7230088f20 tx=0x7f722c009250 comp rx=0 tx=0).stop 2024-08-17T02:25:45.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.868+0000 7f72379f4700 1 -- 172.21.15.104:0/629673970 shutdown_connections 2024-08-17T02:25:45.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.868+0000 7f72379f4700 1 --2- 172.21.15.104:0/629673970 >> v2:172.21.15.117:3300/0 conn(0x7f7230159c50 0x7f72300b3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.868+0000 7f72379f4700 1 --2- 172.21.15.104:0/629673970 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7230159340 0x7f7230159710 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.868+0000 7f72379f4700 1 -- 172.21.15.104:0/629673970 >> 172.21.15.104:0/629673970 conn(0x7f72300994f0 msgr2=0x7f72300675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:45.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.868+0000 7f72379f4700 1 -- 172.21.15.104:0/629673970 shutdown_connections 2024-08-17T02:25:45.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.868+0000 7f72379f4700 1 -- 172.21.15.104:0/629673970 wait complete. 2024-08-17T02:25:45.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.872+0000 7f72379f4700 1 Processor -- start 2024-08-17T02:25:45.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.872+0000 7f72379f4700 1 -- start start 2024-08-17T02:25:45.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.876+0000 7f72379f4700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72300b4160 0x7f72300acc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.876+0000 7f72379f4700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7230159340 0x7f72301699c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.876+0000 7f72379f4700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7230159c50 0x7f72300ae9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.876+0000 7f72379f4700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f723016ce30 con 0x7f7230159340 2024-08-17T02:25:45.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.876+0000 7f72379f4700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72300ad6f0 con 0x7f72300b4160 2024-08-17T02:25:45.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.876+0000 7f72379f4700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72300ae550 con 0x7f7230159c50 2024-08-17T02:25:45.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.876+0000 7f7234f8f700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7230159340 0x7f72301699c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.876+0000 7f7235790700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72300b4160 0x7f72300acc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.876+0000 7f7235790700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72300b4160 0x7f72300acc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.104:60986/0 (socket says 172.21.15.104:60986) 2024-08-17T02:25:45.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.876+0000 7f7235790700 1 -- 172.21.15.104:0/3582039546 learned_addr learned my addr 172.21.15.104:0/3582039546 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:45.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.876+0000 7f7235f91700 1 --2- 172.21.15.104:0/3582039546 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7230159c50 0x7f72300ae9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.876+0000 7f7235790700 1 -- 172.21.15.104:0/3582039546 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7230159c50 msgr2=0x7f72300ae9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.876+0000 7f7235790700 1 --2- 172.21.15.104:0/3582039546 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7230159c50 0x7f72300ae9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.876+0000 7f7235790700 1 -- 172.21.15.104:0/3582039546 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7230159340 msgr2=0x7f72301699c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.876+0000 7f7235790700 1 --2- 172.21.15.104:0/3582039546 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7230159340 0x7f72301699c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.876+0000 7f7235790700 1 -- 172.21.15.104:0/3582039546 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f722c0094f0 con 0x7f72300b4160 2024-08-17T02:25:45.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.876+0000 7f7234f8f700 1 --2- 172.21.15.104:0/3582039546 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7230159340 0x7f72301699c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:45.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.876+0000 7f7235790700 1 --2- 172.21.15.104:0/3582039546 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72300b4160 0x7f72300acc40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f722c0030c0 tx=0x7f722c016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:45.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.876+0000 7f72257fa700 1 -- 172.21.15.104:0/3582039546 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722c00b8d0 con 0x7f72300b4160 2024-08-17T02:25:45.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.876+0000 7f72257fa700 1 -- 172.21.15.104:0/3582039546 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f722c00ba30 con 0x7f72300b4160 2024-08-17T02:25:45.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.876+0000 7f72379f4700 1 -- 172.21.15.104:0/3582039546 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72300ad940 con 0x7f72300b4160 2024-08-17T02:25:45.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.876+0000 7f72257fa700 1 -- 172.21.15.104:0/3582039546 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722c01c6d0 con 0x7f72300b4160 2024-08-17T02:25:45.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.876+0000 7f72379f4700 1 -- 172.21.15.104:0/3582039546 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72300adf00 con 0x7f72300b4160 2024-08-17T02:25:45.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.880+0000 7f72379f4700 1 -- 172.21.15.104:0/3582039546 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72300645c0 con 0x7f72300b4160 2024-08-17T02:25:45.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.880+0000 7f72257fa700 1 -- 172.21.15.104:0/3582039546 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f722c01cb00 con 0x7f72300b4160 2024-08-17T02:25:45.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.880+0000 7f72257fa700 1 --2- 172.21.15.104:0/3582039546 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7214060860 0x7f7214062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.880+0000 7f72257fa700 1 -- 172.21.15.104:0/3582039546 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f722c07e140 con 0x7f72300b4160 2024-08-17T02:25:45.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.880+0000 7f7234f8f700 1 --2- 172.21.15.104:0/3582039546 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7214060860 0x7f7214062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.880+0000 7f7234f8f700 1 --2- 172.21.15.104:0/3582039546 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7214060860 0x7f7214062d10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f72300b0850 tx=0x7f72200091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:45.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:45.888+0000 7f72257fa700 1 -- 172.21.15.104:0/3582039546 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f722c04e830 con 0x7f72300b4160 2024-08-17T02:25:46.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.052+0000 7f72379f4700 1 -- 172.21.15.104:0/3582039546 --> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f72300ae690 con 0x7f7214060860 2024-08-17T02:25:46.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.052+0000 7f72257fa700 1 -- 172.21.15.104:0/3582039546 <== mgr.4111 v2:172.21.15.117:6832/24084 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7220011d10 con 0x7f7214060860 2024-08-17T02:25:46.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.056+0000 7f72379f4700 1 -- 172.21.15.104:0/3582039546 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7214060860 msgr2=0x7f7214062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:46.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.056+0000 7f72379f4700 1 --2- 172.21.15.104:0/3582039546 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7214060860 0x7f7214062d10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f72300b0850 tx=0x7f72200091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.056+0000 7f72379f4700 1 -- 172.21.15.104:0/3582039546 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72300b4160 msgr2=0x7f72300acc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:46.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.056+0000 7f72379f4700 1 --2- 172.21.15.104:0/3582039546 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72300b4160 0x7f72300acc40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f722c0030c0 tx=0x7f722c016000 comp rx=0 tx=0).stop 2024-08-17T02:25:46.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.056+0000 7f72379f4700 1 -- 172.21.15.104:0/3582039546 shutdown_connections 2024-08-17T02:25:46.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.056+0000 7f72379f4700 1 --2- 172.21.15.104:0/3582039546 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7214060860 0x7f7214062d10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.056+0000 7f72379f4700 1 --2- 172.21.15.104:0/3582039546 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7230159c50 0x7f72300ae9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.056+0000 7f72379f4700 1 --2- 172.21.15.104:0/3582039546 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7230159340 0x7f72301699c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.056+0000 7f72379f4700 1 --2- 172.21.15.104:0/3582039546 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72300b4160 0x7f72300acc40 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.056+0000 7f72379f4700 1 -- 172.21.15.104:0/3582039546 >> 172.21.15.104:0/3582039546 conn(0x7f72300994f0 msgr2=0x7f72300af8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:46.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.056+0000 7f72379f4700 1 -- 172.21.15.104:0/3582039546 shutdown_connections 2024-08-17T02:25:46.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.056+0000 7f72379f4700 1 -- 172.21.15.104:0/3582039546 wait complete. 2024-08-17T02:25:46.061 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 7 to deep-scrub 2024-08-17T02:25:46.071 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:25:46.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.176+0000 7f4b5359e700 1 Processor -- start 2024-08-17T02:25:46.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.176+0000 7f4b5359e700 1 -- start start 2024-08-17T02:25:46.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.180+0000 7f4b5359e700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4b540b0350 0x7f4b540ad7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:46.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.180+0000 7f4b5359e700 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b540af2b0 con 0x7f4b54155d20 2024-08-17T02:25:46.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.180+0000 7f4b5359e700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b540af590 con 0x7f4b5406df10 2024-08-17T02:25:46.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.180+0000 7f4b5359e700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b540b07a0 con 0x7f4b540b0350 2024-08-17T02:25:46.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.180+0000 7f4b5259c700 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f4b54155d20 0x7f4b540aea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:43644/0 (socket says 172.21.15.104:43644) 2024-08-17T02:25:46.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.180+0000 7f4b5259c700 1 -- 172.21.15.104:0/1887470429 learned_addr learned my addr 172.21.15.104:0/1887470429 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-08-17T02:25:46.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.180+0000 7f4b51d9b700 1 --2- 172.21.15.104:0/1887470429 >> v2:172.21.15.117:3300/0 conn(0x7f4b540b0350 0x7f4b540ad7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:46.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.180+0000 7f4b5159a700 1 -- 172.21.15.104:0/1887470429 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2432809784 0 0) 0x7f4b540af2b0 con 0x7f4b54155d20 2024-08-17T02:25:46.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.180+0000 7f4b5159a700 1 -- 172.21.15.104:0/1887470429 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b40003570 con 0x7f4b54155d20 2024-08-17T02:25:46.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.180+0000 7f4b51d9b700 1 -- 172.21.15.104:0/1887470429 >> v1:172.21.15.117:6789/0 conn(0x7f4b5406df10 legacy=0x7f4b5406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:46.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.180+0000 7f4b51d9b700 1 -- 172.21.15.104:0/1887470429 >> v1:172.21.15.104:6789/0 conn(0x7f4b54155d20 legacy=0x7f4b540aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:46.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.180+0000 7f4b51d9b700 1 -- 172.21.15.104:0/1887470429 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b540af870 con 0x7f4b540b0350 2024-08-17T02:25:46.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.180+0000 7f4b51d9b700 1 --2- 172.21.15.104:0/1887470429 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b540b0350 0x7f4b540ad7c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c009e60 tx=0x7f4b3c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69e06ca47279cd4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:46.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.180+0000 7f4b5159a700 1 -- 172.21.15.104:0/1887470429 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c00bb60 con 0x7f4b540b0350 2024-08-17T02:25:46.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.180+0000 7f4b5159a700 1 -- 172.21.15.104:0/1887470429 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b3c00bcc0 con 0x7f4b540b0350 2024-08-17T02:25:46.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.180+0000 7f4b5159a700 1 -- 172.21.15.104:0/1887470429 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c011670 con 0x7f4b540b0350 2024-08-17T02:25:46.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.180+0000 7f4b5359e700 1 -- 172.21.15.104:0/1887470429 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b540b0350 msgr2=0x7f4b540ad7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:46.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.180+0000 7f4b5359e700 1 --2- 172.21.15.104:0/1887470429 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b540b0350 0x7f4b540ad7c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c009e60 tx=0x7f4b3c009780 comp rx=0 tx=0).stop 2024-08-17T02:25:46.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.180+0000 7f4b5359e700 1 -- 172.21.15.104:0/1887470429 shutdown_connections 2024-08-17T02:25:46.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.180+0000 7f4b5359e700 1 --2- 172.21.15.104:0/1887470429 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b540b0350 0x7f4b540ad7c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.180+0000 7f4b5359e700 1 -- 172.21.15.104:0/1887470429 >> 172.21.15.104:0/1887470429 conn(0x7f4b540678d0 msgr2=0x7f4b54067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:46.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.180+0000 7f4b5359e700 1 -- 172.21.15.104:0/1887470429 shutdown_connections 2024-08-17T02:25:46.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.180+0000 7f4b5359e700 1 -- 172.21.15.104:0/1887470429 wait complete. 2024-08-17T02:25:46.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.184+0000 7f4b5359e700 1 Processor -- start 2024-08-17T02:25:46.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.184+0000 7f4b5359e700 1 -- start start 2024-08-17T02:25:46.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.184+0000 7f4b5359e700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b5406df10 0x7f4b5414d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:46.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.184+0000 7f4b5359e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b540b0350 0x7f4b540a9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:46.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.184+0000 7f4b5359e700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4b54155d20 0x7f4b5414ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:46.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.184+0000 7f4b5359e700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b54141cd0 con 0x7f4b54155d20 2024-08-17T02:25:46.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.184+0000 7f4b5359e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5414e8f0 con 0x7f4b540b0350 2024-08-17T02:25:46.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.184+0000 7f4b5359e700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b54152c10 con 0x7f4b5406df10 2024-08-17T02:25:46.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.184+0000 7f4b52d9d700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4b54155d20 0x7f4b5414ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:46.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.184+0000 7f4b52d9d700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4b54155d20 0x7f4b5414ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54086/0 (socket says 172.21.15.104:54086) 2024-08-17T02:25:46.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.184+0000 7f4b52d9d700 1 -- 172.21.15.104:0/797417846 learned_addr learned my addr 172.21.15.104:0/797417846 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:25:46.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.184+0000 7f4b51d9b700 1 --2- 172.21.15.104:0/797417846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b540b0350 0x7f4b540a9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:46.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.184+0000 7f4b5259c700 1 --2- 172.21.15.104:0/797417846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b5406df10 0x7f4b5414d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:46.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.184+0000 7f4b52d9d700 1 -- 172.21.15.104:0/797417846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b5406df10 msgr2=0x7f4b5414d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:46.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.184+0000 7f4b52d9d700 1 --2- 172.21.15.104:0/797417846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b5406df10 0x7f4b5414d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.184+0000 7f4b52d9d700 1 -- 172.21.15.104:0/797417846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b540b0350 msgr2=0x7f4b540a9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:46.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.184+0000 7f4b52d9d700 1 --2- 172.21.15.104:0/797417846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b540b0350 0x7f4b540a9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.184+0000 7f4b52d9d700 1 -- 172.21.15.104:0/797417846 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b3c009a20 con 0x7f4b54155d20 2024-08-17T02:25:46.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.184+0000 7f4b52d9d700 1 --2- 172.21.15.104:0/797417846 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4b54155d20 0x7f4b5414ed80 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c00c590 tx=0x7f4b4c007eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:46.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.184+0000 7f4b4a7fc700 1 -- 172.21.15.104:0/797417846 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c011590 con 0x7f4b54155d20 2024-08-17T02:25:46.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.184+0000 7f4b4a7fc700 1 -- 172.21.15.104:0/797417846 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b4c0116f0 con 0x7f4b54155d20 2024-08-17T02:25:46.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.184+0000 7f4b5359e700 1 -- 172.21.15.104:0/797417846 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b5414d8f0 con 0x7f4b54155d20 2024-08-17T02:25:46.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.184+0000 7f4b4a7fc700 1 -- 172.21.15.104:0/797417846 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c011ab0 con 0x7f4b54155d20 2024-08-17T02:25:46.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.184+0000 7f4b5359e700 1 -- 172.21.15.104:0/797417846 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b54152930 con 0x7f4b54155d20 2024-08-17T02:25:46.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.188+0000 7f4b5359e700 1 -- 172.21.15.104:0/797417846 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b540643a0 con 0x7f4b54155d20 2024-08-17T02:25:46.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.188+0000 7f4b4a7fc700 1 -- 172.21.15.104:0/797417846 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f4b4c01b3b0 con 0x7f4b54155d20 2024-08-17T02:25:46.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.188+0000 7f4b4a7fc700 1 --2- 172.21.15.104:0/797417846 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4b34060890 0x7f4b34062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:46.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.188+0000 7f4b4a7fc700 1 -- 172.21.15.104:0/797417846 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f4b4c07bcc0 con 0x7f4b54155d20 2024-08-17T02:25:46.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.188+0000 7f4b5259c700 1 --2- 172.21.15.104:0/797417846 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4b34060890 0x7f4b34062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:46.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.188+0000 7f4b5259c700 1 --2- 172.21.15.104:0/797417846 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4b34060890 0x7f4b34062d40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4b440058d0 tx=0x7f4b44009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:46.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.196+0000 7f4b4a7fc700 1 -- 172.21.15.104:0/797417846 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f4b4c04c3b0 con 0x7f4b54155d20 2024-08-17T02:25:46.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.356+0000 7f4b5359e700 1 -- 172.21.15.104:0/797417846 --> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4b5406f5f0 con 0x7f4b34060890 2024-08-17T02:25:46.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.360+0000 7f4b4a7fc700 1 -- 172.21.15.104:0/797417846 <== mgr.4111 v2:172.21.15.117:6832/24084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48767 (secure 0 0 0) 0x7f4b5406f5f0 con 0x7f4b34060890 2024-08-17T02:25:46.365 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:25:46.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.364+0000 7f4b5359e700 1 -- 172.21.15.104:0/797417846 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4b34060890 msgr2=0x7f4b34062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:46.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.364+0000 7f4b5359e700 1 --2- 172.21.15.104:0/797417846 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4b34060890 0x7f4b34062d40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4b440058d0 tx=0x7f4b44009040 comp rx=0 tx=0).stop 2024-08-17T02:25:46.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.364+0000 7f4b5359e700 1 -- 172.21.15.104:0/797417846 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4b54155d20 msgr2=0x7f4b5414ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:46.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.364+0000 7f4b5359e700 1 --2- 172.21.15.104:0/797417846 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4b54155d20 0x7f4b5414ed80 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c00c590 tx=0x7f4b4c007eb0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.364+0000 7f4b5359e700 1 -- 172.21.15.104:0/797417846 shutdown_connections 2024-08-17T02:25:46.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.364+0000 7f4b5359e700 1 --2- 172.21.15.104:0/797417846 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f4b34060890 0x7f4b34062d40 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.364+0000 7f4b5359e700 1 --2- 172.21.15.104:0/797417846 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4b54155d20 0x7f4b5414ed80 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.364+0000 7f4b5359e700 1 --2- 172.21.15.104:0/797417846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b540b0350 0x7f4b540a9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.364+0000 7f4b5359e700 1 --2- 172.21.15.104:0/797417846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b5406df10 0x7f4b5414d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.364+0000 7f4b5359e700 1 -- 172.21.15.104:0/797417846 >> 172.21.15.104:0/797417846 conn(0x7f4b540678d0 msgr2=0x7f4b54063060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:46.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.364+0000 7f4b5359e700 1 -- 172.21.15.104:0/797417846 shutdown_connections 2024-08-17T02:25:46.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:25:46.364+0000 7f4b5359e700 1 -- 172.21.15.104:0/797417846 wait complete. 2024-08-17T02:25:46.368 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-08-17T02:25:46.379 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2024-08-17T02:25:46.166463+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2388500,"kb_used_data":5480,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752586220,"statfs":{"total":773094113280,"available":770648289280,"internally_reserved":0,"allocated":5611520,"data_stored":3037256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.109321"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":185,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-08-17T02:25:38.061119+0000","last_change":"2024-08-17T02:22:11.967052+0000","last_active":"2024-08-17T02:25:38.061119+0000","last_peered":"2024-08-17T02:25:38.061119+0000","last_clean":"2024-08-17T02:25:38.061119+0000","last_became_active":"2024-08-17T02:22:11.965269+0000","last_became_peered":"2024-08-17T02:22:11.965269+0000","last_unstale":"2024-08-17T02:25:38.061119+0000","last_undegraded":"2024-08-17T02:25:38.061119+0000","last_fullsized":"2024-08-17T02:25:38.061119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:22:10.930862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:22:10.930862+0000","last_clean_scrub_stamp":"2024-08-17T02:22:10.930862+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509488,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297892,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073948,"statfs":{"total":96636764160,"available":96331722752,"internally_reserved":0,"allocated":552960,"data_stored":232065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.92800000000000005,"15min":0.90200000000000002},"min":{"1min":0.56799999999999995,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.2310000000000001,"5min":1.236,"15min":1.236},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.73299999999999998,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.2609999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.79500000000000004}]},{"osd":1,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.88300000000000001,"15min":0.88900000000000001},"min":{"1min":0.629,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.90600000000000003,"15min":0.91000000000000003},"min":{"1min":0.70399999999999996,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1739999999999999,"5min":1.413,"15min":1.413},"last":1.1160000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.97599999999999998,"15min":0.96199999999999997},"min":{"1min":0.65800000000000003,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.2250000000000001,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92800000000000005,"15min":0.92400000000000004},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.198,"5min":1.23,"15min":1.23},"last":0.87}]},{"osd":3,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.91400000000000003,"15min":0.91100000000000003},"min":{"1min":0.66500000000000004,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.1619999999999999,"5min":1.302,"15min":1.302},"last":1.0469999999999999},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.96299999999999997,"15min":0.97299999999999998},"min":{"1min":0.74299999999999999,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.254,"5min":1.341,"15min":1.341},"last":1.071}]},{"osd":4,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.89000000000000001,"15min":0.90400000000000003},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.125,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":1.014,"5min":1.0529999999999999,"15min":1.0649999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.351,"5min":1.482,"15min":1.482},"last":0.90700000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":1.0109999999999999,"15min":1.0209999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.246,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":1.155},{"interface":"front","average":{"1min":1.159,"5min":1.171,"15min":1.1890000000000001},"min":{"1min":0.99099999999999999,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.4159999999999999,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.94399999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.1240000000000001,"15min":1.1439999999999999},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.3400000000000001,"5min":1.393,"15min":1.393},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.141,"5min":1.1559999999999999,"15min":1.1639999999999999},"min":{"1min":0.78200000000000003,"5min":0.752,"15min":0.752},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":1.129}]}]},{"osd":5,"up_from":15,"seq":64424509487,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298480,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073360,"statfs":{"total":96636764160,"available":96331120640,"internally_reserved":0,"allocated":1146880,"data_stored":822433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.83399999999999996,"15min":0.82799999999999996},"min":{"1min":0.61799999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.92900000000000005,"15min":0.91800000000000004},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.216,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":1}]},{"osd":1,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.89900000000000002,"15min":0.879},"min":{"1min":0.67000000000000004,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.89900000000000002,"15min":0.90600000000000003},"min":{"1min":0.65600000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.1000000000000001,"5min":1.282,"15min":1.282},"last":0.72199999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.91600000000000004,"15min":0.91200000000000003},"min":{"1min":0.68200000000000005,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.879,"5min":0.874,"15min":0.88200000000000001},"min":{"1min":0.69499999999999995,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.079,"5min":1.216,"15min":1.216},"last":0.63400000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.92600000000000005,"15min":0.93100000000000005},"min":{"1min":0.64900000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.0169999999999999,"5min":0.95199999999999996,"15min":0.93899999999999995},"min":{"1min":0.82799999999999996,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.27,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":1.1220000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.93700000000000006,"15min":0.95799999999999996},"min":{"1min":0.61699999999999999,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.03,"5min":0.98699999999999999,"15min":0.97099999999999997},"min":{"1min":0.76000000000000001,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":1.21}]},{"osd":6,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":1.0049999999999999,"15min":1.0309999999999999},"min":{"1min":0.69999999999999996,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.226,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.0549999999999999},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.0609999999999999,"15min":1.091},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.2110000000000001,"5min":1.371,"15min":1.371},"last":1.159}]},{"osd":7,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.0700000000000001,"15min":1.0609999999999999},"min":{"1min":0.90100000000000002,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.175,"15min":1.1819999999999999},"min":{"1min":0.95699999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":1.548,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.244}]}]},{"osd":4,"up_from":15,"seq":64424509487,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297896,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073944,"statfs":{"total":96636764160,"available":96331718656,"internally_reserved":0,"allocated":552960,"data_stored":232065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.83299999999999996,"15min":0.81200000000000006},"min":{"1min":0.58099999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.204,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85199999999999998,"15min":0.84199999999999997},"min":{"1min":0.64200000000000002,"5min":0.501,"15min":0.501},"max":{"1min":1.0820000000000001,"5min":2.0329999999999999,"15min":2.0329999999999999},"last":0.80600000000000005}]},{"osd":1,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.86399999999999999,"15min":0.84399999999999997},"min":{"1min":0.64200000000000002,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.2170000000000001,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.95799999999999996,"15min":0.98599999999999999},"min":{"1min":0.71799999999999997,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.1040000000000001,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":1.141}]},{"osd":2,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.92700000000000005,"15min":0.95399999999999996},"min":{"1min":0.69599999999999995,"5min":0.621,"15min":0.621},"max":{"1min":1.0589999999999999,"5min":1.726,"15min":1.726},"last":1.073},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.92700000000000005,"15min":0.91700000000000004},"min":{"1min":0.69099999999999995,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1930000000000001,"5min":1.367,"15min":1.367},"last":0.70699999999999996}]},{"osd":3,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.87,"15min":0.879},"min":{"1min":0.69299999999999995,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.0089999999999999,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.86899999999999999,"5min":1.0069999999999999,"15min":1.05},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.173,"5min":1.653,"15min":1.653},"last":0.64600000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.91500000000000004,"15min":0.92900000000000005},"min":{"1min":0.60899999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.214,"5min":1.3,"15min":1.3},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.995,"15min":1.0329999999999999},"min":{"1min":0.64500000000000002,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.194,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.1140000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":1.069,"15min":1.097},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.2370000000000001,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.107,"15min":1.1140000000000001},"min":{"1min":0.77000000000000002,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.5109999999999999,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":1.1970000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.0449999999999999,"15min":1.0600000000000001},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.167,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.071,"5min":1.2070000000000001,"15min":1.2450000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.542,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":1.1639999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509487,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297900,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073940,"statfs":{"total":96636764160,"available":96331714560,"internally_reserved":0,"allocated":552960,"data_stored":232065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63300000000000001,"15min":0.64900000000000002},"min":{"1min":0.47299999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.77700000000000002,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.76700000000000002,"15min":0.754},"min":{"1min":0.66600000000000004,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.006,"5min":1.159,"15min":1.159},"last":0.74199999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.70299999999999996,"15min":0.68700000000000006},"min":{"1min":0.51700000000000002,"5min":0.443,"15min":0.443},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.81399999999999995,"15min":0.83099999999999996},"min":{"1min":0.54400000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0129999999999999,"5min":1.381,"15min":1.381},"last":0.68700000000000006}]},{"osd":2,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.70299999999999996,"15min":0.69699999999999995},"min":{"1min":0.59199999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.873,"5min":0.876,"15min":0.88200000000000001},"min":{"1min":0.60999999999999999,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0189999999999999,"5min":1.45,"15min":1.45},"last":0.82399999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":0.93100000000000005,"15min":0.91100000000000003},"min":{"1min":0.85999999999999999,"5min":0.63,"15min":0.63},"max":{"1min":1.3100000000000001,"5min":1.526,"15min":1.526},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97499999999999998,"15min":0.98699999999999999},"min":{"1min":0.77700000000000002,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.306,"5min":2.04,"15min":2.04},"last":0.84899999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":1.006,"15min":1.0129999999999999},"min":{"1min":0.74099999999999999,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.272,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.034,"5min":1.0449999999999999,"15min":1.054},"min":{"1min":0.85599999999999998,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.2529999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.879}]},{"osd":6,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.093,"15min":1.1060000000000001},"min":{"1min":0.85599999999999998,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.248,"5min":1.577,"15min":1.577},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.081,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.97699999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.2629999999999999,"5min":1.448,"15min":1.448},"last":1.0449999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.0920000000000001,"15min":1.0880000000000001},"min":{"1min":0.94999999999999996,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.3620000000000001,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.127},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.131,"15min":1.125},"min":{"1min":0.90400000000000003,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.6799999999999999,"5min":2.109,"15min":2.109},"last":1.1890000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509487,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297896,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073944,"statfs":{"total":96636764160,"available":96331718656,"internally_reserved":0,"allocated":552960,"data_stored":232065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.62,"15min":0.627},"min":{"1min":0.40699999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90200000000000002,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68799999999999994,"15min":0.67900000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.749}]},{"osd":1,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.747,"15min":0.73299999999999998},"min":{"1min":0.55000000000000004,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.77100000000000002,"15min":0.75600000000000001},"min":{"1min":0.52000000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.879}]},{"osd":3,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.752,"15min":0.746},"min":{"1min":0.55900000000000005,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0609999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.80800000000000005,"15min":0.81000000000000005},"min":{"1min":0.48099999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.3660000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.80300000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.94899999999999995,"15min":0.94799999999999995},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.2030000000000001,"5min":1.391,"15min":1.391},"last":1.016},{"interface":"front","average":{"1min":0.96299999999999997,"5min":1.0449999999999999,"15min":1.073},"min":{"1min":0.745,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.2370000000000001,"5min":1.974,"15min":1.974},"last":1.153}]},{"osd":5,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0820000000000001,"15min":1.1140000000000001},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.3280000000000001,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":1.2370000000000001},{"interface":"front","average":{"1min":0.999,"5min":1.0249999999999999,"15min":1.026},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.274,"5min":1.296,"15min":1.296},"last":0.86299999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.087,"15min":1.111},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.3080000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.079,"5min":1.1040000000000001,"15min":1.1259999999999999},"min":{"1min":0.76100000000000001,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.284,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.121}]},{"osd":7,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.141,"15min":1.165},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.3819999999999999,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.1279999999999999,"15min":1.1240000000000001},"min":{"1min":0.73199999999999998,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.411,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.0449999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509488,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298480,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073360,"statfs":{"total":96636764160,"available":96331120640,"internally_reserved":0,"allocated":1146880,"data_stored":822433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66000000000000003,"15min":0.67500000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.137,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.69399999999999995,"15min":0.68400000000000005},"min":{"1min":0.502,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.96799999999999997,"5min":1.016,"15min":1.016},"last":0.91800000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.72599999999999998,"15min":0.74199999999999999},"min":{"1min":0.55000000000000004,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.1419999999999999,"5min":1.194,"15min":1.194},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.79800000000000004,"15min":0.79200000000000004},"min":{"1min":0.60799999999999998,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.083,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.72999999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.86599999999999999,"15min":0.879},"min":{"1min":0.63200000000000001,"5min":0.63,"15min":0.63},"max":{"1min":1.129,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.86499999999999999,"15min":0.85099999999999998},"min":{"1min":0.624,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.66800000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.97699999999999998,"15min":0.97199999999999998},"min":{"1min":0.78900000000000003,"5min":0.746,"15min":0.746},"max":{"1min":1.1699999999999999,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.0429999999999999,"15min":1.069},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.165,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.71099999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.018,"15min":1.024},"min":{"1min":0.79000000000000004,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.248,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":1.081,"5min":1.1419999999999999,"15min":1.1679999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.272,"5min":1.893,"15min":1.893},"last":0.82499999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.123,"15min":1.129},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.304,"5min":1.964,"15min":1.964},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.091,"5min":1.133,"15min":1.145},"min":{"1min":0.83399999999999996,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.282,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":0.77700000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.1859999999999999,"15min":1.194},"min":{"1min":0.96499999999999997,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.478,"5min":1.649,"15min":1.649},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.179,"15min":1.179},"min":{"1min":0.92000000000000004,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.3819999999999999,"5min":1.5,"15min":1.5},"last":1.103}]}]},{"osd":0,"up_from":15,"seq":64424509487,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297896,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073944,"statfs":{"total":96636764160,"available":96331718656,"internally_reserved":0,"allocated":552960,"data_stored":232065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:25:17 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.63900000000000001,"15min":0.63500000000000001},"min":{"1min":0.50800000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.97799999999999998,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71499999999999997,"15min":0.70299999999999996},"min":{"1min":0.56599999999999995,"5min":0.318,"15min":0.318},"max":{"1min":0.999,"5min":1.498,"15min":1.498},"last":0.76900000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:25:17 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.72599999999999998,"15min":0.69799999999999995},"min":{"1min":0.53900000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.71099999999999997,"15min":0.68100000000000005},"min":{"1min":0.56000000000000005,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.91600000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:25:17 2024","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.878,"15min":0.90100000000000002},"min":{"1min":0.56599999999999995,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.2110000000000001,"5min":5.0270000000000001,"15min":5.0270000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81200000000000006,"15min":0.80200000000000005},"min":{"1min":0.61099999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.97799999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:25:17 2024","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.98099999999999998,"15min":0.97499999999999998},"min":{"1min":0.80600000000000005,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.26,"5min":2.633,"15min":2.633},"last":1.101},{"interface":"front","average":{"1min":0.94599999999999995,"5min":1.099,"15min":1.169},"min":{"1min":0.746,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.141,"5min":5.0700000000000003,"15min":5.0700000000000003},"last":1.256}]},{"osd":5,"last update":"Sat Aug 17 02:25:17 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.048,"15min":1.032},"min":{"1min":0.80000000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.365,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.026,"5min":1.0620000000000001,"15min":1.0600000000000001},"min":{"1min":0.79500000000000004,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.333,"5min":1.915,"15min":1.915},"last":1.4830000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:25:17 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.1910000000000001,"15min":1.262},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.347,"5min":5.133,"15min":5.133},"last":1.5609999999999999},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.85499999999999998,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.323,"5min":1.702,"15min":1.702},"last":1.633}]},{"osd":7,"last update":"Sat Aug 17 02:25:17 2024","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.145,"15min":1.137},"min":{"1min":0.76600000000000001,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.4419999999999999,"5min":2.3759999999999999,"15min":2.3759999999999999},"last":1.593},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.254,"15min":1.3120000000000001},"min":{"1min":0.88100000000000001,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.3819999999999999,"5min":5.101,"15min":5.101},"last":1.3959999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542192,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302060,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069780,"statfs":{"total":96636764160,"available":96327454720,"internally_reserved":0,"allocated":552960,"data_stored":232065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.90800000000000003,"15min":0.89600000000000002},"min":{"1min":0.64500000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.284,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.86899999999999999,"15min":0.84199999999999997},"min":{"1min":0.628,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.2370000000000001,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.95399999999999996}]},{"osd":1,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.92800000000000005,"15min":0.94799999999999995},"min":{"1min":0.66300000000000003,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.097,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.95099999999999996,"15min":0.97899999999999998},"min":{"1min":0.61499999999999999,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.2529999999999999,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.89400000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.97999999999999998,"15min":1.016},"min":{"1min":0.65600000000000003,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.23,"5min":1.377,"15min":1.377},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.94799999999999995,"15min":0.92000000000000004},"min":{"1min":0.74299999999999999,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.323,"5min":1.635,"15min":1.635},"last":1.075}]},{"osd":3,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":1.024,"15min":1.018},"min":{"1min":0.65700000000000003,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.23,"5min":1.772,"15min":1.772},"last":1.179},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0349999999999999,"15min":1.052},"min":{"1min":0.77900000000000003,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.196,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.92800000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.95699999999999996,"15min":0.96099999999999997},"min":{"1min":0.65100000000000002,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.198,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.0720000000000001,"15min":1.0860000000000001},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.3680000000000001,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.2250000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":1.069,"15min":1.127},"min":{"1min":0.69299999999999995,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.2130000000000001,"5min":2.2759999999999998,"15min":2.2759999999999998},"last":0.87},{"interface":"front","average":{"1min":1.075,"5min":1.1659999999999999,"15min":1.202},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.409,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.022}]},{"osd":7,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.1930000000000001,"15min":1.2110000000000001},"min":{"1min":0.78700000000000003,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.365,"5min":2.5059999999999998,"15min":2.5059999999999998},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.218,"15min":1.268},"min":{"1min":0.84499999999999997,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.306,"5min":2.5779999999999998,"15min":2.5779999999999998},"last":0.997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:25:46.383 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-08-17T02:22:10.930862+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=17, tm_hour=2, tm_min=22, tm_sec=10, tm_wday=5, tm_yday=230, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=17, tm_hour=2, tm_min=25, tm_sec=41, tm_wday=5, tm_yday=230, tm_isdst=0) 2024-08-17T02:25:46.383 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-08-17T02:25:50.373 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:25:50.375 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:06.385 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:26:06.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.492+0000 7f5b95e8a700 1 Processor -- start 2024-08-17T02:26:06.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.492+0000 7f5b95e8a700 1 -- start start 2024-08-17T02:26:06.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.492+0000 7f5b95e8a700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f5b9015b050 0x7f5b9015e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.492+0000 7f5b95e8a700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5b900b0b50 0x7f5b900aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.492+0000 7f5b95e8a700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b9015ea70 con 0x7f5b900af050 2024-08-17T02:26:06.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.492+0000 7f5b95e8a700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b9006e1b0 con 0x7f5b9015b050 2024-08-17T02:26:06.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.492+0000 7f5b95e8a700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b900af450 con 0x7f5b900b0b50 2024-08-17T02:26:06.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.496+0000 7f5b94e88700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f5b9015b050 0x7f5b9015e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.496+0000 7f5b94e88700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f5b9015b050 0x7f5b9015e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:58788/0 (socket says 172.21.15.104:58788) 2024-08-17T02:26:06.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.496+0000 7f5b94e88700 1 -- 172.21.15.104:0/1395418457 learned_addr learned my addr 172.21.15.104:0/1395418457 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:26:06.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.496+0000 7f5b8ffff700 1 --2- 172.21.15.104:0/1395418457 >> v2:172.21.15.117:3300/0 conn(0x7f5b900b0b50 0x7f5b900aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.496+0000 7f5b94e88700 1 -- 172.21.15.104:0/1395418457 >> v2:172.21.15.117:3300/0 conn(0x7f5b900b0b50 msgr2=0x7f5b900aeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:06.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.496+0000 7f5b94e88700 1 --2- 172.21.15.104:0/1395418457 >> v2:172.21.15.117:3300/0 conn(0x7f5b900b0b50 0x7f5b900aeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.496+0000 7f5b94e88700 1 -- 172.21.15.104:0/1395418457 >> v1:172.21.15.117:6789/0 conn(0x7f5b900af050 legacy=0x7f5b901610e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.496+0000 7f5b94e88700 1 -- 172.21.15.104:0/1395418457 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b900b10e0 con 0x7f5b9015b050 2024-08-17T02:26:06.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.496+0000 7f5b94e88700 1 --2- 172.21.15.104:0/1395418457 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b9015b050 0x7f5b9015e530 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5b90070240 tx=0x7f5b7c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=478a3ba1ea7a72cf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:06.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.496+0000 7f5b8f7fe700 1 -- 172.21.15.104:0/1395418457 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c009e70 con 0x7f5b9015b050 2024-08-17T02:26:06.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.496+0000 7f5b8f7fe700 1 -- 172.21.15.104:0/1395418457 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7c00b860 con 0x7f5b9015b050 2024-08-17T02:26:06.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.496+0000 7f5b8f7fe700 1 -- 172.21.15.104:0/1395418457 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c00bc00 con 0x7f5b9015b050 2024-08-17T02:26:06.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.496+0000 7f5b95e8a700 1 -- 172.21.15.104:0/1395418457 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b9015b050 msgr2=0x7f5b9015e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.496+0000 7f5b95e8a700 1 --2- 172.21.15.104:0/1395418457 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b9015b050 0x7f5b9015e530 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5b90070240 tx=0x7f5b7c009250 comp rx=0 tx=0).stop 2024-08-17T02:26:06.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.496+0000 7f5b95e8a700 1 -- 172.21.15.104:0/1395418457 shutdown_connections 2024-08-17T02:26:06.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.496+0000 7f5b95e8a700 1 --2- 172.21.15.104:0/1395418457 >> v2:172.21.15.117:3300/0 conn(0x7f5b900b0b50 0x7f5b900aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.496+0000 7f5b95e8a700 1 --2- 172.21.15.104:0/1395418457 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b9015b050 0x7f5b9015e530 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.496+0000 7f5b95e8a700 1 -- 172.21.15.104:0/1395418457 >> 172.21.15.104:0/1395418457 conn(0x7f5b90067860 msgr2=0x7f5b90067c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:06.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.496+0000 7f5b95e8a700 1 -- 172.21.15.104:0/1395418457 shutdown_connections 2024-08-17T02:26:06.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.496+0000 7f5b95e8a700 1 -- 172.21.15.104:0/1395418457 wait complete. 2024-08-17T02:26:06.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.500+0000 7f5b95e8a700 1 Processor -- start 2024-08-17T02:26:06.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.500+0000 7f5b95e8a700 1 -- start start 2024-08-17T02:26:06.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.500+0000 7f5b95e8a700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b900af050 0x7f5b9015bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.500+0000 7f5b95e8a700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b900b0b50 0x7f5b900a5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.500+0000 7f5b95e8a700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b9015b050 0x7f5b900a6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.500+0000 7f5b95e8a700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b90158260 con 0x7f5b900af050 2024-08-17T02:26:06.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.500+0000 7f5b95e8a700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9015d4e0 con 0x7f5b900b0b50 2024-08-17T02:26:06.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.500+0000 7f5b95e8a700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9015d7c0 con 0x7f5b9015b050 2024-08-17T02:26:06.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.500+0000 7f5b94e88700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b900af050 0x7f5b9015bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.500+0000 7f5b94e88700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b900af050 0x7f5b9015bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:58800/0 (socket says 172.21.15.104:58800) 2024-08-17T02:26:06.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.500+0000 7f5b94e88700 1 -- 172.21.15.104:0/91860338 learned_addr learned my addr 172.21.15.104:0/91860338 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:26:06.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.500+0000 7f5b8ffff700 1 --2- 172.21.15.104:0/91860338 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b900b0b50 0x7f5b900a5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.500+0000 7f5b95689700 1 --2- 172.21.15.104:0/91860338 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b9015b050 0x7f5b900a6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.500+0000 7f5b94e88700 1 -- 172.21.15.104:0/91860338 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b9015b050 msgr2=0x7f5b900a6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.500+0000 7f5b94e88700 1 --2- 172.21.15.104:0/91860338 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b9015b050 0x7f5b900a6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.500+0000 7f5b94e88700 1 -- 172.21.15.104:0/91860338 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b900b0b50 msgr2=0x7f5b900a5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.500+0000 7f5b94e88700 1 --2- 172.21.15.104:0/91860338 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b900b0b50 0x7f5b900a5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.500+0000 7f5b94e88700 1 -- 172.21.15.104:0/91860338 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b7c0094f0 con 0x7f5b900af050 2024-08-17T02:26:06.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.500+0000 7f5b94e88700 1 --2- 172.21.15.104:0/91860338 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b900af050 0x7f5b9015bdf0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f5b9006f760 tx=0x7f5b7c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:06.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.500+0000 7f5b8cff9700 1 -- 172.21.15.104:0/91860338 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c00bbe0 con 0x7f5b900af050 2024-08-17T02:26:06.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.500+0000 7f5b8cff9700 1 -- 172.21.15.104:0/91860338 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7c011420 con 0x7f5b900af050 2024-08-17T02:26:06.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.500+0000 7f5b95e8a700 1 -- 172.21.15.104:0/91860338 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b9015daa0 con 0x7f5b900af050 2024-08-17T02:26:06.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.500+0000 7f5b8cff9700 1 -- 172.21.15.104:0/91860338 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c0117e0 con 0x7f5b900af050 2024-08-17T02:26:06.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.500+0000 7f5b95e8a700 1 -- 172.21.15.104:0/91860338 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b90140ae0 con 0x7f5b900af050 2024-08-17T02:26:06.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.504+0000 7f5b95e8a700 1 -- 172.21.15.104:0/91860338 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b90140d00 con 0x7f5b900af050 2024-08-17T02:26:06.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.504+0000 7f5b8cff9700 1 -- 172.21.15.104:0/91860338 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f5b7c011bd0 con 0x7f5b900af050 2024-08-17T02:26:06.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.504+0000 7f5b8cff9700 1 --2- 172.21.15.104:0/91860338 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f5b74060860 0x7f5b74062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.504+0000 7f5b8cff9700 1 -- 172.21.15.104:0/91860338 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f5b7c07dd50 con 0x7f5b900af050 2024-08-17T02:26:06.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.504+0000 7f5b8ffff700 1 --2- 172.21.15.104:0/91860338 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f5b74060860 0x7f5b74062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.508+0000 7f5b8ffff700 1 --2- 172.21.15.104:0/91860338 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f5b74060860 0x7f5b74062d10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5b900aebc0 tx=0x7f5b840091a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:06.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.512+0000 7f5b8cff9700 1 -- 172.21.15.104:0/91860338 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f5b7c081030 con 0x7f5b900af050 2024-08-17T02:26:06.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.672+0000 7f5b95e8a700 1 -- 172.21.15.104:0/91860338 --> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5b900643a0 con 0x7f5b74060860 2024-08-17T02:26:06.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.676+0000 7f5b8cff9700 1 -- 172.21.15.104:0/91860338 <== mgr.4111 v2:172.21.15.117:6832/24084 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48686 (secure 0 0 0) 0x7f5b900643a0 con 0x7f5b74060860 2024-08-17T02:26:06.682 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:26:06.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.680+0000 7f5b95e8a700 1 -- 172.21.15.104:0/91860338 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f5b74060860 msgr2=0x7f5b74062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.680+0000 7f5b95e8a700 1 --2- 172.21.15.104:0/91860338 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f5b74060860 0x7f5b74062d10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5b900aebc0 tx=0x7f5b840091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.680+0000 7f5b95e8a700 1 -- 172.21.15.104:0/91860338 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b900af050 msgr2=0x7f5b9015bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.680+0000 7f5b95e8a700 1 --2- 172.21.15.104:0/91860338 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b900af050 0x7f5b9015bdf0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f5b9006f760 tx=0x7f5b7c017000 comp rx=0 tx=0).stop 2024-08-17T02:26:06.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.680+0000 7f5b95e8a700 1 -- 172.21.15.104:0/91860338 shutdown_connections 2024-08-17T02:26:06.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.680+0000 7f5b95e8a700 1 --2- 172.21.15.104:0/91860338 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f5b74060860 0x7f5b74062d10 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.680+0000 7f5b95e8a700 1 --2- 172.21.15.104:0/91860338 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b9015b050 0x7f5b900a6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.680+0000 7f5b95e8a700 1 --2- 172.21.15.104:0/91860338 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b900b0b50 0x7f5b900a5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.680+0000 7f5b95e8a700 1 --2- 172.21.15.104:0/91860338 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b900af050 0x7f5b9015bdf0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.680+0000 7f5b95e8a700 1 -- 172.21.15.104:0/91860338 >> 172.21.15.104:0/91860338 conn(0x7f5b90067860 msgr2=0x7f5b9006a320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:06.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.680+0000 7f5b95e8a700 1 -- 172.21.15.104:0/91860338 shutdown_connections 2024-08-17T02:26:06.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.680+0000 7f5b95e8a700 1 -- 172.21.15.104:0/91860338 wait complete. 2024-08-17T02:26:06.685 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-08-17T02:26:06.696 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-08-17T02:26:06.171773+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2388484,"kb_used_data":5480,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752586236,"statfs":{"total":773094113280,"available":770648305664,"internally_reserved":0,"allocated":5611520,"data_stored":3037256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003265"},"pg_stats":[{"pgid":"1.0","version":"47'119","reported_seq":197,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-08-17T02:25:49.254223+0000","last_change":"2024-08-17T02:25:49.254152+0000","last_active":"2024-08-17T02:25:49.254223+0000","last_peered":"2024-08-17T02:25:49.254223+0000","last_clean":"2024-08-17T02:25:49.254223+0000","last_became_active":"2024-08-17T02:22:11.965269+0000","last_became_peered":"2024-08-17T02:22:11.965269+0000","last_unstale":"2024-08-17T02:25:49.254223+0000","last_undegraded":"2024-08-17T02:25:49.254223+0000","last_fullsized":"2024-08-17T02:25:49.254223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"47'119","last_scrub_stamp":"2024-08-17T02:25:49.253933+0000","last_deep_scrub":"47'119","last_deep_scrub_stamp":"2024-08-17T02:25:49.253933+0000","last_clean_scrub_stamp":"2024-08-17T02:25:49.253933+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:50:21.063178+0000","scrub_duration":0.010059831,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509492,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297892,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073948,"statfs":{"total":96636764160,"available":96331722752,"internally_reserved":0,"allocated":552960,"data_stored":232065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.92800000000000005,"15min":0.90200000000000002},"min":{"1min":0.56799999999999995,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.2310000000000001,"5min":1.236,"15min":1.236},"last":1.056},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.73299999999999998,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.2609999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":1.006}]},{"osd":1,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.88300000000000001,"15min":0.88900000000000001},"min":{"1min":0.629,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.90600000000000003,"15min":0.91000000000000003},"min":{"1min":0.70399999999999996,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1739999999999999,"5min":1.413,"15min":1.413},"last":0.93700000000000006}]},{"osd":2,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.97599999999999998,"15min":0.96199999999999997},"min":{"1min":0.65800000000000003,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.2250000000000001,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92800000000000005,"15min":0.92400000000000004},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.198,"5min":1.23,"15min":1.23},"last":0.90500000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.91400000000000003,"15min":0.91100000000000003},"min":{"1min":0.66500000000000004,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.1619999999999999,"5min":1.302,"15min":1.302},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.96299999999999997,"15min":0.97299999999999998},"min":{"1min":0.74299999999999999,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.254,"5min":1.341,"15min":1.341},"last":0.84099999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.89000000000000001,"15min":0.90400000000000003},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.125,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.745},{"interface":"front","average":{"1min":1.014,"5min":1.0529999999999999,"15min":1.0649999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.351,"5min":1.482,"15min":1.482},"last":0.871}]},{"osd":5,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":1.0109999999999999,"15min":1.0209999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.246,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":1.159,"5min":1.171,"15min":1.1890000000000001},"min":{"1min":0.99099999999999999,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.4159999999999999,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.085}]},{"osd":6,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.1240000000000001,"15min":1.1439999999999999},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.3400000000000001,"5min":1.393,"15min":1.393},"last":1.145},{"interface":"front","average":{"1min":1.141,"5min":1.1559999999999999,"15min":1.1639999999999999},"min":{"1min":0.78200000000000003,"5min":0.752,"15min":0.752},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.97299999999999998}]}]},{"osd":5,"up_from":15,"seq":64424509491,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298472,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073368,"statfs":{"total":96636764160,"available":96331128832,"internally_reserved":0,"allocated":1146880,"data_stored":822433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.83399999999999996,"15min":0.82799999999999996},"min":{"1min":0.61799999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.92900000000000005,"15min":0.91800000000000004},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.216,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":1.0740000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.89900000000000002,"15min":0.879},"min":{"1min":0.67000000000000004,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":1.022},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.89900000000000002,"15min":0.90600000000000003},"min":{"1min":0.65600000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.1000000000000001,"5min":1.282,"15min":1.282},"last":1.0509999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.91600000000000004,"15min":0.91200000000000003},"min":{"1min":0.68200000000000005,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.879,"5min":0.874,"15min":0.88200000000000001},"min":{"1min":0.69499999999999995,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.079,"5min":1.216,"15min":1.216},"last":0.83599999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.92600000000000005,"15min":0.93100000000000005},"min":{"1min":0.64900000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.0169999999999999,"5min":0.95199999999999996,"15min":0.93899999999999995},"min":{"1min":0.82799999999999996,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.27,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.86699999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.93700000000000006,"15min":0.95799999999999996},"min":{"1min":0.61699999999999999,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":1},{"interface":"front","average":{"1min":1.03,"5min":0.98699999999999999,"15min":0.97099999999999997},"min":{"1min":0.76000000000000001,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.65700000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":1.0049999999999999,"15min":1.0309999999999999},"min":{"1min":0.69999999999999996,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.226,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.748},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.0609999999999999,"15min":1.091},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.2110000000000001,"5min":1.371,"15min":1.371},"last":0.94699999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.0700000000000001,"15min":1.0609999999999999},"min":{"1min":0.90100000000000002,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.175,"15min":1.1819999999999999},"min":{"1min":0.95699999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":1.548,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.1180000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509491,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297896,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073944,"statfs":{"total":96636764160,"available":96331718656,"internally_reserved":0,"allocated":552960,"data_stored":232065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.83299999999999996,"15min":0.81200000000000006},"min":{"1min":0.58099999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.204,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.1799999999999999},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85199999999999998,"15min":0.84199999999999997},"min":{"1min":0.64200000000000002,"5min":0.501,"15min":0.501},"max":{"1min":1.0820000000000001,"5min":2.0329999999999999,"15min":2.0329999999999999},"last":0.80200000000000005}]},{"osd":1,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.86399999999999999,"15min":0.84399999999999997},"min":{"1min":0.64200000000000002,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.2170000000000001,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.95799999999999996,"15min":0.98599999999999999},"min":{"1min":0.71799999999999997,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.1040000000000001,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":1.0529999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.92700000000000005,"15min":0.95399999999999996},"min":{"1min":0.69599999999999995,"5min":0.621,"15min":0.621},"max":{"1min":1.0589999999999999,"5min":1.726,"15min":1.726},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.92700000000000005,"15min":0.91700000000000004},"min":{"1min":0.69099999999999995,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1930000000000001,"5min":1.367,"15min":1.367},"last":0.746}]},{"osd":3,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.87,"15min":0.879},"min":{"1min":0.69299999999999995,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.0089999999999999,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":1},{"interface":"front","average":{"1min":0.86899999999999999,"5min":1.0069999999999999,"15min":1.05},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.173,"5min":1.653,"15min":1.653},"last":1.206}]},{"osd":5,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.91500000000000004,"15min":0.92900000000000005},"min":{"1min":0.60899999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.214,"5min":1.3,"15min":1.3},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.995,"15min":1.0329999999999999},"min":{"1min":0.64500000000000002,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.194,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.137}]},{"osd":6,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":1.069,"15min":1.097},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.2370000000000001,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.115},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.107,"15min":1.1140000000000001},"min":{"1min":0.77000000000000002,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.5109999999999999,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":1.2470000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:25:14 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.0449999999999999,"15min":1.0600000000000001},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.167,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.085},{"interface":"front","average":{"1min":1.071,"5min":1.2070000000000001,"15min":1.2450000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.542,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":1.331}]}]},{"osd":3,"up_from":15,"seq":64424509491,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297900,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073940,"statfs":{"total":96636764160,"available":96331714560,"internally_reserved":0,"allocated":552960,"data_stored":232065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63300000000000001,"15min":0.64900000000000002},"min":{"1min":0.47299999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.77700000000000002,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.76700000000000002,"15min":0.754},"min":{"1min":0.66600000000000004,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.006,"5min":1.159,"15min":1.159},"last":0.94399999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.70299999999999996,"15min":0.68700000000000006},"min":{"1min":0.51700000000000002,"5min":0.443,"15min":0.443},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.81399999999999995,"15min":0.83099999999999996},"min":{"1min":0.54400000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0129999999999999,"5min":1.381,"15min":1.381},"last":0.84199999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.70299999999999996,"15min":0.69699999999999995},"min":{"1min":0.59199999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.873,"5min":0.876,"15min":0.88200000000000001},"min":{"1min":0.60999999999999999,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0189999999999999,"5min":1.45,"15min":1.45},"last":0.91900000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":0.93100000000000005,"15min":0.91100000000000003},"min":{"1min":0.85999999999999999,"5min":0.63,"15min":0.63},"max":{"1min":1.3100000000000001,"5min":1.526,"15min":1.526},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97499999999999998,"15min":0.98699999999999999},"min":{"1min":0.77700000000000002,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.306,"5min":2.04,"15min":2.04},"last":0.80900000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":1.006,"15min":1.0129999999999999},"min":{"1min":0.74099999999999999,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.272,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.034,"5min":1.0449999999999999,"15min":1.054},"min":{"1min":0.85599999999999998,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.2529999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.147}]},{"osd":6,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.093,"15min":1.1060000000000001},"min":{"1min":0.85599999999999998,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.248,"5min":1.577,"15min":1.577},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.081,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.97699999999999998,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.2629999999999999,"5min":1.448,"15min":1.448},"last":1.1719999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.0920000000000001,"15min":1.0880000000000001},"min":{"1min":0.94999999999999996,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.3620000000000001,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.226},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.131,"15min":1.125},"min":{"1min":0.90400000000000003,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.6799999999999999,"5min":2.109,"15min":2.109},"last":1.0349999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509491,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297896,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073944,"statfs":{"total":96636764160,"available":96331718656,"internally_reserved":0,"allocated":552960,"data_stored":232065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.62,"15min":0.627},"min":{"1min":0.40699999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90200000000000002,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68799999999999994,"15min":0.67900000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.68700000000000006}]},{"osd":1,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.747,"15min":0.73299999999999998},"min":{"1min":0.55000000000000004,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.77100000000000002,"15min":0.75600000000000001},"min":{"1min":0.52000000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.83199999999999996}]},{"osd":3,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.752,"15min":0.746},"min":{"1min":0.55900000000000005,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0609999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.80800000000000005,"15min":0.81000000000000005},"min":{"1min":0.48099999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.3660000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.79700000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.94899999999999995,"15min":0.94799999999999995},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.2030000000000001,"5min":1.391,"15min":1.391},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.96299999999999997,"5min":1.0449999999999999,"15min":1.073},"min":{"1min":0.745,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.2370000000000001,"5min":1.974,"15min":1.974},"last":0.94299999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0820000000000001,"15min":1.1140000000000001},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.3280000000000001,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":1.087},{"interface":"front","average":{"1min":0.999,"5min":1.0249999999999999,"15min":1.026},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.274,"5min":1.296,"15min":1.296},"last":0.88900000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.087,"15min":1.111},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.3080000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":1.139},{"interface":"front","average":{"1min":1.079,"5min":1.1040000000000001,"15min":1.1259999999999999},"min":{"1min":0.76100000000000001,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.284,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.98199999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.141,"15min":1.165},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.3819999999999999,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":1.165},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.1279999999999999,"15min":1.1240000000000001},"min":{"1min":0.73199999999999998,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.411,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.0109999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509492,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298472,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073368,"statfs":{"total":96636764160,"available":96331128832,"internally_reserved":0,"allocated":1146880,"data_stored":822433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66000000000000003,"15min":0.67500000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.137,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.69399999999999995,"15min":0.68400000000000005},"min":{"1min":0.502,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.96799999999999997,"5min":1.016,"15min":1.016},"last":0.625}]},{"osd":2,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.72599999999999998,"15min":0.74199999999999999},"min":{"1min":0.55000000000000004,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.1419999999999999,"5min":1.194,"15min":1.194},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.79800000000000004,"15min":0.79200000000000004},"min":{"1min":0.60799999999999998,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.083,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.83899999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.86599999999999999,"15min":0.879},"min":{"1min":0.63200000000000001,"5min":0.63,"15min":0.63},"max":{"1min":1.129,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.86499999999999999,"15min":0.85099999999999998},"min":{"1min":0.624,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.72699999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.97699999999999998,"15min":0.97199999999999998},"min":{"1min":0.78900000000000003,"5min":0.746,"15min":0.746},"max":{"1min":1.1699999999999999,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.0429999999999999,"15min":1.069},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.165,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.79000000000000004}]},{"osd":5,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.018,"15min":1.024},"min":{"1min":0.79000000000000004,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.248,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.872},{"interface":"front","average":{"1min":1.081,"5min":1.1419999999999999,"15min":1.1679999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.272,"5min":1.893,"15min":1.893},"last":1.107}]},{"osd":6,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.123,"15min":1.129},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.304,"5min":1.964,"15min":1.964},"last":1.242},{"interface":"front","average":{"1min":1.091,"5min":1.133,"15min":1.145},"min":{"1min":0.83399999999999996,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.282,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.081}]},{"osd":7,"last update":"Sat Aug 17 02:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.1859999999999999,"15min":1.194},"min":{"1min":0.96499999999999997,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.478,"5min":1.649,"15min":1.649},"last":1.27},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.179,"15min":1.179},"min":{"1min":0.92000000000000004,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.3819999999999999,"5min":1.5,"15min":1.5},"last":1.173}]}]},{"osd":0,"up_from":15,"seq":64424509491,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297896,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073944,"statfs":{"total":96636764160,"available":96331718656,"internally_reserved":0,"allocated":552960,"data_stored":232065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:25:17 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.63900000000000001,"15min":0.63500000000000001},"min":{"1min":0.50800000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.97799999999999998,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71499999999999997,"15min":0.70299999999999996},"min":{"1min":0.56599999999999995,"5min":0.318,"15min":0.318},"max":{"1min":0.999,"5min":1.498,"15min":1.498},"last":0.64800000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:25:17 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.72599999999999998,"15min":0.69799999999999995},"min":{"1min":0.53900000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.71099999999999997,"15min":0.68100000000000005},"min":{"1min":0.56000000000000005,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.73399999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:25:17 2024","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.878,"15min":0.90100000000000002},"min":{"1min":0.56599999999999995,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.2110000000000001,"5min":5.0270000000000001,"15min":5.0270000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81200000000000006,"15min":0.80200000000000005},"min":{"1min":0.61099999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":1.0109999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:25:17 2024","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.98099999999999998,"15min":0.97499999999999998},"min":{"1min":0.80600000000000005,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.26,"5min":2.633,"15min":2.633},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.94599999999999995,"5min":1.099,"15min":1.169},"min":{"1min":0.746,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.141,"5min":5.0700000000000003,"15min":5.0700000000000003},"last":1.1359999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:25:17 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.048,"15min":1.032},"min":{"1min":0.80000000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.365,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.026,"5min":1.0620000000000001,"15min":1.0600000000000001},"min":{"1min":0.79500000000000004,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.333,"5min":1.915,"15min":1.915},"last":0.98399999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:25:17 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.1910000000000001,"15min":1.262},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.347,"5min":5.133,"15min":5.133},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.85499999999999998,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.323,"5min":1.702,"15min":1.702},"last":1.3100000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:25:17 2024","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.145,"15min":1.137},"min":{"1min":0.76600000000000001,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.4419999999999999,"5min":2.3759999999999999,"15min":2.3759999999999999},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.254,"15min":1.3120000000000001},"min":{"1min":0.88100000000000001,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.3819999999999999,"5min":5.101,"15min":5.101},"last":1.2470000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542196,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302060,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069780,"statfs":{"total":96636764160,"available":96327454720,"internally_reserved":0,"allocated":552960,"data_stored":232065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.90800000000000003,"15min":0.89600000000000002},"min":{"1min":0.64500000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.284,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.86899999999999999,"15min":0.84199999999999997},"min":{"1min":0.628,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.2370000000000001,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.93200000000000005}]},{"osd":1,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.92800000000000005,"15min":0.94799999999999995},"min":{"1min":0.66300000000000003,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.097,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.95099999999999996,"15min":0.97899999999999998},"min":{"1min":0.61499999999999999,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.2529999999999999,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.90000000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.97999999999999998,"15min":1.016},"min":{"1min":0.65600000000000003,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.23,"5min":1.377,"15min":1.377},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.94799999999999995,"15min":0.92000000000000004},"min":{"1min":0.74299999999999999,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.323,"5min":1.635,"15min":1.635},"last":0.76600000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":1.024,"15min":1.018},"min":{"1min":0.65700000000000003,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.23,"5min":1.772,"15min":1.772},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0349999999999999,"15min":1.052},"min":{"1min":0.77900000000000003,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.196,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.873}]},{"osd":4,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.95699999999999996,"15min":0.96099999999999997},"min":{"1min":0.65100000000000002,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.198,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.0720000000000001,"15min":1.0860000000000001},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.3680000000000001,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.1120000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":1.069,"15min":1.127},"min":{"1min":0.69299999999999995,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.2130000000000001,"5min":2.2759999999999998,"15min":2.2759999999999998},"last":1.137},{"interface":"front","average":{"1min":1.075,"5min":1.1659999999999999,"15min":1.202},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.409,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.079}]},{"osd":7,"last update":"Sat Aug 17 02:25:15 2024","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.1930000000000001,"15min":1.2110000000000001},"min":{"1min":0.78700000000000003,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.365,"5min":2.5059999999999998,"15min":2.5059999999999998},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.218,"15min":1.268},"min":{"1min":0.84499999999999997,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.306,"5min":2.5779999999999998,"15min":2.5779999999999998},"last":1.272}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:26:06.698 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-08-17T02:26:06.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.800+0000 7f5e4a2e0700 1 Processor -- start 2024-08-17T02:26:06.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.800+0000 7f5e4a2e0700 1 -- start start 2024-08-17T02:26:06.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.804+0000 7f5e4a2e0700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f5e4406e810 0x7f5e4406ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.804+0000 7f5e4a2e0700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e4415ad40 0x7f5e440b0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.804+0000 7f5e4a2e0700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5e4415b1a0 0x7f5e440b1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.804+0000 7f5e4a2e0700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e440b2b20 con 0x7f5e4406e810 2024-08-17T02:26:06.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.804+0000 7f5e4a2e0700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e4415bbe0 con 0x7f5e4415b1a0 2024-08-17T02:26:06.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.804+0000 7f5e4a2e0700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4406f120 con 0x7f5e4415ad40 2024-08-17T02:26:06.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.804+0000 7f5e43fff700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f5e4406e810 0x7f5e4406ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.804+0000 7f5e43fff700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f5e4406e810 0x7f5e4406ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:58810/0 (socket says 172.21.15.104:58810) 2024-08-17T02:26:06.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.804+0000 7f5e43fff700 1 -- 172.21.15.104:0/4001871892 learned_addr learned my addr 172.21.15.104:0/4001871892 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:26:06.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.804+0000 7f5e4887d700 1 --2- 172.21.15.104:0/4001871892 >> v2:172.21.15.117:3300/0 conn(0x7f5e4415b1a0 0x7f5e440b1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.804+0000 7f5e3b7fe700 1 --2- 172.21.15.104:0/4001871892 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e4415ad40 0x7f5e440b0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.804+0000 7f5e43fff700 1 -- 172.21.15.104:0/4001871892 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e4415ad40 msgr2=0x7f5e440b0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:06.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.804+0000 7f5e43fff700 1 --2- 172.21.15.104:0/4001871892 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e4415ad40 0x7f5e440b0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.804+0000 7f5e43fff700 1 -- 172.21.15.104:0/4001871892 >> v2:172.21.15.117:3300/0 conn(0x7f5e4415b1a0 msgr2=0x7f5e440b1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:06.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.804+0000 7f5e43fff700 1 --2- 172.21.15.104:0/4001871892 >> v2:172.21.15.117:3300/0 conn(0x7f5e4415b1a0 0x7f5e440b1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.804+0000 7f5e43fff700 1 -- 172.21.15.104:0/4001871892 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e4415b620 con 0x7f5e4406e810 2024-08-17T02:26:06.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.804+0000 7f5e4887d700 1 --2- 172.21.15.104:0/4001871892 >> v2:172.21.15.117:3300/0 conn(0x7f5e4415b1a0 0x7f5e440b1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:06.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.804+0000 7f5e43fff700 1 --2- 172.21.15.104:0/4001871892 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e4406e810 0x7f5e4406ebe0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5e440ac9c0 tx=0x7f5e34009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76b0962dabe6b54a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:06.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.804+0000 7f5e437fe700 1 -- 172.21.15.104:0/4001871892 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3400b640 con 0x7f5e4406e810 2024-08-17T02:26:06.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.804+0000 7f5e437fe700 1 -- 172.21.15.104:0/4001871892 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3400b7a0 con 0x7f5e4406e810 2024-08-17T02:26:06.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.804+0000 7f5e437fe700 1 -- 172.21.15.104:0/4001871892 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3400bb60 con 0x7f5e4406e810 2024-08-17T02:26:06.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.804+0000 7f5e4a2e0700 1 -- 172.21.15.104:0/4001871892 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e4406e810 msgr2=0x7f5e4406ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.804+0000 7f5e4a2e0700 1 --2- 172.21.15.104:0/4001871892 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e4406e810 0x7f5e4406ebe0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5e440ac9c0 tx=0x7f5e34009250 comp rx=0 tx=0).stop 2024-08-17T02:26:06.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.804+0000 7f5e4a2e0700 1 -- 172.21.15.104:0/4001871892 shutdown_connections 2024-08-17T02:26:06.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.804+0000 7f5e4a2e0700 1 --2- 172.21.15.104:0/4001871892 >> v2:172.21.15.117:3300/0 conn(0x7f5e4415b1a0 0x7f5e440b1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.804+0000 7f5e4a2e0700 1 --2- 172.21.15.104:0/4001871892 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e4415ad40 0x7f5e440b0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.804+0000 7f5e4a2e0700 1 --2- 172.21.15.104:0/4001871892 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e4406e810 0x7f5e4406ebe0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.804+0000 7f5e4a2e0700 1 -- 172.21.15.104:0/4001871892 >> 172.21.15.104:0/4001871892 conn(0x7f5e440ca470 msgr2=0x7f5e4406e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:06.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.804+0000 7f5e4a2e0700 1 -- 172.21.15.104:0/4001871892 shutdown_connections 2024-08-17T02:26:06.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.804+0000 7f5e4a2e0700 1 -- 172.21.15.104:0/4001871892 wait complete. 2024-08-17T02:26:06.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.808+0000 7f5e4a2e0700 1 Processor -- start 2024-08-17T02:26:06.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.808+0000 7f5e4a2e0700 1 -- start start 2024-08-17T02:26:06.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.808+0000 7f5e4a2e0700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e4406e810 0x7f5e440c4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.808+0000 7f5e4a2e0700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e4415ad40 0x7f5e441473e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.808+0000 7f5e4a2e0700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e440c6cc0 0x7f5e44159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.808+0000 7f5e4a2e0700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e44147920 con 0x7f5e4415ad40 2024-08-17T02:26:06.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.808+0000 7f5e4a2e0700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e440c6220 con 0x7f5e4406e810 2024-08-17T02:26:06.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.808+0000 7f5e4a2e0700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4415d6f0 con 0x7f5e440c6cc0 2024-08-17T02:26:06.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.808+0000 7f5e3b7fe700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e4415ad40 0x7f5e441473e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.808+0000 7f5e3b7fe700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e4415ad40 0x7f5e441473e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:58816/0 (socket says 172.21.15.104:58816) 2024-08-17T02:26:06.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.808+0000 7f5e3b7fe700 1 -- 172.21.15.104:0/2252001590 learned_addr learned my addr 172.21.15.104:0/2252001590 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:26:06.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.808+0000 7f5e43fff700 1 --2- 172.21.15.104:0/2252001590 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e4406e810 0x7f5e440c4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.808+0000 7f5e4887d700 1 --2- 172.21.15.104:0/2252001590 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e440c6cc0 0x7f5e44159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.808+0000 7f5e3b7fe700 1 -- 172.21.15.104:0/2252001590 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e440c6cc0 msgr2=0x7f5e44159840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.808+0000 7f5e3b7fe700 1 --2- 172.21.15.104:0/2252001590 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e440c6cc0 0x7f5e44159840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.808+0000 7f5e3b7fe700 1 -- 172.21.15.104:0/2252001590 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e4406e810 msgr2=0x7f5e440c4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.808+0000 7f5e3b7fe700 1 --2- 172.21.15.104:0/2252001590 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e4406e810 0x7f5e440c4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.808+0000 7f5e3b7fe700 1 -- 172.21.15.104:0/2252001590 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e3c009a20 con 0x7f5e4415ad40 2024-08-17T02:26:06.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.808+0000 7f5e3b7fe700 1 --2- 172.21.15.104:0/2252001590 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e4415ad40 0x7f5e441473e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c00ece0 tx=0x7f5e2c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:06.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.808+0000 7f5e40ff9700 1 -- 172.21.15.104:0/2252001590 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c00ca60 con 0x7f5e4415ad40 2024-08-17T02:26:06.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.808+0000 7f5e40ff9700 1 -- 172.21.15.104:0/2252001590 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2c00cbe0 con 0x7f5e4415ad40 2024-08-17T02:26:06.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.808+0000 7f5e40ff9700 1 -- 172.21.15.104:0/2252001590 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c013470 con 0x7f5e4415ad40 2024-08-17T02:26:06.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.808+0000 7f5e4a2e0700 1 -- 172.21.15.104:0/2252001590 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e340094f0 con 0x7f5e4415ad40 2024-08-17T02:26:06.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.808+0000 7f5e4a2e0700 1 -- 172.21.15.104:0/2252001590 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e440c5610 con 0x7f5e4415ad40 2024-08-17T02:26:06.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.808+0000 7f5e4a2e0700 1 -- 172.21.15.104:0/2252001590 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e4415d880 con 0x7f5e4415ad40 2024-08-17T02:26:06.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.812+0000 7f5e40ff9700 1 -- 172.21.15.104:0/2252001590 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f5e2c013860 con 0x7f5e4415ad40 2024-08-17T02:26:06.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.812+0000 7f5e40ff9700 1 --2- 172.21.15.104:0/2252001590 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f5e24060860 0x7f5e24062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.812+0000 7f5e40ff9700 1 -- 172.21.15.104:0/2252001590 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f5e2c07ce40 con 0x7f5e4415ad40 2024-08-17T02:26:06.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.812+0000 7f5e43fff700 1 --2- 172.21.15.104:0/2252001590 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f5e24060860 0x7f5e24062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.812+0000 7f5e43fff700 1 --2- 172.21.15.104:0/2252001590 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f5e24060860 0x7f5e24062d10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5e440ac9c0 tx=0x7f5e34017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:06.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.820+0000 7f5e40ff9700 1 -- 172.21.15.104:0/2252001590 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f5e4415d880 con 0x7f5e4415ad40 2024-08-17T02:26:06.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.984+0000 7f5e4a2e0700 1 -- 172.21.15.104:0/2252001590 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f5e44064630 con 0x7f5e4415ad40 2024-08-17T02:26:06.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.988+0000 7f5e40ff9700 1 -- 172.21.15.104:0/2252001590 <== mon.0 v2:172.21.15.104:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5e2c04d490 con 0x7f5e4415ad40 2024-08-17T02:26:06.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.988+0000 7f5e40ff9700 1 -- 172.21.15.104:0/2252001590 <== mon.0 v2:172.21.15.104:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7f5e44064630 con 0x7f5e4415ad40 2024-08-17T02:26:06.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.992+0000 7f5e4a2e0700 1 -- 172.21.15.104:0/2252001590 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f5e24060860 msgr2=0x7f5e24062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.992+0000 7f5e4a2e0700 1 --2- 172.21.15.104:0/2252001590 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f5e24060860 0x7f5e24062d10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5e440ac9c0 tx=0x7f5e34017000 comp rx=0 tx=0).stop 2024-08-17T02:26:06.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.992+0000 7f5e4a2e0700 1 -- 172.21.15.104:0/2252001590 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e4415ad40 msgr2=0x7f5e441473e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.992+0000 7f5e4a2e0700 1 --2- 172.21.15.104:0/2252001590 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e4415ad40 0x7f5e441473e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c00ece0 tx=0x7f5e2c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.992+0000 7f5e4a2e0700 1 -- 172.21.15.104:0/2252001590 shutdown_connections 2024-08-17T02:26:06.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.992+0000 7f5e4a2e0700 1 --2- 172.21.15.104:0/2252001590 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f5e24060860 0x7f5e24062d10 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.992+0000 7f5e4a2e0700 1 --2- 172.21.15.104:0/2252001590 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e440c6cc0 0x7f5e44159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.992+0000 7f5e4a2e0700 1 --2- 172.21.15.104:0/2252001590 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e4415ad40 0x7f5e441473e0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.992+0000 7f5e4a2e0700 1 --2- 172.21.15.104:0/2252001590 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e4406e810 0x7f5e440c4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.992+0000 7f5e4a2e0700 1 -- 172.21.15.104:0/2252001590 >> 172.21.15.104:0/2252001590 conn(0x7f5e440ca470 msgr2=0x7f5e44154240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:06.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.992+0000 7f5e4a2e0700 1 -- 172.21.15.104:0/2252001590 shutdown_connections 2024-08-17T02:26:06.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:06.992+0000 7f5e4a2e0700 1 -- 172.21.15.104:0/2252001590 wait complete. 2024-08-17T02:26:07.010 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:26:07.011 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:07.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.116+0000 7f7f902c6700 1 Processor -- start 2024-08-17T02:26:07.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.116+0000 7f7f902c6700 1 -- start start 2024-08-17T02:26:07.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.120+0000 7f7f902c6700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f88156f80 0x7f7f880ae3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.120+0000 7f7f902c6700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7f880ace80 0x7f7f88157350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.120+0000 7f7f902c6700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7f88157890 0x7f7f880aab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.120+0000 7f7f902c6700 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f880adf50 con 0x7f7f880ace80 2024-08-17T02:26:07.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.120+0000 7f7f902c6700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f880ae920 con 0x7f7f88157890 2024-08-17T02:26:07.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.120+0000 7f7f902c6700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f880ad340 con 0x7f7f88156f80 2024-08-17T02:26:07.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.120+0000 7f7f8d861700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7f880ace80 0x7f7f88157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.120+0000 7f7f8d861700 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7f880ace80 0x7f7f88157350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56148/0 (socket says 172.21.15.104:56148) 2024-08-17T02:26:07.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.120+0000 7f7f8d861700 1 -- 172.21.15.104:0/1897414611 learned_addr learned my addr 172.21.15.104:0/1897414611 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:26:07.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.120+0000 7f7f8e062700 1 --2- 172.21.15.104:0/1897414611 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f88156f80 0x7f7f880ae3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.120+0000 7f7f8e863700 1 --2- 172.21.15.104:0/1897414611 >> v2:172.21.15.117:3300/0 conn(0x7f7f88157890 0x7f7f880aab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.120+0000 7f7f8d861700 1 -- 172.21.15.104:0/1897414611 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f88156f80 msgr2=0x7f7f880ae3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:07.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.120+0000 7f7f8d861700 1 --2- 172.21.15.104:0/1897414611 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f88156f80 0x7f7f880ae3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.120+0000 7f7f8d861700 1 -- 172.21.15.104:0/1897414611 >> v2:172.21.15.117:3300/0 conn(0x7f7f88157890 msgr2=0x7f7f880aab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:07.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.120+0000 7f7f8d861700 1 --2- 172.21.15.104:0/1897414611 >> v2:172.21.15.117:3300/0 conn(0x7f7f88157890 0x7f7f880aab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.120+0000 7f7f8d861700 1 -- 172.21.15.104:0/1897414611 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f880ad620 con 0x7f7f880ace80 2024-08-17T02:26:07.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.120+0000 7f7f8d861700 1 --2- 172.21.15.104:0/1897414611 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7f880ace80 0x7f7f88157350 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f7f880adec0 tx=0x7f7f84009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5289d53a63f5edac server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:07.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.120+0000 7f7f8d060700 1 -- 172.21.15.104:0/1897414611 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8400e070 con 0x7f7f880ace80 2024-08-17T02:26:07.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.120+0000 7f7f8d060700 1 -- 172.21.15.104:0/1897414611 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7f8400ba50 con 0x7f7f880ace80 2024-08-17T02:26:07.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.120+0000 7f7f8d060700 1 -- 172.21.15.104:0/1897414611 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f840092e0 con 0x7f7f880ace80 2024-08-17T02:26:07.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.120+0000 7f7f902c6700 1 -- 172.21.15.104:0/1897414611 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7f880ace80 msgr2=0x7f7f88157350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.120+0000 7f7f902c6700 1 --2- 172.21.15.104:0/1897414611 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7f880ace80 0x7f7f88157350 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f7f880adec0 tx=0x7f7f84009840 comp rx=0 tx=0).stop 2024-08-17T02:26:07.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.120+0000 7f7f902c6700 1 -- 172.21.15.104:0/1897414611 shutdown_connections 2024-08-17T02:26:07.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.120+0000 7f7f902c6700 1 --2- 172.21.15.104:0/1897414611 >> v2:172.21.15.117:3300/0 conn(0x7f7f88157890 0x7f7f880aab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.120+0000 7f7f902c6700 1 --2- 172.21.15.104:0/1897414611 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7f880ace80 0x7f7f88157350 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.120+0000 7f7f902c6700 1 --2- 172.21.15.104:0/1897414611 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f88156f80 0x7f7f880ae3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.120+0000 7f7f902c6700 1 -- 172.21.15.104:0/1897414611 >> 172.21.15.104:0/1897414611 conn(0x7f7f88066e00 msgr2=0x7f7f88067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:07.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.120+0000 7f7f902c6700 1 -- 172.21.15.104:0/1897414611 shutdown_connections 2024-08-17T02:26:07.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.120+0000 7f7f902c6700 1 -- 172.21.15.104:0/1897414611 wait complete. 2024-08-17T02:26:07.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.124+0000 7f7f902c6700 1 Processor -- start 2024-08-17T02:26:07.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.124+0000 7f7f902c6700 1 -- start start 2024-08-17T02:26:07.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.124+0000 7f7f902c6700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f880ace80 0x7f7f880969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.124+0000 7f7f902c6700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f88156f80 0x7f7f8814ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.124+0000 7f7f902c6700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7f88157890 0x7f7f8814b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.124+0000 7f7f902c6700 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f88099d30 con 0x7f7f88157890 2024-08-17T02:26:07.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.124+0000 7f7f902c6700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f88152180 con 0x7f7f88156f80 2024-08-17T02:26:07.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.124+0000 7f7f902c6700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f88152740 con 0x7f7f880ace80 2024-08-17T02:26:07.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.124+0000 7f7f8e863700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7f88157890 0x7f7f8814b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.124+0000 7f7f8e863700 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7f88157890 0x7f7f8814b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56158/0 (socket says 172.21.15.104:56158) 2024-08-17T02:26:07.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.124+0000 7f7f8e863700 1 -- 172.21.15.104:0/414424367 learned_addr learned my addr 172.21.15.104:0/414424367 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-08-17T02:26:07.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.124+0000 7f7f8e062700 1 --2- 172.21.15.104:0/414424367 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f880ace80 0x7f7f880969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.124+0000 7f7f8d861700 1 --2- 172.21.15.104:0/414424367 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f88156f80 0x7f7f8814ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.124+0000 7f7f8e863700 1 -- 172.21.15.104:0/414424367 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f880ace80 msgr2=0x7f7f880969f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.124+0000 7f7f8e863700 1 --2- 172.21.15.104:0/414424367 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f880ace80 0x7f7f880969f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.124+0000 7f7f8e863700 1 -- 172.21.15.104:0/414424367 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f88156f80 msgr2=0x7f7f8814ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.124+0000 7f7f8e863700 1 --2- 172.21.15.104:0/414424367 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f88156f80 0x7f7f8814ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.124+0000 7f7f8e863700 1 -- 172.21.15.104:0/414424367 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f84009ae0 con 0x7f7f88157890 2024-08-17T02:26:07.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.124+0000 7f7f8e863700 1 --2- 172.21.15.104:0/414424367 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7f88157890 0x7f7f8814b2e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f7f8000d8c0 tx=0x7f7f80008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:07.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.124+0000 7f7f7e7fc700 1 -- 172.21.15.104:0/414424367 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f800125f0 con 0x7f7f88157890 2024-08-17T02:26:07.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.124+0000 7f7f7e7fc700 1 -- 172.21.15.104:0/414424367 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7f80012750 con 0x7f7f88157890 2024-08-17T02:26:07.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.124+0000 7f7f902c6700 1 -- 172.21.15.104:0/414424367 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f880975a0 con 0x7f7f88157890 2024-08-17T02:26:07.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.124+0000 7f7f7e7fc700 1 -- 172.21.15.104:0/414424367 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f80012b30 con 0x7f7f88157890 2024-08-17T02:26:07.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.124+0000 7f7f902c6700 1 -- 172.21.15.104:0/414424367 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f881523d0 con 0x7f7f88157890 2024-08-17T02:26:07.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.128+0000 7f7f902c6700 1 -- 172.21.15.104:0/414424367 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f881528b0 con 0x7f7f88157890 2024-08-17T02:26:07.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.128+0000 7f7f7e7fc700 1 -- 172.21.15.104:0/414424367 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7f80013480 con 0x7f7f88157890 2024-08-17T02:26:07.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.128+0000 7f7f7e7fc700 1 --2- 172.21.15.104:0/414424367 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7f6c060890 0x7f7f6c062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.128+0000 7f7f7e7fc700 1 -- 172.21.15.104:0/414424367 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f7f8007cb70 con 0x7f7f88157890 2024-08-17T02:26:07.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.128+0000 7f7f8e062700 1 --2- 172.21.15.104:0/414424367 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7f6c060890 0x7f7f6c062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.128+0000 7f7f8e062700 1 --2- 172.21.15.104:0/414424367 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7f6c060890 0x7f7f6c062d40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7f78006fd0 tx=0x7f7f78008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:07.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.132+0000 7f7f7e7fc700 1 -- 172.21.15.104:0/414424367 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f7f8004d2e0 con 0x7f7f88157890 2024-08-17T02:26:07.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.328+0000 7f7f902c6700 1 -- 172.21.15.104:0/414424367 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7f880645c0 con 0x7f7f88157890 2024-08-17T02:26:07.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.332+0000 7f7f7e7fc700 1 -- 172.21.15.104:0/414424367 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+3538 (secure 0 0 0) 0x7f7f80050900 con 0x7f7f88157890 2024-08-17T02:26:07.335 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-08-17T02:26:07.335 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":22,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/3848434798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3848434798},{"type":"v1","addr":"172.21.15.117:6836","nonce":3848434798}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4894,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1461239637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1461239637},{"type":"v1","addr":"172.21.15.117:6837","nonce":1461239637}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5328,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/3001967297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":3001967297},{"type":"v1","addr":"172.21.15.104:6835","nonce":3001967297}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5418,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/314127110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":314127110},{"type":"v1","addr":"172.21.15.104:6833","nonce":314127110}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[]} 2024-08-17T02:26:07.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.332+0000 7f7f902c6700 1 -- 172.21.15.104:0/414424367 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7f6c060890 msgr2=0x7f7f6c062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.332+0000 7f7f902c6700 1 --2- 172.21.15.104:0/414424367 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7f6c060890 0x7f7f6c062d40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7f78006fd0 tx=0x7f7f78008040 comp rx=0 tx=0).stop 2024-08-17T02:26:07.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.332+0000 7f7f902c6700 1 -- 172.21.15.104:0/414424367 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7f88157890 msgr2=0x7f7f8814b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.332+0000 7f7f902c6700 1 --2- 172.21.15.104:0/414424367 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7f88157890 0x7f7f8814b2e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f7f8000d8c0 tx=0x7f7f80008040 comp rx=0 tx=0).stop 2024-08-17T02:26:07.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.332+0000 7f7f902c6700 1 -- 172.21.15.104:0/414424367 shutdown_connections 2024-08-17T02:26:07.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.332+0000 7f7f902c6700 1 --2- 172.21.15.104:0/414424367 >> [v2:172.21.15.117:6832/24084,v1:172.21.15.117:6833/24084] conn(0x7f7f6c060890 0x7f7f6c062d40 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.332+0000 7f7f902c6700 1 --2- 172.21.15.104:0/414424367 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7f88157890 0x7f7f8814b2e0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.332+0000 7f7f902c6700 1 --2- 172.21.15.104:0/414424367 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f88156f80 0x7f7f8814ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.332+0000 7f7f902c6700 1 --2- 172.21.15.104:0/414424367 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f880ace80 0x7f7f880969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.332+0000 7f7f902c6700 1 -- 172.21.15.104:0/414424367 >> 172.21.15.104:0/414424367 conn(0x7f7f88066e00 msgr2=0x7f7f880a95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:07.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.332+0000 7f7f902c6700 1 -- 172.21.15.104:0/414424367 shutdown_connections 2024-08-17T02:26:07.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-08-17T02:26:07.332+0000 7f7f902c6700 1 -- 172.21.15.104:0/414424367 wait complete. 2024-08-17T02:26:07.339 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 22 2024-08-17T02:26:07.349 DEBUG:tasks.cephfs.filesystem:already dead... 2024-08-17T02:26:07.349 INFO:teuthology.misc:Shutting down mds daemons... 2024-08-17T02:26:07.349 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-17T02:26:07.349 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:26:07.364 INFO:tasks.ceph.mds.a:Stopped 2024-08-17T02:26:07.365 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-17T02:26:07.365 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:26:07.374 INFO:tasks.ceph.mds.c:Stopped 2024-08-17T02:26:07.375 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-17T02:26:07.375 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:26:07.391 INFO:tasks.ceph.mds.b:Stopped 2024-08-17T02:26:07.392 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-17T02:26:07.392 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:26:07.408 INFO:tasks.ceph.mds.d:Stopped 2024-08-17T02:26:07.409 INFO:teuthology.misc:Shutting down osd daemons... 2024-08-17T02:26:07.409 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-08-17T02:26:07.409 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:26:07.487 INFO:tasks.ceph.osd.0:Stopped 2024-08-17T02:26:07.487 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-08-17T02:26:07.487 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:26:07.576 INFO:tasks.ceph.osd.1:Stopped 2024-08-17T02:26:07.576 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-08-17T02:26:07.576 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:26:07.651 INFO:tasks.ceph.osd.2:Stopped 2024-08-17T02:26:07.651 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-08-17T02:26:07.651 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:26:07.749 INFO:tasks.ceph.osd.3:Stopped 2024-08-17T02:26:07.750 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-08-17T02:26:07.750 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:26:07.827 INFO:tasks.ceph.osd.4:Stopped 2024-08-17T02:26:07.828 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-08-17T02:26:07.828 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:26:07.916 INFO:tasks.ceph.osd.5:Stopped 2024-08-17T02:26:07.916 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-08-17T02:26:07.916 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:26:08.016 INFO:tasks.ceph.osd.6:Stopped 2024-08-17T02:26:08.017 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-08-17T02:26:08.017 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:26:08.103 INFO:tasks.ceph.osd.7:Stopped 2024-08-17T02:26:08.103 INFO:teuthology.misc:Shutting down mgr daemons... 2024-08-17T02:26:08.103 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-08-17T02:26:08.103 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:26:08.131 INFO:tasks.ceph.mgr.y:Stopped 2024-08-17T02:26:08.131 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-08-17T02:26:08.132 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:26:08.157 INFO:tasks.ceph.mgr.x:Stopped 2024-08-17T02:26:08.157 INFO:teuthology.misc:Shutting down mon daemons... 2024-08-17T02:26:08.157 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-17T02:26:08.157 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:26:08.177 INFO:tasks.ceph.mon.a:Stopped 2024-08-17T02:26:08.177 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-17T02:26:08.177 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:26:08.196 INFO:tasks.ceph.mon.b:Stopped 2024-08-17T02:26:08.196 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-08-17T02:26:08.196 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:26:08.254 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-08-17T02:26:08.254 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-08-17T02:26:08.255 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-08-17T02:26:08.255 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-08-17T02:26:08.255 INFO:tasks.ceph.mon.c:Stopped 2024-08-17T02:26:08.255 INFO:tasks.ceph:Checking cluster log for badness... 2024-08-17T02:26:08.255 DEBUG:teuthology.orchestra.run.smithi104:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-08-17T02:26:08.277 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi104.front.sepia.ceph.com 2024-08-17T02:26:08.277 DEBUG:teuthology.orchestra.run.smithi104:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-08-17T02:26:08.613 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi104.front.sepia.ceph.com 2024-08-17T02:26:08.613 DEBUG:teuthology.orchestra.run.smithi104:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-08-17T02:26:08.864 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi104.front.sepia.ceph.com 2024-08-17T02:26:08.864 DEBUG:teuthology.orchestra.run.smithi104:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-08-17T02:26:09.050 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi104.front.sepia.ceph.com 2024-08-17T02:26:09.051 DEBUG:teuthology.orchestra.run.smithi104:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-08-17T02:26:09.275 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi117.front.sepia.ceph.com 2024-08-17T02:26:09.276 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-08-17T02:26:09.537 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi117.front.sepia.ceph.com 2024-08-17T02:26:09.538 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-08-17T02:26:09.675 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi117.front.sepia.ceph.com 2024-08-17T02:26:09.675 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-08-17T02:26:09.809 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi117.front.sepia.ceph.com 2024-08-17T02:26:09.810 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-08-17T02:26:09.950 INFO:tasks.ceph:Archiving mon data... 2024-08-17T02:26:09.951 DEBUG:teuthology.misc:Transferring archived files from smithi104:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858240/data/mon.a.tgz 2024-08-17T02:26:09.951 DEBUG:teuthology.orchestra.run.smithi104:> mktemp 2024-08-17T02:26:09.958 INFO:teuthology.orchestra.run.smithi104.stdout:/tmp/tmp.sMa4C35JKk 2024-08-17T02:26:09.958 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.sMa4C35JKk 2024-08-17T02:26:10.080 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 0666 /tmp/tmp.sMa4C35JKk 2024-08-17T02:26:10.100 DEBUG:teuthology.orchestra.remote:smithi104:/tmp/tmp.sMa4C35JKk is 313KB 2024-08-17T02:26:10.161 DEBUG:teuthology.orchestra.run.smithi104:> rm -fr /tmp/tmp.sMa4C35JKk 2024-08-17T02:26:10.168 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858240/data/mon.b.tgz 2024-08-17T02:26:10.168 DEBUG:teuthology.orchestra.run.smithi117:> mktemp 2024-08-17T02:26:10.175 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.hjcf8iLlFo 2024-08-17T02:26:10.175 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.hjcf8iLlFo 2024-08-17T02:26:10.320 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.hjcf8iLlFo 2024-08-17T02:26:10.342 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.hjcf8iLlFo is 411KB 2024-08-17T02:26:10.404 DEBUG:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.hjcf8iLlFo 2024-08-17T02:26:10.410 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858240/data/mon.c.tgz 2024-08-17T02:26:10.411 DEBUG:teuthology.orchestra.run.smithi117:> mktemp 2024-08-17T02:26:10.417 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.8so9oUsGG2 2024-08-17T02:26:10.417 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.8so9oUsGG2 2024-08-17T02:26:10.561 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.8so9oUsGG2 2024-08-17T02:26:10.585 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.8so9oUsGG2 is 411KB 2024-08-17T02:26:10.647 DEBUG:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.8so9oUsGG2 2024-08-17T02:26:10.654 INFO:tasks.ceph:Cleaning ceph cluster... 2024-08-17T02:26:10.654 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-17T02:26:10.657 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-17T02:26:10.672 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-08-17T02:26:10.672 DEBUG:teuthology.orchestra.run.smithi104:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-08-17T02:26:10.675 DEBUG:teuthology.orchestra.run.smithi117:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-08-17T02:26:10.701 INFO:teuthology.orchestra.run.smithi117.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-08-17T02:26:10.701 INFO:teuthology.orchestra.run.smithi104.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-08-17T02:26:10.708 INFO:tasks.ceph:Archiving crash dumps... 2024-08-17T02:26:10.709 DEBUG:teuthology.misc:Transferring archived files from smithi104:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858240/remote/smithi104/crash 2024-08-17T02:26:10.710 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-17T02:26:10.765 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858240/remote/smithi117/crash 2024-08-17T02:26:10.766 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-17T02:26:10.782 INFO:tasks.ceph:Shutting down logrotate 2024-08-17T02:26:10.782 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:10.785 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:10.868 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:10.883 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:10.899 INFO:tasks.ceph:Compressing logs... 2024-08-17T02:26:10.899 DEBUG:teuthology.orchestra.run.smithi104:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-17T02:26:10.902 DEBUG:teuthology.orchestra.run.smithi117:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-17T02:26:10.917 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32401.log 2024-08-17T02:26:10.918 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24129.log 2024-08-17T02:26:10.918 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32401.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-08-17T02:26:10.919 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29994.log 2024-08-17T02:26:10.920 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32401.log.gz 2024-08-17T02:26:10.920 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.24129.log: /var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31980.log 2024-08-17T02:26:10.920 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.29994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33136.log 2024-08-17T02:26:10.920 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.29994.log.gz 2024-08-17T02:26:10.922 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31542.log 2024-08-17T02:26:10.922 INFO:teuthology.orchestra.run.smithi104.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.24129.log.gz 2024-08-17T02:26:10.923 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.31980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34091.log 2024-08-17T02:26:10.923 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.33136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34901.log 2024-08-17T02:26:10.923 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.34091.log: /var/log/ceph/ceph-client.admin.31542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34434.log 2024-08-17T02:26:10.923 INFO:teuthology.orchestra.run.smithi104.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31980.log.gz 2024-08-17T02:26:10.923 INFO:teuthology.orchestra.run.smithi104.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34091.log.gz 2024-08-17T02:26:10.923 INFO:teuthology.orchestra.run.smithi104.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.33136.log.gz 2024-08-17T02:26:10.923 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31240.log 2024-08-17T02:26:10.923 INFO:teuthology.orchestra.run.smithi104.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31542.log.gz 2024-08-17T02:26:10.924 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.34901.log: gzip /var/log/ceph/ceph-client.admin.34434.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.32563.log 2024-08-17T02:26:10.942 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24274.log 2024-08-17T02:26:10.942 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-08-17T02:26:10.943 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-08-17T02:26:10.943 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.24274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24196.log 2024-08-17T02:26:10.943 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-mds.d.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.24274.log.gz 2024-08-17T02:26:10.943 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-08-17T02:26:10.943 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-08-17T02:26:10.943 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.24196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.30169.log 2024-08-17T02:26:10.944 INFO:teuthology.orchestra.run.smithi117.stderr: 87.5%/var/log/ceph/ceph-osd.5.log: -- replaced with /var/log/ceph/ceph-client.admin.24196.log.gz 2024-08-17T02:26:10.944 INFO:teuthology.orchestra.run.smithi117.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-08-17T02:26:10.944 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-08-17T02:26:10.944 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-mgr.x.log: gzip /var/log/ceph/ceph-client.1.30169.log: -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-17T02:26:10.944 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.30007.log 2024-08-17T02:26:10.944 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-08-17T02:26:10.944 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.3.30007.log: 88.9% -- replaced with /var/log/ceph/ceph-client.3.30007.log.gz 2024-08-17T02:26:10.945 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24382.log 2024-08-17T02:26:10.945 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-osd.6.log: 95.4% 93.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-17T02:26:10.946 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24329.log 2024-08-17T02:26:10.946 INFO:teuthology.orchestra.run.smithi117.stderr: -- replaced with /var/log/ceph/ceph-client.1.30169.log.gz 2024-08-17T02:26:10.946 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-08-17T02:26:10.946 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.24382.log: /var/log/ceph/ceph-client.admin.24329.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.24382.log.gz 2024-08-17T02:26:10.946 INFO:teuthology.orchestra.run.smithi117.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.24329.log.gz 2024-08-17T02:26:10.946 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24301.log 2024-08-17T02:26:10.946 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24246.log 2024-08-17T02:26:10.947 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-mds.b.log: /var/log/ceph/ceph-client.admin.24301.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.24301.log.gz 2024-08-17T02:26:10.947 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-17T02:26:10.947 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.24246.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.24246.log.gz 2024-08-17T02:26:10.947 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24356.log 2024-08-17T02:26:10.947 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph.log: 91.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-17T02:26:10.947 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-08-17T02:26:10.947 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.24356.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.24356.log.gz 2024-08-17T02:26:10.947 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.29892.log 2024-08-17T02:26:10.951 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24221.log 2024-08-17T02:26:10.951 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.1.29892.log: 89.3% -- replaced with /var/log/ceph/ceph-client.1.29892.log.gz 2024-08-17T02:26:10.958 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-08-17T02:26:10.958 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.24221.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.24221.log.gz 2024-08-17T02:26:10.965 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-osd.7.log: 91.0% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-08-17T02:26:10.994 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.31240.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34434.log.gz 2024-08-17T02:26:10.995 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34847.log 2024-08-17T02:26:10.995 INFO:teuthology.orchestra.run.smithi104.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31240.log.gz 2024-08-17T02:26:10.995 INFO:teuthology.orchestra.run.smithi104.stderr:gzip 87.9%-5 --verbose -- /var/log/ceph/ceph-client.admin.32115.log -- replaced with /var/log/ceph/ceph-client.admin.34901.log.gz 2024-08-17T02:26:10.995 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-08-17T02:26:10.995 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32962.log 2024-08-17T02:26:10.995 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.34847.log: /var/log/ceph/ceph-client.admin.32115.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-08-17T02:26:10.995 INFO:teuthology.orchestra.run.smithi104.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.32563.log.gz 2024-08-17T02:26:10.995 INFO:teuthology.orchestra.run.smithi104.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32115.log.gz 2024-08-17T02:26:10.996 INFO:teuthology.orchestra.run.smithi104.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34847.log.gz 2024-08-17T02:26:10.996 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35252.log 2024-08-17T02:26:10.996 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32962.log: /var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34172.log 2024-08-17T02:26:10.996 INFO:teuthology.orchestra.run.smithi104.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32962.log.gz 2024-08-17T02:26:10.996 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.35252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31076.log 2024-08-17T02:26:10.996 INFO:teuthology.orchestra.run.smithi104.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35252.log.gz 2024-08-17T02:26:10.996 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31352.log 2024-08-17T02:26:10.996 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.34172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34669.log 2024-08-17T02:26:10.997 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.31076.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34172.log.gz 2024-08-17T02:26:10.997 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34010.log 2024-08-17T02:26:10.997 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.31352.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31076.log.gz 2024-08-17T02:26:10.997 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34982.log 2024-08-17T02:26:10.997 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.34669.log: /var/log/ceph/ceph-client.admin.34010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35090.log 2024-08-17T02:26:10.997 INFO:teuthology.orchestra.run.smithi104.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34669.log.gz 2024-08-17T02:26:10.997 INFO:teuthology.orchestra.run.smithi104.stderr: 91.0%gzip -- replaced with /var/log/ceph/ceph-client.0.31352.log.gz 2024-08-17T02:26:10.998 INFO:teuthology.orchestra.run.smithi104.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.29855.log 2024-08-17T02:26:10.998 INFO:teuthology.orchestra.run.smithi104.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34010.log.gz 2024-08-17T02:26:10.998 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.34982.log: /var/log/ceph/ceph-client.admin.35090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34615.log 2024-08-17T02:26:10.998 INFO:teuthology.orchestra.run.smithi104.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34982.log.gz 2024-08-17T02:26:10.998 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-08-17T02:26:10.998 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.29855.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35090.log.gz 2024-08-17T02:26:10.998 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32034.log 2024-08-17T02:26:10.998 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.34615.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.29855.log.gz 2024-08-17T02:26:10.999 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30582.log 2024-08-17T02:26:10.999 INFO:teuthology.orchestra.run.smithi104.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34615.log.gz 2024-08-17T02:26:10.999 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30363.log 2024-08-17T02:26:10.999 INFO:teuthology.orchestra.run.smithi104.stderr: 88.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.32034.log.gz 2024-08-17T02:26:10.999 INFO:teuthology.orchestra.run.smithi104.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.34461.log 2024-08-17T02:26:10.999 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34955.log 2024-08-17T02:26:10.999 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30363.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.30582.log.gz 2024-08-17T02:26:10.999 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31184.log 2024-08-17T02:26:11.000 INFO:teuthology.orchestra.run.smithi104.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.30363.log.gz 2024-08-17T02:26:11.000 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.34461.log: /var/log/ceph/ceph-client.admin.34955.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34461.log.gz 2024-08-17T02:26:11.000 INFO:teuthology.orchestra.run.smithi104.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34955.log.gz 2024-08-17T02:26:11.000 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32455.log 2024-08-17T02:26:11.000 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.31184.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.31184.log.gz 2024-08-17T02:26:11.000 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35335.log 2024-08-17T02:26:11.000 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29882.log 2024-08-17T02:26:11.000 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33742.log 2024-08-17T02:26:11.001 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.35335.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.32455.log.gz 2024-08-17T02:26:11.001 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33244.log 2024-08-17T02:26:11.001 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.29882.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35335.log.gz 2024-08-17T02:26:11.001 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.33742.log: -- /var/log/ceph/ceph-client.admin.31845.log 2024-08-17T02:26:11.001 INFO:teuthology.orchestra.run.smithi104.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.29882.log.gz 2024-08-17T02:26:11.001 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.33244.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33742.log.gz 2024-08-17T02:26:11.001 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29799.log 2024-08-17T02:26:11.001 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 /var/log/ceph/ceph-client.admin.31845.log: --verbose -- /var/log/ceph/ceph-client.admin.34820.log 2024-08-17T02:26:11.002 INFO:teuthology.orchestra.run.smithi104.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33244.log.gz 2024-08-17T02:26:11.002 INFO:teuthology.orchestra.run.smithi104.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31845.log.gz 2024-08-17T02:26:11.002 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.29799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29734.log 2024-08-17T02:26:11.002 INFO:teuthology.orchestra.run.smithi104.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.29799.log.gz 2024-08-17T02:26:11.002 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.34820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32320.log 2024-08-17T02:26:11.002 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34820.log.gz 2024-08-17T02:26:11.002 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31791.log 2024-08-17T02:26:11.002 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.29734.log: gzip -5 /var/log/ceph/ceph-client.admin.32320.log: --verbose -- /var/log/ceph/ceph-client.admin.30364.log 2024-08-17T02:26:11.003 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.29734.log.gz 2024-08-17T02:26:11.003 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.31791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31602.log 2024-08-17T02:26:11.003 INFO:teuthology.orchestra.run.smithi104.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32320.log.gz 2024-08-17T02:26:11.003 INFO:teuthology.orchestra.run.smithi104.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31791.log.gz 2024-08-17T02:26:11.003 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30364.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.30364.log.gz 2024-08-17T02:26:11.003 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-08-17T02:26:11.003 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34118.log 2024-08-17T02:26:11.003 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.31602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29826.log 2024-08-17T02:26:11.004 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-mgr.y.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31602.log.gz 2024-08-17T02:26:11.004 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33379.log 2024-08-17T02:26:11.004 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.34118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30375.log 2024-08-17T02:26:11.004 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.29826.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34118.log.gz 2024-08-17T02:26:11.004 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.33379.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.29826.log.gz 2024-08-17T02:26:11.004 INFO:teuthology.orchestra.run.smithi104.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33379.log.gz 2024-08-17T02:26:11.004 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35171.log 2024-08-17T02:26:11.004 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33298.log 2024-08-17T02:26:11.005 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.35171.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.30375.log.gz 2024-08-17T02:26:11.005 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32061.log 2024-08-17T02:26:11.005 INFO:teuthology.orchestra.run.smithi104.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35171.log.gz 2024-08-17T02:26:11.005 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.33298.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33298.log.gz 2024-08-17T02:26:11.005 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34578.log 2024-08-17T02:26:11.005 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 /var/log/ceph/ceph-client.admin.32061.log: --verbose -- /var/log/ceph/ceph-client.admin.30359.log 2024-08-17T02:26:11.005 INFO:teuthology.orchestra.run.smithi104.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-08-17T02:26:11.006 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.34578.log: 93.4% 89.0% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-08-17T02:26:11.006 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32061.log.gz 2024-08-17T02:26:11.006 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33769.log 2024-08-17T02:26:11.006 INFO:teuthology.orchestra.run.smithi104.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34578.log.gz 2024-08-17T02:26:11.006 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30369.log 2024-08-17T02:26:11.006 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.33769.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.30359.log.gz 2024-08-17T02:26:11.006 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33769.log.gz 2024-08-17T02:26:11.007 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30212.log 2024-08-17T02:26:11.007 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31022.log 2024-08-17T02:26:11.007 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30212.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.30369.log.gz 2024-08-17T02:26:11.007 INFO:teuthology.orchestra.run.smithi104.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.30212.log.gz 2024-08-17T02:26:11.007 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29643.log 2024-08-17T02:26:11.007 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.31022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33848.log 2024-08-17T02:26:11.007 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30370.log 2024-08-17T02:26:11.007 INFO:teuthology.orchestra.run.smithi104.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31022.log.gz 2024-08-17T02:26:11.008 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.29643.log: gzip /var/log/ceph/ceph-client.admin.33848.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.32879.log 2024-08-17T02:26:11.008 INFO:teuthology.orchestra.run.smithi104.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.29643.log.gz 2024-08-17T02:26:11.008 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24253.log 2024-08-17T02:26:11.008 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30370.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33848.log.gz 2024-08-17T02:26:11.008 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33352.log 2024-08-17T02:26:11.008 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32879.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.30370.log.gz 2024-08-17T02:26:11.008 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33676.log 2024-08-17T02:26:11.008 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.24253.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32879.log.gz 2024-08-17T02:26:11.009 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34326.log 2024-08-17T02:26:11.009 INFO:teuthology.orchestra.run.smithi104.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.24253.log.gz 2024-08-17T02:26:11.009 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.33352.log: /var/log/ceph/ceph-client.admin.33676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32428.log 2024-08-17T02:26:11.009 INFO:teuthology.orchestra.run.smithi104.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33352.log.gz 2024-08-17T02:26:11.009 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.34326.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33676.log.gz 2024-08-17T02:26:11.009 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30320.log 2024-08-17T02:26:11.009 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34326.log.gz 2024-08-17T02:26:11.009 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30131.log 2024-08-17T02:26:11.010 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32428.log.gz 2024-08-17T02:26:11.010 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32293.log 2024-08-17T02:26:11.010 INFO:teuthology.orchestra.run.smithi104.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.30320.log.gz 2024-08-17T02:26:11.010 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31656.log 2024-08-17T02:26:11.010 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34739.log 2024-08-17T02:26:11.010 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32293.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.30131.log.gz 2024-08-17T02:26:11.010 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.31656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35387.log 2024-08-17T02:26:11.010 INFO:teuthology.orchestra.run.smithi104.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32293.log.gz 2024-08-17T02:26:11.011 INFO:teuthology.orchestra.run.smithi104.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31656.log.gz 2024-08-17T02:26:11.011 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.34739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31764.log 2024-08-17T02:26:11.011 INFO:teuthology.orchestra.run.smithi104.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34739.log.gz 2024-08-17T02:26:11.011 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.35387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34696.log 2024-08-17T02:26:11.011 INFO:teuthology.orchestra.run.smithi104.stderr:gzip 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35387.log.gz-5 2024-08-17T02:26:11.011 INFO:teuthology.orchestra.run.smithi104.stderr:--verbose -- /var/log/ceph/ceph-client.admin.35144.log 2024-08-17T02:26:11.011 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.31764.log: gzip /var/log/ceph/ceph-client.admin.34696.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.31399.log 2024-08-17T02:26:11.012 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-17T02:26:11.012 INFO:teuthology.orchestra.run.smithi104.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.31764.log.gz 2024-08-17T02:26:11.012 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.35144.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34696.log.gz 2024-08-17T02:26:11.012 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.31399.log: gzip -5 --verbose -- 87.7%/var/log/ceph/ceph-client.admin.32852.log 2024-08-17T02:26:11.012 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31399.log.gz 2024-08-17T02:26:11.012 INFO:teuthology.orchestra.run.smithi104.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35144.log.gz 2024-08-17T02:26:11.012 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph.audit.log: 88.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-17T02:26:11.012 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30104.log 2024-08-17T02:26:11.013 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32991.log 2024-08-17T02:26:11.013 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30104.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32852.log.gz 2024-08-17T02:26:11.013 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30779.log 2024-08-17T02:26:11.013 INFO:teuthology.orchestra.run.smithi104.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.30104.log.gz 2024-08-17T02:26:11.013 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31103.log 2024-08-17T02:26:11.013 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30779.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32991.log.gz 2024-08-17T02:26:11.013 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32347.log 2024-08-17T02:26:11.013 INFO:teuthology.orchestra.run.smithi104.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.30779.log.gz 2024-08-17T02:26:11.014 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30860.log 2024-08-17T02:26:11.014 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.31103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34407.log 2024-08-17T02:26:11.014 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32347.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31103.log.gz 2024-08-17T02:26:11.014 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30995.log 2024-08-17T02:26:11.014 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30860.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32347.log.gz 2024-08-17T02:26:11.014 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.34407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34353.log 2024-08-17T02:26:11.014 INFO:teuthology.orchestra.run.smithi104.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.30860.log.gz 2024-08-17T02:26:11.014 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35306.log 2024-08-17T02:26:11.015 INFO:teuthology.orchestra.run.smithi104.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34407.log.gz 2024-08-17T02:26:11.015 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31629.log 2024-08-17T02:26:11.015 INFO:teuthology.orchestra.run.smithi104.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.30995.log.gz 2024-08-17T02:26:11.015 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.34353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33190.log 2024-08-17T02:26:11.015 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.35306.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34353.log.gz 2024-08-17T02:26:11.015 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.31629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31953.log 2024-08-17T02:26:11.015 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35306.log.gz 2024-08-17T02:26:11.015 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.33190.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31629.log.gz 2024-08-17T02:26:11.016 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33798.log 2024-08-17T02:26:11.016 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.31953.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33190.log.gz 2024-08-17T02:26:11.016 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33593.log 2024-08-17T02:26:11.016 INFO:teuthology.orchestra.run.smithi104.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.31953.log.gz 2024-08-17T02:26:11.016 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.33798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31569.log 2024-08-17T02:26:11.016 INFO:teuthology.orchestra.run.smithi104.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.33798.log.gz 2024-08-17T02:26:11.016 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33593.log: /var/log/ceph/ceph-client.admin.34380.log 2024-08-17T02:26:11.016 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33593.log.gz/var/log/ceph/ceph-client.admin.31569.log: 2024-08-17T02:26:11.016 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34874.log 2024-08-17T02:26:11.017 INFO:teuthology.orchestra.run.smithi104.stderr: 89.6%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.31569.log.gz--verbose 2024-08-17T02:26:11.017 INFO:teuthology.orchestra.run.smithi104.stderr:-- /var/log/ceph/ceph-client.admin.34380.log: /var/log/ceph/ceph-client.admin.33956.log 2024-08-17T02:26:11.017 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30588.log 2024-08-17T02:26:11.017 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.34874.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34380.log.gz 2024-08-17T02:26:11.017 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32088.log 2024-08-17T02:26:11.017 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.33956.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34874.log.gz 2024-08-17T02:26:11.017 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33715.log 2024-08-17T02:26:11.017 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30588.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33956.log.gz 2024-08-17T02:26:11.018 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35198.log 2024-08-17T02:26:11.018 INFO:teuthology.orchestra.run.smithi104.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.30588.log.gz 2024-08-17T02:26:11.018 INFO:teuthology.orchestra.run.smithi104.stderr:gzip /var/log/ceph/ceph-client.admin.33715.log: 88.3%-5 -- replaced with /var/log/ceph/ceph-client.admin.32088.log.gz--verbose 2024-08-17T02:26:11.018 INFO:teuthology.orchestra.run.smithi104.stderr:-- /var/log/ceph/ceph-client.admin.34145.log 2024-08-17T02:26:11.018 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32509.log 2024-08-17T02:26:11.018 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.35198.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33715.log.gz 2024-08-17T02:26:11.019 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.34145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35063.log 2024-08-17T02:26:11.019 INFO:teuthology.orchestra.run.smithi104.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35198.log.gz 2024-08-17T02:26:11.019 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31157.log 2024-08-17T02:26:11.019 INFO:teuthology.orchestra.run.smithi104.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34145.log.gz 2024-08-17T02:26:11.019 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.35063.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-08-17T02:26:11.019 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.32509.log.gz 2024-08-17T02:26:11.019 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35063.log.gz 2024-08-17T02:26:11.019 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.31157.log: -- /var/log/ceph/ceph-client.admin.30050.log 2024-08-17T02:26:11.020 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33026.log 2024-08-17T02:26:11.020 INFO:teuthology.orchestra.run.smithi104.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31157.log.gz 2024-08-17T02:26:11.020 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30806.log 2024-08-17T02:26:11.020 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30050.log: gzip /var/log/ceph/ceph-client.admin.33026.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.33622.log 2024-08-17T02:26:11.020 INFO:teuthology.orchestra.run.smithi104.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.30050.log.gz 2024-08-17T02:26:11.020 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 /var/log/ceph/ceph-client.admin.30806.log: --verbose -- /var/log/ceph/ceph-client.admin.31899.log 2024-08-17T02:26:11.020 INFO:teuthology.orchestra.run.smithi104.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33026.log.gz 2024-08-17T02:26:11.021 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33406.log 2024-08-17T02:26:11.021 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.33622.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.30806.log.gz 2024-08-17T02:26:11.021 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.31899.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33622.log.gz 2024-08-17T02:26:11.021 INFO:teuthology.orchestra.run.smithi104.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.31899.log.gz 2024-08-17T02:26:11.021 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33457.log 2024-08-17T02:26:11.021 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33271.log 2024-08-17T02:26:11.021 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.33406.log: /var/log/ceph/ceph-client.admin.33457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34642.log 2024-08-17T02:26:11.021 INFO:teuthology.orchestra.run.smithi104.stderr: 88.9% 92.3% -- replaced with /var/log/ceph/ceph-client.admin.33457.log.gz -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-08-17T02:26:11.022 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-08-17T02:26:11.022 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.33271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30576.log 2024-08-17T02:26:11.022 INFO:teuthology.orchestra.run.smithi104.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.33406.log.gz 2024-08-17T02:26:11.022 INFO:teuthology.orchestra.run.smithi104.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33271.log.gz 2024-08-17T02:26:11.022 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32007.log 2024-08-17T02:26:11.022 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.34642.log: /var/log/ceph/ceph-client.admin.30576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30374.log 2024-08-17T02:26:11.022 INFO:teuthology.orchestra.run.smithi104.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34642.log.gz 2024-08-17T02:26:11.022 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32007.log: gzip 88.3%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.30576.log.gz-- 2024-08-17T02:26:11.023 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.34212.log 2024-08-17T02:26:11.023 INFO:teuthology.orchestra.run.smithi104.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32007.log.gz 2024-08-17T02:26:11.023 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29936.log 2024-08-17T02:26:11.023 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.34212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30239.log 2024-08-17T02:26:11.023 INFO:teuthology.orchestra.run.smithi104.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.30374.log.gz 2024-08-17T02:26:11.023 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29909.log 2024-08-17T02:26:11.023 INFO:teuthology.orchestra.run.smithi104.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34212.log.gz 2024-08-17T02:26:11.023 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.29936.log: /var/log/ceph/ceph-client.admin.30239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33217.log 2024-08-17T02:26:11.024 INFO:teuthology.orchestra.run.smithi104.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.29936.log.gz 2024-08-17T02:26:11.024 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31049.log 2024-08-17T02:26:11.024 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.29909.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.30239.log.gz 2024-08-17T02:26:11.024 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33983.log 2024-08-17T02:26:11.024 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.33217.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.29909.log.gz 2024-08-17T02:26:11.024 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33163.log 2024-08-17T02:26:11.024 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.31049.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33217.log.gz 2024-08-17T02:26:11.024 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32482.log 2024-08-17T02:26:11.024 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.33983.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31049.log.gz 2024-08-17T02:26:11.025 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.33163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31737.log 2024-08-17T02:26:11.025 INFO:teuthology.orchestra.run.smithi104.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33983.log.gz 2024-08-17T02:26:11.025 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32906.log 2024-08-17T02:26:11.025 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32482.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33163.log.gz 2024-08-17T02:26:11.025 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.32482.log.gz 2024-08-17T02:26:11.025 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.31737.log: -- /var/log/ceph/ceph-client.admin.30077.log 2024-08-17T02:26:11.025 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32144.log 2024-08-17T02:26:11.025 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32906.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31737.log.gz 2024-08-17T02:26:11.026 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32933.log 2024-08-17T02:26:11.026 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30077.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32906.log.gz 2024-08-17T02:26:11.026 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34793.log 2024-08-17T02:26:11.026 INFO:teuthology.orchestra.run.smithi104.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.30077.log.gz 2024-08-17T02:26:11.026 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32933.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32144.log.gz 2024-08-17T02:26:11.026 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33080.log 2024-08-17T02:26:11.026 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.34793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32661.log 2024-08-17T02:26:11.026 INFO:teuthology.orchestra.run.smithi104.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32933.log.gz 2024-08-17T02:26:11.027 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34793.log.gz 2024-08-17T02:26:11.027 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33566.log 2024-08-17T02:26:11.027 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.33080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34542.log 2024-08-17T02:26:11.027 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32661.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32596.log 2024-08-17T02:26:11.027 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.33566.log: -- replaced with /var/log/ceph/ceph-client.admin.33080.log.gz 2024-08-17T02:26:11.027 INFO:teuthology.orchestra.run.smithi104.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32661.log.gz 2024-08-17T02:26:11.027 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.34542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33649.log 2024-08-17T02:26:11.027 INFO:teuthology.orchestra.run.smithi104.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33566.log.gz 2024-08-17T02:26:11.028 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34299.log 2024-08-17T02:26:11.028 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32596.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34542.log.gz 2024-08-17T02:26:11.028 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34928.log 2024-08-17T02:26:11.028 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.33649.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.32596.log.gz 2024-08-17T02:26:11.028 INFO:teuthology.orchestra.run.smithi104.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33649.log.gz 2024-08-17T02:26:11.028 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.34299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32825.log 2024-08-17T02:26:11.028 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.34928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30585.log 2024-08-17T02:26:11.028 INFO:teuthology.orchestra.run.smithi104.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34299.log.gz 2024-08-17T02:26:11.029 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35360.log 2024-08-17T02:26:11.029 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32825.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34928.log.gz 2024-08-17T02:26:11.029 INFO:teuthology.orchestra.run.smithi104.stderr:gzip /var/log/ceph/ceph-client.admin.30585.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.30591.log 2024-08-17T02:26:11.029 INFO:teuthology.orchestra.run.smithi104.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32825.log.gz 2024-08-17T02:26:11.029 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34272.log 2024-08-17T02:26:11.029 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.35360.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.30585.log.gz 2024-08-17T02:26:11.029 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32771.log 2024-08-17T02:26:11.029 INFO:teuthology.orchestra.run.smithi104.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35360.log.gz 2024-08-17T02:26:11.030 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35117.log 2024-08-17T02:26:11.030 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.34272.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.30591.log.gz 2024-08-17T02:26:11.030 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33109.log 2024-08-17T02:26:11.030 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32771.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34272.log.gz 2024-08-17T02:26:11.030 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30587.log 2024-08-17T02:26:11.030 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.35117.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32771.log.gz 2024-08-17T02:26:11.030 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30590.log 2024-08-17T02:26:11.031 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.33109.log: 87.3%/var/log/ceph/ceph-client.admin.30587.log: -- replaced with /var/log/ceph/ceph-client.admin.35117.log.gz 2024-08-17T02:26:11.031 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.31493.log 2024-08-17T02:26:11.031 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33109.log.gz 2024-08-17T02:26:11.031 INFO:teuthology.orchestra.run.smithi104.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.30587.log.gz 2024-08-17T02:26:11.031 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.19265.log 2024-08-17T02:26:11.031 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30590.log: /var/log/ceph/ceph-client.2.31493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35279.log 2024-08-17T02:26:11.031 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.30590.log.gz 2024-08-17T02:26:11.031 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33875.log 2024-08-17T02:26:11.032 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph.tmp-client.admin.19265.log: 0.0%gzip -- replaced with /var/log/ceph/ceph.tmp-client.admin.19265.log.gz-5 2024-08-17T02:26:11.032 INFO:teuthology.orchestra.run.smithi104.stderr:--verbose -- /var/log/ceph/ceph-client.admin.30293.log /var/log/ceph/ceph-client.admin.35279.log: 2024-08-17T02:26:11.032 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30914.log 2024-08-17T02:26:11.032 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.33875.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35279.log.gz 2024-08-17T02:26:11.032 INFO:teuthology.orchestra.run.smithi104.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.2.31493.log.gz 2024-08-17T02:26:11.032 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35036.log 2024-08-17T02:26:11.032 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30293.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33875.log.gz 2024-08-17T02:26:11.032 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30914.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-17T02:26:11.033 INFO:teuthology.orchestra.run.smithi104.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.30293.log.gz 2024-08-17T02:26:11.033 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34515.log 2024-08-17T02:26:11.033 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.35036.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.30914.log.gz 2024-08-17T02:26:11.033 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30833.log 2024-08-17T02:26:11.033 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35036.log.gz 2024-08-17T02:26:11.033 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.34515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31130.log 2024-08-17T02:26:11.033 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30887.log 2024-08-17T02:26:11.033 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30833.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34515.log.gz 2024-08-17T02:26:11.034 INFO:teuthology.orchestra.run.smithi104.stderr: 84.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-17T02:26:11.034 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.31130.log: -- /var/log/ceph/ceph-client.admin.30941.log 2024-08-17T02:26:11.034 INFO:teuthology.orchestra.run.smithi104.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.30833.log.gz 2024-08-17T02:26:11.034 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-08-17T02:26:11.034 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30887.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.31130.log.gz 2024-08-17T02:26:11.034 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35009.log 2024-08-17T02:26:11.034 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30941.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.30887.log.gz 2024-08-17T02:26:11.034 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34488.log 2024-08-17T02:26:11.035 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-osd.0.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.30941.log.gz 2024-08-17T02:26:11.035 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32212.log 2024-08-17T02:26:11.035 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.35009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30023.log 2024-08-17T02:26:11.035 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.34488.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35009.log.gz 2024-08-17T02:26:11.035 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35225.log 2024-08-17T02:26:11.035 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32212.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34488.log.gz 2024-08-17T02:26:11.035 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31683.log 2024-08-17T02:26:11.036 INFO:teuthology.orchestra.run.smithi104.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32212.log.gz 2024-08-17T02:26:11.036 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.30023.log.gz 2024-08-17T02:26:11.036 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 /var/log/ceph/ceph-client.admin.35225.log: --verbose -- /var/log/ceph/ceph-client.admin.31926.log 2024-08-17T02:26:11.036 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31818.log 2024-08-17T02:26:11.036 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.31683.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35225.log.gz 2024-08-17T02:26:11.036 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.31926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32744.log 2024-08-17T02:26:11.036 INFO:teuthology.orchestra.run.smithi104.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.31683.log.gz 2024-08-17T02:26:11.036 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30968.log 2024-08-17T02:26:11.037 INFO:teuthology.orchestra.run.smithi104.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31926.log.gz 2024-08-17T02:26:11.037 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.31818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34245.log 2024-08-17T02:26:11.037 INFO:teuthology.orchestra.run.smithi104.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31818.log.gz 2024-08-17T02:26:11.037 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30266.log 2024-08-17T02:26:11.037 INFO:teuthology.orchestra.run.smithi104.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32744.log.gz 2024-08-17T02:26:11.037 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30968.log: /var/log/ceph/ceph-client.admin.34245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32715.log 2024-08-17T02:26:11.037 INFO:teuthology.orchestra.run.smithi104.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.30968.log.gz 2024-08-17T02:26:11.037 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34245.log.gz 2024-08-17T02:26:11.038 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29700.log 2024-08-17T02:26:11.038 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31710.log 2024-08-17T02:26:11.038 INFO:teuthology.orchestra.run.smithi104.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.30266.log.gz 2024-08-17T02:26:11.038 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32715.log: gzip /var/log/ceph/ceph-client.admin.29700.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.33902.log 2024-08-17T02:26:11.038 INFO:teuthology.orchestra.run.smithi104.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32715.log.gz 2024-08-17T02:26:11.038 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.31710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32798.log 2024-08-17T02:26:11.038 INFO:teuthology.orchestra.run.smithi104.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.29700.log.gz 2024-08-17T02:26:11.041 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32266.log 2024-08-17T02:26:11.041 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.33902.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31710.log.gz 2024-08-17T02:26:11.042 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30158.log 2024-08-17T02:26:11.042 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32798.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33902.log.gz 2024-08-17T02:26:11.042 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30185.log 2024-08-17T02:26:11.042 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32266.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32798.log.gz 2024-08-17T02:26:11.042 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33929.log 2024-08-17T02:26:11.042 INFO:teuthology.orchestra.run.smithi104.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32266.log.gz 2024-08-17T02:26:11.042 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 88.2%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.30158.log.gz/var/log/ceph/ceph-client.admin.30373.log 2024-08-17T02:26:11.043 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-08-17T02:26:11.043 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30185.log: /var/log/ceph/ceph-client.admin.33929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33053.log 2024-08-17T02:26:11.043 INFO:teuthology.orchestra.run.smithi104.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.30185.log.gz 2024-08-17T02:26:11.043 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-08-17T02:26:11.043 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30373.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33929.log.gz 2024-08-17T02:26:11.043 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32171.log 2024-08-17T02:26:11.043 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.33053.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.30373.log.gz 2024-08-17T02:26:11.043 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32536.log 2024-08-17T02:26:11.044 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-osd.3.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.33053.log.gz 2024-08-17T02:26:11.044 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32239.log 2024-08-17T02:26:11.044 INFO:teuthology.orchestra.run.smithi104.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32171.log.gz 2024-08-17T02:26:11.044 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34766.log 2024-08-17T02:26:11.044 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33325.log 2024-08-17T02:26:11.044 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32239.log: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29963.log 2024-08-17T02:26:11.044 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.34766.log: -- replaced with /var/log/ceph/ceph-client.admin.32536.log.gz 2024-08-17T02:26:11.044 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32239.log.gz 2024-08-17T02:26:11.044 INFO:teuthology.orchestra.run.smithi104.stderr: 89.2%/var/log/ceph/ceph-client.admin.33325.log: -- replaced with /var/log/ceph/ceph-client.admin.34766.log.gzgzip 2024-08-17T02:26:11.045 INFO:teuthology.orchestra.run.smithi104.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.24389.log 2024-08-17T02:26:11.045 INFO:teuthology.orchestra.run.smithi104.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33325.log.gz 2024-08-17T02:26:11.045 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.29963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33515.log 2024-08-17T02:26:11.045 INFO:teuthology.orchestra.run.smithi104.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.29963.log.gz 2024-08-17T02:26:11.045 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.24389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30589.log 2024-08-17T02:26:11.045 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31872.log 2024-08-17T02:26:11.045 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.24389.log.gz 2024-08-17T02:26:11.046 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.33515.log: /var/log/ceph/ceph-client.admin.30589.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.30589.log.gz 2024-08-17T02:26:11.046 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32374.log 2024-08-17T02:26:11.046 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32688.log 2024-08-17T02:26:11.046 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.31872.log: /var/log/ceph/ceph-client.admin.32374.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31872.log.gz 2024-08-17T02:26:11.046 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32374.log.gz 2024-08-17T02:26:11.046 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34064.log 2024-08-17T02:26:11.046 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32688.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.32688.log.gz 2024-08-17T02:26:11.047 INFO:teuthology.orchestra.run.smithi104.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.0.33515.log.gz 2024-08-17T02:26:11.047 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34037.log 2024-08-17T02:26:11.047 INFO:teuthology.orchestra.run.smithi104.stderr:gzip /var/log/ceph/ceph-client.admin.34064.log: -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-08-17T02:26:11.047 INFO:teuthology.orchestra.run.smithi104.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34064.log.gz 2024-08-17T02:26:11.047 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.34037.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34037.log.gz 2024-08-17T02:26:11.048 INFO:teuthology.orchestra.run.smithi117.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-08-17T02:26:11.048 INFO:teuthology.orchestra.run.smithi117.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-08-17T02:26:11.048 INFO:teuthology.orchestra.run.smithi117.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-08-17T02:26:11.105 INFO:teuthology.orchestra.run.smithi117.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-08-17T02:26:11.115 INFO:teuthology.orchestra.run.smithi117.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-08-17T02:26:11.134 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-osd.2.log: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-08-17T02:26:11.144 INFO:teuthology.orchestra.run.smithi117.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-08-17T02:26:11.163 INFO:teuthology.orchestra.run.smithi104.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-08-17T02:26:11.178 INFO:teuthology.orchestra.run.smithi104.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-08-17T02:26:11.181 INFO:teuthology.orchestra.run.smithi104.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-08-17T02:26:11.181 INFO:teuthology.orchestra.run.smithi117.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-08-17T02:26:11.183 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-08-17T02:26:11.183 INFO:teuthology.orchestra.run.smithi117.stderr:real 0m0.278s 2024-08-17T02:26:11.183 INFO:teuthology.orchestra.run.smithi117.stderr:user 0m1.099s 2024-08-17T02:26:11.183 INFO:teuthology.orchestra.run.smithi117.stderr:sys 0m0.055s 2024-08-17T02:26:11.210 INFO:teuthology.orchestra.run.smithi104.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-08-17T02:26:11.212 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-08-17T02:26:11.212 INFO:teuthology.orchestra.run.smithi104.stderr:real 0m0.308s 2024-08-17T02:26:11.212 INFO:teuthology.orchestra.run.smithi104.stderr:user 0m1.224s 2024-08-17T02:26:11.212 INFO:teuthology.orchestra.run.smithi104.stderr:sys 0m0.128s 2024-08-17T02:26:11.213 INFO:tasks.ceph:Archiving logs... 2024-08-17T02:26:11.213 DEBUG:teuthology.misc:Transferring archived files from smithi104:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858240/remote/smithi104/log 2024-08-17T02:26:11.214 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-17T02:26:11.547 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858240/remote/smithi117/log 2024-08-17T02:26:11.548 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-17T02:26:11.692 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-17T02:26:11.714 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-17T02:26:11.714 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-17T02:26:11.717 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-17T02:26:11.793 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-17T02:26:11.802 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-17T02:26:11.802 DEBUG:teuthology.orchestra.run.smithi104:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:26:11.804 DEBUG:teuthology.orchestra.run.smithi117:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:26:11.825 INFO:teuthology.orchestra.run.smithi104.stdout: remote refid st t when poll reach delay offset jitter 2024-08-17T02:26:11.825 INFO:teuthology.orchestra.run.smithi104.stdout:============================================================================== 2024-08-17T02:26:11.826 INFO:teuthology.orchestra.run.smithi104.stdout:+hv01.front.sepi 67.205.162.81 3 u 61 64 177 0.050 1.942 1.144 2024-08-17T02:26:11.826 INFO:teuthology.orchestra.run.smithi104.stdout:+hv02.front.sepi 63.231.80.2 3 u 62 64 177 0.083 1.338 0.863 2024-08-17T02:26:11.826 INFO:teuthology.orchestra.run.smithi104.stdout:*hv03.front.sepi 74.6.168.72 3 u 1 64 377 0.067 0.203 1.157 2024-08-17T02:26:11.826 INFO:teuthology.orchestra.run.smithi104.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:26:11.830 INFO:teuthology.orchestra.run.smithi117.stdout: remote refid st t when poll reach delay offset jitter 2024-08-17T02:26:11.830 INFO:teuthology.orchestra.run.smithi117.stdout:============================================================================== 2024-08-17T02:26:11.831 INFO:teuthology.orchestra.run.smithi117.stdout:+hv01.front.sepi 67.205.162.81 3 u 1 64 377 0.103 0.340 0.259 2024-08-17T02:26:11.831 INFO:teuthology.orchestra.run.smithi117.stdout:*hv02.front.sepi 63.231.80.2 3 u 8 64 377 0.063 0.453 0.183 2024-08-17T02:26:11.831 INFO:teuthology.orchestra.run.smithi117.stdout:+hv03.front.sepi 74.6.168.72 3 u - 64 377 0.072 0.464 0.576 2024-08-17T02:26:11.831 INFO:teuthology.orchestra.run.smithi117.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:26:11.832 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-17T02:26:11.841 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-17T02:26:11.841 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-17T02:26:11.849 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-17T02:26:11.858 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-17T02:26:11.866 INFO:teuthology.task.internal:Duration was 817.268279 seconds 2024-08-17T02:26:11.866 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-17T02:26:11.875 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-17T02:26:11.875 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-17T02:26:11.877 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-17T02:26:11.931 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-17T02:26:11.932 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi104.front.sepia.ceph.com 2024-08-17T02:26:11.932 DEBUG:teuthology.orchestra.run.smithi104:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-17T02:26:11.944 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi117.front.sepia.ceph.com 2024-08-17T02:26:11.944 DEBUG:teuthology.orchestra.run.smithi117:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-17T02:26:11.956 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-17T02:26:11.957 DEBUG:teuthology.orchestra.run.smithi104:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-17T02:26:11.959 DEBUG:teuthology.orchestra.run.smithi117:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-17T02:26:11.996 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-17T02:26:11.996 DEBUG:teuthology.orchestra.run.smithi104:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-17T02:26:12.036 DEBUG:teuthology.orchestra.run.smithi117:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-17T02:26:12.116 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-17T02:26:12.125 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-17T02:26:12.126 DEBUG:teuthology.orchestra.run.smithi104:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-17T02:26:12.140 DEBUG:teuthology.orchestra.run.smithi117:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-17T02:26:12.157 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-17T02:26:12.168 DEBUG:teuthology.orchestra.run.smithi104:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:26:12.171 DEBUG:teuthology.orchestra.run.smithi117:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:26:12.183 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern = core 2024-08-17T02:26:12.185 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = core 2024-08-17T02:26:12.202 DEBUG:teuthology.orchestra.run.smithi104:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:26:12.251 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:26:12.252 DEBUG:teuthology.orchestra.run.smithi117:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:26:12.257 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:26:12.258 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-17T02:26:12.268 INFO:teuthology.task.internal:Transferring archived files... 2024-08-17T02:26:12.269 DEBUG:teuthology.misc:Transferring archived files from smithi104:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858240/remote/smithi104 2024-08-17T02:26:12.270 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-17T02:26:12.298 DEBUG:teuthology.misc:Transferring archived files from smithi117:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858240/remote/smithi117 2024-08-17T02:26:12.298 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-17T02:26:12.324 INFO:teuthology.task.internal:Removing archive directory... 2024-08-17T02:26:12.324 DEBUG:teuthology.orchestra.run.smithi104:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-17T02:26:12.327 DEBUG:teuthology.orchestra.run.smithi117:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-17T02:26:12.371 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-17T02:26:12.383 INFO:teuthology.task.internal:Not uploading archives. 2024-08-17T02:26:12.383 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-17T02:26:12.394 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-17T02:26:12.394 DEBUG:teuthology.orchestra.run.smithi104:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-17T02:26:12.396 DEBUG:teuthology.orchestra.run.smithi117:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-17T02:26:12.402 INFO:teuthology.orchestra.run.smithi104.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 17 02:26 /home/ubuntu/cephtest 2024-08-17T02:26:12.404 INFO:teuthology.orchestra.run.smithi117.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 17 02:26 /home/ubuntu/cephtest 2024-08-17T02:26:12.406 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-17T02:26:12.416 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-17T02:26:12.437 INFO:teuthology.run:Summary data: description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} duration: 817.2682785987854 failure_reason: 'Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes)' flavor: default owner: scheduled_mchangir@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=1b5c43da6a3a4880a16c74a97dfa0746 status: fail success: false 2024-08-17T02:26:12.438 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-17T02:26:12.599 INFO:teuthology.run:FAIL